Here is a more MSBuild way of doing this.
<Target Name="CopyRoslynFiles" AfterTargets="AfterBuild" Condition="!$(Disable_CopyWebApplication) And '$(OutDir)' != '$(OutputPath)'"><ItemGroup><RoslynFiles Include="$(CscToolPath)\*" /></ItemGroup><MakeDir Directories="$(WebProjectOutputDir)\bin\roslyn" /><Copy SourceFiles="@(RoslynFiles)" DestinationFolder="$(WebProjectOutputDir)\bin\roslyn" SkipUnchangedFiles="true" Retries="$(CopyRetryCount)" RetryDelayMilliseconds="$(CopyRetryDelayMilliseconds)" /></Target>
But I notice that the roslyn files are also in my bin directory (not in a folder). The app seems to work, though.