Instead of trying to serve the node modules folder, you can also use Gulp to copy what you need to wwwroot.
https://docs.asp.net/en/latest/client-side/using-gulp.html
This might help too
Visual Studio 2015 ASP.NET 5, Gulp task not copying files from node_modules