theoretically it could be done by defining a custom build step to the VS project. And you can make a file template to create a new java file, don't know if you could have it throw things in the right package or not, so you may end up writing quite a bit of the stuff a java ide would throw in already. it's not impossible, but from experience (I've used xcode on mac, vs in windows, eclipse, netbeans, code::blocks, and ended up compiling from command line for both java and c++ a lot) it's easier just to learn the new ide.
if you are insistent, i found this: http://improve.dk/compiling-java-in-visual-studio/
i plan on following and trying to modify it to create a general template for java
if possible (meaning if i understand enough of what im doing) im goint to implement a custom wizard for java projects and files.