According to the documentation, you should be able to switch back and forth like this:
In [2]: %matplotlib inline
In [3]: plot(...)
In [4]: %matplotlib qt # wx, gtk, osx, tk, empty uses default
In [5]: plot(...)
and that will pop up a regular plot window (a restart on the notebook may be necessary).
I hope this helps.