Nautilus can be used easily in this case.
For Fedora 16, go to File
-> Connect To server
,
select the appropriate protocol, enter required details and simply connect, just make sure that the SSH Server is running on other side. It works great.
Edit: This is valid on Ubuntu 14.04 as well