scp or sftp copy multiple files with single command

Question

I d like to copy files from to remote server in different directories  For example  I want to run these 4 commands at once   scp remote A 1 txt local A 1 txt scp remote A 2 txt local A 2 txt scp remote B 1 txt local B 1 txt scp remote C 1 txt local C 1 txt   What is the easiest way to do that

User · Answer

Problem  Copying multiple directories from remote server to local machine using a single SCP command and retaining each directory as it is in the remote server   Solution  SCP can do this easily  This solves the annoying problem of entering password multiple times when using SCP with multiple folders  Consequently  this also saves a lot of time   e g     copies folders t1  t2  t3 from  test  to your local working directory   note that there shouldn t be any space in between the folder names    we also escape the braces    please note the dot at the end of the SCP command     cd   working directory    scp -r username contact server de  work datasets images test   t1 t2 t3        PS  Motivated by this great answer  scp or sftp copy multiple files with single command     Based on the comments  this also works fine in Git Bash on Windows

User · Answer

As Jiri mentioned  you can use scp -r user host  some remote path  some local path to copy files recursively   This assumes that there s a single directory containing all of the files you want to transfer  and nothing else    However  SFTP provides an alternative if you want to transfer files from multiple different directories  and the destinations are not identical   sftp user host  lt  lt  EOF   get  some remote path1 file1  some local path1 file1   get  some remote path2 file2  some local path2 file2   get  some remote path3 file3  some local path3 file3 EOF   This uses the  here doc  syntax to define a sequence of SFTP input commands   As an alternative  you could put the SFTP commands into a text file and execute sftp user host -b batchFile txt

User · Answer

In my case  I am restricted to only using the sftp command  So  I had to use a batchfile with sftp   I created a script such as the following  This assumes you are working in the  tmp directory  and you want to put the files in the destdir on remote system on the remote system  This also only works with a noninteractive login  You need to set up public private keys so you can login without entering a password  Change as needed      bin bash  cd  tmp   start script with list of files to transfer ls -1 fileset1   gt  batchfile1 ls -1 fileset2   gt  gt  batchfile1  sed -i -e  s   put    batchfile1 echo  cd destdir on remote system   gt  batchfile cat batchfile1  gt  gt  batchfile rm batchfile1  sftp -b batchfile user host

User · Answer

Copy multiple files from remote to local     scp your username remote edu  some remote directory   a b c        Copy multiple files from local to remote     scp foo txt bar txt your username remotehost edu     scp  foo bar  txt your username remotehost edu     scp   txt your username remotehost edu     Copy multiple files from remote to remote     scp your username remote1 edu  some remote directory foobar txt   your username remote2 edu  some remote directory    Source  http   www hypexr org linux scp help php

User · Answer

After playing with scp for a while I have found the most robust solution    Beware of the single and double quotation marks   Local to remote   scp -r  FILE1   FILE2  HOST   DIR     Remote to local   scp -r HOST   FILE1   FILE2    DIR    Notice that whatever after  HOST   will be sent to the remote and parsed there  So we must make sure they are not processed by the local shell  That is why single quotation marks come in  The double quotation marks are used to handle spaces in the file names   If files are all in the same directory  we can use   to match them all  such as  scp -r  DIR IN    txt HOST   DIR   scp -r HOST   DIR IN    txt   DIR    Compared to using the      syntax which is supported only by some shells  this one is universal

User · Answer

scp uses ssh for data transfer with the same authentication and provides the same security as ssh    A best practise here is to implement  SSH KEYS AND PUBLIC KEY AUTHENTICATION   With this  you can write your scripts without worring about authentication  Simple as that   See WHAT IS SSH-KEYGEN

User · Answer

The simplest way is   local  scp remote  A 1 A 2 B 3 C 4  txt      So       list can include directories  A B and C here are directories   1 txt  and  2 txt  are file names in those directories    Although it would copy all these four files into one local directory - not sure if that s what you wanted   In the above case you will end up remote files A 1 txt  A 2 txt  B 3 txt and C 4 txt copied over to a single local directory  with file names   1 txt    2 txt    3 txt and   4 txt

User · Answer

NOTE  I apologize in advance for answering only a portion of the above question   However  I found these commands to be useful for my current unix needs   Uploading specific files from a local machine to a remote machine     Desktop dump files  scp file1 txt file2 txt lab1 cpp etc ext your-user-id remotemachine edu Folder1 DestinationFolderForFiles   Uploading an entire directory from a local machine to a remote machine      scp -r Desktop dump files your-user-id remotemachine edu Folder1 DestinationFolderForFiles   Downloading an entire directory from a remote machine to a local machine     Desktop  scp -r your-user-id remote host edu Public web  Desktop

User · Answer

Is more simple without using scp  tar cf - file1     file n   ssh user server  tar xf -   This also let  you do some things like compress the stream  -C  or  since OpenSSH v7 3  -J any times to jump through one  or more  proxy servers  You can avoid using passwords coping your public key to    ssh authorized keys with ssh-copy-id  Posted also here  with more details  and here

User · Answer

In the specific case where all the files have the same extension but with different suffix  say number of log file  you use the following  scp user name ip of remote machine  some log folder some log file       This will copy all files named some log file from the given folder within the remote  i e - some log file 1   some log file 2  some log file 3

User · Answer

scp remote   A-C   12  txt  local

User · Answer

You can copy whole directories with using -r switch so if you can isolate your files into own directory  you can copy everything at once   scp -r   dir-with-files user remote-server upload-path  scp -r user remote-server path-to-dir-with-files download-path   so for instance  scp -r root 192 168 1 100  var log   backup-logs   Or if there is just few of them  you can use   scp 1 txt 2 txt 3 log user remote-server upload-path

User · Answer

You can do this way   scp hostname serverNameOrServerIp  path to files    file1 file2 file3    fileExtension      This will download all the listed filenames to whatever local directory you re on   Make sure not to put spaces between each filename only use a comma

User · Answer

The answers with  file1 file2 file3  works only with bash  on remote or locally   The real way is    scp user remote   path1 file1  path2 file2  path3 file3   localPath

User · Answer

Copy multiple directories   scp -r dir1 dir2 dir3 admin 127 0 0 1

User · Answer

From local to server    scp file1 txt file2 sh username ip of server copyto   pathtoupload  From server to local    scp -T username ip of server copyfrom  file1 txt file2 txt     yourpathtocopy

[sftp] scp or sftp copy multiple files with single command

Examples related to sftp

Examples related to scp