Downloading a large file using curl

Question

I need to download remote file using curl   Here s the sample code I have    ch   curl init    curl setopt  ch  CURLOPT URL   url   curl setopt  ch  CURLOPT RETURNTRANSFER  1     st   curl exec  ch    fd   fopen  tmp name   w    fwrite  fd   st   fclose  fd    curl close  ch     But it can t handle big files  because it reads to memory first   Is it possible to stream the file directly to disk

User · Answer

I use this handy function   By downloading it with a 4094 byte step it will not full your memory  function download  file source   file target         rh   fopen  file source   rb         wh   fopen  file target   w b        if    rh      wh            return false             while   feof  rh             if  fwrite  wh  fread  rh  4096       FALSE                return false                    echo              flush               fclose  rh       fclose  wh        return true      Usage         result   download  http   url   path local file      You can then check if everything is ok with        if    result           throw new Exception  Download error

User · Answer

Find below code if you want to download the contents of the specified URL also want to saves it to a file    lt  php  ch   curl init          Set the URL of the page or file to download     curl setopt  ch  CURLOPT URL  http   news google com news hl en amp topic t amp output rss      fp   fopen  rss xml    w           Ask cURL to write the contents to a file    curl setopt  ch  CURLOPT FILE   fp    curl exec   ch    curl close   ch   fclose  fp     gt    If you want to downloads file from the FTP server you can use php FTP extension  Please find below code    lt  php  SERVER ADDRESS      SERVER USERNAME      SERVER PASSWORD      conn id   ftp connect  SERVER ADDRESS       login with username and password  login result   ftp login  conn id   SERVER USERNAME   SERVER PASSWORD     server file  test pdf    FTP server file path   local file    new pdf     Local server file path     ----- DOWNLOAD  SERVER FILE AND SAVE TO  LOCAL FILE--------   if  ftp get  conn id   local file   server file  FTP BINARY         echo  Successfully written to  local file n     else       echo  There was a problem n      ftp close  conn id     gt

User · Answer

when curl is used to download a large file then CURLOPT TIMEOUT is the main option you have to set for  CURLOPT RETURNTRANSFER has to be true in case you are getting file like pdf csv image etc  You may find the further detail over here correct url  Curl Doc From that page  curl setopt  request  CURLOPT TIMEOUT  300     set timeout to 5 mins  curl setopt  request  CURLOPT RETURNTRANSFER  true      true to get the output as string otherwise false

User · Answer

You can use this function  which creates a tempfile in the filesystem and returns the path to the downloaded file if everything worked fine   function getFileContents  url           Workaround  Save temp file      img   tempnam sys get temp dir     pdf-         img          pathinfo  url  PATHINFO EXTENSION         fp   fopen  img   w           ch   curl init        curl setopt  ch  CURLOPT SSL VERIFYHOST  0       curl setopt  ch  CURLOPT SSL VERIFYPEER  0        curl setopt  ch  CURLOPT URL   url       curl setopt  ch  CURLOPT FILE   fp       curl setopt  ch  CURLOPT HEADER  false       curl setopt  ch  CURLOPT FOLLOWLOCATION  true         result   curl exec  ch       curl close  ch        fclose  fp        return  result    img   false

User · Answer

lt  php set time limit 0     This is the file where we save the    information  fp   fopen  dirname   FILE        localfile tmp    w       Here is the file we are downloading  replace spaces with  20  ch   curl init str replace       20   url    curl setopt  ch  CURLOPT TIMEOUT  50      write curl response to file curl setopt  ch  CURLOPT FILE   fp    curl setopt  ch  CURLOPT FOLLOWLOCATION  true      get curl response curl exec  ch    curl close  ch   fclose  fp     gt

[php] Downloading a large file using curl

Examples related to php

Examples related to curl

Examples related to download