Downloading a large file using curl

Question

I need to download remote file using curl   Here s the sample code I have    ch   curl init    curl setopt  ch  CURLOPT URL   url   curl setopt  ch  CURLOPT RETURNTRANSFER  1     st   curl exec  ch    fd   fopen  tmp name   w    fwrite  fd   st   fclose  fd    curl close  ch     But it can t handle big files  because it reads to memory first   Is it possible to stream the file directly to disk

User · Answer

Find below code if you want to download the contents of the specified URL also want to saves it to a file.

<?php
$ch = curl_init();
/**
* Set the URL of the page or file to download.
*/
curl_setopt($ch, CURLOPT_URL,'http://news.google.com/news?hl=en&topic=t&output=rss');

$fp = fopen('rss.xml', 'w+');
/**
* Ask cURL to write the contents to a file
*/
curl_setopt($ch, CURLOPT_FILE, $fp);

curl_exec ($ch);

curl_close ($ch);
fclose($fp);
?>

If you want to downloads file from the FTP server you can use php FTP extension. Please find below code:

<?php
$SERVER_ADDRESS="";
$SERVER_USERNAME="";
$SERVER_PASSWORD="";
$conn_id = ftp_connect($SERVER_ADDRESS);

// login with username and password
$login_result = ftp_login($conn_id, $SERVER_USERNAME, $SERVER_PASSWORD);

$server_file="test.pdf" //FTP server file path 
$local_file = "new.pdf"; //Local server file path 

##----- DOWNLOAD $SERVER_FILE AND SAVE TO $LOCAL_FILE--------##
if (ftp_get($conn_id, $local_file, $server_file, FTP_BINARY)) {
    echo "Successfully written to $local_file\n";
} else {
    echo "There was a problem\n";
}

ftp_close($conn_id);
?>

User · Answer

I use this handy function   By downloading it with a 4094 byte step it will not full your memory  function download  file source   file target         rh   fopen  file source   rb         wh   fopen  file target   w b        if    rh      wh            return false             while   feof  rh             if  fwrite  wh  fread  rh  4096       FALSE                return false                    echo              flush               fclose  rh       fclose  wh        return true      Usage         result   download  http   url   path local file      You can then check if everything is ok with        if    result           throw new Exception  Download error

User · Answer

when curl is used to download a large file then CURLOPT TIMEOUT is the main option you have to set for  CURLOPT RETURNTRANSFER has to be true in case you are getting file like pdf csv image etc  You may find the further detail over here correct url  Curl Doc From that page  curl setopt  request  CURLOPT TIMEOUT  300     set timeout to 5 mins  curl setopt  request  CURLOPT RETURNTRANSFER  true      true to get the output as string otherwise false

User · Answer

lt  php set time limit 0     This is the file where we save the    information  fp   fopen  dirname   FILE        localfile tmp    w       Here is the file we are downloading  replace spaces with  20  ch   curl init str replace       20   url    curl setopt  ch  CURLOPT TIMEOUT  50      write curl response to file curl setopt  ch  CURLOPT FILE   fp    curl setopt  ch  CURLOPT FOLLOWLOCATION  true      get curl response curl exec  ch    curl close  ch   fclose  fp     gt

User · Answer

You can use this function  which creates a tempfile in the filesystem and returns the path to the downloaded file if everything worked fine   function getFileContents  url           Workaround  Save temp file      img   tempnam sys get temp dir     pdf-         img          pathinfo  url  PATHINFO EXTENSION         fp   fopen  img   w           ch   curl init        curl setopt  ch  CURLOPT SSL VERIFYHOST  0       curl setopt  ch  CURLOPT SSL VERIFYPEER  0        curl setopt  ch  CURLOPT URL   url       curl setopt  ch  CURLOPT FILE   fp       curl setopt  ch  CURLOPT HEADER  false       curl setopt  ch  CURLOPT FOLLOWLOCATION  true         result   curl exec  ch       curl close  ch        fclose  fp        return  result    img   false

[php] Downloading a large file using curl

Examples related to php

Examples related to curl

Examples related to download