How can I find where I will be redirected using cURL

Question

I m trying to make curl follow a redirect but I can t quite get it to work right  I have a string that I want to send as a GET param to a server and get the resulting URL   Example      String   Kobold Vermin   Url   www wowhead com search q Kobold Worker   If you go to that url it will redirect you to  www wowhead com npc 257   I want curl to return this URL to my PHP code so that i can extract the  npc 257  and use it   Current code   function npcID  name         urltopost    http   www wowhead com search q      name       ch   curl init        curl setopt  ch  CURLOPT USERAGENT   Mozilla 5 0  Windows  U  Windows NT 5 1  en-US  rv 1 8 1 1  Gecko 20061204 Firefox 2 0 0 1        curl setopt  ch  CURLOPT URL   urltopost       curl setopt  ch  CURLOPT REFERER   http   www wowhead com        curl setopt  ch  CURLOPT HTTPHEADER  Array  Content-Type application x-www-form-urlencoded         curl setopt  ch  CURLOPT FOLLOWLOCATION  TRUE       return curl getinfo  ch  CURLINFO EFFECTIVE URL       This however returns www wowhead com search q Kobold Worker and not www wowhead com npc 257   I suspect PHP is returning before the external redirect happens  How can I fix this

User · Answer

Lot s of regex here  despite the fact i really like them this way might be more stable to me    resultCurl curl exec  curl     get curl result   Optional line if you want to store the http status code  headerHttpCode curl getinfo  curl CURLINFO HTTP CODE      let s use dom and xpath  dom   new  DOMDocument    libxml use internal errors true    dom- gt loadHTML  resultCurl  LIBXML HTML NODEFDTD   libxml use internal errors false    xpath   new  DOMXPath  dom    head  xpath- gt query   html body p a  href      newUrl  head 0 - gt nodeValue    The location part is a link in the HTML sent by apache  So Xpath is perfect to recover it

User · Answer

The chosen answer here is decent but its case sensitive  doesn t protect against relative location  headers  which some sites do  or pages that might actually have the phrase Location  in their content     which zillow currently does    A bit sloppy  but a couple quick edits to make this a bit smarter are   function getOriginalURL  url         ch   curl init        curl setopt  ch  CURLOPT URL   url       curl setopt  ch  CURLOPT HEADER  true       curl setopt  ch  CURLOPT FOLLOWLOCATION  false       curl setopt  ch  CURLOPT RETURNTRANSFER  TRUE        result   curl exec  ch        httpStatus   curl getinfo  ch  CURLINFO HTTP CODE       curl close  ch           if it s not a redirection  3XX   move along     if   httpStatus  lt  300     httpStatus  gt   400          return  url          look for a location  header to find the target URL     if preg match   location       i    result   r              location   trim  r 1                if the location is a relative URL  attempt to make it absolute         if  preg match               location                  urlParts   parse url  url               if   urlParts  scheme                     baseURL    urlParts  scheme                       if   urlParts  host                     baseURL     urlParts  host                 if   urlParts  port                     baseURL         urlParts  port                 return  baseURL  location                     return  location            return  url      Note that this still only goes 1 redirection deep  To go deeper  you actually need to get the content and follow the redirects

User · Answer

Sometimes you need to get HTTP headers but at the same time you don t want return those headers     This skeleton takes care of cookies and HTTP redirects using recursion  The main idea here is to avoid return HTTP headers to the client code   You can build a very strong curl class over it  Add POST functionality  etc    lt  php  class curl      static private  cookie file                    static private  user agent                       static private  max redirects            10      static private  followlocation allowed   true     function   construct              set a file to store cookies     self   cookie file    cookies txt           set some general User Agent     self   user agent    Mozilla 4 0  compatible  MSIE 5 01  Windows NT 5 0         if     file exists self   cookie file       is writable self   cookie file               throw new Exception  Cookie file missing or not writable                   check for PHP settings that unfits        correct functioning of CURLOPT FOLLOWLOCATION      if  ini get  open basedir            ini get  safe mode       On               self   followlocation allowed   false                            Main method for GET requests       param  string  url URI to get       return string      request s body         static public function get  url           process   curl init  url            self   set basic options  process           this function is in charge of output request s body        so DO NOT include HTTP headers     curl setopt  process  CURLOPT HEADER  0        if  self   followlocation allowed                 if PHP settings allow it use AUTOMATIC REDIRECTION       curl setopt  process  CURLOPT FOLLOWLOCATION  true         curl setopt  process  CURLOPT MAXREDIRS  self   max redirects              else             curl setopt  process  CURLOPT FOLLOWLOCATION  false               return   curl exec  process        if   return     false              throw new Exception  Curl error      curl error  process                  test for redirection HTTP codes      code   curl getinfo  process  CURLINFO HTTP CODE       if   code    301     code    302              curl close  process          try                    go to extract new Location URI          location   self   parse redirection header  url                 catch  Exception  e                  throw  e                    IMPORTANT return        return self  get  location              curl close  process        return  return         static function  set basic options  process           curl setopt  process  CURLOPT USERAGENT  self   user agent       curl setopt  process  CURLOPT COOKIEFILE  self   cookie file       curl setopt  process  CURLOPT COOKIEJAR  self   cookie file       curl setopt  process  CURLOPT RETURNTRANSFER  1          curl setopt  process  CURLOPT VERBOSE  1          curl setopt  process  CURLOPT SSL VERIFYHOST  false          curl setopt  process  CURLOPT SSL VERIFYPEER  false          static function  parse redirection header  url           process   curl init  url            self   set basic options  process           NOW we need to parse HTTP headers     curl setopt  process  CURLOPT HEADER  1         return   curl exec  process        if   return     false              throw new Exception  Curl error      curl error  process               curl close  process        if     preg match   Location           return   location               throw new Exception  No Location found               if  self   max redirects--  lt   0              throw new Exception  Max redirections reached trying to get       url              return trim  location 1

User · Answer

The answer above didn t work for me on one of my servers  something to to with basedir  so I re-hashed it a little  The code below works on all my servers    ch   curl init    curl setopt  ch  CURLOPT URL   url   curl setopt  ch  CURLOPT HEADER  true   curl setopt  ch  CURLOPT FOLLOWLOCATION  false   curl setopt  ch  CURLOPT RETURNTRANSFER  TRUE    a   curl exec  ch   curl close   ch        the returned headers  headers   explode   n   a      if there is no redirection this will be the final url  redir    url     loop through the headers and check for a Location  str  j   count  headers   for  i   0   i  lt   j   i        if we find the Location header strip it and fill the redir var        if strpos  headers  i   Location        false            redir   trim str replace  Location       headers  i             break             do whatever you want with the result echo redir

User · Answer

You can use    redirectURL   curl getinfo  ch CURLINFO REDIRECT URL

User · Answer

Add this line to curl inizialization  curl setopt  ch  CURLOPT FOLLOWLOCATION  true     and use getinfo before curl close   redirectURL   curl getinfo  ch CURLINFO EFFECTIVE URL      es    ch   curl init  url   curl setopt  ch  CURLOPT HEADER  false   curl setopt  ch  CURLOPT USERAGENT  Mozilla 5 0  Windows  U  Windows NT 5 1  en-US  rv 1 8 1 13  Gecko 20080311 Firefox 2 0 0 13    curl setopt  ch  CURLOPT RETURNTRANSFER  true   curl setopt  ch  CURLOPT BINARYTRANSFER  true   curl setopt  ch  CURLOPT SSL VERIFYPEER  false   curl setopt  ch  CURLOPT FOLLOWLOCATION  true   curl setopt  ch  CURLOPT CONNECTTIMEOUT  0    curl setopt  ch  CURLOPT TIMEOUT  60    html   curl exec  ch    redirectURL   curl getinfo  ch CURLINFO EFFECTIVE URL    curl close  ch

User · Answer

To make cURL follow a redirect  use   curl setopt  ch  CURLOPT FOLLOWLOCATION  true     Erm    I don t think you re actually executing the curl    Try   curl exec  ch       after setting the options  and before the curl getinfo   call   EDIT  If you just want to find out where a page redirects to  I d use the advice here  and just use Curl to grab the headers and extract the Location  header from them    ch   curl init    curl setopt  ch  CURLOPT URL   url   curl setopt  ch  CURLOPT HEADER  true   curl setopt  ch  CURLOPT FOLLOWLOCATION  false   curl setopt  ch  CURLOPT RETURNTRANSFER  true    result   curl exec  ch   if  preg match   Location       i    result   match         location   trim  match 1

[php] How can I find where I will be redirected using cURL?

Examples related to php

Examples related to redirect

Examples related to curl