Curl to return http status code along with the response

Question

I use curl to get http headers to find http status code and also return response  I get the http headers with the command    curl -I http   localhost      To get the response  I use the command     curl http   localhost      As soon as use the -I flag  I get only the headers and the response is no longer there  Is there a way to get both the http response and the headers http status code in in one command

User · Answer

while     do curl -sL -w  quot   http code    url effective   n quot  http   host -o  dev null  done

User · Answer

This is a way to retrieve the body  quot AND quot  the status code and format it to a proper json or whatever format works for you  Some may argue it s the incorrect use of write format option but this works for me when I need both body and status code in my scripts to check status code and relay back the responses from server  curl -X GET -w  quot   stderr    quot status  quot     quot   http code   quot     quot body  quot    quot   stdout   quot   quot   -s -o -    https   github com    2 gt  amp 1  run the code above and you should get back a json in this format     quot status quot     lt status code gt    quot body quot     lt body of response gt     with the -w write format option  since stderr is printed first  you can format your output with the var http code and place the body of the response in a value  body  and follow up the enclosing using var stdout  Then redirect your stderr output to stdout and you ll be able to combine both http code and response body into a neat output

User · Answer

I use this command to print the status code without any other output  Additionally  it will only perform a HEAD request and follow the redirection  respectively -I and -L    curl -o -I -L -s -w    http code   http   localhost   This makes it very easy to check the status code in a health script   sh -c      curl -o -I -L -s -w    http code   http   localhost  -eq 200

User · Answer

My way to achieve this  To get both  header and body   I usually perform a curl -D-  lt url gt  as in    curl -D- http   localhost 1234 foo HTTP 1 1 200 OK Connection  Keep-Alive Transfer-Encoding  chunked Content-Type  application json Date  Wed  29 Jul 2020 20 59 21 GMT    quot data quot    quot out csv quot     This will dump headers  -D  to stdout  -   Look for --dump-header in man curl   IMHO also very handy in this context  I often use jq to get that json data  eg from some rest APIs  formatted  But as jq doesn t expect a HTTP header  the trick is to print headers to stderr using -D dev stderr  Note that this time we also use -sS  --silent  --show-errors  to suppress the progress meter  because we write to a pipe     curl -sSD dev stderr http   localhost 1231 foo   jq   HTTP 1 1 200 OK Connection  Keep-Alive Transfer-Encoding  chunked Content-Type  application json Date  Wed  29 Jul 2020 21 08 22 GMT       quot data quot          quot out csv quot         I guess this also can be handy if you d like to print headers  for quick inspection  to console but redirect body to a file  eg when its some kind of binary to not mess up your terminal     curl -sSD dev stderr http   localhost 1231  gt   dev null HTTP 1 1 200 OK Connection  Keep-Alive Transfer-Encoding  chunked Content-Type  application json Date  Wed  29 Jul 2020 21 20 02 GMT   Be aware  This is NOT the same as curl -I  lt url gt   As -I will perform a HEAD request and not a GET request  Look for --head in man curl  Yes  For most HTTP servers this will yield same result  But I know a lot of business applications which don t implement HEAD request at all  -P

User · Answer

In my experience we usually use curl this way curl -f http   localhost 1234 foo    exit 1  curl   22  The requested URL returned error  400 Bad Request  This way we can pipe the curl when it fails  and it also shows the status code

User · Answer

Append a line  quot http code 200 quot  at the end  and then grep for the keyword  quot http code  quot  and extract the response code  result   curl -w  quot  nhttp code   http code  quot  http   localhost   echo  quot result    result  quot     the curl result with  quot http code  quot  at the end  http code   echo  quot   result  quot    grep  http code     sed  s http code   g     echo  quot HTTP CODE    http code  quot    the http response code  In this case  you can still use the non-silent mode   verbose mode to get more information about the request such as the curl response body

User · Answer

Wow so many answers  cURL devs definitely left it to us as a home exercise    Ok here is my take - a script that makes the cURL working as it s supposed to be  i e    show the output as cURL would  exit with non-zero code in case of HTTP response code not in 2XX range  Save it as curl-wrapper sh      bin bash  output   curl -w  quot  n  http code  quot   quot    quot   res     if     quot  res quot      quot 0 quot      then   echo -e  quot  output quot    exit  res fi  if     output      0-9   0-9         then     httpCode   BASH REMATCH 1       body   output 0 -   httpCode        echo -e  quot  body quot       if    httpCode  lt  200     httpCode  gt   300    then           Remove this is you want to have pure output even in            case of failure          echo         echo  quot Failure HTTP response code    httpCode  quot          exit 1     fi else     echo -e  quot  output quot      echo     echo  quot Cannot get the HTTP return code quot      exit 1 fi   So then it s just business as usual  but instead of curl do   curl-wrapper sh  So when the result falls in 200-299 range    curl-wrapper sh www google com       the same output as pure curl would return    echo      0  And when the result is out of in 200-299 range    curl-wrapper sh www google com no-such-page      the same output as pure curl would return - plus the line      below with the failed HTTP code  this line can be removed if needed      Failure HTTP response code  404 echo      1  Just do not pass  quot -w --write-out quot  argument since that s what added inside the script

User · Answer

This command   curl http   localhost -w      http code     will get the comma separated body and status  you can split them to get them out    You can change the delimiter as you like

User · Answer

the verbose mode will tell you everything  curl -v http   localhost

User · Answer

I found this question because I wanted independent access to BOTH the response and the content in order to add some error handling for the user  You can print the HTTP status code to std out and write the contents to another file  curl -s -o response txt -w  quot   http code  quot  http   example com  This allows you to check the return code and then decide if the response is worth printing  processing  logging  etc  http response   curl -s -o response txt -w  quot   http code  quot  http   example com  if    http response     quot 200 quot     then       handle error else     echo  quot Server returned  quot      cat response txt     fi

User · Answer

I was able to get a solution by looking at the curl doc which specifies to use - for the output to get the output to stdout   curl -o - http   localhost  To get the response with just the http return code  I could just do curl -o  dev null -s -w  quot   http code  n quot  http   localhost

User · Answer

Some good answers here  but like the OP I found myself wanting  in a scripting context  all of   any response body returned by the server  regardless of the response status-code  some services will send error details e g  in JSON form when the response is an error the HTTP response code the curl exit status code  This is difficult to achieve with a single curl invocation and I was looking for a complete solution example  since the required processing is complex  I combined some other bash recipes on multiplexing stdout stderr return-code with some of the ideas here to arrive at the following example      IFS  read -rd    out   IFS  read -rd    http code   IFS  read -rd    status    lt   lt    out   curl -sSL -o  dev stderr -w  quot   http code  quot   https   httpbin org json      2 gt  amp 1  printf   0 s   quot  out quot   quot    quot    Then the results can be found in variables  echo out  out echo http code  http code echo status  status  Results  out    quot slideshow quot      quot author quot    quot Yours Truly quot    quot date quot    quot date of publication quot    quot slides quot        quot title quot    quot Wake up to WonderWidgets  quot    quot type quot    quot all quot        quot items quot      quot Why  lt em gt WonderWidgets lt  em gt  are great quot    quot Who  lt em gt buys lt  em gt  WonderWidgets quot      quot title quot    quot Overview quot    quot type quot    quot all quot        quot title quot    quot Sample Slide Show quot      http code 200 status 0  The script works by multiplexing the output  HTTP response code and curl exit status separated by null characters  then reading these back into the current shell script   It can be tested with curl requests that would return a  gt  400 response code but also produce output  Note that without the -f flag  curl won t return non-zero error codes when the server returns an abnormal HTTP response code i e   gt  400  and with the -f flag  server output is suppresses on error  making use of this flag for error-detection and processing unattractive  Credits for the generic read with IFS processing go to this answer  https   unix stackexchange com a 430182 45479

User · Answer

The -i option is the one that you want   curl -i http   localhost      -i  --include       Include protocol headers in the output  H F    Alternatively you can use the verbose option   curl -v http   localhost      -v  --verbose       Make the operation more talkative

User · Answer

I have used this        request cmd    curl -i -o - --silent -X GET --header  Accept  application json  --header  Authorization   your auth code     https   example com      To get the HTTP status      http status   echo   request cmd    grep HTTP    awk   print  2        echo  http status   To get the response body I ve used this       output response   echo   request cmd    grep body      echo  output response

User · Answer

For programmatic usage  I use the following     curlwithcode         code 0       Run curl in a separate command  capturing output of -w    http code   into statuscode       and sending the content to a file with -o  gt  cat  gt  tmp curl body      statuscode   curl -w    http code             -o  gt  cat  gt  tmp curl body                          code           body    cat  tmp curl body       echo  statuscode    statuscode      echo  exitcode    code      echo  body    body     curlwithcode https   api github com users tj   It shows following output     statuscode   200 exitcode   0 body        login    tj      id   25254

User · Answer

A one-liner  just to get the status-code would be  curl -s -i https   www google com   head -1  Changing it to head -2 will give the time as well   If you want a while-true loop over it  it would be  URL  quot https   www google com quot   while true  do     echo  quot ------ quot      curl -s -i  URL   head -2     sleep 2  done  Which produces the following  until you do cmd C  or ctrl C in Windows   ------ HTTP 2 200 date  Sun  07 Feb 2021 20 03 38 GMT ------ HTTP 2 200 date  Sun  07 Feb 2021 20 03 41 GMT ------ HTTP 2 200 date  Sun  07 Feb 2021 20 03 43 GMT ------ HTTP 2 200 date  Sun  07 Feb 2021 20 03 45 GMT ------ HTTP 2 200 date  Sun  07 Feb 2021 20 03 47 GMT ------ HTTP 2 200 date  Sun  07 Feb 2021 20 03 49 GMT

[shell] Curl to return http status code along with the response

Examples related to shell

Examples related to curl

Examples related to http-status-code-415