Reading content from URL with Node js

Question

I m trying to read the content from a URL with Node js but all I seem to get are a bunch of bytes  I m obviously doing something wrong but I m not sure what  This is the code I currently have   var http   require  http     var client   http createClient 80   google com    request   client request    request on  response   function  res         res on  data   function  data             console log  data                  request end      Any insight would be greatly appreciated

User · Answer

the data object is a buffer of bytes   Simply call  toString   to get human-readable code   console log  data toString        reference  Node js buffers

User · Answer

HTTP and HTTPS   const getScript    url    gt        return new Promise  resolve  reject    gt            const http        require  http                  https       require  https             let client   http           if  url toString   indexOf  https       0                client   https                     client get url   resp    gt                let data                       A chunk of data has been recieved              resp on  data    chunk    gt                    data    chunk                                  The whole response has been received  Print out the result              resp on  end        gt                    resolve data                               on  error    err    gt                reject err                            async  url    gt        console log await getScript url        https   sidanmor com

User · Answer

A slightly modified version of  sidanmor  s code  The main point is  not every webpage is purely ASCII  user should be able to handle the decoding manually  even encode into base64  function httpGet url      return new Promise  resolve  reject    gt        const http   require  http          https   require  https         let client   http       if  url toString   indexOf  quot https quot       0          client   https             client get url   resp    gt          let chunks                 A chunk of data has been recieved        resp on  data    chunk    gt            chunks push chunk                       The whole response has been received  Print out the result        resp on  end        gt            resolve Buffer concat chunks                      on  quot error quot    err    gt          reject err                     async url    gt      var buf   await httpGet url     console log buf toString  utf-8         https   httpbin org headers

User · Answer

try using the on error event of the client to find the issue   var http   require  http     var options         host   google com       path        var request   http request options  function  res        var data           res on  data   function  chunk            data    chunk              res on  end   function              console log data                request on  error   function  e        console log e message       request end

[node.js] Reading content from URL with Node.js

Examples related to node.js