Python handling socket error Errno 104 Connection reset by peer

Question

When using Python 2 7 with urllib2 to retrieve data from an API  I get the error  Errno 104  Connection reset by peer  Whats causing the error  and how should the error be handled so that the script does not crash   ticker py  def urlopen url       response   None     request   urllib2 Request url url      try          response   urllib2 urlopen request  read       except urllib2 HTTPError as err          print  HTTPError           format url  err code      except urllib2 URLError as err          print  URLError           format url  err reason      except httplib BadStatusLine as err          print  BadStatusLine      format url      return response  def get rate from currency  EUR   to currency  USD        url    https   finance yahoo com d quotes csv f sl1 amp s  s s X              from currency  to currency      data   urlopen url      if   s s     from currency  to currency  in data          return float data strip   split      1       return None   counter   0 while True       counter   counter   1     if counter  0 or counter 10          rateEurUsd   float get rate  EUR    USD           does more stuff here   Traceback  Traceback  most recent call last     File   var www testApp python ticker py   line 71  in  lt module gt      rateEurUsd   float get rate  EUR    USD      File   var www testApp python ticker py   line 29  in get exchange rate     data   urlopen url    File   var www testApp python ticker py   line 16  in urlopen     response   urllib2 urlopen request  read     File   usr lib python2 7 urllib2 py   line 126  in urlopen     return  opener open url  data  timeout    File   usr lib python2 7 urllib2 py   line 406  in open     response   meth req  response    File   usr lib python2 7 urllib2 py   line 519  in http response      http   request  response  code  msg  hdrs    File   usr lib python2 7 urllib2 py   line 438  in error     result   self  call chain  args    File   usr lib python2 7 urllib2 py   line 378  in  call chain     result   func  args    File   usr lib python2 7 urllib2 py   line 625  in http error 302     return self parent open new  timeout req timeout    File   usr lib python2 7 urllib2 py   line 406  in open     response   meth req  response    File   usr lib python2 7 urllib2 py   line 519  in http response      http   request  response  code  msg  hdrs    File   usr lib python2 7 urllib2 py   line 438  in error     result   self  call chain  args    File   usr lib python2 7 urllib2 py   line 378  in  call chain     result   func  args    File   usr lib python2 7 urllib2 py   line 625  in http error 302     return self parent open new  timeout req timeout    File   usr lib python2 7 urllib2 py   line 400  in open     response   self  open req  data    File   usr lib python2 7 urllib2 py   line 418  in  open       open   req    File   usr lib python2 7 urllib2 py   line 378  in  call chain     result   func  args    File   usr lib python2 7 urllib2 py   line 1207  in http open     return self do open httplib HTTPConnection  req    File   usr lib python2 7 urllib2 py   line 1180  in do open     r   h getresponse buffering True    File   usr lib python2 7 httplib py   line 1030  in getresponse     response begin     File   usr lib python2 7 httplib py   line 407  in begin     version  status  reason   self  read status     File   usr lib python2 7 httplib py   line 365  in  read status     line   self fp readline     File   usr lib python2 7 socket py   line 447  in readline     data   self  sock recv self  rbufsize  socket error   Errno 104  Connection reset by peer error  Forever detected script exited with code  1

User · Answer

There is a way to catch the error directly in the except clause with ConnectionResetError  better to isolate the right error  This example also catches the timeout   from urllib request import urlopen  from socket import timeout  url    http           try       string   urlopen url  timeout 5  read   except ConnectionResetError      print     gt  ConnectionResetError       pass except timeout       print     gt  Timeout       pass

User · Answer

You can try to add some time sleep calls to your code    It seems like the server side limits the amount of requests per timeunit  hour  day  second  as a security issue  You need to guess how many  maybe using another script with a counter   and adjust your script to not surpass this limit   In order to avoid your code from crashing  try to catch this error with try    except around the urllib2 calls

User · Answer

Connection reset by peer  is the TCP IP equivalent of slamming the phone back on the hook  It s more polite than merely not replying  leaving one hanging  But it s not the FIN-ACK expected of the truly polite TCP IP converseur   From other SO answer    So you can t do anything about it  it is the issue of the server    But you could use try    except block to handle that exception   from socket import error as SocketError import errno  try      response   urllib2 urlopen request  read   except SocketError as e      if e errno    errno ECONNRESET          raise   Not error we are looking for     pass   Handle error here

[python] Python handling socket.error: [Errno 104] Connection reset by peer

Examples related to python

Examples related to ubuntu

Examples related to python-2.7

Examples related to urllib2