How to configure logging to syslog in Python

Question

I can t get my head around Python s logging module  My needs are very simple  I just want to log everything to syslog  After reading documentation I came up with this simple test script   import logging import logging handlers  my logger   logging getLogger  MyLogger   my logger setLevel logging DEBUG   handler   logging handlers SysLogHandler    my logger addHandler handler   my logger debug  this is debug   my logger critical  this is critical     But this script does not produce any log records in syslog  What s wrong

User · Answer

I fix it on my notebook  The rsyslog service did not listen on socket service    I config this line bellow in   etc rsyslog conf file and solved the problem    SystemLogSocketName   dev log

User · Answer

I found the syslog module to make it quite easy to get the basic logging behavior you describe   import syslog syslog syslog  This is a test message   syslog syslog syslog LOG INFO   Test message at INFO priority     There are other things you could do  too  but even just the first two lines of that will get you what you ve asked for as I understand it

User · Answer

Here s the yaml dictConfig way recommended for 3 2  amp  later   In log cfg yml   version  1 disable existing loggers  true  formatters      default          format      process d    name s   funcName s   lineno s  -   levelname s    message s   handlers      syslog          class  logging handlers SysLogHandler         level  DEBUG         formatter  default         address   dev log         facility  local0      rotating file          class  logging handlers RotatingFileHandler         level  DEBUG         formatter  default         filename  rotating log         maxBytes  10485760   10MB         backupCount  20         encoding  utf8  root      level  DEBUG     handlers   syslog  rotating file      propogate  yes  loggers      main          level  DEBUG         handlers   syslog  rotating file          propogate  yes   Load the config using   log config   yaml safe load open  cfg yml    logging config dictConfig log config    Configured both syslog  amp  a direct file  Note that the  dev log is OS specific

User · Answer

Piecing things together from here and other places  this is what I came up with that works on unbuntu 12 04 and centOS6  Create an file in  etc rsyslog d  that ends in  conf and add the following text  local6           var log my-logfile   Restart rsyslog  reloading did NOT seem to work for the new log files  Maybe it only reloads existing conf files   sudo restart rsyslog   Then you can use this test program to make sure it actually works   import logging  sys from logging import config  LOGGING          version   1       disable existing loggers   False       formatters              verbose                  format      levelname s   module s P  process d T  thread d   message s                                 handlers              stdout                  class    logging StreamHandler                stream   sys stdout               formatter    verbose                           sys-logger6                  class    logging handlers SysLogHandler                address     dev log                facility    local6                formatter    verbose                                  loggers              my-logger                  handlers     sys-logger6   stdout                 level   logging DEBUG               propagate   True                                  config dictConfig LOGGING    logger   logging getLogger  my-logger    logger debug  Debug   logger info  Info   logger warn  Warn   logger error  Error   logger critical  Critical

User · Answer

I add a little extra comment just in case it helps anyone because I found this exchange useful but needed this little extra bit of info to get it all working   To log to a specific facility using SysLogHandler you need to specify the facility value  Say for example that you have defined   local3       var log mylog  in syslog  then you ll want to use   handler   logging handlers SysLogHandler address     localhost  514   facility 19   and you also need to have syslog listening on UDP to use localhost instead of  dev log

User · Answer

You can also add a file handler or rotating file handler to send your logs to a local file  http   docs python org 2 library logging handlers html

User · Answer

Is your syslog conf set up to handle facility user   You can set the facility used by the python logger with the facility argument  something like this   handler   logging handlers SysLogHandler facility SysLogHandler LOG DAEMON

User · Answer

import syslog syslog openlog ident  LOG IDENTIFIER  logoption syslog LOG PID  facility syslog LOG LOCAL0  syslog syslog  Log processing initiated        the above script will log to LOCAL0 facility with our custom  LOG IDENTIFIER     you can use LOCAL 0-7  for local purpose

User · Answer

Change the line to this   handler   SysLogHandler address   dev log     This works for me  import logging import logging handlers  my logger   logging getLogger  MyLogger   my logger setLevel logging DEBUG   handler   logging handlers SysLogHandler address     dev log    my logger addHandler handler   my logger debug  this is debug   my logger critical  this is critical

User · Answer

You should always use the local host for logging  whether to  dev log or localhost  through the TCP stack  This allows the fully RFC compliant and featureful system logging daemon to handle syslog  This eliminates the need for the remote daemon to be functional and provides the enhanced capabilities of syslog daemon s such as rsyslog and syslog-ng for instance  The same philosophy goes for SMTP  Just hand it to the local SMTP software  In this case use  program mode  not the daemon  but it s the same idea  Let the more capable software handle it  Retrying  queuing  local spooling  using TCP instead of UDP for syslog and so forth become possible  You can also  re- configure those daemons separately from your code as it should be   Save your coding for your application  let other software do it s job in concert

User · Answer

From https   github com luismartingil per scripts tree master python syslog     usr bin python   - - coding  utf-8 - -      Implements a new handler for the logging module which uses the pure syslog python module    author   Luis Martin Gil  year  2013     import logging import syslog  class SysLogLibHandler logging Handler          A logging handler that emits messages to syslog syslog         FACILITY    syslog LOG LOCAL0                  syslog LOG LOCAL1                  syslog LOG LOCAL2                  syslog LOG LOCAL3                  syslog LOG LOCAL4                  syslog LOG LOCAL5                  syslog LOG LOCAL6                  syslog LOG LOCAL7      def   init   self  n               Pre   0  lt   n  lt   7              try              syslog openlog logoption syslog LOG PID  facility self FACILITY n           except Exception   err              try                  syslog openlog syslog LOG PID  self FACILITY n               except Exception  err                  try                      syslog openlog  my ident   syslog LOG PID  self FACILITY n                   except                      raise           We got it         logging Handler   init   self       def emit self  record           syslog syslog self format record    if   name         main             Lets play with the log class            Some variables we need      id    myproj v2 0      logStr    debug      logFacilityLocalN   1        Defines a logging level and logging format based on a given string key      LOG ATTR     debug    logging DEBUG                             id       levelname -9s   name -15s   threadName -14s    lineno -4d   message s                     info    logging INFO                            id       levelname -9s   message s                     warning    logging WARNING                               id       levelname -9s   message s                     error    logging ERROR                             id       levelname -9s   message s                     critical    logging CRITICAL                                id       levelname -9s   message s        loglevel  logformat   LOG ATTR logStr         Configuring the logger     logger   logging getLogger       logger setLevel loglevel         Clearing previous logs     logger handlers             Setting formaters and adding handlers      formatter   logging Formatter logformat      handlers          handlers append SysLogLibHandler logFacilityLocalN       for h in handlers          h setFormatter formatter          logger addHandler h         Yep      logging debug  test debug       logging info  test info       logging warning  test warning       logging error  test error       logging critical  test critical

[python] How to configure logging to syslog in Python?

Examples related to python

Examples related to logging

Examples related to syslog