Pretty-print an entire Pandas Series DataFrame

Question

I work with Series and DataFrames on the terminal a lot  The default   repr   for a Series returns a reduced sample  with some head and tail values  but the rest missing   Is there a builtin way to pretty-print the entire Series   DataFrame   Ideally  it would support proper alignment  perhaps borders between columns  and maybe even color-coding for the different columns

User · Answer

Sure  if this comes up a lot  make a function like this one  You can even configure it to load every time you start IPython  https   ipython org ipython-doc 1 config overview html  def print full x       pd set option  display max rows   len x       print x      pd reset option  display max rows     As for coloring  getting too elaborate with colors sounds counterproductive to me  but I agree something like bootstrap s  table-striped would be nice  You could always create an issue to suggest this feature

User · Answer

After importing pandas  as an alternative to using the context manager  set such options for displaying entire dataframes   pd set option  display max columns   None     or 1000 pd set option  display max rows   None     or 1000 pd set option  display max colwidth   -1     or 199   For full list of useful options  see   pd describe option  display

User · Answer

datascroller was created in part to solve this problem  pip install datascroller  It loads the dataframe into a terminal view you can  quot scroll quot  with your mouse or arrow keys  kind of like an Excel workbook at the terminal that supports querying  highlighting  etc  import pandas as pd from datascroller import scroll    Call  scroll  with a Pandas DataFrame as the sole argument  my df   pd read csv   lt path to your csv gt    scroll my df

User · Answer

Scripts Nobody has proposed this simple plain-text solution  from pprint import pprint  pprint s to dict     which produces results like the following      Diabetes   0 06365372374283895      Obesity   0 06365372374283895      Bachelors   0 0      Poverty   0 09548058561425843      Driving Deaths   1 1775938892425206      Excessive Drinking   0 06365372374283895   Jupyter Notebooks Additionally  when using Jupyter notebooks  this is a great solution  Note  pd Series   has no  to html   so it must be converted to pd DataFrame   from IPython display import display  HTML  display HTML s to frame   to html      which produces results like the following

User · Answer

Try using display   function  This would automatically use Horizontal and vertical scroll bars and with this you can display different datasets easily instead of using print     display dataframe    display   supports proper alignment also    However if you want to make the dataset more beautiful you can check pd option context    It has lot of options to clearly show the dataframe   Note - I am using Jupyter Notebooks

User · Answer

Using pd options display This answer is a variation of the prior answer by lucidyan  It makes the code more readable by avoiding the use of set option  After importing pandas  as an alternative to using the context manager  set such options for displaying large dataframes  def set pandas display options   - gt  None       quot  quot  quot Set pandas display options  quot  quot  quot        Ref  https   stackoverflow com a 52432757      display   pd options display      display max columns   1000     display max rows   1000     display max colwidth   199     display width   None       display precision   2    set as needed  set pandas display options    After this  you can use either display df  or just df if using a notebook  otherwise print df   Using to string Pandas 0 25 3 does have DataFrame to string and Series to string methods which accept formatting options  Using to markdown If what you need is markdown output  Pandas 1 0 0 has DataFrame to markdown and Series to markdown methods  Using to html If what you need is HTML output  Pandas 0 25 3 does have a DataFrame to html method but not a Series to html  Note that a Series can be converted to a DataFrame

User · Answer

You can also use the option context  with one or more options   with pd option context  display max rows   None   display max columns   None      more options can be specified also     print df    This will automatically return the options to their previous values   If you are working on jupyter-notebook  using display df  instead of print df  will use jupyter rich display logic  like so

User · Answer

Use the tabulate package   pip install tabulate   And consider the following example usage   import pandas as pd from io import StringIO from tabulate import tabulate  c      Chromosome Start End chr1 3 6 chr1 5 7 chr1 8 9     df   pd read table StringIO c   sep   s    header 0   print tabulate df  headers  keys   tablefmt  psql      ---- -------------- --------- -------         Chromosome       Start     End    ---- -------------- --------- -------     0   chr1                 3       6      1   chr1                 5       7      2   chr1                 8       9    ---- -------------- --------- -------

User · Answer

Try this  pd set option  display height  1000  pd set option  display max rows  500  pd set option  display max columns  500  pd set option  display width  1000

User · Answer

No need to hack settings  There is a simple way   print df to string

User · Answer

If you are using Ipython Notebook  Jupyter   You can use HTML  from IPython core display import HTML display HTML df to html

User · Answer

You can achieve this using below method  just pass the total no  of columns present in the DataFrame as arg to      display max columns     For eg     df  DataFrame     with pd option context  display max rows   None   display max columns   df shape 1        print df

[python] Pretty-print an entire Pandas Series / DataFrame

Examples related to python

Examples related to pandas

Examples related to dataframe