How do I expand the output display to see more columns of a pandas DataFrame

Question

Is there a way to widen the display of output in either interactive or script-execution mode   Specifically  I am using the describe   function on a pandas DataFrame   When the DataFrame is 5 columns  labels  wide  I get the descriptive statistics that I want   However  if the DataFrame has any more columns  the statistics are suppressed and something like this is returned    gt  gt  Index  8 entries  count to max    gt  gt  Data columns     gt  gt  x1          8  non-null values    gt  gt  x2          8  non-null values    gt  gt  x3          8  non-null values    gt  gt  x4          8  non-null values    gt  gt  x5          8  non-null values    gt  gt  x6          8  non-null values    gt  gt  x7          8  non-null values     The  8  value is given whether there are 6 or 7 columns   What does the  8  refer to   I have already tried dragging the IDLE window larger  as well as increasing the  Configure IDLE  width options  to no avail   My purpose in using pandas and describe   is to avoid using a second program like Stata to do basic data manipulation and investigation

User · Answer

You can use this custom function for displaying things for pandas Dataframe.

def display_all(df):     # for any Dataframe df
   with pd.option_context('display.max_rows',1000): # change number of rows accordingly
      with pd.option_context('display.max_columns',1000): # change number of columns accordingly
          display(df)

display_all(df.head()) # pass this function to your dataframe and Voila!

You don't have use pd.set_option for whole notebook just use for single cell.

User · Answer

It seems like all above answers solve the problem  One more point  instead of pd set option  option name    you can use the  auto-complete-able   pd options display width   None   See Pandas doc  Options and Settings      Options have a full    dotted-style     case-insensitive name  e g    display max rows   You can get set options directly as attributes of   the top-level options attribute   In  1   import pandas as pd  In  2   pd options display max rows Out 2   15  In  3   pd options display max rows   999  In  4   pd options display max rows Out 4   999           for the max     params      max rows and max columns are used in   repr     methods to decide if to string   or info   is used to render an object to a string  In case python IPython is running in a terminal this can be set to 0 and pandas will correctly auto-detect the width the terminal and swap to a smaller format in case all columns would not fit vertically  The IPython notebook  IPython qtconsole  or IDLE do not run in a terminal and hence it is not possible to do correct auto-detection     None    value means unlimited   emphasis not in original    for the width param      Width of the display in characters  In case python IPython is running in a terminal this can be set to None and pandas will correctly auto-detect the width  Note that the IPython notebook  IPython qtconsole  or IDLE do not run in a terminal and hence it is not possible to correctly detect the width

User · Answer

pd options display max columns   100  You can specify the numbers of columns as per your requirement in max columns

User · Answer

If you want to set options temporarily to display one large DataFrame  you can use option context   with pd option context  display max rows   None   display max columns   None       print  df    Option values are restored automatically when you exit the with block

User · Answer

If you don t want to mess with your display options and you just want to see this one particular list of columns without expanding out every dataframe you view  you could try    df columns values

User · Answer

The below line is enough to display all columns from dataframe   pd set option  display max columns   None

User · Answer

You can set the output display to match your current terminal width   pd set option  display width   pd util terminal get terminal size   0

User · Answer

You can use print df describe   to string   to force it to show the whole table    You can use to string   like this for any DataFrame   The result of describe is just a DataFrame itself    The 8 is the number of rows in the DataFrame holding the  description   because describe computes 8 statistics  min  max  mean  etc

User · Answer

import pandas as pd pd set option  display max columns   100  pd set option  display width   1000   SentenceA    William likes Piano and Piano likes William  SentenceB    Sara likes Guitar  SentenceC    Mamoosh likes Piano  SentenceD    William is a CS Student  SentenceE    Sara is kind  SentenceF    Mamoosh is kind    bowA   SentenceA split      bowB   SentenceB split      bowC   SentenceC split      bowD   SentenceD split      bowE   SentenceE split      bowF   SentenceF split         Creating a set consisted of all words  wordSet   set bowA  union set bowB   union set bowC   union set bowD   union set bowE   union set bowF   print  Set of all words is     wordSet     Initiating dictionary with 0 value for all BOWs  wordDictA   dict fromkeys wordSet  0  wordDictB   dict fromkeys wordSet  0  wordDictC   dict fromkeys wordSet  0  wordDictD   dict fromkeys wordSet  0  wordDictE   dict fromkeys wordSet  0  wordDictF   dict fromkeys wordSet  0   for word in bowA      wordDictA word     1 for word in bowB      wordDictB word     1 for word in bowC      wordDictC word     1 for word in bowD      wordDictD word     1 for word in bowE      wordDictE word     1 for word in bowF      wordDictF word     1    Printing Term frequency  print  SentenceA TF     wordDictA  print  SentenceB TF     wordDictB  print  SentenceC TF     wordDictC  print  SentenceD TF     wordDictD  print  SentenceE TF     wordDictE  print  SentenceF TF     wordDictF   print pd DataFrame  wordDictA  wordDictB  wordDictB  wordDictC  wordDictD  wordDictE  wordDictF      OutPut       CS  Guitar  Mamoosh  Piano  Sara  Student  William  a  and  is  kind  likes 0   0       0        0      2     0        0        2  0    1   0     0      2 1   0       1        0      0     1        0        0  0    0   0     0      1 2   0       1        0      0     1        0        0  0    0   0     0      1 3   0       0        1      1     0        0        0  0    0   0     0      1 4   1       0        0      0     0        1        1  1    0   1     0      0 5   0       0        0      0     1        0        0  0    0   1     1      0 6   0       0        1      0     0        0        0  0    0   1     1      0

User · Answer

Set column max width using   pd set option  max colwidth   800    This particular statement sets max width to 800px  per column

User · Answer

You can simply do the following steps    You can change the options for pandas max columns feature as follows  import pandas as pd pd options display max columns   10    this allows 10 columns to display  you can change this as you need  Like that you can change the number of rows as you need to display as follows  if you need to change maximum rows as well   pd options display max rows   999    this allows to print 999 rows at a time    Please kindly refer the doc to change different options settings for pandas

User · Answer

You can also try in a loop   for col in df columns       print col

User · Answer

You can adjust pandas print options with set printoptions   In  3   df describe   Out 3     lt class  pandas core frame DataFrame  gt  Index  8 entries  count to max Data columns  x1    8  non-null values x2    8  non-null values x3    8  non-null values x4    8  non-null values x5    8  non-null values x6    8  non-null values x7    8  non-null values dtypes  float64 7   In  4   pd set printoptions precision 2   In  5   df describe   Out 5                x1       x2       x3       x4       x5       x6       x7 count      8 0      8 0      8 0      8 0      8 0      8 0      8 0 mean   69024 5  69025 5  69026 5  69027 5  69028 5  69029 5  69030 5 std       17 1     17 1     17 1     17 1     17 1     17 1     17 1 min    69000 0  69001 0  69002 0  69003 0  69004 0  69005 0  69006 0 25     69012 2  69013 2  69014 2  69015 2  69016 2  69017 2  69018 2 50     69024 5  69025 5  69026 5  69027 5  69028 5  69029 5  69030 5 75     69036 8  69037 8  69038 8  69039 8  69040 8  69041 8  69042 8 max    69049 0  69050 0  69051 0  69052 0  69053 0  69054 0  69055 0   However this will not work in all cases as pandas detects your console width and it will only use to string if the output fits in the console  see the docstring of set printoptions    In this case you can explicitly call to string as answered by BrenBarn   Update  With version 0 10 the way wide dataframes are printed changed   In  3   df describe   Out 3                     x1            x2            x3            x4            x5    count      8 000000      8 000000      8 000000      8 000000      8 000000    mean   59832 361578  27356 711336  49317 281222  51214 837838  51254 839690    std    22600 723536  26867 192716  28071 737509  21012 422793  33831 515761    min    31906 695474   1648 359160     56 378115  16278 322271     43 745574    25     45264 625201  12799 540572  41429 628749  40374 273582  29789 643875    50     56340 214856  18666 456293  51995 661512  54894 562656  47667 684422    75     75587 003417  31375 610322  61069 190523  67811 893435  76014 884048    max    98136 474782  84544 484627  91743 983895  75154 587156  99012 695717                      x6            x7   count      8 000000      8 000000   mean   41863 000717  33950 235126   std    38709 468281  29075 745673   min     3590 990740   1833 464154   25     15145 759625   6879 523949   50     22139 243042  33706 029946   75     72038 983496  51449 893980   max    98601 190488  83309 051963     Further more the API for setting pandas options changed   In  4   pd set option  display precision   2   In  5   df describe   Out 5                x1       x2       x3       x4       x5       x6       x7 count      8 0      8 0      8 0      8 0      8 0      8 0      8 0 mean   59832 4  27356 7  49317 3  51214 8  51254 8  41863 0  33950 2 std    22600 7  26867 2  28071 7  21012 4  33831 5  38709 5  29075 7 min    31906 7   1648 4     56 4  16278 3     43 7   3591 0   1833 5 25     45264 6  12799 5  41429 6  40374 3  29789 6  15145 8   6879 5 50     56340 2  18666 5  51995 7  54894 6  47667 7  22139 2  33706 0 75     75587 0  31375 6  61069 2  67811 9  76014 9  72039 0  51449 9 max    98136 5  84544 5  91744 0  75154 6  99012 7  98601 2  83309 1

User · Answer

Update  Pandas 0 23 4 onwards  This is not necessary  pandas autodetects the size of your terminal window if you set pd options display width   0   For older versions see at bottom    pandas set printoptions      is deprecated  Instead  use pandas set option optname  val   or equivalently pd options  lt opt hierarchical name gt    val  Like   import pandas as pd pd set option  display max rows   500  pd set option  display max columns   500  pd set option  display width   1000    Here is the help for set option    set option pat value  - Sets the value of the specified option  Available options  display  chop threshold  colheader justify  column space  date dayfirst           date yearfirst  encoding  expand frame repr  float format  height           line width  max columns  max colwidth  max info columns  max info rows           max rows  max seq items  mpl style  multi sparse  notebook repr html           pprint nest depth  precision  width  mode  sim interactive  use inf as null   Parameters ---------- pat - str regexp which should match a single option   Note  partial matches are supported for convenience  but unless you use the full option name  e g  x y z option name   your code may break in future versions if new options with similar names are introduced   value - new value of option   Returns ------- None  Raises ------ KeyError if no such option exists  display chop threshold   default  None   currently  None    float or None         if set to a float value  all float values smaller then the given threshold         will be displayed as exactly 0 by repr and friends  display colheader justify   default  right   currently  right     left   right          Controls the justification of column headers  used by DataFrameFormatter  display column space   default  12   currently  12 No description available   display date dayfirst   default  False   currently  False    boolean         When True  prints and parses dates with the day first  eg 20 01 2005 display date yearfirst   default  False   currently  False    boolean         When True  prints and parses dates with the year first  eg 2005 01 20 display encoding   default  UTF-8   currently  UTF-8    str unicode         Defaults to the detected encoding of the console          Specifies the encoding to be used for strings returned by to string          these are generally strings meant to be displayed on the console  display expand frame repr   default  True   currently  True    boolean         Whether to print out the full DataFrame repr for wide DataFrames         across multiple lines   max columns  is still respected  but the output will         wrap-around across multiple  pages  if it s width exceeds  display width   display float format   default  None   currently  None    callable         The callable should accept a floating point number and return         a string with the desired format of the number  This is used         in some places like SeriesFormatter          See core format EngFormatter for an example  display height   default  60   currently  1000    int         Deprecated           Deprecated  use  display height  instead    display line width   default  80   currently  1000    int         Deprecated           Deprecated  use  display width  instead    display max columns   default  20   currently  500    int         max rows and max columns are used in   repr     methods to decide if         to string   or info   is used to render an object to a string   In case         python IPython is running in a terminal this can be set to 0 and pandas         will correctly auto-detect the width the terminal and swap to a smaller         format in case all columns would not fit vertically  The IPython notebook          IPython qtconsole  or IDLE do not run in a terminal and hence it is not         possible to do correct auto-detection           None  value means unlimited  display max colwidth   default  50   currently  50    int         The maximum width in characters of a column in the repr of         a pandas data structure  When the column overflows  a               placeholder is embedded in the output  display max info columns   default  100   currently  100    int         max info columns is used in DataFrame info method to decide if         per column information will be printed  display max info rows   default  1690785   currently  1690785    int or None         max info rows is the maximum number of rows for which a frame will         perform a null check on its columns when repr ing To a console          The default is 1 000 000 rows  So  if a DataFrame has more         1 000 000 rows there will be no null check performed on the         columns and thus the representation will take much less time to         display in an interactive session  A value of None means always         perform a null check when repr ing  display max rows   default  60   currently  500    int         This sets the maximum number of rows pandas should output when printing         out various output  For example  this value determines whether the repr           for a dataframe prints out fully or just a summary repr           None  value means unlimited  display max seq items   default  None   currently  None    int or None          when pretty-printing a long sequence  no more then  max seq items          will be printed  If items are ommitted  they will be denoted by the addition         of       to the resulting string           If set to None  the number of items to be printed is unlimited  display mpl style   default  None   currently  None    bool          Setting this to  default  will modify the rcParams used by matplotlib         to give plots a more pleasing visual style by default          Setting this to None False restores the values to their initial value  display multi sparse   default  True   currently  True    boolean          sparsify  MultiIndex display  don t display repeated         elements in outer levels within groups  display notebook repr html   default  True   currently  True    boolean         When True  IPython notebook will use html representation for         pandas objects  if it is available   display pprint nest depth   default  3   currently  3    int         Controls the number of nested levels to process when pretty-printing display precision   default  7   currently  7    int         Floating point output precision  number of significant digits   This is         only a suggestion display width   default  80   currently  1000    int         Width of the display in characters  In case python IPython is running in         a terminal this can be set to None and pandas will correctly auto-detect the         width          Note that the IPython notebook  IPython qtconsole  or IDLE do not run in a         terminal and hence it is not possible to correctly detect the width  mode sim interactive   default  False   currently  False    boolean         Whether to simulate interactive mode for purposes of testing mode use inf as null   default  False   currently  False    boolean         True means treat None  NaN  INF  -INF as null  old way           False means None and NaN are null  but INF  -INF are not null          new way   Call def    pd set option self   args    kwds      EDIT  older version information  much of this has been deprecated   As  bmu mentioned  pandas auto detects  by default  the size of the display area  a summary view will be used when an object repr does not fit on the display  You mentioned resizing the IDLE window  to no effect  If you do print df describe   to string   does it fit on the IDLE window   The terminal size is determined by pandas util terminal get terminal size    deprecated and removed   this returns a tuple containing the  width  height  of the display  Does the output match the size of your IDLE window  There might be an issue  there was one before when running a terminal in emacs    Note that it is possible to bypass the autodetect  pandas set printoptions max rows 200  max columns 10  will never switch to summary view if number of rows  columns does not exceed the given limits     The  max colwidth  option helps in seeing untruncated form of each column

User · Answer

None of these answers were working for me  A couple of them would indeed print all the columns  but it would look sloppy  As in all the information was there  but it wasn t formatted correctly  I m using a terminal inside of Neovim so I suspect that to be the reason  This mini function does exactly what I need  just change df data in the two places it is for your dataframe name  col range is set to what pandas naturally shows  for me it is 5 but it could be bigger or smaller for you   import math col range   5 for   in range int math ceil len df data columns  col range         idx1     col range     idx2   idx1 col range     print df data iloc    idx1 idx2  describe

User · Answer

I used these settings when scale of data is high    environment settings   pd set option  display max column  None  pd set option  display max rows  None  pd set option  display max seq items  None  pd set option  display max colwidth   500  pd set option  expand frame repr   True   You can refer to the documentation here

User · Answer

According to the docs for v0 18 0  if you re running on a terminal  ie not iPython notebook  qtconsole or IDLE   it s a 2-liner to have Pandas auto-detect your screen width and adapt on the fly with how many columns it shows   pd set option  display large repr    truncate   pd set option  display max columns   0

User · Answer

Only using these 3 lines worked for me   pd set option  display max columns   None    pd set option  display expand frame repr   False  pd set option  max colwidth   -1    Anaconda   Python 3 6 5   pandas  0 23 0   Visual Studio Code 1 26

User · Answer

Try this   pd set option  display expand frame repr   False    From the documentation      display expand frame repr   boolean      Whether to print out the full DataFrame repr for wide DataFrames across multiple lines  max columns is still respected  but the output will wrap-around across multiple    pages    if it   s width exceeds display width   default  True   currently  True    See  http   pandas pydata org pandas-docs stable generated pandas set option html

[python] How do I expand the output display to see more columns of a pandas DataFrame?

Examples related to python

Examples related to pandas

Examples related to printing

Examples related to column-width