Visualizing decision tree in scikit-learn

Question

I am trying to design a simple Decision Tree using scikit-learn in Python  I am using Anaconda s Ipython Notebook with Python 2 7 3 on Windows OS  and visualize it as follows   from pandas import read csv  DataFrame from sklearn import tree from os import system  data   read csv  D  training csv   Y   data Y X   data ix    X0   X33    dtree   tree DecisionTreeClassifier criterion    entropy   dtree   dtree fit X  Y   dotfile   open  D  dtree2 dot    w   dotfile   tree export graphviz dtree  out file   dotfile  feature names   X columns  dotfile close   system  dot -Tpng D  dot -o D  dtree2 png     However  I get the following error   AttributeError   NoneType  object has no attribute  close    I use the following blog post as reference  Blogpost link  The following stackoverflow question doesn t seem to work for me as well  Question  Could someone help me with how to visualize the decision tree in scikit-learn

User · Answer

If  like me  you have a problem installing graphviz  you can visualize the tree by   exporting it with export graphviz as shown in previous answers Open the  dot file in a text editor Copy the piece of code and paste it   webgraphviz com

User · Answer

I copy and change a part of your code as the below   from pandas import read csv  DataFrame from sklearn import tree from sklearn tree import DecisionTreeClassifier from os import system  data   read csv  D  training csv   Y   data Y X   data ix    X0   X33    dtree   tree DecisionTreeClassifier criterion    entropy   dtree   dtree fit X  Y    After making sure you have dtree  which means that the above code runs well  you add the below code to visualize decision tree   Remember to install graphviz first  pip install graphviz   import graphviz  from graphviz import Source dot data   tree export graphviz dtree  out file None  feature names X columns  graph   graphviz Source dot data   graph render  name of file  view   True    I tried with my data  visualization worked well and I got a pdf file viewed immediately

User · Answer

Simple way founded here with pydotplus  graphviz must be installed    from IPython display import Image   from sklearn import tree import pydotplus   installing pyparsing maybe needed        dot data   tree export graphviz best model  out file None  feature names   X columns  graph   pydotplus graph from dot data dot data  Image graph create png

User · Answer

Alternatively  you could try using pydot for producing the png file from dot       tree export graphviz dtreg  out file  tree dot    produces dot file  import pydot dotfile   StringIO   tree export graphviz dtreg  out file dotfile  pydot graph from dot data dotfile getvalue    write png  dtree2 png

User · Answer

Here is the minimal code to have a nice looking graph with just 3 lines of code    from sklearn import tree import pydotplus  dot data tree export graphviz dt filled True rounded True  graph pydotplus graph from dot data dot data  graph write png  tree png       plt imshow plt imread  tree png      I have added the plt imgshow to view the graph it Jupyter Notebook  You can ignore it if you are only interested in saving the png file   I installed the following dependencies    pip3 install graphviz pip3 install pydotplus   For MacOs the pip version of Graphviz did not work  Following Graphviz s official documentation I installed it with brew and everything worked fine    brew install graphviz

User · Answer

The following also works fine   from sklearn datasets import load iris iris   load iris      Model  can also use single decision tree  from sklearn ensemble import RandomForestClassifier model   RandomForestClassifier n estimators 10     Train model fit iris data  iris target    Extract single tree estimator   model estimators  5   from sklearn tree import export graphviz   Export as dot file export graphviz estimator  out file  tree dot                    feature names   iris feature names                  class names   iris target names                  rounded   True  proportion   False                   precision   2  filled   True     Convert to png using system command  requires Graphviz  from subprocess import call call   dot    -Tpng    tree dot    -o    tree png    -Gdpi 600       Display in jupyter notebook from IPython display import Image Image filename    tree png       You can find the source here

User · Answer

sklearn tree export graphviz doesn t return anything  and so by default returns None   By doing dotfile   tree export graphviz      you overwrite your open file object  which had been previously assigned to dotfile  so you get an error when you try to close the file  as it s now None    To fix it change your code to      dotfile   open  D  dtree2 dot    w   tree export graphviz dtree  out file   dotfile  feature names   X columns  dotfile close

User · Answer

If you run into issues with grabbing the source  dot directly you can also use Source from file like this   from graphviz import Source from sklearn import tree tree export graphviz dtreg  out file  tree dot   feature names X columns  Source from file  tree dot

User · Answer

Here is one liner for those who are using jupyter and sklearn 18 2    You don t even need matplotlib for that  Only requirement is graphviz   pip install graphviz   than run  according to code in question X is a pandas DataFrame   from graphviz import Source from sklearn import tree Source  tree export graphviz dtreg  out file None  feature names X columns     This will display it in SVG format  Code above produces Graphviz s Source object  source code - not scary  That would be rendered directly in jupyter    Some things you are likely to do with it  Display it in jupter   from IPython display import SVG graph   Source  tree export graphviz dtreg  out file None  feature names X columns   SVG graph pipe format  svg      Save as png   graph   Source  tree export graphviz dtreg  out file None  feature names X columns   graph format    png  graph render  dtree render  view True    Get the png image  save it and view it   graph   Source  tree export graphviz dtreg  out file None  feature names X columns   png bytes   graph pipe format  png   with open  dtree pipe png   wb   as f      f write png bytes   from IPython display import Image Image png bytes    If you are going to play with that lib here are the links to examples and userguide

User · Answer

Scikit learn recently introduced the plot tree method to make this very easy  new in version 0 21  May 2019    Documentation here    Here s the minimum code you need   from sklearn import tree plt figure figsize  40 20      customize according to the size of your tree     tree plot tree your model name  feature names   X columns  plt show     plot tree supports some arguments to beautify the tree  For example   from sklearn import tree plt figure figsize  40 20         tree plot tree your model name  feature names   X columns                filled True  fontsize 6  rounded   True  plt show     If you want to save the picture to a file  add the following line before plt show     plt savefig  filename png     If you want to view the rules in text format  there s an answer here  It s more intuitive to read

User · Answer

You can copy the contents of the export graphviz file and you can paste the same in the webgraphviz com site    You can check out the article on How to visualize the decision tree in Python with graphviz for more information

[python] Visualizing decision tree in scikit-learn

Examples related to python

Examples related to scikit-learn

Examples related to visualization

Examples related to decision-tree