How to open my files in data folder with pandas using relative path

Question

I m working with pandas and need to read some csv files  the structure is something like this   folder folder2 scripts folder script py folder folder2 data folder data csv  How can I open the data csv file from the script in scripts folder  I ve tried this  absolute path   os path abspath os path dirname  data csv     pandas read csv absolute path     data csv    I get this error  File folder folder2 data folder data csv does not exist

User · Answer

With python or pandas when you use read csv or pd read csv  both of them look into current working directory  by default where the python process have started  So you need to use os module to chdir   and take it from there   import pandas as pd  import os print os getcwd    os chdir  D  01Coding Python data sets myowndata   print os getcwd    df   pd read csv  data csv  nrows 10  print df head

User · Answer

You could use the   file   attribute   import os import pandas as pd df   pd read csv os path join os path dirname   file         data folder data csv

User · Answer

You can always point to your home directory using   then you can refer to your data folder  import pandas as pd df   pd read csv  quot   mydata data csv quot    For your case  it should be like this import pandas as pd df   pd read csv  quot   folder folder2 data folder data csv quot    You can also set your data directory as a prefix import pandas as pd DATA DIR    quot   folder folder2 data folder  quot  df   pd read csv DATA DIR  quot data csv quot    You can take advantage of f-strings as  nikos-tavoularis said import pandas as pd DATA DIR    quot   folder folder2 data folder  quot  FILE NAME    quot data csv quot  df   pd read csv f quot  DATA DIR  FILE NAME  quot

User · Answer

script py current file   os path abspath os path dirname   file      older folder2 scripts folder   csv filename csv filename   os path join current file      data folder data csv

User · Answer

This link here answers it  Reading file using relative path in python project Basically using Path from pathlib you ll do the following in script py from pathlib import Path path   Path   file    parent    quot    data folder data csv quot  pd read csv path

User · Answer

I was also looking for the relative path version  this works OK  Note when run  Spyder 3 6  you will see  unicode error   unicodeescape  codec can t decode bytes at the closing triple quote  Remove the offending comment lines 14 and 15 and adjust the file names and location for your environment and check for indentation   -- coding  utf-8 --      Created on Fri Jan 24 12 12 40 2020  Source      Read a  csv into pandas from F  drive on Windows 7  Demonstrates      Load a csv not in the CWD by specifying relative path - windows version   author  Doug  From CWD C  Users Doug  spyder-py3 Data Camp pandas we will load file  C  Users Doug  spyder-py3 Data Camp Cleaning g1803 csv        import csv  trainData2       with open r    Cleaning g1803 csv    r   as train2Csv     trainReader2   csv reader train2Csv  delimiter      quotechar         for row in trainReader2         trainData2 append row   print trainData2

User · Answer

Keeping things tidy with f-strings   import os import pandas as pd  data files       data folder   csv name    data csv   pd read csv f  data files  csv name

User · Answer

import pandas as pd df   pd read csv  C  data folder data csv

User · Answer

Pandas will start looking from where your current python file is located  Therefore you can move from your current directory to where your data is located with      For example   pd read csv           data folder data csv     Will go 3 levels up and then into a data folder  assuming it s there  Or  pd read csv  data folder data csv     assuming your data folder is in the same directory as your  py file

User · Answer

Try  import pandas as pd pd read csv     data folder data csv

User · Answer

For non-Windows users   import pandas as pd import os  os chdir     data folder   df   pd read csv  data csv     For Windows users   import pandas as pd  df   pd read csv r C  data folder data csv     The prefix r in location above saves time when giving the location to the pandas Dataframe

[python] How to open my files in data_folder with pandas using relative path?

Examples related to python

Examples related to pandas

Examples related to relative-path