Find all CSV files in a directory using Python

Question

How can I find all files in directory with the extension  csv in python

User · Answer

Use the python glob module to easily list out the files we need  import glob path csv glob glob  quot    data subfolrder   csv quot

User · Answer

Many  linked  answers change working directory with os chdir    But you don t have to  Recursively print all CSV files in  home project  directory  pathname    quot  home project      csv quot   for file in glob iglob pathname  recursive True       print file   Requires python 3 5   From docs  1    pathname can be either absolute  like  usr src Python-1 5 Makefile  or relative  like       Tools     gif  pathname can contain shell-style wildcards  Whether or not the results are sorted depends on the file system  If recursive is true  the pattern    will match any files and zero or more directories  subdirectories and symbolic links to directories   1  https   docs python org 3 library glob html glob glob

User · Answer

use Python OS module to find csv file in a directory   the simple example is here    import os    This is the path where you want to search path   r d      this is the extension you want to detect extension     csv   for root  dirs list  files list in os walk path       for file name in files list          if os path splitext file name  -1     extension              file name path   os path join root  file name              print file name             print file name path     This is the full path of the filter file

User · Answer

While solution given by thclpr works it scans only immediate files in the directory and not files in the sub directories if any  Although this is not the requirement but just in case someone wishes to scan sub directories too below is the code that uses os walk  import os from glob import glob PATH     home someuser projects someproject  EXT      csv  all csv files    file                  for path  subdir  files in os walk PATH                   for file in glob os path join path  EXT    print all csv files    Copied from this blog

User · Answer

By using the combination of filters and lambda  you can easily filter out csv files in given folder  import os  files   os listdir  quot  path-to-dir quot       files   list filter lambda f  f endswith   csv    files      lambda returns True if filename name ends with  csv or else False   and filter function uses the returned boolean value to filter  csv files from list files

User · Answer

from os import listdir  def find csv filenames  path to dir  suffix   csv         filenames   listdir path to dir      return   filename for filename in filenames if filename endswith  suffix       The function find csv filenames   returns a list of filenames as strings  that reside in the directory path to dir with the given suffix  by default    csv     Addendum  How to print the filenames   filenames   find csv filenames  my directory   for name in filenames    print name

User · Answer

You could just use glob with recursive   true  the pattern    will match any files and zero or more directories  subdirectories and symbolic links to directories  import glob  os  os chdir  quot C   Users  username  Desktop  MAIN DIRECTORY quot    for file in glob glob  quot    csv quot   recursive   true       print file

User · Answer

Please use this tested working code  This function will return a list of all the CSV files with absolute CSV file paths in your specified path  import os from glob import glob  def get csv files dir path  ext       os chdir dir path      return list map lambda x  os path join dir path  x   glob f    ext       print get csv files  quot E   input  dir  path quot    quot csv quot

User · Answer

import os  path    C  Users Shashank Desktop   os chdir path   for p n f in os walk os getcwd         for a in f          a   str a          if a endswith   csv                print a              print p    This will help to identify path also of these csv files

User · Answer

import os import glob  path    c     extension    csv  os chdir path  result   glob glob        format extension   print result

User · Answer

I had to get csv files that were in subdirectories  therefore  using the response from tchlpr I modified it to work best for my use case   import os import glob  os chdir    path to main dir    result   glob glob        csv    print  result

User · Answer

This solution uses the python function filter  This function creates a list of elements for which a function returns true   In this case  the anonymous function used is partial matching   csv  on every element of the directory files list obtained with os listdir  the path i want to look in    import os  filepath   filepath to my CSVs     for example     my data    list filter lambda x    csv  in x  os listdir  filepath to my CSVs

[python] Find all CSV files in a directory using Python

Examples related to python

Examples related to csv

Examples related to file

Examples related to directory

Examples related to find