Best Fastest way to read an Excel Sheet into a DataTable

Question

I m hoping someone here can point me in the right direction - I m trying to create a fairly robust utility program to read the data from an Excel sheet  may be  xls OR  xlsx  into a DataTable as quickly and leanly as possible   I came up with this routine in VB  although I d be just as happy with a good C  answer    Public Shared Function ReadExcelIntoDataTable ByVal FileName As String  ByVal SheetName As String  As DataTable     Dim RetVal As New DataTable      Dim strConnString As String     strConnString    Driver  Microsoft Excel Driver    xls    xlsx    xlsm    xlsb   DBQ    amp  FileName  amp           Dim strSQL As String      strSQL    SELECT   FROM     amp  SheetName  amp            Dim y As New Odbc OdbcDataAdapter strSQL  strConnString       y Fill RetVal       Return RetVal  End Function   I m wondering if this is the best way to do it or if there are better   more efficent ways  or just more intelligent ways - Maybe Linq   native  Net providers  to use instead   ALSO  just a quick and silly additional question - Do I need to include code such as y Dispose   and y   Nothing or will that be taken care of since the variable should die at the end of the routine  right    Thanks

User · Answer

public DataTable ImportExceltoDatatable string filepath           string sqlquery   Select   From  SheetName   Where YourCondition       string sqlquery    Select   From  SheetName   Where Id  ID 007        DataSet ds   new DataSet        string constring     Provider Microsoft ACE OLEDB 12 0 Data Source     filepath     Extended Properties   Excel 12 0 HDR YES          OleDbConnection con   new OleDbConnection constring            OleDbDataAdapter da   new OleDbDataAdapter sqlquery  con       da Fill ds       DataTable dt   ds Tables 0       return dt

User · Answer

If you want to do the same thing in C  based on Ciar  n Answer  string sSheetName   null  string sConnection   null  DataTable dtTablesList   default DataTable   OleDbCommand oleExcelCommand   default OleDbCommand   OleDbDataReader oleExcelReader   default OleDbDataReader   OleDbConnection oleExcelConnection   default OleDbConnection    sConnection    Provider Microsoft ACE OLEDB 12 0 Data Source C   Test xls Extended Properties   Excel 12 0 HDR No IMEX 1      oleExcelConnection   new OleDbConnection sConnection   oleExcelConnection Open     dtTablesList   oleExcelConnection GetSchema  Tables     if  dtTablesList Rows Count  gt  0         sSheetName   dtTablesList Rows 0   TABLE NAME   ToString       dtTablesList Clear    dtTablesList Dispose      if   string IsNullOrEmpty sSheetName         oleExcelCommand   oleExcelConnection CreateCommand        oleExcelCommand CommandText    Select   From      sSheetName            oleExcelCommand CommandType   CommandType Text      oleExcelReader   oleExcelCommand ExecuteReader        nOutputRow   0       while  oleExcelReader Read                    oleExcelReader Close      oleExcelConnection Close         here is another way read Excel into a DataTable without using OLEDB   very quick   Keep in mind that the file ext would have to be  CSV for this to work properly   private static DataTable GetDataTabletFromCSVFile string csv file path        csvData   new DataTable defaultTableName       try               using  TextFieldParser csvReader   new TextFieldParser csv file path                         csvReader SetDelimiters new string                                 tableDelim                              csvReader HasFieldsEnclosedInQuotes   true              string   colFields   csvReader ReadFields                foreach  string column in colFields                                DataColumn datecolumn   new DataColumn column                   datecolumn AllowDBNull   true                  csvData Columns Add datecolumn                              while   csvReader EndOfData                                string   fieldData   csvReader ReadFields                      Making empty value as null                 for  int i   0  i  lt  fieldData Length  i                                          if  fieldData i     string Empty                                                fieldData i    string Empty    fieldData i    null                                             Skip rows that have any csv header information or blank rows in them                     if  fieldData 0  Contains  Disclaimer      string IsNullOrEmpty fieldData 0                                                  continue                                                          csvData Rows Add fieldData                                     catch  Exception ex                  return csvData

User · Answer

This seemed to work pretty well for me   private DataTable ReadExcelFile string sheetName  string path         using  OleDbConnection conn   new OleDbConnection                  DataTable dt   new DataTable            string Import FileName   path          string fileExtension   Path GetExtension Import FileName           if  fileExtension      xls               conn ConnectionString    Provider Microsoft Jet OLEDB 4 0 Data Source     Import FileName          Extended Properties  Excel 8 0 HDR YES             if  fileExtension      xlsx               conn ConnectionString    Provider Microsoft ACE OLEDB 12 0 Data Source     Import FileName          Extended Properties  Excel 12 0 Xml HDR YES             using  OleDbCommand comm   new OleDbCommand                          comm CommandText    Select   from      sheetName                     comm Connection   conn              using  OleDbDataAdapter da   new OleDbDataAdapter                                  da SelectCommand   comm                  da Fill dt                   return dt

User · Answer

Use the below snippet it will be helpfull    string POCpath     G  Althaf abc xlsx    string POCConnection    Provider Microsoft ACE OLEDB 12 0 Data Source     POCpath     Extended Properties   Excel 12 0 HDR Yes IMEX 1       OleDbConnection POCcon   new OleDbConnection POCConnection   OleDbCommand POCcommand   new OleDbCommand    DataTable dt   new DataTable    OleDbDataAdapter POCCommand   new OleDbDataAdapter  select   from  Sheet1      POCcon   POCCommand Fill dt   Console WriteLine dt Rows Count

User · Answer

I found it pretty easy like this      using System      using System Data      using System IO      using Excel       public DataTable ExcelToDataTableUsingExcelDataReader string storePath                FileStream stream   File Open storePath  FileMode Open  FileAccess Read            string fileExtension   Path GetExtension storePath           IExcelDataReader excelReader   null          if  fileExtension      xls                         excelReader   ExcelReaderFactory CreateBinaryReader stream                     else if  fileExtension      xlsx                         excelReader   ExcelReaderFactory CreateOpenXmlReader stream                      excelReader IsFirstRowAsColumnNames   true          DataSet result   excelReader AsDataSet            var test   result Tables 0           return result Tables 0           Note  you need to install SharpZipLib package for this  Install-Package SharpZipLib   neat and clean

User · Answer

You can use OpenXml SDK for   xlsx files  It works very quickly  I made simple C  IDataReader implementation for this sdk  See here  Now you can easy read excel file to DataTable and you can import excel file to sql server database  use SqlBulkCopy   ExcelDataReader reads very fast  On my machine 10000 records less 3 sec and 60000 less 8 sec   Read to DataTable example   class Program       static void Main string   args                var dt   new DataTable            using  var reader   new ExcelDataReader   data xlsx                dt Load reader            Console WriteLine  done      dt Rows Count           Console ReadKey

User · Answer

lt summary gt      ReadToDataTable reads the given Excel file to a datatable       lt  summary gt       lt param name  quot table quot  gt The table to be populated  lt  param gt       lt param name  quot incomingFileName quot  gt The file to attempt to read to  lt  param gt       lt returns gt TRUE if success  FALSE otherwise  lt  returns gt       lt remarks gt  lt  remarks gt  Public Function ReadToDataTable ByRef table As DataTable                                  incomingFileName As String  As Boolean     Dim returnValue As Boolean   False     Try          Dim sheetName As String    quot  quot          Dim connectionString As String    quot Provider Microsoft ACE OLEDB 12 0 Data Source  quot   amp  incomingFileName  amp   quot  Extended Properties  quot  quot Excel 12 0 HDR No IMEX 1 quot  quot  quot          Dim tablesInFile As DataTable         Dim oleExcelCommand As OleDbCommand         Dim oleExcelReader As OleDbDataReader         Dim oleExcelConnection As OleDbConnection          oleExcelConnection   New OleDbConnection connectionString          oleExcelConnection Open            tablesInFile   oleExcelConnection GetSchema  quot Tables quot            If tablesInFile Rows Count  gt  0 Then             sheetName   tablesInFile Rows 0   quot TABLE NAME quot   ToString         End If          If sheetName  lt  gt   quot  quot  Then              oleExcelCommand   oleExcelConnection CreateCommand               oleExcelCommand CommandText    quot Select   From   quot   amp  sheetName  amp   quot   quot              oleExcelCommand CommandType   CommandType Text              oleExcelReader   oleExcelCommand ExecuteReader               Determine what row of the Excel file we are on             Dim currentRowIndex As Integer   0              While oleExcelReader Read                  If we are on the First Row  then add the item as Columns in the DataTable                 If currentRowIndex   0 Then                     For currentFieldIndex As Integer   0 To  oleExcelReader VisibleFieldCount - 1                          Dim currentColumnName As String   oleExcelReader Item currentFieldIndex  ToString                         table Columns Add currentColumnName  GetType String                           table AcceptChanges                       Next                 End If                  If we are on a Row with Data  add the data to the SheetTable                 If currentRowIndex  gt  0 Then                     Dim newRow As DataRow   table NewRow                     For currentFieldIndex As Integer   0 To  oleExcelReader VisibleFieldCount - 1                          Dim currentColumnName As String   table Columns currentFieldIndex  ColumnName                         newRow currentColumnName    oleExcelReader Item currentFieldIndex                          If IsDBNull newRow currentFieldIndex   Then                             newRow currentFieldIndex     quot  quot                          End If                     Next                     table Rows Add newRow                      table AcceptChanges                   End If                   Increment the CurrentRowIndex                 currentRowIndex    1             End While              oleExcelReader Close            End If          oleExcelConnection Close           returnValue   True     Catch ex As Exception          LastError   ex ToString         Return False     End Try       Return returnValue End Function

User · Answer

I ve used this method and for me  it is so efficient and fast      Step 1  Download NuGet source of Generic Parsing by Andrew Rissing    Step 2  Reference this to your project    Step 3  Reference Microsoft Office Interop Excel to your project    Step 4  Follow the logic below  public static DataTable ExcelSheetToDataTable string filePath            Save a copy of the Excel file as CSV     var xlApp   new XL Application        var xlWbk   xlApp Workbooks Open filePath       var tempPath           Path Combine Environment              GetFolderPath Environment SpecialFolder UserProfile                 AppData                 Local                  Temp                Path GetFileNameWithoutExtension filePath      csv         xlApp DisplayAlerts   false      xlWbk SaveAs tempPath  XL XlFileFormat xlCSV       xlWbk Close SaveChanges  false       xlApp Quit            The actual parsing     using  var parser   new GenericParserAdapter tempPath             parser FirstRowHasHeader   true          return parser GetDataTable               Generic Parsing by Andrew Rissing

User · Answer

This is the way to read from excel oledb  try       System Data OleDb OleDbConnection MyConnection      System Data DataSet DtSet      System Data OleDb OleDbDataAdapter MyCommand      string strHeader7           strHeader7    hdr7     Yes     No       MyConnection   new System Data OleDb OleDbConnection  Provider Microsoft ACE OLEDB 12 0 Data Source     fn     Extended Properties   Excel 12 0 HDR     strHeader7     IMEX 1          MyCommand   new System Data OleDb OleDbDataAdapter  select   from      wks         MyConnection       MyCommand TableMappings Add  Table    TestTable        DtSet   new System Data DataSet        MyCommand Fill DtSet       dgv7 DataSource   DtSet Tables 0       MyConnection Close      catch  Exception ex        MessageBox Show ex ToString

User · Answer

The below code is tested by myself and is very simple  understandable  usable and fast  This code  initially takes all sheet names  then puts all tables of that excel file in a DataSet       public static DataSet ToDataSet string exceladdress  int startRecord   0  int maxRecord   -1  string condition                     DataSet result   new DataSet            using  OleDbConnection connection   new OleDbConnection                   exceladdress TrimEnd   ToLower   EndsWith  x                       Provider Microsoft ACE OLEDB 12 0 Data Source      exceladdress           Extended Properties  Excel 12 0 Xml HDR YES                       provider Microsoft Jet OLEDB 4 0 Data Source      exceladdress      Extended Properties Excel 8 0                 try                               connection Open                    DataTable schema   connection GetOleDbSchemaTable OleDbSchemaGuid Tables  null                   foreach  DataRow drSheet in schema Rows                      if  drSheet  TABLE NAME   ToString   Contains                                                     string s   drSheet  TABLE NAME   ToString                            if  s StartsWith       s   s Substring 1  s Length - 2                           System Data OleDb OleDbDataAdapter command                               new System Data OleDb OleDbDataAdapter string Join      SELECT   FROM     s        condition   connection                           DataTable dt   new DataTable                            if  maxRecord  gt  -1  amp  amp  startRecord  gt  -1  command Fill startRecord  maxRecord  dt                           else command Fill dt                           result Tables Add dt                                         return result                            catch  Exception ex    return null                finally   connection Close              Enjoy

User · Answer

I have always used OLEDB for this  something like         Dim sSheetName As String     Dim sConnection As String     Dim dtTablesList As DataTable     Dim oleExcelCommand As OleDbCommand     Dim oleExcelReader As OleDbDataReader     Dim oleExcelConnection As OleDbConnection      sConnection    Provider Microsoft ACE OLEDB 12 0 Data Source C  Test xls Extended Properties   Excel 12 0 HDR No IMEX 1         oleExcelConnection   New OleDbConnection sConnection      oleExcelConnection Open        dtTablesList   oleExcelConnection GetSchema  Tables        If dtTablesList Rows Count  gt  0 Then         sSheetName   dtTablesList Rows 0   TABLE NAME   ToString     End If      dtTablesList Clear       dtTablesList Dispose        If sSheetName  lt  gt     Then          oleExcelCommand   oleExcelConnection CreateCommand           oleExcelCommand CommandText    Select   From     amp  sSheetName  amp              oleExcelCommand CommandType   CommandType Text          oleExcelReader   oleExcelCommand ExecuteReader          nOutputRow   0          While oleExcelReader Read          End While          oleExcelReader Close        End If      oleExcelConnection Close     The ACE OLEDB provider will read both  xls and  xlsx files and I have always found the speed quite good

User · Answer

Here is another way of doing it  public DataSet CreateTable string source        using  var connection   new OleDbConnection GetConnectionString source  true                  var dataSet   new DataSet            connection Open            var schemaTable   connection GetOleDbSchemaTable OleDbSchemaGuid Tables  null           if  schemaTable    null              return dataSet           var sheetName               foreach  DataRow row in schemaTable Rows                        sheetName   row  TABLE NAME   ToString                break                     var command   string Format  SELECT   FROM   0      sheetName           var adapter   new OleDbDataAdapter command  connection           adapter TableMappings Add  TABLE    TestTable            adapter Fill dataSet           connection Close             return dataSet               private string GetConnectionString string source  bool hasHeader        return string Format  Provider Microsoft ACE OLEDB 12 0 Data Source  0       Extended Properties   Excel 12 0 HDR  1  IMEX 1     source   hasHeader    YES     NO

[c#] Best /Fastest way to read an Excel Sheet into a DataTable?

Examples related to c#

Examples related to .net

Examples related to vb.net