HTML Agility pack - parsing tables

Question

I want to use the HTML agility pack to parse tables from complex web pages  but I am somehow lost in the object model   I looked at the link example  but did not find any table data this way  Can I use XPath to get the tables  I am basically lost after having loaded the data as to how to get the tables  I have done this in Perl before and it was a bit clumsy  but worked   HTML  TableParser     I am also happy if one can just shed a light on the right object order for the parsing

User · Answer

The most simple what I ve found to get the XPath for a particular Element is to install FireBug extension for Firefox go to the site webpage press F12 to bring up firebug  right select and right click the element on the page that you want to query and select  Inspect Element  Firebug will select the element in its IDE then right click the Element in Firebug and choose  Copy XPath  this function will give you the exact XPath Query you need to get the element you want using HTML Agility Library

User · Answer

I know this is a pretty old question but this was my solution that helped with visualizing the table so you can create a class structure  This is also using the HTML Agility Pack  HtmlDocument doc   new HtmlDocument    doc LoadHtml    lt html gt  lt body gt  lt p gt  lt table id   foo   gt  lt tr gt  lt th gt hello lt  th gt  lt  tr gt  lt tr gt  lt td gt world lt  td gt  lt  tr gt  lt  table gt  lt  body gt  lt  html gt     var table   doc DocumentNode SelectSingleNode    table    var tableRows   table SelectNodes  tr    var columns   tableRows 0  SelectNodes  th text      for  int i   1  i  lt  tableRows Count  i          for  int e   0  e  lt  columns Count  e                  var value   tableRows i  SelectSingleNode   td  e   1              Console Write columns e  InnerText         value InnerText         Console WriteLine

User · Answer

In my case  there is a single table which happens to be a device list from a router   If you wish to read the table using TR TH TD  row  header  data  instead of a matrix as mentioned above  you can do something like the following       List lt TableRow gt  deviceTable    from table in document DocumentNode SelectNodes XPathQueries SELECT TABLE                                         from row in table  SelectNodes HtmlBody TR                                         let rows   row SelectSingleNode HtmlBody TR                                         where row FirstChild OriginalName    null  amp  amp  row FirstChild OriginalName Equals HtmlBody T HEADER                                         select new TableRow                                                                                     Header   row SelectSingleNode HtmlBody T HEADER   InnerText                                             Data   row SelectSingleNode HtmlBody T DATA   InnerText   ToList                                                 TableRow is just a simple object with Header and Data as properties  The approach takes care of null-ness and this case    x000D   x000D   lt tr gt  x000D       lt td width  28   gt  amp nbsp  lt  td gt  x000D   lt  tr gt  x000D   x000D   x000D    which is row without a header   The HtmlBody object with the constants hanging off of it are probably readily deduced but I apologize for it even still   I came from the world where if you have   in your code  it should either be constant or localizable

User · Answer

How about something like  Using HTML Agility Pack  HtmlDocument doc   new HtmlDocument    doc LoadHtml    lt html gt  lt body gt  lt p gt  lt table id   foo   gt  lt tr gt  lt th gt hello lt  th gt  lt  tr gt  lt tr gt  lt td gt world lt  td gt  lt  tr gt  lt  table gt  lt  body gt  lt  html gt     foreach  HtmlNode table in doc DocumentNode SelectNodes    table          Console WriteLine  Found      table Id       foreach  HtmlNode row in table SelectNodes  tr              Console WriteLine  row            foreach  HtmlNode cell in row SelectNodes  th td                  Console WriteLine  cell      cell InnerText                       Note that you can make it prettier with LINQ-to-Objects if you want   var query   from table in doc DocumentNode SelectNodes    table   Cast lt HtmlNode gt                from row in table SelectNodes  tr   Cast lt HtmlNode gt                from cell in row SelectNodes  th td   Cast lt HtmlNode gt                select new  Table   table Id  CellText   cell InnerText    foreach var cell in query        Console WriteLine   0    1    cell Table  cell CellText

User · Answer

Line from above answer   HtmlDocument doc   new HtmlDocument      This doesn t work in VS 2015 C   You cannot construct an HtmlDocument any more   Another MS  feature  that makes things more difficult to use  Try HtmlAgilityPack HtmlWeb and check out this link for some sample code

[c#] HTML Agility pack - parsing tables

Examples related to c#

Examples related to html

Examples related to html-parsing

Examples related to html-agility-pack