Parsing json and searching through it

Question

I have this code   import json from pprint import pprint json data open  bookmarks json   jdata   json load json data  pprint  jdata  json data close     How can I search through it for u uri   u http

User · Answer

ObjectPath is a library that provides ability to query JSON and nested structures of dicts and lists. For example, you can search for all attributes called "foo" regardless how deep they are by using $..foo.

While the documentation focuses on the command line interface, you can perform the queries programmatically by using the package's Python internals. The example below assumes you've already loaded the data into Python data structures (dicts & lists). If you're starting with a JSON file or string you just need to use load or loads from the json module first.

import objectpath

data = [
    {'foo': 1, 'bar': 'a'},
    {'foo': 2, 'bar': 'b'},
    {'NoFooHere': 2, 'bar': 'c'},
    {'foo': 3, 'bar': 'd'},
]

tree_obj = objectpath.Tree(data)

tuple(tree_obj.execute('$..foo'))
# returns: (1, 2, 3)

Notice that it just skipped elements that lacked a "foo" attribute, such as the third item in the list. You can also do much more complex queries, which makes ObjectPath handy for deeply nested structures (e.g. finding where x has y that has z: $.x.y.z). I refer you to the documentation and tutorial for more information.

User · Answer

You can use jsonpipe if you just need the output  and more comfortable with command line    cat bookmarks json   jsonpipe  grep uri

User · Answer

As json loads simply returns a dict  you can use the operators that apply to dicts    gt  gt  gt  jdata   json load    uri    http     foo    bar      gt  gt  gt   uri  in jdata         Check if  uri  is in jdata s keys True  gt  gt  gt  jdata  uri             Will return the value belonging to the key  uri  u http     Edit  to give an idea regarding how to loop through the data  consider the following example    gt  gt  gt  import json  gt  gt  gt  jdata   json loads open   bookmarks json   read     gt  gt  gt  for c in jdata  children   0   children            print  Title      URI      format c get  title    No title                                              c get  uri    No uri        Title  Recently Bookmarked  URI  place folder BOOKMARKS MENU      Title  Recent Tags  URI  place sort 14 amp type 6 amp maxResults 10 amp queryType 1 Title    URI  No uri Title  Mozilla Firefox  URI  No uri   Inspecting the jdata data structure will allow you to navigate it as you wish  The pprint call you already have is a good starting point for this   Edit2  Another attempt  This gets the file you mentioned in a list of dictionaries  With this  I think you should be able to adapt it to your needs    gt  gt  gt  def build structure data  d              if  children  in data              for c in data  children                    d append   title   c get  title    No title                                              uri   c get  uri   None                    build structure c  d          return d      gt  gt  gt  pprint pprint build structure jdata      title   u Bookmarks Menu    uri   None      title   u Recently Bookmarked      uri     u place folder BOOKMARKS MENU amp folder UNFILED BOOKMARKS amp             title   u Recent Tags      uri     u place sort 14 amp type 6 amp maxResults 10 amp queryType 1       title   u     uri   None      title   u Mozilla Firefox    uri   None      title   u Help and Tutorials      uri     u http   www mozilla com en-US firefox help                 To then  search through it for u uri   u http     do something like this   for c in build structure jdata       if c  uri   startswith  http             print  Started with http

User · Answer

Functions to search through and print dicts  like JSON   made in python 3  Search   def pretty search dict or list  key to search  search for first only False               Give it a dict or a list of dicts and a dict key  to get values of       it will search through it and all containing dicts and arrays     for all values of dict key you gave  and will return you set of them     unless you wont specify search for first only True       param dict or list        param key to search        param search for first only        return               search result   set       if isinstance dict or list  dict           for key in dict or list              key value   dict or list key              if key    key to search                  if search for first only                      return key value                 else                      search result add key value              if isinstance key value  dict  or isinstance key value  list  or isinstance key value  set                    search result   pretty search key value  key to search  search for first only                  if  search result and search for first only                      return  search result                 elif  search result                      for result in  search result                          search result add result      elif isinstance dict or list  list  or isinstance dict or list  set           for element in dict or list              if isinstance element  list  or isinstance element  set  or isinstance element  dict                    search result   pretty search element  key to search  search result                  if  search result and search for first only                      return  search result                 elif  search result                      for result in  search result                          search result add result      return search result if search result else None   Print   def pretty print dict or list  print spaces 0               Give it a dict key  to get values of       it will return you a pretty for print version     of a dict or a list of dicts you gave        param dict or list        param print spaces        return               pretty text          if isinstance dict or list  dict           for key in dict or list              key value   dict or list key              if isinstance key value  dict                   key value   pretty print key value  print spaces   1                  pretty text      t    print spaces        n   n  format key  key value              elif isinstance key value  list  or isinstance key value  set                   pretty text      t    print spaces        n  format key                  for element in key value                      if isinstance element  dict  or isinstance element  list  or isinstance element  set                           pretty text    pretty print element  print spaces   1                      else                          pretty text      t     print spaces   1        n  format element              else                  pretty text      t    print spaces           n  format key  key value      elif isinstance dict or list  list  or isinstance dict or list  set           for element in dict or list              if isinstance element  dict  or isinstance element  list  or isinstance element  set                   pretty text    pretty print element  print spaces   1              else                  pretty text      t    print spaces       n  format element      else          pretty text    str dict or list      if print spaces    0          print pretty text      return pretty text

User · Answer

Seems there s a typo  missing colon  in the JSON dict provided by jro  The correct syntax would be  jdata   json load    quot uri quot    quot http  quot    quot foo quot    quot bar quot      This cleared it up for me when playing with the code

[python] Parsing json and searching through it

Examples related to python

Examples related to string

Examples related to json

Examples related to grep

Examples related to pprint