Parsing json and searching through it

Question

I have this code   import json from pprint import pprint json data open  bookmarks json   jdata   json load json data  pprint  jdata  json data close     How can I search through it for u uri   u http

User · Answer

Functions to search through and print dicts, like JSON. *made in python 3

Search:

def pretty_search(dict_or_list, key_to_search, search_for_first_only=False):
    """
    Give it a dict or a list of dicts and a dict key (to get values of),
    it will search through it and all containing dicts and arrays
    for all values of dict key you gave, and will return you set of them
    unless you wont specify search_for_first_only=True

    :param dict_or_list: 
    :param key_to_search: 
    :param search_for_first_only: 
    :return: 
    """
    search_result = set()
    if isinstance(dict_or_list, dict):
        for key in dict_or_list:
            key_value = dict_or_list[key]
            if key == key_to_search:
                if search_for_first_only:
                    return key_value
                else:
                    search_result.add(key_value)
            if isinstance(key_value, dict) or isinstance(key_value, list) or isinstance(key_value, set):
                _search_result = pretty_search(key_value, key_to_search, search_for_first_only)
                if _search_result and search_for_first_only:
                    return _search_result
                elif _search_result:
                    for result in _search_result:
                        search_result.add(result)
    elif isinstance(dict_or_list, list) or isinstance(dict_or_list, set):
        for element in dict_or_list:
            if isinstance(element, list) or isinstance(element, set) or isinstance(element, dict):
                _search_result = pretty_search(element, key_to_search, search_result)
                if _search_result and search_for_first_only:
                    return _search_result
                elif _search_result:
                    for result in _search_result:
                        search_result.add(result)
    return search_result if search_result else None

Print:

def pretty_print(dict_or_list, print_spaces=0):
    """
    Give it a dict key (to get values of),
    it will return you a pretty for print version
    of a dict or a list of dicts you gave.

    :param dict_or_list: 
    :param print_spaces: 
    :return: 
    """
    pretty_text = ""
    if isinstance(dict_or_list, dict):
        for key in dict_or_list:
            key_value = dict_or_list[key]
            if isinstance(key_value, dict):
                key_value = pretty_print(key_value, print_spaces + 1)
                pretty_text += "\t" * print_spaces + "{}:\n{}\n".format(key, key_value)
            elif isinstance(key_value, list) or isinstance(key_value, set):
                pretty_text += "\t" * print_spaces + "{}:\n".format(key)
                for element in key_value:
                    if isinstance(element, dict) or isinstance(element, list) or isinstance(element, set):
                        pretty_text += pretty_print(element, print_spaces + 1)
                    else:
                        pretty_text += "\t" * (print_spaces + 1) + "{}\n".format(element)
            else:
                pretty_text += "\t" * print_spaces + "{}: {}\n".format(key, key_value)
    elif isinstance(dict_or_list, list) or isinstance(dict_or_list, set):
        for element in dict_or_list:
            if isinstance(element, dict) or isinstance(element, list) or isinstance(element, set):
                pretty_text += pretty_print(element, print_spaces + 1)
            else:
                pretty_text += "\t" * print_spaces + "{}\n".format(element)
    else:
        pretty_text += str(dict_or_list)
    if print_spaces == 0:
        print(pretty_text)
    return pretty_text

User · Answer

ObjectPath is a library that provides ability to query JSON and nested structures of dicts and lists  For example  you can search for all attributes called  foo  regardless how deep they are by using    foo    While the documentation focuses on the command line interface  you can perform the queries programmatically by using the package s Python internals  The example below assumes you ve already loaded the data into Python data structures  dicts  amp  lists   If you re starting with a JSON file or string you just need to use load or loads from the json module first   import objectpath  data           foo   1   bar    a          foo   2   bar    b          NoFooHere   2   bar    c          foo   3   bar    d       tree obj   objectpath Tree data   tuple tree obj execute     foo      returns   1  2  3    Notice that it just skipped elements that lacked a  foo  attribute  such as the third item in the list  You can also do much more complex queries  which makes ObjectPath handy for deeply nested structures  e g  finding where x has y that has z    x y z   I refer you to the documentation and tutorial for more information

User · Answer

As json loads simply returns a dict  you can use the operators that apply to dicts    gt  gt  gt  jdata   json load    uri    http     foo    bar      gt  gt  gt   uri  in jdata         Check if  uri  is in jdata s keys True  gt  gt  gt  jdata  uri             Will return the value belonging to the key  uri  u http     Edit  to give an idea regarding how to loop through the data  consider the following example    gt  gt  gt  import json  gt  gt  gt  jdata   json loads open   bookmarks json   read     gt  gt  gt  for c in jdata  children   0   children            print  Title      URI      format c get  title    No title                                              c get  uri    No uri        Title  Recently Bookmarked  URI  place folder BOOKMARKS MENU      Title  Recent Tags  URI  place sort 14 amp type 6 amp maxResults 10 amp queryType 1 Title    URI  No uri Title  Mozilla Firefox  URI  No uri   Inspecting the jdata data structure will allow you to navigate it as you wish  The pprint call you already have is a good starting point for this   Edit2  Another attempt  This gets the file you mentioned in a list of dictionaries  With this  I think you should be able to adapt it to your needs    gt  gt  gt  def build structure data  d              if  children  in data              for c in data  children                    d append   title   c get  title    No title                                              uri   c get  uri   None                    build structure c  d          return d      gt  gt  gt  pprint pprint build structure jdata      title   u Bookmarks Menu    uri   None      title   u Recently Bookmarked      uri     u place folder BOOKMARKS MENU amp folder UNFILED BOOKMARKS amp             title   u Recent Tags      uri     u place sort 14 amp type 6 amp maxResults 10 amp queryType 1       title   u     uri   None      title   u Mozilla Firefox    uri   None      title   u Help and Tutorials      uri     u http   www mozilla com en-US firefox help                 To then  search through it for u uri   u http     do something like this   for c in build structure jdata       if c  uri   startswith  http             print  Started with http

User · Answer

Seems there s a typo  missing colon  in the JSON dict provided by jro  The correct syntax would be  jdata   json load    quot uri quot    quot http  quot    quot foo quot    quot bar quot      This cleared it up for me when playing with the code

User · Answer

You can use jsonpipe if you just need the output  and more comfortable with command line    cat bookmarks json   jsonpipe  grep uri

[python] Parsing json and searching through it

Examples related to python

Examples related to string

Examples related to json

Examples related to grep

Examples related to pprint