Lucrul cu coloane de date imbricate

Restructurarea datelor cu pandas

Maria Eugenia Inzaugarat

Data Scientist

Recapitulare

  • Cum se citesc date JSON imbricate într-un DataFrame folosind json_normalize().
Restructurarea datelor cu pandas

Date imbricate în coloane

writers = ["Mary Shelley", "Ernest Hemingway"]
books = ["{'title': 'Frankenstein', 'year': 1818}", 
        "{'title': 'The Old Man and the Sea', 'year': 1951}"]

collection = pd.DataFrame( )
Restructurarea datelor cu pandas

Date imbricate în coloane

writers = ["Mary Shelley", "Ernest Hemingway"]
books = ["{'title': 'Frankenstein', 'year': 1818}", 
        "{'title': 'The Old Man and the Sea', 'year': 1951}"]

collection = pd.DataFrame(dict( ))
Restructurarea datelor cu pandas

Date imbricate în coloane

writers = ["Mary Shelley", "Ernest Hemingway"]
books = ['{"title": "Frankenstein", "year": "1818"}',
         '{"title": "The Old Man and the Sea", "year":"1951"}']

collection = pd.DataFrame(dict(writers=writers, books=books))
collection
            writers                                               books
0      Mary Shelley             {'title': 'Frankenstein', 'year': 1818}
1  Ernest Hemingway  {'title': 'The Old Man and the Sea', 'year': 1951}
Restructurarea datelor cu pandas

Conversia datelor imbricate

import json

books = collection['books']
Restructurarea datelor cu pandas

Conversia datelor imbricate

import json

books = collection['books'].apply( )
Restructurarea datelor cu pandas

Conversia datelor imbricate

import json

books = collection['books'].apply(json.loads)
Restructurarea datelor cu pandas

Conversia datelor imbricate

import json

books = collection['books'].apply(json.loads).apply(pd.Series)
books
                     title  year
0             Frankenstein  1818
1  The Old Man and the Sea  1951
Restructurarea datelor cu pandas

Concatenare la loc

collection = collection.drop(columns='books')

pd.concat([collection, books], axis=1)
            writers                    title  year
0      Mary Shelley             Frankenstein  1818
1  Ernest Hemingway  The Old Man and the Sea  1951
Restructurarea datelor cu pandas

Serializarea datelor imbricate

import json
books = collection['books'].apply(json.loads)



Restructurarea datelor cu pandas

Serializarea datelor imbricate

import json
books = collection['books'].apply(json.loads).to_list()

books_dump = json.dumps(books)
new_books = pd.read_json(books_dump)
new_books
                     title  year
0             Frankenstein  1818
1  The Old Man and the Sea  1951
Restructurarea datelor cu pandas

Serializarea datelor imbricate

pd.concat([collection['writers'], new_books], axis=1)
            writers                    title  year
0      Mary Shelley             Frankenstein  1818
1  Ernest Hemingway  The Old Man and the Sea  1951
Restructurarea datelor cu pandas

Să exersăm!

Restructurarea datelor cu pandas

Preparing Video For Download...