Updating and deleting vectors

Vector Databases for Embeddings with Pinecone

James Chapman

Curriculum Manager, DataCamp

Keeping things fresh...

Keep data current
Optimize query performance
Maintain data integrity

The lifecycle of data from capture, to usage, validation, and updates or removal.

Updating vector values

index.fetch(ids=['1'])

{'namespace': '',
 'usage': {'read_units': 1},
 'vectors': {'1': {'id': '1',
                   'metadata': {"genre": "action", "year": 2023},
                   'values': [-0.0131468913, ...]}
            }
}

Updating vector values

index.update(

    id="1",

    values=[0.370695321, ...]

)

Ensure: list length = index dimensionality

¹ https://docs.pinecone.io/docs/update-data

Updating vector values

index.fetch(ids=['1'])

{'namespace': '',
 'usage': {'read_units': 1},
 'vectors': {'1': {'id': '1',
                   'metadata': {"genre": "action", "year": 2023},
                   'values': [0.370695321, ...]}
            }
}

Updating vector metadata

index.update(
    id="1",
    set_metadata={"genre": "comedy", "rating": 5}
)

¹ https://docs.pinecone.io/docs/update-data

Updating vector metadata

index.fetch(ids=['1'])

{'namespace': '',
 'usage': {'read_units': 1},
 'vectors': {'1': {'id': '1',
                   'metadata': {"genre": "comedy", "year": 2023, "rating": 5},
                   'values': [0.370695321, ...]}
            }
}

Updating values and metadata

index.update(
    id="1",
    values=[-0.31956, ...],
    set_metadata={"genre": "thriller", "ratings": 4}
)

¹ https://docs.pinecone.io/docs/update-data

Deleting vectors

index.delete(
    ids=["1", "2"]
)

¹ https://docs.pinecone.io/docs/delete-data

Deleting vectors by-metadata

index.delete(
    filter={
        "genre": {"$eq": "action"},
    }
)

Deleting vectors within a namespace

index.delete(delete_all=True, namespace='namespace1')

Note: Also removes the namespace!

¹ https://docs.pinecone.io/docs/delete-data

Let's practice!

Vector Databases for Embeddings with Pinecone