Skip to content

Datastore Fetcher

Fetch dataset resource data from the DataStore.

This fetcher is used to fetch data from the DataStore using the resource ID.

__init__(resource_id, limit=2000000, cache_strategy=None)

Initialize the DatastoreDataFetcher.

PARAMETER DESCRIPTION
resource_id

The ID of the resource to fetch data for.

TYPE: str

limit

The maximum number of rows to fetch.

TYPE: int DEFAULT: 2000000

cache_strategy

The cache strategy to use. If not provided, the configured cache strategy will be used.

TYPE: str DEFAULT: None

fetch_data()

Fetch data from the DataStore.

RETURNS DESCRIPTION
DataFrame

pd.DataFrame: Data from the DataStore

make_cache_key()

Generate a cache key for the DataStore data fetcher.

Uses the resource ID as the part of a cache key.

RETURNS DESCRIPTION
str

The cache key

TYPE: str