Skip to content

databaker: cache looksups for preview+extraction #22

@mikeAdamss

Description

@mikeAdamss

the preview functionality works by basically doing all the lookups.

currently, we then we get to aspandas() and repeat exactly the same series of lookups.

give the new "engine" classes persist, we can probably add a dictionary to cache the results within each dimension engine (eg store{obs_cell: (looked_up_cell, looked_up_cell_value)}) every time we successfully lookup something to save us the processing overhead of repeating ourselves.

remember this needs to be cached after cellvalueoverrides, but the cache needs looking at as soon as we enter def lookup() (I think, something along those lines).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions