Skip to content

Strategy to Index variable data #12

@rohenaz

Description

@rohenaz

A simple example would be:
In planaria.js where index keys are defined, declare "out" instead of each individual pushdata field name.

This is challenging because:

  1. When you don't explicitly define the keys, new records can come in while the planaria is already indexed, requiring an expensive on-the-fly re-index for searches to yield results for new fields.
  2. with variable width protocols such as MAP, there may be many fields. It's possible to create a planaria that translates pushdatas into human readable field names based on the MAP schema where MAP keys become field names. When you have many different possible field names being indexed, you will quickly hit the mongodb limit of 64 field index max.

What can be done so that dynamic field names might be possible without explicitly defining each field to index?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions