Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Strategy to Index variable data #12

Open
rohenaz opened this issue May 19, 2019 · 0 comments
Open

Strategy to Index variable data #12

rohenaz opened this issue May 19, 2019 · 0 comments

Comments

@rohenaz
Copy link

rohenaz commented May 19, 2019

A simple example would be:
In planaria.js where index keys are defined, declare "out" instead of each individual pushdata field name.

This is challenging because:

  1. When you don't explicitly define the keys, new records can come in while the planaria is already indexed, requiring an expensive on-the-fly re-index for searches to yield results for new fields.
  2. with variable width protocols such as MAP, there may be many fields. It's possible to create a planaria that translates pushdatas into human readable field names based on the MAP schema where MAP keys become field names. When you have many different possible field names being indexed, you will quickly hit the mongodb limit of 64 field index max.

What can be done so that dynamic field names might be possible without explicitly defining each field to index?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant