Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix qdrant index duplicates upon initialisation #454

Open
arkodoescode opened this issue Oct 26, 2024 · 0 comments
Open

Fix qdrant index duplicates upon initialisation #454

arkodoescode opened this issue Oct 26, 2024 · 0 comments

Comments

@arkodoescode
Copy link

arkodoescode commented Oct 26, 2024

Issue: The Qdrant index does not implement _sync_index() and _remove_and_sync() methods and relies on add() method to add points upon initialisation. Also it does not generate UUIDs deterministically based on the utterance so every time it is initialised it creates a duplicate with a new ID.

Proposed fix:
There are two ways to go about this as far as I can see.

  1. Generate UUIDs deterministically based on utterance so Qdrant internally updates the point instead of creating a duplicate. (This will not sync locally deleted utterances though, so not a complete solution)
  2. Implement the sync methods.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant