Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve] Increase the cache prefetch success rate when entryId is discontinuous. #4539

Open
zhuhai1221 opened this issue Dec 25, 2024 · 0 comments

Comments

@zhuhai1221
Copy link

When Pulsar's persistence is configured with EnsembleSize != WriteQuorum, for example, EnsembleSize=2 and WriteQuorum=1, entry prefetching fails. If there is a backlog of messages, after the RocksDB index cache is evicted, the disk read rate becomes very slow, and entry prefetching fails because the entryId is validated, and at this point, the entryId is discontinuous.

Is it possible to read entries without validating the entryId?

use
org.apache.bookkeeper.bookie.storage.EntryLogger#readEntry(long)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant