Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add KCL features #24

Open
thomasdziedzic opened this issue Apr 18, 2015 · 0 comments
Open

Add KCL features #24

thomasdziedzic opened this issue Apr 18, 2015 · 0 comments

Comments

@thomasdziedzic
Copy link

It would be nice to have a haskell library that matches the feature set of the KCL.

http://docs.aws.amazon.com/kinesis/latest/dev/developing-consumer-apps-with-kcl.html

Some notable features:

  • Checkpoints processed records (handled remotely so tolerant of a machine disappearing)
  • Coordinates shard associations with other workers
  • Balances shard-worker associations

The way KCL implements this is through a dynamodb table where it keeps track of the current owner/checkpoint and other info in a single row per shard per application

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants