Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create proper shuffle operation while reading multiple files #1

Open
vkuznet opened this issue Nov 9, 2018 · 0 comments
Open

Create proper shuffle operation while reading multiple files #1

vkuznet opened this issue Nov 9, 2018 · 0 comments

Comments

@vkuznet
Copy link
Owner

vkuznet commented Nov 9, 2018

We need to support shuffle while reading data batches from multiple files. For that data generator should consume list of files and be able to read chunks from all of them randomly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant