-
Notifications
You must be signed in to change notification settings - Fork 138
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[feat]Rocksdb backend #121
Open
bashimao
wants to merge
67
commits into
tensorflow:master
Choose a base branch
from
bashimao:rocksdb-backend
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 1 commit
Commits
Show all changes
67 commits
Select commit
Hold shift + click to select a range
d6a137c
RocksDB hashtable backend for Tensorflow Recommenders Addons.
bashimao 0b48160
Fix major bugs and establish proper compiler toolchain.
bashimao 6eb84c4
Only create if not in read_only mode.
bashimao e8cbf37
Decouple cleaning from creating a column family.
bashimao 9cdaec7
Correct pending linker issues.
bashimao 42aff13
Add op definitions for RocksDB.
bashimao 222fe26
Need to include op-definitions in compiler directives.
bashimao 052c2e2
Automatically import RocksDB table object upon module load.
bashimao 96856d7
Add interface code to properly transfer arguments to the C++ implemen…
bashimao 06738d2
Typo...
bashimao 23a0b0e
Fix opening non-existent database bug.
bashimao b55ac03
Merge branch 'tensorflow:master' into rocksdb-backend
bashimao c2ae3c3
Fix typo.
bashimao 159c4c3
Add connection pool functionality to allow access multiple tables in …
bashimao 51e8389
Fix insert bug. Add configurable size function, two modes: 1) through…
bashimao e8558e1
Merge branch 'rocksdb-backend' of github.com:bashimao/recommenders-ad…
bashimao 4c0d09f
Fix up all known issues, add registry functionalities.
bashimao 6287344
Make DBWrapper thread-safe.
bashimao 101275c
Switch to reader/writer lock for performance.
bashimao ccc7b58
Allow settign export_path from Python.
bashimao d9e8680
Extract the default value's shape.
bashimao ed8f58a
Improved support for multi-dimensional tensors.
bashimao 15c7953
Improve multi-threading stability. Added limit for export to pass tes…
bashimao 2fb2dec
Fix typo.
bashimao 2dff086
Now passing all but 2 tests.
bashimao c7828ee
Loop condition was wrong.
bashimao 43fe98e
Pointer value instead of pointed to value written to file.
bashimao 1de6a0a
Protect against divide by zero.
bashimao 626ce3a
Add Import/Export lock to avoid overlapping transactions - despite re…
bashimao 972c4f9
Remove export lock idea. Instead make the mutex absolute. We have a p…
bashimao e6d52d9
Passing all relevant checks.
bashimao c770dc0
Reformatted cc-/h-files to conform to Google-style.
bashimao 62600bd
Tick up copyright disclaimer version number.
bashimao c8ce053
Reformat with yapf.
bashimao ff725b2
Tick down rules_foreign_cc package version according to Heka's recomm…
bashimao eff7a39
Merge branch 'master' into rocksdb-backend
bashimao de7fb53
Reformat python code.
bashimao 82816b0
Merge branch 'master' into rocksdb-backend
bashimao 804efb9
Code cosmetics
bashimao e116424
Fix Python format according to proposed coding standards.
bashimao 36bd30a
Manually ran clang format. Not sure why it did not work before.
bashimao bbeca4a
Merge branch 'master' into rocksdb-backend
rhdong 05d6d2a
Merge branch 'master' into rocksdb-backend
bashimao 45a748b
Fix up Bazel rules for 0.6 foreign_cc.
bashimao 567e92d
Somehow these libs are no longer needed?!
bashimao dbcd36b
Resolve most wiggles that prevent compiling ant testing.
bashimao ddbb499
Temporary fix for library search path.
bashimao bff04bb
Apply yapf.
bashimao 08c83e4
Apply Clang Format.
bashimao fc7ac16
Change to a more commonly used path that has symlinks.
bashimao f6bd10d
Add dependencies to ci images.
bashimao 46be6bd
Fix syntax error. ;-)
bashimao ecdc998
Merge branch 'master' into rocksdb-backend
bashimao 0011199
Now included in base image. https://github.com/tensorflow/recommender…
bashimao fbd18bc
Simplify a couple of things.
bashimao b32139d
Can process true/false. So why is it 0/1?
bashimao 15714b3
Update C++ portion of RocksDB implementation to accommodate interface…
bashimao 9811e82
Merge branch 'tensorflow:master' into rocksdb-backend
bashimao db166a3
Merge branch 'master' into rocksdb-backend
bashimao 366638d
Allow using pre-built rocksdb version.
bashimao a1bb85f
Merge branch 'master' into rocksdb-backend
bashimao 778f244
Fix up bazel environment to use pre-compiled rocksdb.
bashimao f86ec70
Implement MemoryUsed API.
bashimao eaa6219
Bugfixes and implement FindWithExists API.
bashimao 4ebd8ac
Minor bugfix.
bashimao 4a86ac2
Add minor error check.
bashimao 53b732d
Accumulation API. Dummy implementation.
bashimao File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just remove the block