Skip to content

Commit

Permalink
print memory taken by buffer columns
Browse files Browse the repository at this point in the history
  • Loading branch information
karasikov committed Oct 28, 2023
1 parent 3cdfd85 commit 8ad62e2
Showing 1 changed file with 4 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -310,8 +310,11 @@ BRWT BRWTBottomUpBuilder::build(
num_nodes_parallel = std::min(num_nodes_parallel, done.size());
// initialize buffers for merging columns
// these may be huge, so we keep only a few of them
size_t num_buffers = std::max(num_nodes_parallel, size_t(1));
logger->trace("Initializing {} column buffers, in total {:.2} GB", num_buffers,
num_buffers * ((num_rows + 63) / 64 * 8) / 1e9);
std::vector<sdsl::bit_vector> buffers;
for (size_t i = 0; i < std::max(num_nodes_parallel, size_t(1)); ++i) {
for (size_t i = 0; i < num_buffers; ++i) {
buffers.emplace_back(num_rows);
}

Expand Down

0 comments on commit 8ad62e2

Please sign in to comment.