Repository navigation

Benchmark sharding basic functionality - #1813

Open

cmdupuis3 wants to merge 58 commits into

UXARRAY:mainfrom

cmdupuis3:cmd/bench_shards

Commits on Aug 21, 2026
- Cached benchmark IO sketch
  cmdupuis3
  committed
  1c7665d
- benchmark debugging
  cmdupuis3
  committed
  787e2d4
- Sample large benchmarks fewer times
  cmdupuis3
  committed
  96ce618
- Temp fork/thread speedup for connectivity. REEVALUATE OR REMOVE WHEN CONNECTIVITY BECOMES MULTITHREADED
  cmdupuis3
  committed
  4060897
- Cache benchmark sampling across forks too
  cmdupuis3
  committed
  7ab239d
- Per-resolution async benchmarks
  cmdupuis3
  committed
  c63676c
- Benchmark IO caching fixes
  cmdupuis3
  committed
  85f7c0c
Commits on Aug 24, 2026
- cached IO benchmarks deslopping
  cmdupuis3
  committed
  9cd8fa8
- cached IO deslop global variables
  cmdupuis3
  committed
  b1a6be6
- bench cached IO: more global variable deslopping
  cmdupuis3
  committed
  41f68b2
- Prime the fixture cache before asv run, not during it
  
  cmdupuis3
  and
  claude
  committed
  4dad004
Commits on Aug 25, 2026
- Merge branch 'main' into cmd/bench_io
  cmdupuis3
  authored
  60cf1db
- Lazy neighborhood filter kernel compilation
  cmdupuis3
  committed
  ec83767
- Lazy nb kernels with functools cache instead
  cmdupuis3
  committed
  8564410
Commits on Aug 26, 2026
- Move kernels inside
  cmdupuis3
  committed
  7127726
- merge cmd/lazy_nb_kernels to cmd/bench_io
  cmdupuis3
  committed
  d1ab4e0
- Cached IO: try to impose more CI thread safety
  cmdupuis3
  committed
  c00fd1d
- Cached IO: lazy interpreter warming; NetCDF warming
  cmdupuis3
  committed
  526e320
- Cached IO: configuration tweaks
  cmdupuis3
  committed
  a064b30
- Merge branch 'main' into cmd/bench_io
  cmdupuis3
  authored
  b17b7a5
- Partially revert a064b30, add cpu info dump
  cmdupuis3
  committed
  a0f4a80
Commits on Aug 27, 2026
- Cache the asv environment and fixtures, and report durations
  
  cmdupuis3
  and
  claude
  committed
  f54d634
- Fix 'run benchmark' action for manual runs
  cmdupuis3
  committed
  8f66e30
- Cache the asv environment and fixtures on main too
  
  cmdupuis3
  and
  claude
  committed
  3b46b08
- Split the suite into shards of roughly equal cost
  
  cmdupuis3
  and
  claude
  committed
  04f96f2
- ASV workflow branch for pre-caching IO
  cmdupuis3
  committed
  f9e5546
- ASV benchmarks skip existing commits
  cmdupuis3
  committed
  966e5a8
Commits on Aug 28, 2026
- ASV diff against merge base rather than main
  cmdupuis3
  committed
  6ad7a7f
- ASV multithreading
  cmdupuis3
  committed
  d472982
- Merge branch 'UXARRAY:main' into cmd/bench_io
  cmdupuis3
  authored
  dbbd6ca
- Merge branch 'cmd/bench_io' into cmd/bench_shards
  cmdupuis3
  committed
  aaf1dd8
- Generalize caching across machine names
  cmdupuis3
  committed
  5114500
- Fully async sharding (?)
  cmdupuis3
  committed
  4f044ff
- Benchmark sharding fix
  cmdupuis3
  committed
  8da3f54
- Sharding fix 2
  cmdupuis3
  committed
  f7d8118
- Rework shard partitioning
  cmdupuis3
  committed
  99c49b5
- Load balancing and removing thread sweeps
  cmdupuis3
  committed
  8428e1d
- HPC benchmark scipts
  cmdupuis3
  committed
  6bcf1e7
- HPC bugs
  cmdupuis3
  committed
  63dfedb
- Benchmark machine names
  cmdupuis3
  committed
  4803894
- Thread/core numbers for benchmarks
  cmdupuis3
  committed
  6a4882d
- ASV machine bug
  cmdupuis3
  committed
  cd8d5ed
- benchmark shard bug
  cmdupuis3
  committed
  98e9c9d
Commits on Sep 9, 2026
- Merge main into cmd/bench_io
  cmdupuis3
  committed
  8066798
Commits on Sep 17, 2026
- Cached benchmarks IO deslop p1
  cmdupuis3
  committed
  f417df8
- Cached benchmark IO deslop p2
  cmdupuis3
  committed
  7bb949a
- Cached benchmark IO deslop p3
  cmdupuis3
  committed
  353805c
- Merge branch 'main' into cmd/bench_io
  cmdupuis3
  authored
  937fb06
Commits on Sep 18, 2026
- Merge branch 'main' into cmd/bench_io
  cmdupuis3
  authored
  152e418
Commits on Oct 6, 2026
- Merge origin/main into cmd/bench_shards
  
  cmdupuis3
  and
  claude
  committed
  5cfac6d
- Merge cmd/bench_io into cmd/bench_shards
  
  cmdupuis3
  and
  claude
  committed
  7c1a1cc
- Benchmark shards: asv run instead of asv continuous
  
  cmdupuis3
  and
  claude
  committed
  2739e6f
- Drop merge leftovers in gcagca and mpas_ocean benchmarks
  
  cmdupuis3
  and
  claude
  committed
  cc1d850
- Condense comments and docstrings added on the benchmark sharding branch
  
  cmdupuis3
  and
  claude
  committed
  aa5a267
- Trim neighborhood benchmark radii
  
  cmdupuis3
  and
  claude
  committed
  189e78f
- Simplify the benchmark sharding helpers, workflow and HPC scripts
  
  cmdupuis3
  and
  claude
  committed
  dc3df00
Commits on Oct 7, 2026
- Remove hpc scripts (maybe re-add on a new branch)
  cmdupuis3
  committed
  d136d95
Commits on Oct 8, 2026
- Build neighborhood benchmark setups once per process; seed PR durations from main
  
  cmdupuis3
  and
  claude
  committed
  c88d68d

Commits

Commits on Aug 21, 2026

Commits on Aug 24, 2026

Commits on Aug 25, 2026

Commits on Aug 26, 2026

Commits on Aug 27, 2026

Commits on Aug 28, 2026

Commits on Sep 9, 2026

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Commits on Oct 6, 2026

Commits on Oct 7, 2026

Commits on Oct 8, 2026