perf: compare to v0.6.7 #326

maksymar · 2025-05-28T05:35:08Z

DO NOT SUBMIT!

This PR is an empty commit compare current main branch to v0.6.7 results.

This reverts commit c49aa21.

maksymar · 2025-06-12T07:43:57Z

Compare v0.6.9 vs v0.6.7

btreemap

---------------------------------------------------

Summary:
  instructions:
    status:   Regressions and improvements 🔴🟢
    counts:   [total 285 | regressed 50 | improved 134 | new 0 | unchanged 101]
    change:   [max +899.01M | p75 +4.24M | median -8.50M | p25 -99.48M | min -1.78B]
    change %: [max +26.15% | p75 +0.94% | median -1.49% | p25 -9.79% | min -88.41%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                                        | calls |     ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|---------------------------------------------|-------|---------|---------|----|--------|-----|---------|
|   +    | btreemap_v2_scan_keys_1k_0b                 |       |   1.19M | +26.15% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_rev_1k_0b             |       |   1.19M | +23.88% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_1024_128            |       |   7.38B | +13.87% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_512_128             |       |   4.09B | +13.32% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_mem_manager_remove_blob512_u64  |       |   4.35B | +12.87% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_256_128             |       |   2.44B | +10.74% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_1k_10kib              |       |   2.60M | +10.32% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_rev_1k_10kib          |       |   2.58M |  +9.59% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_128_128             |       |   1.61B |  +9.15% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_range_count_1k_10kib            |       |   2.65M |  +8.67% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_1024_128            |       |   5.50B |  +7.70% |  0 |  0.00% | 196 |   0.00% |
|   +    | btreemap_v2_insert_blob_512_128             |       |   3.05B |  +6.63% |  0 |  0.00% | 111 |   0.00% |
|   +    | btreemap_v2_insert_blob_256_128             |       |   1.80B |  +6.50% |  0 |  0.00% |  67 |   0.00% |
|   +    | btreemap_v2_mem_manager_insert_blob512_u64  |       |   3.15B |  +6.23% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_64                |       | 981.77M |  +5.58% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_16                |       | 885.75M |  +5.38% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_128_128             |       |   1.19B |  +4.62% |  0 |  0.00% |  46 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_4                |       | 712.64M |  +3.93% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_64               |       | 543.10M |  +3.87% |  0 |  0.00% |  18 |   0.00% |
|   +    | btreemap_v2_get_vec_16_128                  |       | 456.73M |  +3.83% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_64               |       | 754.17M |  +3.81% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_8                |       | 712.28M |  +3.80% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_32               |       | 536.93M |  +3.77% |  0 |  0.00% |  13 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_32                |       | 879.00M |  +3.77% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_128              |       | 551.94M |  +3.66% |  0 |  0.00% |  28 |   0.00% |
|  ...   | ... 134 rows omitted ...                    |       |         |         |    |        |     |         |
|   -    | btreemap_v2_insert_vec_1024_128             |       |   2.73B | -17.75% |  0 |  0.00% | 193 |   0.00% |
|   -    | btreemap_v2_get_vec_128_128                 |       | 583.90M | -17.80% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_last_vec_128_128            |       |   1.51B | -17.85% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_vec_32_256             |       | 441.72M | -18.09% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_vec_128_128            |       | 574.28M | -19.15% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_last_vec_256_128            |       |   2.06B | -20.30% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_first_vec_256_128           |       |   2.00B | -21.02% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_first_blob_64_128           |       |   1.05B | -21.19% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_last_blob_64_128            |       |   1.02B | -22.30% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_last_vec_512_128            |       |   2.79B | -25.20% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_first_vec_512_128           |       |   2.69B | -25.40% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_vec_256_128                 |       | 912.19M | -26.01% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_vec_256_128            |       | 902.32M | -26.81% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_blob_64_128                 |       | 436.96M | -27.38% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_vec512_u64      |       |   1.27B | -29.03% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_last_vec_1024_128           |       |   4.24B | -29.62% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_first_vec_1024_128          |       |   4.02B | -30.38% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_vec_512_128                 |       |   1.26B | -30.83% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_blob_64_128            |       | 414.36M | -31.14% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_vec512_u64 |       |   1.23B | -31.31% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_vec_512_128            |       |   1.25B | -31.38% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_vec_1024_128                |       |   1.84B | -36.97% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_vec_1024_128           |       |   1.82B | -37.54% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_10mib_values                |       | 388.59M | -68.34% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_10mib_values           |       | 142.21M | -88.41% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------

compare

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 18 | regressed 0 | improved 3 | new 0 | unchanged 15]
    change:   [max +11 | p75 0 | median -2 | p25 -245.41K | min -2.89B]
    change %: [max 0.00% | p75 0.00% | median -0.00% | p25 -0.00% | min -25.60%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                    | calls |     ins |  ins Δ% |    HI |  HI Δ% |   SMI |  SMI Δ% |
|--------|-------------------------|-------|---------|---------|-------|--------|-------|---------|
|   -    | read_chunks_btreemap_1m |       | 134.60B |  -2.10% | 1.89K |  0.00% | 3.20K |   0.00% |
|   -    | read_chunks_btreemap_1k |       |   5.42B |  -7.21% | 1.60K |  0.00% | 1.67K |   0.00% |
|   -    | read_chunks_btreemap_1  |       |   1.22B | -25.60% | 3.23K |  0.00% | 1.67K |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------

memory_manager

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

vec

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 16 | regressed 0 | improved 1 | new 0 | unchanged 15]
    change:   [max +102.33K | p75 +20.00K | median 0 | p25 0 | min -480.00K]
    change %: [max +1.82% | p75 +0.31% | median 0.00% | p25 0.00% | min -9.11%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name        | calls |   ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|-------------|-------|-------|---------|----|--------|-----|---------|
|   -    | vec_get_u64 |       | 4.79M |  -9.11% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------

…to maksym/base

github-actions · 2025-07-10T12:19:06Z

`canbench` 🏋 (dir: ./benchmarks/vec) `258c0f1` 2025-07-18 05:30:22 UTC

✅ ./benchmarks/vec/canbench_results.yml is up to date
📦 canbench_results_vec.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 16 | regressed 0 | improved 4 | new 0 | unchanged 12]
    change:   [max +102.33K | p75 +20.00K | median +20.00K | p25 -120.00K | min -8.84M]
    change %: [max +1.82% | p75 +0.62% | median +0.51% | p25 -2.09% | min -50.45%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                        | calls |    ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|-----------------------------|-------|--------|---------|----|--------|-----|---------|
|   -    | vec_insert_u64              |       |  5.38M |  -8.35% |  0 |  0.00% |   1 |   0.00% |
|   -    | vec_get_u64                 |       |  4.79M |  -9.11% |  0 |  0.00% |   0 |   0.00% |
|   -    | vec_get_blob_64_mem_manager |       | 13.65M | -39.29% |  0 |  0.00% |   0 |   0.00% |
|   -    | vec_get_blob_4_mem_manager  |       |  7.19M | -50.45% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-07-10T12:19:06Z

`canbench` 🏋 (dir: ./benchmarks/memory_manager) `258c0f1` 2025-07-18 05:30:18 UTC

✅ ./benchmarks/memory_manager/canbench_results.yml is up to date
📦 canbench_results_memory-manager.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 -76.96K | median -153.92K | p25 -1.66M | min -3.17M]
    change %: [max 0.00% | p75 -0.01% | median -0.01% | p25 -0.46% | min -0.90%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-07-10T12:19:07Z

`canbench` 🏋 (dir: ./benchmarks/io_chunks) `258c0f1` 2025-07-18 05:30:59 UTC

✅ ./benchmarks/io_chunks/canbench_results.yml is up to date
📦 canbench_results_io_chunks.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 18 | regressed 0 | improved 12 | new 0 | unchanged 6]
    change:   [max -986 | p75 -361.15K | median -288.62M | p25 -856.87M | min -85.19B]
    change %: [max -0.00% | p75 -0.19% | median -49.33% | p25 -61.06% | min -83.80%]

  heap_increase:
    status:   Regressions and improvements 🔴🟢
    counts:   [total 18 | regressed 1 | improved 2 | new 0 | unchanged 15]
    change:   [max +1.60K | p75 0 | median 0 | p25 0 | min -1.62K]
    change %: [max +inf% | p75 0.00% | median 0.00% | p25 0.00% | min -99.20%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                     | calls |     ins |  ins Δ% |    HI |   HI Δ% |   SMI |  SMI Δ% |
|--------|--------------------------|-------|---------|---------|-------|---------|-------|---------|
|   -    | write_chunks_vec_1m      |       |   1.90B | -28.20% |     0 |   0.00% | 1.54K |   0.00% |
|   -    | read_chunks_vec_1m       |       |   1.01B | -46.71% |     0 |   0.00% |     0 |   0.00% |
|   -    | write_chunks_stable_1m   |       | 255.41M | -48.45% |     0 |   0.00% | 1.66K |   0.00% |
|   -    | read_chunks_stable_1m    |       | 230.00M | -50.22% |     0 |   0.00% |     0 |   0.00% |
|   -    | write_chunks_btreemap_1m |       |  83.66B | -50.45% |     0 |   0.00% | 3.07K |   0.00% |
|   -    | read_chunks_btreemap_1m  |       |  40.94B | -53.20% |     0 |   0.00% |     0 |   0.00% |
|   -    | write_chunks_btreemap_1k |       |   4.19B | -56.14% |     2 | -50.00% | 1.54K |   0.00% |
|   -    | write_chunks_btreemap_1  |       | 357.21M | -62.70% |    13 | -99.20% | 1.54K |   0.00% |
|   -    | read_chunks_btreemap_1k  |       | 498.23M | -70.99% |     0 |   0.00% |     0 |   0.00% |
|   -    | read_chunks_vec_1k       |       | 105.83M | -73.19% |     0 |   0.00% |     0 |   0.00% |
|   -    | read_chunks_vec_1        |       | 104.86M | -73.33% |     0 |   0.00% |     0 |   0.00% |
|  +/-   | read_chunks_btreemap_1   |       | 148.72M | -83.80% | 1.60K |   +inf% |     0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-07-10T12:19:07Z

`canbench` 🏋 (dir: ./benchmarks/btreemap) `258c0f1` 2025-07-18 05:32:01 UTC

✅ ./benchmarks/btreemap/canbench_results.yml is up to date
📦 canbench_results_btreemap.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Regressions and improvements 🔴🟢
    counts:   [total 303 | regressed 24 | improved 203 | new 0 | unchanged 76]
    change:   [max +883.02M | p75 -2.11M | median -26.90M | p25 -132.45M | min -1.77B]
    change %: [max +13.63% | p75 -0.69% | median -5.16% | p25 -13.61% | min -98.33%]

  heap_increase:
    status:   Improvements detected 🟢
    counts:   [total 303 | regressed 0 | improved 1 | new 0 | unchanged 302]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min -161]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min -50.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 303 | regressed 0 | improved 0 | new 0 | unchanged 303]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                                         | calls |     ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|----------------------------------------------|-------|---------|---------|----|--------|-----|---------|
|   +    | btreemap_v2_remove_blob_1024_128             |       |   7.36B | +13.63% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_512_128              |       |   4.07B | +12.87% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_256_128              |       |   2.42B |  +9.99% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_128_128              |       |   1.59B |  +7.88% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_1024_128             |       |   5.50B |  +7.61% |  0 |  0.00% | 196 |   0.00% |
|   +    | btreemap_v2_insert_blob_512_128              |       |   3.04B |  +6.39% |  0 |  0.00% | 111 |   0.00% |
|   +    | btreemap_v2_insert_blob_256_128              |       |   1.79B |  +6.03% |  0 |  0.00% |  67 |   0.00% |
|   +    | btreemap_v2_scan_keys_1k_10kib               |       |   2.50M |  +4.37% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_64                 |       | 968.31M |  +4.12% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_rev_1k_10kib           |       |   2.48M |  +3.85% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_128_128              |       |   1.18B |  +3.84% |  0 |  0.00% |  46 |   0.00% |
|   +    | btreemap_v2_scan_keys_1k_0b                  |       | 982.66K |  +3.82% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_16                 |       | 871.33M |  +3.65% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_0                 |       | 490.46M |  +3.61% |  0 |  0.00% |   8 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_0                 |       | 654.25M |  +3.01% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_0                  |       | 834.33M |  +2.53% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_32                 |       | 867.57M |  +2.41% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_64                |       | 534.92M |  +2.28% |  0 |  0.00% |  18 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_32                |       | 528.95M |  +2.21% |  0 |  0.00% |  13 |   0.00% |
|   +    | btreemap_v2_insert_principal                 |       | 503.31M |  +2.20% |  0 |  0.00% |   8 |   0.00% |
|   +    | btreemap_v2_get_vec_16_128                   |       | 449.74M |  +2.16% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_rev_1k_0b              |       | 984.22K |  +2.13% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_8                 |       | 517.59M |  +2.05% |  0 |  0.00% |   9 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_8                  |       | 856.48M |  +2.04% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_first_blob_32_512            |       | 957.57M |  -2.13% |  0 |  0.00% |   0 |   0.00% |
|  ...   | ... 177 rows omitted ...                     |       |         |         |    |        |     |         |
|   -    | btreemap_v2_mem_manager_insert_vec512_u64    |       |   1.96B | -41.01% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_remove_u64_vec512    |       |   1.22B | -45.51% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_insert_u64_vec512    |       | 834.10M | -46.42% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_remove_u64_blob512   |       | 882.97M | -47.67% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_insert_u64_blob512   |       | 607.29M | -47.87% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_insert_u64_u64       |       | 520.55M | -48.55% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_remove_u64_u64       |       | 736.79M | -48.55% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_u64_vec512       |       | 388.83M | -51.10% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_u64_vec512  |       | 367.04M | -53.84% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_vec512_u64       |       |   1.24B | -54.30% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_u64_blob512      |       | 295.41M | -55.16% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_u64_u64          |       | 291.72M | -55.30% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_vec512_u64  |       |   1.20B | -55.81% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_u64_u64     |       | 283.52M | -56.55% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_u64_blob512 |       | 278.86M | -57.67% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_value_sum_1k_10kib         |       |  20.67M | -63.93% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_value_sum_20_10mib         |       | 398.31M | -64.00% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_10mib_values                 |       | 388.59M | -68.46% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_10mib_values            |       | 142.21M | -88.46% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_key_sum_1k_10kib           |       |   2.57M | -95.51% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_1k_10kib               |       |   2.49M | -95.64% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_rev_1k_10kib           |       |   2.48M | -95.66% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_20_10mib               |       |  18.47M | -98.33% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_rev_20_10mib           |       |  18.47M | -98.33% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_key_sum_20_10mib           |       |  18.47M | -98.33% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-07-14T11:16:41Z

`canbench` 🏋 (dir: ./benchmarks/nns) `258c0f1` 2025-07-18 05:30:28 UTC

✅ ./benchmarks/nns/canbench_results.yml is up to date
📦 canbench_results_nns.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 16 | regressed 0 | improved 8 | new 0 | unchanged 8]
    change:   [max -38 | p75 -38 | median -33.92K | p25 -355.99M | min -7.96B]
    change %: [max -0.00% | p75 -0.00% | median -21.85% | p25 -50.19% | min -52.56%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                                  | calls |     ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|---------------------------------------|-------|---------|---------|----|--------|-----|---------|
|   -    | vote_cascading_stable_chain_1k_15     |       | 867.33M | -43.03% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_chain_10k_15    |       |   9.82B | -44.77% |  5 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_chain_10k_5     |       |   3.01B | -49.16% |  5 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_centralized_1k  |       | 100.00M | -50.15% |  1 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_chain_1k_5      |       | 253.04M | -50.32% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_single_vote_1k  |       |  66.84K | -50.36% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_single_vote_10k |       |  91.47K | -51.68% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_centralized_10k |       |   1.38B | -52.56% | 10 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

maksymar · 2025-07-18T08:18:03Z

Compare v0.7.0 vs v0.6.7

btreemap

---------------------------------------------------

Summary:
  instructions:
    status:   Regressions and improvements 🔴🟢
    counts:   [total 303 | regressed 24 | improved 203 | new 0 | unchanged 76]
    change:   [max +883.02M | p75 -2.11M | median -26.90M | p25 -132.45M | min -1.77B]
    change %: [max +13.63% | p75 -0.69% | median -5.16% | p25 -13.61% | min -98.33%]

  heap_increase:
    status:   Improvements detected 🟢
    counts:   [total 303 | regressed 0 | improved 1 | new 0 | unchanged 302]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min -161]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min -50.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 303 | regressed 0 | improved 0 | new 0 | unchanged 303]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                                         | calls |     ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|----------------------------------------------|-------|---------|---------|----|--------|-----|---------|
|   +    | btreemap_v2_remove_blob_1024_128             |       |   7.36B | +13.63% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_512_128              |       |   4.07B | +12.87% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_256_128              |       |   2.42B |  +9.99% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_blob_128_128              |       |   1.59B |  +7.88% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_1024_128             |       |   5.50B |  +7.61% |  0 |  0.00% | 196 |   0.00% |
|   +    | btreemap_v2_insert_blob_512_128              |       |   3.04B |  +6.39% |  0 |  0.00% | 111 |   0.00% |
|   +    | btreemap_v2_insert_blob_256_128              |       |   1.79B |  +6.03% |  0 |  0.00% |  67 |   0.00% |
|   +    | btreemap_v2_scan_keys_1k_10kib               |       |   2.50M |  +4.37% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_64                 |       | 968.31M |  +4.12% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_rev_1k_10kib           |       |   2.48M |  +3.85% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_128_128              |       |   1.18B |  +3.84% |  0 |  0.00% |  46 |   0.00% |
|   +    | btreemap_v2_scan_keys_1k_0b                  |       | 982.66K |  +3.82% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_16                 |       | 871.33M |  +3.65% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_0                 |       | 490.46M |  +3.61% |  0 |  0.00% |   8 |   0.00% |
|   +    | btreemap_v2_remove_blob_32_0                 |       | 654.25M |  +3.01% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_0                  |       | 834.33M |  +2.53% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_32                 |       | 867.57M |  +2.41% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_64                |       | 534.92M |  +2.28% |  0 |  0.00% |  18 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_32                |       | 528.95M |  +2.21% |  0 |  0.00% |  13 |   0.00% |
|   +    | btreemap_v2_insert_principal                 |       | 503.31M |  +2.20% |  0 |  0.00% |   8 |   0.00% |
|   +    | btreemap_v2_get_vec_16_128                   |       | 449.74M |  +2.16% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_scan_keys_rev_1k_0b              |       | 984.22K |  +2.13% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreemap_v2_insert_blob_32_8                 |       | 517.59M |  +2.05% |  0 |  0.00% |   9 |   0.00% |
|   +    | btreemap_v2_remove_vec_32_8                  |       | 856.48M |  +2.04% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_pop_first_blob_32_512            |       | 957.57M |  -2.13% |  0 |  0.00% |   0 |   0.00% |
|  ...   | ... 177 rows omitted ...                     |       |         |         |    |        |     |         |
|   -    | btreemap_v2_mem_manager_insert_vec512_u64    |       |   1.96B | -41.01% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_remove_u64_vec512    |       |   1.22B | -45.51% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_insert_u64_vec512    |       | 834.10M | -46.42% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_remove_u64_blob512   |       | 882.97M | -47.67% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_insert_u64_blob512   |       | 607.29M | -47.87% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_insert_u64_u64       |       | 520.55M | -48.55% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_remove_u64_u64       |       | 736.79M | -48.55% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_u64_vec512       |       | 388.83M | -51.10% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_u64_vec512  |       | 367.04M | -53.84% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_vec512_u64       |       |   1.24B | -54.30% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_u64_blob512      |       | 295.41M | -55.16% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_get_u64_u64          |       | 291.72M | -55.30% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_vec512_u64  |       |   1.20B | -55.81% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_u64_u64     |       | 283.52M | -56.55% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_mem_manager_contains_u64_blob512 |       | 278.86M | -57.67% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_value_sum_1k_10kib         |       |  20.67M | -63.93% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_value_sum_20_10mib         |       | 398.31M | -64.00% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_get_10mib_values                 |       | 388.59M | -68.46% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_contains_10mib_values            |       | 142.21M | -88.46% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_key_sum_1k_10kib           |       |   2.57M | -95.51% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_1k_10kib               |       |   2.49M | -95.64% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_rev_1k_10kib           |       |   2.48M | -95.66% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_20_10mib               |       |  18.47M | -98.33% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_scan_iter_rev_20_10mib           |       |  18.47M | -98.33% |  0 |  0.00% |   0 |   0.00% |
|   -    | btreemap_v2_range_key_sum_20_10mib           |       |  18.47M | -98.33% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

io_chunks

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 18 | regressed 0 | improved 12 | new 0 | unchanged 6]
    change:   [max -986 | p75 -361.15K | median -288.62M | p25 -856.87M | min -85.19B]
    change %: [max -0.00% | p75 -0.19% | median -49.33% | p25 -61.06% | min -83.80%]

  heap_increase:
    status:   Regressions and improvements 🔴🟢
    counts:   [total 18 | regressed 1 | improved 2 | new 0 | unchanged 15]
    change:   [max +1.60K | p75 0 | median 0 | p25 0 | min -1.62K]
    change %: [max +inf% | p75 0.00% | median 0.00% | p25 0.00% | min -99.20%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                     | calls |     ins |  ins Δ% |    HI |   HI Δ% |   SMI |  SMI Δ% |
|--------|--------------------------|-------|---------|---------|-------|---------|-------|---------|
|   -    | write_chunks_vec_1m      |       |   1.90B | -28.20% |     0 |   0.00% | 1.54K |   0.00% |
|   -    | read_chunks_vec_1m       |       |   1.01B | -46.71% |     0 |   0.00% |     0 |   0.00% |
|   -    | write_chunks_stable_1m   |       | 255.41M | -48.45% |     0 |   0.00% | 1.66K |   0.00% |
|   -    | read_chunks_stable_1m    |       | 230.00M | -50.22% |     0 |   0.00% |     0 |   0.00% |
|   -    | write_chunks_btreemap_1m |       |  83.66B | -50.45% |     0 |   0.00% | 3.07K |   0.00% |
|   -    | read_chunks_btreemap_1m  |       |  40.94B | -53.20% |     0 |   0.00% |     0 |   0.00% |
|   -    | write_chunks_btreemap_1k |       |   4.19B | -56.14% |     2 | -50.00% | 1.54K |   0.00% |
|   -    | write_chunks_btreemap_1  |       | 357.21M | -62.70% |    13 | -99.20% | 1.54K |   0.00% |
|   -    | read_chunks_btreemap_1k  |       | 498.23M | -70.99% |     0 |   0.00% |     0 |   0.00% |
|   -    | read_chunks_vec_1k       |       | 105.83M | -73.19% |     0 |   0.00% |     0 |   0.00% |
|   -    | read_chunks_vec_1        |       | 104.86M | -73.33% |     0 |   0.00% |     0 |   0.00% |
|  +/-   | read_chunks_btreemap_1   |       | 148.72M | -83.80% | 1.60K |   +inf% |     0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

nns

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 16 | regressed 0 | improved 8 | new 0 | unchanged 8]
    change:   [max -38 | p75 -38 | median -33.92K | p25 -355.99M | min -7.96B]
    change %: [max -0.00% | p75 -0.00% | median -21.85% | p25 -50.19% | min -52.56%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                                  | calls |     ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|---------------------------------------|-------|---------|---------|----|--------|-----|---------|
|   -    | vote_cascading_stable_chain_1k_15     |       | 867.33M | -43.03% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_chain_10k_15    |       |   9.82B | -44.77% |  5 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_chain_10k_5     |       |   3.01B | -49.16% |  5 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_centralized_1k  |       | 100.00M | -50.15% |  1 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_chain_1k_5      |       | 253.04M | -50.32% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_single_vote_1k  |       |  66.84K | -50.36% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_single_vote_10k |       |  91.47K | -51.68% |  0 |  0.00% |   0 |   0.00% |
|   -    | vote_cascading_stable_centralized_10k |       |   1.38B | -52.56% | 10 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

memory-manager

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 -76.96K | median -153.92K | p25 -1.66M | min -3.17M]
    change %: [max 0.00% | p75 -0.01% | median -0.01% | p25 -0.46% | min -0.90%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

vec

---------------------------------------------------

Summary:
  instructions:
    status:   Improvements detected 🟢
    counts:   [total 16 | regressed 0 | improved 4 | new 0 | unchanged 12]
    change:   [max +102.33K | p75 +20.00K | median +20.00K | p25 -120.00K | min -8.84M]
    change %: [max +1.82% | p75 +0.62% | median +0.51% | p25 -2.09% | min -50.45%]

  heap_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                        | calls |    ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|-----------------------------|-------|--------|---------|----|--------|-----|---------|
|   -    | vec_insert_u64              |       |  5.38M |  -8.35% |  0 |  0.00% |   1 |   0.00% |
|   -    | vec_get_u64                 |       |  4.79M |  -9.11% |  0 |  0.00% |   0 |   0.00% |
|   -    | vec_get_blob_64_mem_manager |       | 13.65M | -39.29% |  0 |  0.00% |   0 |   0.00% |
|   -    | vec_get_blob_4_mem_manager  |       |  7.19M | -50.45% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

canbench_results_btreemap_csv.zip
canbench_results_io_chunks_csv.zip
canbench_results_memory-manager_csv.zip
canbench_results_nns_csv.zip
canbench_results_vec_csv.zip

empty commit

578aa22

maksymar changed the title ~~chore: empty commit~~ chore: benchmark baseline May 28, 2025

maksymar added 10 commits May 28, 2025 08:08

Merge branch 'main' into maksym/base

218ee69

--persist

c49aa21

Revert "--persist"

bddb9bd

This reverts commit c49aa21.

merge main

a6d1467

merge main

525a3bf

revert

69f88db

Merge branch 'main' into maksym/base

2bbbddf

stable-structures 0.6.7

bb83b42

Merge branch 'main' into maksym/base

3ac6965

--persist v0.6.7

55a5a0f

maksymar changed the title ~~chore: benchmark baseline~~ chore: compare to v0.6.7 Jun 6, 2025

maksymar added 7 commits June 6, 2025 10:15

compare head to v0.6.7

ca27233

merge main

44faeaf

v0.6.7

3136714

head vs v0.6.7

331cc0c

Merge branch 'main' into maksym/base

c242fcd

v0.6.7

51d388b

v0.6.7 vs HEAD

e7839ec

maksymar added 9 commits June 12, 2025 13:31

Merge branch 'main' into maksym/base

6ec7003

v0.6.7

e7a2ce5

compare v0.6.7 vs v0.6.9

4118f8a

Merge branch 'main' into maksym/base

c85fff3

Merge branch 'maksym/base' of github.com:dfinity/stable-structures in…

7aa2afe

…to maksym/base

rm csv, logs

0151c6e

0.6.7

f9e7213

merge main

f42b116

--persist

bef3ac0

maksymar added 2 commits July 7, 2025 18:39

merge main

e076302

=0.6.7

e5b6fde

maksymar changed the title ~~chore: compare to v0.6.7~~ perf: compare to v0.6.7 Jul 8, 2025

maksymar added 8 commits July 8, 2025 15:37

merge main

751e69d

revert

03205e7

--persist

2ab0db5

.

b75755b

.

e873cd9

.

709e873

compare to v0.6.7

8002502

merge main

4cf3dfd

dfinity deleted a comment from github-actions bot Jul 10, 2025

Merge branch 'main' into maksym/base

d2601f9

Merge branch 'main' into maksym/base

5c29859

maksymar mentioned this pull request Jul 18, 2025

chore: bump version to v0.7.0 #379

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

perf: compare to v0.6.7 #326

perf: compare to v0.6.7 #326

Uh oh!

maksymar commented May 28, 2025 •

edited

Loading

Uh oh!

maksymar commented Jun 12, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jul 10, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jul 10, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jul 10, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jul 10, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Jul 14, 2025 •

edited

Loading

Uh oh!

maksymar commented Jul 18, 2025

Uh oh!

Uh oh!

perf: compare to v0.6.7 #326

Are you sure you want to change the base?

perf: compare to v0.6.7 #326

Uh oh!

Conversation

maksymar commented May 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

maksymar commented Jun 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Compare v0.6.9 vs v0.6.7

btreemap

compare

memory_manager

vec

Uh oh!

github-actions bot commented Jul 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/vec) 258c0f1 2025-07-18 05:30:22 UTC

Uh oh!

github-actions bot commented Jul 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/memory_manager) 258c0f1 2025-07-18 05:30:18 UTC

Uh oh!

github-actions bot commented Jul 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/io_chunks) 258c0f1 2025-07-18 05:30:59 UTC

Uh oh!

github-actions bot commented Jul 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/btreemap) 258c0f1 2025-07-18 05:32:01 UTC

Uh oh!

github-actions bot commented Jul 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/nns) 258c0f1 2025-07-18 05:30:28 UTC

Uh oh!

maksymar commented Jul 18, 2025

Compare v0.7.0 vs v0.6.7

btreemap

io_chunks

nns

memory-manager

vec

Uh oh!

Uh oh!

maksymar commented May 28, 2025 •

edited

Loading

maksymar commented Jun 12, 2025 •

edited

Loading

github-actions bot commented Jul 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/vec) `258c0f1` 2025-07-18 05:30:22 UTC

github-actions bot commented Jul 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/memory_manager) `258c0f1` 2025-07-18 05:30:18 UTC

github-actions bot commented Jul 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/io_chunks) `258c0f1` 2025-07-18 05:30:59 UTC

github-actions bot commented Jul 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/btreemap) `258c0f1` 2025-07-18 05:32:01 UTC

github-actions bot commented Jul 14, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/nns) `258c0f1` 2025-07-18 05:30:28 UTC