Skip to content

WIP#20951

Draft
Dandandan wants to merge 4 commits intoapache:mainfrom
Dandandan:join_vectorize2
Draft

WIP#20951
Dandandan wants to merge 4 commits intoapache:mainfrom
Dandandan:join_vectorize2

Conversation

@Dandandan
Copy link
Contributor

Which issue does this PR close?

  • Closes #.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@Dandandan
Copy link
Contributor Author

run benchmarks

@github-actions github-actions bot added the physical-plan Changes to the physical-plan crate label Mar 15, 2026
@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062464607-276-n9qsd 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (5d7d477) to 9c3c01a (merge-base) diff using: clickbench_partitioned
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062464607-277-j7xz8 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (5d7d477) to 9c3c01a (merge-base) diff using: tpcds
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062464607-278-c6fcs 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (5d7d477) to 9c3c01a (merge-base) diff using: tpch
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query     ┃                           HEAD ┃                join_vectorize2 ┃       Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1  │ 46.46 / 47.08 ±0.75 / 48.51 ms │ 46.84 / 48.06 ±1.29 / 50.11 ms │    no change │
│ QQuery 2  │ 24.42 / 24.86 ±0.30 / 25.22 ms │ 26.03 / 26.63 ±0.53 / 27.36 ms │ 1.07x slower │
│ QQuery 3  │ 33.52 / 33.66 ±0.14 / 33.85 ms │ 34.11 / 34.82 ±0.55 / 35.78 ms │    no change │
│ QQuery 4  │ 22.28 / 22.45 ±0.27 / 22.99 ms │ 22.24 / 22.53 ±0.36 / 23.22 ms │    no change │
│ QQuery 5  │ 51.10 / 54.00 ±1.54 / 55.71 ms │ 51.60 / 54.14 ±1.84 / 56.56 ms │    no change │
│ QQuery 6  │ 17.83 / 17.95 ±0.11 / 18.12 ms │ 17.94 / 18.14 ±0.17 / 18.41 ms │    no change │
│ QQuery 7  │ 57.47 / 60.54 ±2.09 / 62.36 ms │ 58.64 / 59.87 ±1.15 / 62.02 ms │    no change │
│ QQuery 8  │ 51.42 / 51.74 ±0.26 / 52.22 ms │ 52.42 / 52.93 ±0.55 / 53.78 ms │    no change │
│ QQuery 9  │ 57.06 / 57.63 ±0.61 / 58.73 ms │ 57.82 / 58.54 ±0.84 / 59.81 ms │    no change │
│ QQuery 10 │ 72.31 / 74.09 ±1.30 / 75.85 ms │ 74.01 / 75.31 ±0.98 / 76.99 ms │    no change │
│ QQuery 11 │ 16.83 / 17.24 ±0.47 / 18.14 ms │ 17.39 / 17.72 ±0.18 / 17.88 ms │    no change │
│ QQuery 12 │ 29.04 / 29.48 ±0.41 / 30.04 ms │ 29.39 / 30.05 ±0.50 / 30.92 ms │    no change │
│ QQuery 13 │ 40.50 / 41.51 ±0.92 / 42.78 ms │ 39.64 / 40.72 ±0.80 / 41.56 ms │    no change │
│ QQuery 14 │ 29.27 / 29.87 ±0.63 / 30.94 ms │ 29.84 / 30.21 ±0.50 / 31.19 ms │    no change │
│ QQuery 15 │ 36.05 / 36.47 ±0.31 / 36.92 ms │ 37.64 / 38.02 ±0.39 / 38.74 ms │    no change │
│ QQuery 16 │ 18.56 / 18.82 ±0.23 / 19.25 ms │ 18.35 / 18.61 ±0.14 / 18.76 ms │    no change │
│ QQuery 17 │ 75.57 / 76.68 ±0.98 / 78.21 ms │ 76.32 / 76.98 ±0.56 / 77.79 ms │    no change │
│ QQuery 18 │ 81.49 / 82.97 ±0.97 / 84.01 ms │ 81.48 / 83.35 ±1.51 / 85.37 ms │    no change │
│ QQuery 19 │ 38.50 / 39.11 ±0.58 / 40.15 ms │ 39.13 / 40.10 ±0.81 / 41.50 ms │    no change │
│ QQuery 20 │ 42.53 / 43.48 ±0.59 / 44.11 ms │ 45.00 / 45.49 ±0.44 / 46.32 ms │    no change │
│ QQuery 21 │ 69.47 / 70.79 ±1.13 / 72.81 ms │ 71.37 / 73.78 ±2.01 / 76.86 ms │    no change │
│ QQuery 22 │ 20.11 / 20.51 ±0.41 / 21.29 ms │ 20.39 / 21.05 ±0.38 / 21.39 ms │    no change │
└───────────┴────────────────────────────────┴────────────────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┓
┃ Benchmark Summary              ┃          ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━┩
│ Total Time (HEAD)              │ 950.97ms │
│ Total Time (join_vectorize2)   │ 967.04ms │
│ Average Time (HEAD)            │  43.23ms │
│ Average Time (join_vectorize2) │  43.96ms │
│ Queries Faster                 │        0 │
│ Queries Slower                 │        1 │
│ Queries with No Change         │       21 │
│ Queries with Failure           │        0 │
└────────────────────────────────┴──────────┘

Resource Usage

tpch — base (merge-base)

Metric Value
Wall time 5.0s
Peak memory 4.0 GiB
Avg memory 3.4 GiB
CPU user 34.0s
CPU sys 3.1s
Disk read 0 B
Disk write 148.0 KiB

tpch — branch

Metric Value
Wall time 5.1s
Peak memory 4.0 GiB
Avg memory 3.5 GiB
CPU user 34.2s
CPU sys 3.3s
Disk read 0 B
Disk write 68.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                     HEAD ┃                          join_vectorize2 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │           49.77 / 50.87 ±0.86 / 52.12 ms │           48.86 / 50.16 ±0.73 / 50.87 ms │     no change │
│ QQuery 2  │        157.35 / 158.02 ±0.85 / 159.65 ms │        155.30 / 156.65 ±0.99 / 157.88 ms │     no change │
│ QQuery 3  │        119.80 / 120.86 ±0.76 / 122.07 ms │        120.98 / 121.57 ±0.55 / 122.56 ms │     no change │
│ QQuery 4  │    1433.11 / 1452.02 ±14.12 / 1472.28 ms │    1422.64 / 1454.60 ±20.25 / 1484.77 ms │     no change │
│ QQuery 5  │        186.26 / 188.85 ±1.84 / 191.83 ms │        187.90 / 189.05 ±1.56 / 192.10 ms │     no change │
│ QQuery 6  │    1071.89 / 1096.22 ±23.85 / 1140.47 ms │    1053.12 / 1081.12 ±20.45 / 1109.47 ms │     no change │
│ QQuery 7  │        364.73 / 366.39 ±1.75 / 369.56 ms │        360.56 / 366.08 ±4.33 / 372.26 ms │     no change │
│ QQuery 8  │        123.63 / 126.10 ±1.38 / 127.80 ms │        123.64 / 126.21 ±1.79 / 129.05 ms │     no change │
│ QQuery 9  │       113.99 / 121.72 ±10.61 / 142.44 ms │        112.82 / 117.54 ±2.71 / 121.06 ms │     no change │
│ QQuery 10 │        116.05 / 118.23 ±1.61 / 120.81 ms │        115.49 / 116.50 ±0.94 / 117.67 ms │     no change │
│ QQuery 11 │     1027.35 / 1034.81 ±6.43 / 1046.49 ms │     984.13 / 1015.74 ±17.78 / 1033.84 ms │     no change │
│ QQuery 12 │           48.58 / 50.26 ±1.31 / 51.47 ms │           48.58 / 50.60 ±1.47 / 52.81 ms │     no change │
│ QQuery 13 │        413.97 / 420.02 ±5.42 / 429.61 ms │        416.51 / 417.44 ±1.06 / 419.28 ms │     no change │
│ QQuery 14 │     1116.13 / 1119.22 ±3.06 / 1125.11 ms │     1098.35 / 1104.14 ±4.50 / 1110.70 ms │     no change │
│ QQuery 15 │           18.65 / 19.67 ±0.88 / 20.94 ms │           17.84 / 19.16 ±2.31 / 23.76 ms │     no change │
│ QQuery 16 │           46.56 / 47.25 ±0.52 / 48.06 ms │           46.82 / 47.28 ±0.77 / 48.81 ms │     no change │
│ QQuery 17 │        255.18 / 257.66 ±1.45 / 259.08 ms │        253.14 / 254.83 ±1.12 / 256.02 ms │     no change │
│ QQuery 18 │        135.04 / 137.20 ±2.01 / 140.89 ms │        133.30 / 135.17 ±1.19 / 136.91 ms │     no change │
│ QQuery 19 │        166.38 / 168.53 ±1.24 / 169.94 ms │        164.67 / 166.22 ±1.62 / 169.19 ms │     no change │
│ QQuery 20 │           15.95 / 16.75 ±0.54 / 17.41 ms │           16.28 / 17.10 ±0.55 / 17.78 ms │     no change │
│ QQuery 21 │           24.67 / 24.82 ±0.19 / 25.20 ms │           23.95 / 24.73 ±0.51 / 25.46 ms │     no change │
│ QQuery 22 │       531.08 / 538.26 ±11.83 / 561.84 ms │        523.54 / 531.81 ±5.14 / 537.94 ms │     no change │
│ QQuery 23 │       982.97 / 994.13 ±6.95 / 1000.46 ms │       980.86 / 991.69 ±8.18 / 1000.05 ms │     no change │
│ QQuery 24 │        445.34 / 447.77 ±1.80 / 449.93 ms │        446.30 / 448.94 ±2.45 / 452.05 ms │     no change │
│ QQuery 25 │        371.61 / 374.60 ±2.13 / 377.46 ms │        369.73 / 373.97 ±2.50 / 376.93 ms │     no change │
│ QQuery 26 │           88.88 / 90.40 ±1.87 / 93.93 ms │           86.52 / 87.79 ±1.04 / 89.35 ms │     no change │
│ QQuery 27 │        358.04 / 361.54 ±2.93 / 365.85 ms │        360.21 / 361.38 ±1.22 / 363.53 ms │     no change │
│ QQuery 28 │        155.11 / 155.99 ±0.68 / 156.75 ms │        155.60 / 156.52 ±0.66 / 157.31 ms │     no change │
│ QQuery 29 │        315.28 / 319.93 ±3.98 / 326.14 ms │        313.11 / 315.34 ±2.92 / 321.06 ms │     no change │
│ QQuery 30 │           50.68 / 52.13 ±1.13 / 54.14 ms │           47.73 / 49.19 ±1.26 / 50.79 ms │ +1.06x faster │
│ QQuery 31 │        186.76 / 189.68 ±2.58 / 194.07 ms │        184.66 / 187.74 ±2.04 / 190.24 ms │     no change │
│ QQuery 32 │           62.19 / 63.34 ±0.80 / 64.43 ms │           62.13 / 63.59 ±1.12 / 65.20 ms │     no change │
│ QQuery 33 │        152.69 / 155.00 ±1.46 / 156.54 ms │        153.32 / 155.44 ±1.36 / 157.22 ms │     no change │
│ QQuery 34 │        113.04 / 115.52 ±1.72 / 118.04 ms │        111.61 / 113.17 ±1.17 / 114.74 ms │     no change │
│ QQuery 35 │        118.93 / 121.38 ±1.75 / 124.41 ms │        117.70 / 119.39 ±1.41 / 121.53 ms │     no change │
│ QQuery 36 │        221.62 / 227.94 ±4.51 / 234.51 ms │        226.62 / 230.78 ±3.49 / 236.54 ms │     no change │
│ QQuery 37 │        187.40 / 190.36 ±2.45 / 194.19 ms │        189.14 / 191.04 ±2.16 / 194.67 ms │     no change │
│ QQuery 38 │          93.83 / 98.20 ±2.39 / 100.27 ms │          94.98 / 97.85 ±1.76 / 100.40 ms │     no change │
│ QQuery 39 │        142.92 / 145.66 ±1.40 / 146.73 ms │        143.98 / 145.78 ±2.26 / 150.15 ms │     no change │
│ QQuery 40 │        120.38 / 126.36 ±5.25 / 135.48 ms │        117.90 / 123.25 ±5.40 / 133.46 ms │     no change │
│ QQuery 41 │           18.51 / 19.75 ±1.60 / 22.89 ms │           18.04 / 19.14 ±1.15 / 21.16 ms │     no change │
│ QQuery 42 │        113.93 / 115.08 ±0.83 / 116.33 ms │        113.49 / 115.38 ±1.51 / 117.69 ms │     no change │
│ QQuery 43 │           89.51 / 91.09 ±1.13 / 92.81 ms │           89.77 / 90.33 ±0.42 / 90.70 ms │     no change │
│ QQuery 44 │           18.25 / 18.49 ±0.25 / 18.98 ms │           17.58 / 17.80 ±0.17 / 18.08 ms │     no change │
│ QQuery 45 │           57.02 / 58.79 ±1.08 / 60.37 ms │           59.23 / 60.50 ±1.08 / 62.16 ms │     no change │
│ QQuery 46 │        248.30 / 249.94 ±1.39 / 251.58 ms │        243.16 / 246.30 ±2.63 / 250.18 ms │     no change │
│ QQuery 47 │        795.36 / 804.10 ±5.05 / 809.22 ms │       794.54 / 816.65 ±22.32 / 856.08 ms │     no change │
│ QQuery 48 │        296.61 / 301.06 ±3.47 / 306.61 ms │        303.59 / 309.11 ±3.76 / 314.38 ms │     no change │
│ QQuery 49 │        267.98 / 269.57 ±1.30 / 271.00 ms │        267.69 / 268.49 ±0.74 / 269.86 ms │     no change │
│ QQuery 50 │        249.96 / 252.69 ±1.61 / 254.69 ms │        251.30 / 257.20 ±3.46 / 261.86 ms │     no change │
│ QQuery 51 │        196.68 / 198.91 ±1.84 / 201.55 ms │        198.58 / 200.36 ±2.04 / 204.35 ms │     no change │
│ QQuery 52 │        113.32 / 115.48 ±1.26 / 116.90 ms │        113.77 / 116.63 ±1.97 / 118.91 ms │     no change │
│ QQuery 53 │        109.69 / 110.28 ±0.55 / 111.12 ms │        111.13 / 112.61 ±1.21 / 114.48 ms │     no change │
│ QQuery 54 │        156.49 / 157.97 ±1.75 / 160.31 ms │        160.94 / 162.44 ±0.94 / 163.51 ms │     no change │
│ QQuery 55 │        112.08 / 112.94 ±0.65 / 114.04 ms │        113.24 / 114.32 ±0.97 / 116.09 ms │     no change │
│ QQuery 56 │        152.97 / 154.09 ±1.05 / 156.02 ms │        153.90 / 156.13 ±1.13 / 156.96 ms │     no change │
│ QQuery 57 │        195.71 / 198.74 ±3.83 / 206.21 ms │        194.51 / 197.90 ±2.09 / 200.56 ms │     no change │
│ QQuery 58 │        310.68 / 321.23 ±8.74 / 336.04 ms │        315.94 / 321.07 ±3.71 / 327.56 ms │     no change │
│ QQuery 59 │        217.63 / 219.43 ±1.14 / 220.47 ms │        217.04 / 219.37 ±1.88 / 222.17 ms │     no change │
│ QQuery 60 │        157.96 / 161.27 ±4.64 / 170.48 ms │        157.94 / 160.22 ±2.03 / 163.36 ms │     no change │
│ QQuery 61 │        182.86 / 184.81 ±1.14 / 186.24 ms │        184.28 / 189.18 ±2.78 / 192.09 ms │     no change │
│ QQuery 62 │      965.83 / 978.15 ±16.97 / 1010.47 ms │      916.34 / 982.30 ±56.08 / 1085.66 ms │     no change │
│ QQuery 63 │        112.09 / 115.21 ±2.45 / 119.58 ms │        110.83 / 113.12 ±1.57 / 114.93 ms │     no change │
│ QQuery 64 │        739.13 / 742.82 ±4.56 / 751.77 ms │        741.35 / 746.21 ±4.22 / 753.74 ms │     no change │
│ QQuery 65 │        274.40 / 280.41 ±3.21 / 283.74 ms │        275.79 / 279.72 ±2.54 / 282.26 ms │     no change │
│ QQuery 66 │       258.46 / 278.03 ±13.71 / 300.40 ms │        253.72 / 268.29 ±8.85 / 280.99 ms │     no change │
│ QQuery 67 │        349.61 / 359.24 ±5.86 / 366.09 ms │        356.98 / 366.14 ±4.91 / 371.58 ms │     no change │
│ QQuery 68 │        295.27 / 298.14 ±2.18 / 301.27 ms │        295.01 / 298.63 ±2.84 / 303.45 ms │     no change │
│ QQuery 69 │        114.91 / 116.65 ±1.99 / 120.45 ms │        115.05 / 118.30 ±2.08 / 121.21 ms │     no change │
│ QQuery 70 │       347.01 / 361.24 ±13.92 / 382.56 ms │       356.86 / 375.84 ±18.70 / 405.63 ms │     no change │
│ QQuery 71 │        142.41 / 143.67 ±0.93 / 145.26 ms │        141.61 / 145.48 ±3.33 / 150.30 ms │     no change │
│ QQuery 72 │        748.01 / 751.96 ±6.12 / 764.02 ms │       733.81 / 754.94 ±13.41 / 772.42 ms │     no change │
│ QQuery 73 │        109.61 / 111.24 ±1.38 / 113.23 ms │        109.88 / 111.48 ±0.94 / 112.70 ms │     no change │
│ QQuery 74 │        656.83 / 661.20 ±6.44 / 673.95 ms │        649.26 / 656.82 ±5.68 / 666.31 ms │     no change │
│ QQuery 75 │        297.42 / 299.72 ±2.39 / 304.15 ms │        294.44 / 297.93 ±2.64 / 301.85 ms │     no change │
│ QQuery 76 │        143.27 / 144.62 ±0.70 / 145.28 ms │        140.59 / 142.17 ±1.64 / 145.05 ms │     no change │
│ QQuery 77 │        207.35 / 209.51 ±1.38 / 211.25 ms │        206.56 / 208.42 ±1.47 / 210.46 ms │     no change │
│ QQuery 78 │        378.77 / 381.37 ±1.60 / 383.83 ms │        366.06 / 372.45 ±3.85 / 377.22 ms │     no change │
│ QQuery 79 │        259.76 / 262.84 ±2.50 / 267.04 ms │        253.81 / 256.10 ±1.95 / 259.74 ms │     no change │
│ QQuery 80 │        350.55 / 352.80 ±3.31 / 359.23 ms │        349.38 / 351.16 ±1.41 / 353.22 ms │     no change │
│ QQuery 81 │           32.92 / 34.28 ±1.10 / 35.38 ms │           30.94 / 33.30 ±1.71 / 35.67 ms │     no change │
│ QQuery 82 │        212.05 / 214.03 ±1.14 / 215.19 ms │        210.93 / 212.54 ±1.43 / 214.74 ms │     no change │
│ QQuery 83 │           48.61 / 49.61 ±0.74 / 50.67 ms │           48.16 / 49.16 ±0.99 / 50.36 ms │     no change │
│ QQuery 84 │           52.99 / 53.81 ±0.49 / 54.37 ms │           53.20 / 53.81 ±0.42 / 54.48 ms │     no change │
│ QQuery 85 │        158.14 / 160.00 ±1.07 / 161.21 ms │        154.55 / 156.37 ±1.53 / 158.96 ms │     no change │
│ QQuery 86 │           42.21 / 43.62 ±0.72 / 44.14 ms │           43.01 / 43.72 ±0.58 / 44.59 ms │     no change │
│ QQuery 87 │         96.91 / 101.12 ±3.22 / 105.64 ms │          96.17 / 98.22 ±2.74 / 103.44 ms │     no change │
│ QQuery 88 │        116.86 / 117.92 ±0.61 / 118.62 ms │        115.17 / 115.48 ±0.22 / 115.70 ms │     no change │
│ QQuery 89 │        127.85 / 129.50 ±1.08 / 130.76 ms │        126.58 / 128.08 ±1.11 / 129.99 ms │     no change │
│ QQuery 90 │           29.40 / 30.08 ±0.45 / 30.82 ms │           28.93 / 29.44 ±0.36 / 30.02 ms │     no change │
│ QQuery 91 │           67.35 / 69.54 ±1.60 / 71.47 ms │           66.31 / 68.36 ±1.14 / 69.48 ms │     no change │
│ QQuery 92 │           64.43 / 65.24 ±0.75 / 66.42 ms │           62.72 / 64.32 ±1.38 / 66.64 ms │     no change │
│ QQuery 93 │        202.76 / 207.11 ±2.38 / 209.56 ms │        198.58 / 202.46 ±2.12 / 205.06 ms │     no change │
│ QQuery 94 │           68.63 / 69.31 ±0.49 / 70.04 ms │           67.66 / 68.13 ±0.39 / 68.70 ms │     no change │
│ QQuery 95 │        144.73 / 147.94 ±2.14 / 150.94 ms │        144.99 / 147.95 ±2.02 / 151.16 ms │     no change │
│ QQuery 96 │           80.04 / 81.57 ±0.81 / 82.30 ms │           77.06 / 79.47 ±1.61 / 81.32 ms │     no change │
│ QQuery 97 │        140.47 / 142.96 ±2.03 / 146.51 ms │        137.28 / 139.43 ±1.59 / 141.87 ms │     no change │
│ QQuery 98 │        162.76 / 166.35 ±2.52 / 170.24 ms │        159.02 / 160.90 ±1.27 / 162.48 ms │     no change │
│ QQuery 99 │ 10851.01 / 10903.48 ±41.01 / 10965.15 ms │ 10907.62 / 10955.15 ±46.15 / 11032.75 ms │     no change │
└───────────┴──────────────────────────────────────────┴──────────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary              ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 35615.68ms │
│ Total Time (join_vectorize2)   │ 35579.51ms │
│ Average Time (HEAD)            │   359.75ms │
│ Average Time (join_vectorize2) │   359.39ms │
│ Queries Faster                 │          1 │
│ Queries Slower                 │          0 │
│ Queries with No Change         │         98 │
│ Queries with Failure           │          0 │
└────────────────────────────────┴────────────┘

Resource Usage

tpcds — base (merge-base)

Metric Value
Wall time 178.4s
Peak memory 5.7 GiB
Avg memory 4.6 GiB
CPU user 284.2s
CPU sys 21.6s
Disk read 0 B
Disk write 636.2 MiB

tpcds — branch

Metric Value
Wall time 178.2s
Peak memory 5.4 GiB
Avg memory 4.4 GiB
CPU user 283.0s
CPU sys 21.9s
Disk read 0 B
Disk write 792.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                  HEAD ┃                       join_vectorize2 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │          1.59 / 4.89 ±6.41 / 17.70 ms │          1.63 / 4.90 ±6.36 / 17.62 ms │     no change │
│ QQuery 1  │        14.93 / 15.41 ±0.28 / 15.71 ms │        14.81 / 15.29 ±0.28 / 15.63 ms │     no change │
│ QQuery 2  │        56.70 / 57.03 ±0.32 / 57.60 ms │        56.78 / 57.00 ±0.15 / 57.17 ms │     no change │
│ QQuery 3  │        49.53 / 50.63 ±0.89 / 52.14 ms │        48.70 / 50.67 ±1.53 / 53.22 ms │     no change │
│ QQuery 4  │     316.55 / 323.42 ±3.99 / 327.93 ms │     316.83 / 323.55 ±5.54 / 332.98 ms │     no change │
│ QQuery 5  │     364.46 / 368.79 ±2.73 / 372.90 ms │     365.52 / 367.76 ±2.07 / 371.52 ms │     no change │
│ QQuery 6  │           5.13 / 5.57 ±0.37 / 6.19 ms │           5.16 / 5.42 ±0.33 / 6.03 ms │     no change │
│ QQuery 7  │        17.44 / 18.03 ±0.39 / 18.53 ms │        17.69 / 21.29 ±2.20 / 24.17 ms │  1.18x slower │
│ QQuery 8  │     442.51 / 453.08 ±7.72 / 464.90 ms │     449.47 / 458.53 ±5.09 / 465.11 ms │     no change │
│ QQuery 9  │     709.95 / 722.46 ±9.78 / 735.29 ms │     708.33 / 722.27 ±8.77 / 735.22 ms │     no change │
│ QQuery 10 │       92.86 / 96.55 ±3.84 / 103.45 ms │       94.16 / 97.02 ±3.18 / 103.12 ms │     no change │
│ QQuery 11 │     107.52 / 109.40 ±1.55 / 111.97 ms │     106.77 / 108.69 ±1.41 / 111.05 ms │     no change │
│ QQuery 12 │     355.20 / 363.54 ±4.94 / 368.92 ms │     356.07 / 362.51 ±7.55 / 376.92 ms │     no change │
│ QQuery 13 │     474.88 / 484.78 ±9.20 / 497.10 ms │    461.77 / 486.65 ±30.75 / 547.27 ms │     no change │
│ QQuery 14 │     376.99 / 380.17 ±2.80 / 385.25 ms │     360.67 / 373.53 ±7.63 / 384.20 ms │     no change │
│ QQuery 15 │    379.00 / 409.38 ±23.92 / 452.35 ms │    373.18 / 412.80 ±26.82 / 443.02 ms │     no change │
│ QQuery 16 │    771.97 / 792.79 ±25.04 / 840.43 ms │    759.81 / 785.50 ±24.08 / 829.60 ms │     no change │
│ QQuery 17 │    766.12 / 797.84 ±32.04 / 850.99 ms │    769.51 / 814.15 ±30.10 / 851.36 ms │     no change │
│ QQuery 18 │ 1443.74 / 1462.71 ±10.35 / 1474.69 ms │ 1434.25 / 1502.15 ±43.88 / 1553.76 ms │     no change │
│ QQuery 19 │        35.69 / 37.10 ±1.29 / 38.87 ms │        35.68 / 36.62 ±1.00 / 38.52 ms │     no change │
│ QQuery 20 │    708.36 / 723.97 ±16.77 / 753.43 ms │    710.39 / 721.48 ±10.63 / 740.75 ms │     no change │
│ QQuery 21 │     758.34 / 763.43 ±3.92 / 767.67 ms │     759.01 / 765.79 ±5.49 / 775.34 ms │     no change │
│ QQuery 22 │  1126.34 / 1141.13 ±9.74 / 1156.25 ms │  1136.19 / 1144.30 ±4.85 / 1149.72 ms │     no change │
│ QQuery 23 │ 3217.68 / 3264.09 ±27.73 / 3298.54 ms │ 3210.71 / 3243.83 ±21.42 / 3267.94 ms │     no change │
│ QQuery 24 │     106.38 / 109.73 ±3.12 / 115.31 ms │     105.31 / 108.21 ±1.80 / 110.64 ms │     no change │
│ QQuery 25 │     142.87 / 144.24 ±1.24 / 146.20 ms │     141.07 / 142.83 ±1.11 / 143.91 ms │     no change │
│ QQuery 26 │     104.60 / 106.96 ±1.39 / 108.25 ms │     105.00 / 106.94 ±1.24 / 108.80 ms │     no change │
│ QQuery 27 │     855.70 / 858.98 ±4.21 / 866.87 ms │     855.50 / 859.37 ±5.44 / 870.06 ms │     no change │
│ QQuery 28 │ 7766.35 / 7785.00 ±15.12 / 7800.65 ms │ 7769.70 / 7809.03 ±29.46 / 7857.23 ms │     no change │
│ QQuery 29 │     330.09 / 336.24 ±9.42 / 354.96 ms │    329.97 / 339.80 ±16.47 / 372.60 ms │     no change │
│ QQuery 30 │     376.13 / 385.15 ±7.08 / 394.35 ms │     375.94 / 382.32 ±4.59 / 388.74 ms │     no change │
│ QQuery 31 │     381.53 / 388.61 ±5.46 / 396.34 ms │     392.47 / 402.22 ±5.62 / 408.89 ms │     no change │
│ QQuery 32 │ 1095.14 / 1110.24 ±17.42 / 1142.15 ms │ 1093.90 / 1133.20 ±43.66 / 1200.51 ms │     no change │
│ QQuery 33 │  1542.39 / 1554.67 ±7.63 / 1563.48 ms │ 1534.17 / 1555.23 ±12.06 / 1567.04 ms │     no change │
│ QQuery 34 │ 1549.96 / 1561.92 ±11.53 / 1582.25 ms │ 1543.40 / 1560.96 ±13.28 / 1576.54 ms │     no change │
│ QQuery 35 │     430.70 / 438.45 ±8.46 / 453.66 ms │     431.32 / 433.82 ±2.99 / 439.55 ms │     no change │
│ QQuery 36 │     125.71 / 128.89 ±2.19 / 130.98 ms │     120.13 / 125.34 ±3.59 / 130.16 ms │     no change │
│ QQuery 37 │        51.28 / 51.87 ±0.81 / 53.48 ms │        50.78 / 51.68 ±0.75 / 52.65 ms │     no change │
│ QQuery 38 │        74.86 / 78.06 ±1.91 / 80.54 ms │        75.90 / 77.65 ±1.44 / 80.24 ms │     no change │
│ QQuery 39 │     233.25 / 237.36 ±5.58 / 248.36 ms │     233.44 / 238.11 ±2.62 / 241.36 ms │     no change │
│ QQuery 40 │        27.01 / 29.69 ±2.35 / 33.83 ms │        23.82 / 26.71 ±2.25 / 29.77 ms │ +1.11x faster │
│ QQuery 41 │        20.50 / 22.30 ±1.55 / 25.07 ms │        20.59 / 22.65 ±1.17 / 24.14 ms │     no change │
│ QQuery 42 │        21.11 / 22.01 ±0.76 / 23.21 ms │        20.88 / 21.90 ±0.59 / 22.71 ms │     no change │
└───────────┴───────────────────────────────────────┴───────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary              ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 28196.56ms │
│ Total Time (join_vectorize2)   │ 28279.68ms │
│ Average Time (HEAD)            │   655.73ms │
│ Average Time (join_vectorize2) │   657.67ms │
│ Queries Faster                 │          1 │
│ Queries Slower                 │          1 │
│ Queries with No Change         │         41 │
│ Queries with Failure           │          0 │
└────────────────────────────────┴────────────┘

Resource Usage

clickbench_partitioned — base (merge-base)

Metric Value
Wall time 142.2s
Peak memory 40.6 GiB
Avg memory 33.7 GiB
CPU user 1337.1s
CPU sys 88.1s
Disk read 0 B
Disk write 4.2 GiB

clickbench_partitioned — branch

Metric Value
Wall time 142.5s
Peak memory 39.9 GiB
Avg memory 32.9 GiB
CPU user 1336.3s
CPU sys 94.4s
Disk read 0 B
Disk write 116.0 KiB

@Dandandan
Copy link
Contributor Author

run benchmarks

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062499567-280-6pwg2 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (676dd21) to 9c3c01a (merge-base) diff using: tpcds
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062499567-279-nf8xc 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (676dd21) to 9c3c01a (merge-base) diff using: clickbench_partitioned
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062499567-281-wkcfv 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (676dd21) to 9c3c01a (merge-base) diff using: tpch
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query     ┃                           HEAD ┃                join_vectorize2 ┃       Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1  │ 46.36 / 47.46 ±0.95 / 48.75 ms │ 46.44 / 47.14 ±0.81 / 48.61 ms │    no change │
│ QQuery 2  │ 24.54 / 25.33 ±0.62 / 26.41 ms │ 24.87 / 25.10 ±0.17 / 25.35 ms │    no change │
│ QQuery 3  │ 33.67 / 33.94 ±0.29 / 34.38 ms │ 33.79 / 33.93 ±0.22 / 34.36 ms │    no change │
│ QQuery 4  │ 21.94 / 22.76 ±0.55 / 23.56 ms │ 21.79 / 22.31 ±0.49 / 23.02 ms │    no change │
│ QQuery 5  │ 50.13 / 51.68 ±1.52 / 54.33 ms │ 50.85 / 52.59 ±1.27 / 53.91 ms │    no change │
│ QQuery 6  │ 17.49 / 18.00 ±0.35 / 18.54 ms │ 17.60 / 17.74 ±0.14 / 17.92 ms │    no change │
│ QQuery 7  │ 56.55 / 58.02 ±0.81 / 58.80 ms │ 56.80 / 57.90 ±0.85 / 59.19 ms │    no change │
│ QQuery 8  │ 51.46 / 52.06 ±0.52 / 52.95 ms │ 51.76 / 52.12 ±0.40 / 52.66 ms │    no change │
│ QQuery 9  │ 57.66 / 58.33 ±1.04 / 60.37 ms │ 57.15 / 58.51 ±1.15 / 60.61 ms │    no change │
│ QQuery 10 │ 72.94 / 74.58 ±1.41 / 76.84 ms │ 74.62 / 75.15 ±0.48 / 75.76 ms │    no change │
│ QQuery 11 │ 16.58 / 16.84 ±0.28 / 17.36 ms │ 16.84 / 16.97 ±0.08 / 17.09 ms │    no change │
│ QQuery 12 │ 28.36 / 28.72 ±0.21 / 28.96 ms │ 28.80 / 29.28 ±0.29 / 29.63 ms │    no change │
│ QQuery 13 │ 39.17 / 40.23 ±0.81 / 41.55 ms │ 40.03 / 41.41 ±1.41 / 44.13 ms │    no change │
│ QQuery 14 │ 29.26 / 29.61 ±0.28 / 29.99 ms │ 29.54 / 29.66 ±0.20 / 30.06 ms │    no change │
│ QQuery 15 │ 36.02 / 36.42 ±0.44 / 37.23 ms │ 36.57 / 36.95 ±0.21 / 37.19 ms │    no change │
│ QQuery 16 │ 17.71 / 18.20 ±0.62 / 19.42 ms │ 18.06 / 18.72 ±0.59 / 19.77 ms │    no change │
│ QQuery 17 │ 74.53 / 76.07 ±1.13 / 77.42 ms │ 85.86 / 86.94 ±0.92 / 87.93 ms │ 1.14x slower │
│ QQuery 18 │ 81.47 / 83.07 ±1.36 / 85.36 ms │ 88.01 / 89.39 ±1.43 / 91.98 ms │ 1.08x slower │
│ QQuery 19 │ 38.65 / 39.72 ±1.24 / 42.16 ms │ 41.00 / 41.80 ±0.61 / 42.80 ms │ 1.05x slower │
│ QQuery 20 │ 43.29 / 43.65 ±0.45 / 44.49 ms │ 45.86 / 47.55 ±1.50 / 50.34 ms │ 1.09x slower │
│ QQuery 21 │ 67.00 / 68.77 ±1.29 / 70.70 ms │ 75.48 / 77.41 ±1.53 / 79.98 ms │ 1.13x slower │
│ QQuery 22 │ 19.98 / 20.06 ±0.08 / 20.16 ms │ 21.39 / 21.67 ±0.20 / 21.92 ms │ 1.08x slower │
└───────────┴────────────────────────────────┴────────────────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┓
┃ Benchmark Summary              ┃          ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━┩
│ Total Time (HEAD)              │ 943.54ms │
│ Total Time (join_vectorize2)   │ 980.23ms │
│ Average Time (HEAD)            │  42.89ms │
│ Average Time (join_vectorize2) │  44.56ms │
│ Queries Faster                 │        0 │
│ Queries Slower                 │        6 │
│ Queries with No Change         │       16 │
│ Queries with Failure           │        0 │
└────────────────────────────────┴──────────┘

Resource Usage

tpch — base (merge-base)

Metric Value
Wall time 5.0s
Peak memory 4.0 GiB
Avg memory 3.5 GiB
CPU user 33.8s
CPU sys 3.1s
Disk read 0 B
Disk write 136.0 KiB

tpch — branch

Metric Value
Wall time 5.1s
Peak memory 4.0 GiB
Avg memory 3.5 GiB
CPU user 35.2s
CPU sys 3.2s
Disk read 0 B
Disk write 68.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                     HEAD ┃                          join_vectorize2 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │           49.17 / 50.08 ±0.76 / 51.22 ms │           48.96 / 50.79 ±1.50 / 53.11 ms │     no change │
│ QQuery 2  │        155.20 / 156.84 ±1.26 / 158.71 ms │        158.41 / 158.72 ±0.31 / 159.09 ms │     no change │
│ QQuery 3  │        119.90 / 120.37 ±0.42 / 121.05 ms │        122.54 / 123.00 ±0.26 / 123.24 ms │     no change │
│ QQuery 4  │    1426.35 / 1479.30 ±35.17 / 1517.18 ms │    1426.71 / 1460.95 ±23.63 / 1499.48 ms │     no change │
│ QQuery 5  │        185.73 / 187.58 ±2.44 / 192.31 ms │        186.14 / 187.61 ±1.09 / 189.54 ms │     no change │
│ QQuery 6  │     992.80 / 1038.66 ±41.69 / 1110.43 ms │    1013.65 / 1048.07 ±24.14 / 1088.56 ms │     no change │
│ QQuery 7  │        362.59 / 368.99 ±5.10 / 377.65 ms │        361.77 / 367.06 ±3.39 / 372.14 ms │     no change │
│ QQuery 8  │        121.78 / 124.09 ±1.24 / 125.46 ms │        124.17 / 126.22 ±1.74 / 128.63 ms │     no change │
│ QQuery 9  │        114.89 / 116.52 ±1.63 / 119.46 ms │       111.74 / 119.86 ±10.07 / 139.15 ms │     no change │
│ QQuery 10 │        113.10 / 117.12 ±2.79 / 120.78 ms │        115.37 / 117.88 ±2.22 / 120.87 ms │     no change │
│ QQuery 11 │     969.50 / 1018.30 ±33.64 / 1063.52 ms │     998.68 / 1011.80 ±20.87 / 1053.22 ms │     no change │
│ QQuery 12 │           49.18 / 50.17 ±0.93 / 51.79 ms │           47.93 / 50.61 ±1.50 / 51.83 ms │     no change │
│ QQuery 13 │        408.72 / 418.07 ±5.59 / 424.88 ms │        413.44 / 418.30 ±4.14 / 422.99 ms │     no change │
│ QQuery 14 │     1097.16 / 1104.92 ±5.67 / 1113.96 ms │     1093.06 / 1100.05 ±5.04 / 1106.29 ms │     no change │
│ QQuery 15 │           18.10 / 19.02 ±0.86 / 20.29 ms │           17.41 / 18.37 ±0.93 / 19.92 ms │     no change │
│ QQuery 16 │           45.52 / 46.56 ±0.55 / 47.10 ms │           47.05 / 47.87 ±0.87 / 49.47 ms │     no change │
│ QQuery 17 │        248.13 / 252.04 ±3.60 / 257.88 ms │        250.80 / 257.98 ±5.38 / 266.35 ms │     no change │
│ QQuery 18 │        133.96 / 136.16 ±2.25 / 139.30 ms │        134.61 / 135.45 ±0.84 / 136.79 ms │     no change │
│ QQuery 19 │        163.91 / 167.03 ±3.38 / 173.29 ms │        163.75 / 168.25 ±4.32 / 175.13 ms │     no change │
│ QQuery 20 │           16.12 / 16.58 ±0.31 / 17.05 ms │           16.14 / 16.49 ±0.51 / 17.49 ms │     no change │
│ QQuery 21 │           23.04 / 24.10 ±0.54 / 24.52 ms │           24.47 / 25.10 ±0.59 / 26.12 ms │     no change │
│ QQuery 22 │       527.00 / 539.94 ±12.31 / 560.30 ms │        531.87 / 537.88 ±5.84 / 546.57 ms │     no change │
│ QQuery 23 │      962.11 / 988.44 ±19.79 / 1014.61 ms │     968.87 / 1002.69 ±17.92 / 1020.38 ms │     no change │
│ QQuery 24 │        459.95 / 461.10 ±1.06 / 462.58 ms │        437.22 / 448.01 ±7.67 / 460.69 ms │     no change │
│ QQuery 25 │        368.88 / 375.54 ±5.91 / 386.24 ms │        382.75 / 385.43 ±2.22 / 389.07 ms │     no change │
│ QQuery 26 │           88.83 / 90.00 ±0.61 / 90.52 ms │           86.56 / 90.02 ±2.70 / 93.78 ms │     no change │
│ QQuery 27 │        363.35 / 368.05 ±3.02 / 372.44 ms │        355.53 / 362.27 ±4.72 / 367.22 ms │     no change │
│ QQuery 28 │        154.55 / 158.10 ±2.96 / 161.71 ms │        157.36 / 158.35 ±0.90 / 159.58 ms │     no change │
│ QQuery 29 │        308.46 / 315.49 ±7.24 / 324.49 ms │        318.17 / 321.89 ±3.15 / 327.36 ms │     no change │
│ QQuery 30 │           48.37 / 49.91 ±1.39 / 52.13 ms │           50.54 / 53.33 ±1.55 / 54.97 ms │  1.07x slower │
│ QQuery 31 │        183.93 / 189.01 ±2.86 / 191.66 ms │        187.70 / 189.64 ±2.41 / 194.00 ms │     no change │
│ QQuery 32 │           63.08 / 63.92 ±0.74 / 65.15 ms │           61.56 / 63.29 ±1.20 / 65.14 ms │     no change │
│ QQuery 33 │        150.05 / 153.97 ±2.65 / 157.22 ms │        152.70 / 156.02 ±2.78 / 160.33 ms │     no change │
│ QQuery 34 │        114.06 / 117.56 ±1.93 / 119.66 ms │        111.62 / 112.65 ±0.92 / 113.95 ms │     no change │
│ QQuery 35 │        118.47 / 120.51 ±1.35 / 122.69 ms │        119.29 / 123.30 ±2.82 / 126.44 ms │     no change │
│ QQuery 36 │        224.14 / 230.87 ±6.09 / 241.38 ms │        220.71 / 228.64 ±6.02 / 239.37 ms │     no change │
│ QQuery 37 │        184.71 / 190.02 ±3.32 / 194.02 ms │        183.71 / 187.58 ±2.50 / 191.10 ms │     no change │
│ QQuery 38 │           88.00 / 96.03 ±4.44 / 99.57 ms │          93.02 / 95.52 ±3.00 / 101.14 ms │     no change │
│ QQuery 39 │        139.59 / 148.57 ±8.95 / 160.83 ms │       140.74 / 149.72 ±10.06 / 165.69 ms │     no change │
│ QQuery 40 │        116.74 / 125.08 ±7.36 / 138.63 ms │        118.21 / 126.56 ±4.82 / 133.00 ms │     no change │
│ QQuery 41 │           17.85 / 19.33 ±0.79 / 19.97 ms │           17.22 / 18.38 ±0.88 / 19.81 ms │     no change │
│ QQuery 42 │        111.88 / 115.37 ±2.39 / 119.22 ms │        114.11 / 115.13 ±0.96 / 116.42 ms │     no change │
│ QQuery 43 │           87.54 / 89.11 ±1.07 / 90.30 ms │           89.28 / 91.05 ±1.39 / 92.96 ms │     no change │
│ QQuery 44 │           18.14 / 19.16 ±0.94 / 20.53 ms │           16.84 / 17.35 ±0.53 / 18.35 ms │ +1.10x faster │
│ QQuery 45 │           55.80 / 57.99 ±1.85 / 60.25 ms │           56.03 / 57.50 ±1.20 / 58.67 ms │     no change │
│ QQuery 46 │        239.42 / 246.84 ±8.99 / 263.30 ms │        239.49 / 252.74 ±8.93 / 261.93 ms │     no change │
│ QQuery 47 │       775.04 / 797.25 ±12.19 / 807.03 ms │       780.57 / 809.08 ±18.96 / 838.44 ms │     no change │
│ QQuery 48 │        295.82 / 303.11 ±4.67 / 309.79 ms │        291.64 / 302.21 ±9.21 / 315.36 ms │     no change │
│ QQuery 49 │        265.70 / 269.65 ±2.47 / 273.41 ms │        265.25 / 268.49 ±3.44 / 273.66 ms │     no change │
│ QQuery 50 │        245.01 / 253.30 ±6.17 / 264.08 ms │        249.69 / 257.10 ±7.66 / 271.29 ms │     no change │
│ QQuery 51 │        194.66 / 200.04 ±4.30 / 206.68 ms │        194.06 / 197.03 ±3.35 / 202.94 ms │     no change │
│ QQuery 52 │        114.89 / 117.59 ±2.26 / 121.23 ms │        112.77 / 114.09 ±1.00 / 115.89 ms │     no change │
│ QQuery 53 │        110.83 / 112.47 ±1.06 / 114.00 ms │        109.09 / 112.08 ±1.91 / 114.53 ms │     no change │
│ QQuery 54 │        157.51 / 160.32 ±3.12 / 165.95 ms │        155.66 / 159.10 ±3.69 / 165.46 ms │     no change │
│ QQuery 55 │        112.10 / 114.90 ±2.53 / 119.63 ms │        111.85 / 113.22 ±1.43 / 115.78 ms │     no change │
│ QQuery 56 │        152.72 / 155.32 ±3.72 / 162.62 ms │        152.21 / 155.22 ±3.17 / 160.88 ms │     no change │
│ QQuery 57 │        193.05 / 197.29 ±4.54 / 205.84 ms │        189.08 / 194.16 ±4.48 / 201.52 ms │     no change │
│ QQuery 58 │        316.70 / 323.09 ±5.68 / 333.39 ms │       309.38 / 322.43 ±10.89 / 342.01 ms │     no change │
│ QQuery 59 │        210.58 / 215.30 ±4.75 / 223.68 ms │        211.20 / 216.72 ±4.51 / 224.03 ms │     no change │
│ QQuery 60 │        153.83 / 158.02 ±3.42 / 163.77 ms │        153.38 / 157.56 ±2.41 / 160.65 ms │     no change │
│ QQuery 61 │        179.84 / 183.96 ±4.93 / 191.76 ms │        179.87 / 183.92 ±3.12 / 188.46 ms │     no change │
│ QQuery 62 │      946.58 / 988.56 ±36.42 / 1049.45 ms │      937.41 / 979.76 ±43.59 / 1058.67 ms │     no change │
│ QQuery 63 │        110.88 / 113.29 ±1.49 / 115.31 ms │        109.82 / 113.92 ±2.57 / 117.09 ms │     no change │
│ QQuery 64 │        728.53 / 736.12 ±6.60 / 747.65 ms │       718.97 / 735.52 ±12.29 / 753.46 ms │     no change │
│ QQuery 65 │       261.64 / 277.94 ±12.20 / 298.23 ms │       262.15 / 273.02 ±12.51 / 296.62 ms │     no change │
│ QQuery 66 │        257.13 / 267.37 ±6.42 / 274.30 ms │        257.46 / 269.31 ±9.97 / 281.87 ms │     no change │
│ QQuery 67 │        340.76 / 348.05 ±6.16 / 358.19 ms │       343.96 / 361.90 ±15.73 / 383.08 ms │     no change │
│ QQuery 68 │        287.03 / 296.23 ±7.60 / 306.71 ms │        287.53 / 298.80 ±9.74 / 310.91 ms │     no change │
│ QQuery 69 │        115.31 / 118.35 ±2.03 / 120.55 ms │        113.68 / 115.81 ±2.41 / 120.01 ms │     no change │
│ QQuery 70 │       348.93 / 367.52 ±12.60 / 387.04 ms │       352.91 / 370.42 ±16.25 / 400.98 ms │     no change │
│ QQuery 71 │        143.25 / 144.31 ±1.30 / 146.80 ms │        140.58 / 146.78 ±3.77 / 151.98 ms │     no change │
│ QQuery 72 │       734.15 / 753.09 ±20.57 / 788.30 ms │       733.31 / 755.59 ±12.53 / 770.33 ms │     no change │
│ QQuery 73 │        111.42 / 113.20 ±1.37 / 115.29 ms │        108.26 / 111.15 ±2.26 / 113.84 ms │     no change │
│ QQuery 74 │       633.81 / 697.27 ±38.72 / 736.70 ms │       668.20 / 698.38 ±21.24 / 726.07 ms │     no change │
│ QQuery 75 │        298.86 / 301.10 ±1.78 / 303.11 ms │        294.03 / 303.40 ±6.32 / 310.91 ms │     no change │
│ QQuery 76 │        142.84 / 145.76 ±1.65 / 147.82 ms │        136.79 / 141.33 ±4.76 / 149.92 ms │     no change │
│ QQuery 77 │        206.55 / 208.09 ±1.47 / 210.63 ms │        205.17 / 208.89 ±2.71 / 213.14 ms │     no change │
│ QQuery 78 │        369.11 / 373.76 ±4.15 / 381.44 ms │        377.01 / 381.55 ±6.04 / 393.36 ms │     no change │
│ QQuery 79 │       239.93 / 249.89 ±11.89 / 273.08 ms │        243.36 / 253.99 ±9.99 / 269.22 ms │     no change │
│ QQuery 80 │        341.16 / 348.86 ±5.47 / 356.97 ms │        341.10 / 346.50 ±4.53 / 352.81 ms │     no change │
│ QQuery 81 │           32.01 / 33.82 ±1.34 / 35.91 ms │           31.09 / 32.29 ±0.99 / 33.65 ms │     no change │
│ QQuery 82 │        209.30 / 212.60 ±2.90 / 217.99 ms │        208.89 / 212.17 ±2.53 / 216.22 ms │     no change │
│ QQuery 83 │           47.57 / 48.38 ±0.84 / 49.60 ms │           48.78 / 49.96 ±0.95 / 51.06 ms │     no change │
│ QQuery 84 │           53.52 / 55.07 ±1.38 / 57.07 ms │           53.74 / 55.73 ±1.11 / 57.05 ms │     no change │
│ QQuery 85 │        155.31 / 156.99 ±1.50 / 158.73 ms │        155.21 / 160.94 ±3.07 / 163.52 ms │     no change │
│ QQuery 86 │           42.28 / 44.01 ±0.91 / 44.90 ms │           44.32 / 45.86 ±1.39 / 48.47 ms │     no change │
│ QQuery 87 │          94.67 / 96.51 ±2.28 / 100.87 ms │          94.56 / 97.27 ±3.09 / 103.12 ms │     no change │
│ QQuery 88 │        112.83 / 115.92 ±2.71 / 119.47 ms │        114.06 / 117.33 ±2.41 / 120.57 ms │     no change │
│ QQuery 89 │        126.58 / 127.99 ±1.06 / 129.26 ms │        127.09 / 128.46 ±0.70 / 129.03 ms │     no change │
│ QQuery 90 │           29.99 / 30.81 ±1.33 / 33.45 ms │           30.38 / 30.90 ±0.31 / 31.35 ms │     no change │
│ QQuery 91 │           67.14 / 69.18 ±1.75 / 72.05 ms │           67.21 / 69.21 ±1.12 / 70.56 ms │     no change │
│ QQuery 92 │           62.60 / 63.09 ±0.30 / 63.51 ms │           62.76 / 63.27 ±0.69 / 64.59 ms │     no change │
│ QQuery 93 │        194.00 / 201.70 ±6.03 / 212.22 ms │        195.90 / 201.54 ±4.74 / 209.31 ms │     no change │
│ QQuery 94 │           66.57 / 68.88 ±1.65 / 70.92 ms │           68.36 / 69.57 ±0.93 / 70.72 ms │     no change │
│ QQuery 95 │        142.24 / 145.35 ±2.63 / 148.45 ms │        143.86 / 146.25 ±2.29 / 150.16 ms │     no change │
│ QQuery 96 │           81.65 / 83.06 ±0.76 / 83.94 ms │           77.47 / 82.72 ±2.88 / 85.61 ms │     no change │
│ QQuery 97 │        135.52 / 138.70 ±3.59 / 145.61 ms │        135.51 / 139.85 ±4.15 / 147.46 ms │     no change │
│ QQuery 98 │        158.19 / 164.00 ±4.47 / 170.80 ms │        160.65 / 163.91 ±4.94 / 173.70 ms │     no change │
│ QQuery 99 │ 10907.88 / 10939.91 ±36.83 / 10989.99 ms │ 10925.64 / 10959.12 ±18.53 / 10979.82 ms │     no change │
└───────────┴──────────────────────────────────────────┴──────────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary              ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 35548.76ms │
│ Total Time (join_vectorize2)   │ 35610.14ms │
│ Average Time (HEAD)            │   359.08ms │
│ Average Time (join_vectorize2) │   359.70ms │
│ Queries Faster                 │          1 │
│ Queries Slower                 │          1 │
│ Queries with No Change         │         97 │
│ Queries with Failure           │          0 │
└────────────────────────────────┴────────────┘

Resource Usage

tpcds — base (merge-base)

Metric Value
Wall time 178.1s
Peak memory 5.8 GiB
Avg memory 4.7 GiB
CPU user 282.9s
CPU sys 21.6s
Disk read 0 B
Disk write 636.1 MiB

tpcds — branch

Metric Value
Wall time 178.4s
Peak memory 5.8 GiB
Avg memory 4.7 GiB
CPU user 283.1s
CPU sys 21.9s
Disk read 0 B
Disk write 148.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query     ┃                                  HEAD ┃                       join_vectorize2 ┃       Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 0  │          1.62 / 4.86 ±6.32 / 17.50 ms │          1.66 / 4.99 ±6.47 / 17.92 ms │    no change │
│ QQuery 1  │        14.85 / 15.23 ±0.35 / 15.88 ms │        15.39 / 15.71 ±0.20 / 15.97 ms │    no change │
│ QQuery 2  │        55.75 / 55.93 ±0.14 / 56.10 ms │        56.66 / 56.93 ±0.22 / 57.32 ms │    no change │
│ QQuery 3  │        48.65 / 51.30 ±2.34 / 55.04 ms │        48.88 / 50.10 ±1.18 / 52.09 ms │    no change │
│ QQuery 4  │     302.41 / 311.68 ±6.14 / 321.02 ms │     306.29 / 314.96 ±8.01 / 328.36 ms │    no change │
│ QQuery 5  │     356.93 / 361.04 ±3.09 / 365.20 ms │     355.10 / 359.83 ±3.80 / 366.40 ms │    no change │
│ QQuery 6  │           5.80 / 6.56 ±0.89 / 8.11 ms │           5.07 / 6.85 ±1.63 / 9.44 ms │    no change │
│ QQuery 7  │        16.96 / 17.25 ±0.16 / 17.40 ms │        18.12 / 20.16 ±3.23 / 26.56 ms │ 1.17x slower │
│ QQuery 8  │    439.19 / 448.35 ±14.73 / 477.62 ms │    444.37 / 457.32 ±16.35 / 488.52 ms │    no change │
│ QQuery 9  │     675.99 / 689.28 ±8.58 / 697.90 ms │    675.16 / 692.88 ±12.88 / 708.66 ms │    no change │
│ QQuery 10 │       94.17 / 96.96 ±4.84 / 106.62 ms │       95.70 / 98.68 ±3.56 / 105.41 ms │    no change │
│ QQuery 11 │     106.54 / 108.17 ±1.84 / 111.46 ms │     108.73 / 110.25 ±1.49 / 112.35 ms │    no change │
│ QQuery 12 │     354.78 / 357.60 ±1.74 / 359.78 ms │     353.23 / 356.87 ±3.08 / 361.22 ms │    no change │
│ QQuery 13 │    464.67 / 482.94 ±13.16 / 500.28 ms │    466.00 / 486.69 ±12.30 / 502.41 ms │    no change │
│ QQuery 14 │     360.27 / 364.63 ±4.33 / 370.73 ms │     359.60 / 364.57 ±3.59 / 368.71 ms │    no change │
│ QQuery 15 │    378.28 / 392.94 ±20.57 / 432.46 ms │    375.83 / 404.94 ±22.74 / 442.16 ms │    no change │
│ QQuery 16 │     751.23 / 758.77 ±9.49 / 776.30 ms │    767.06 / 786.64 ±21.81 / 828.15 ms │    no change │
│ QQuery 17 │    731.75 / 749.55 ±10.89 / 762.67 ms │     753.44 / 762.20 ±6.10 / 772.52 ms │    no change │
│ QQuery 18 │ 1438.14 / 1490.36 ±39.67 / 1536.21 ms │ 1514.14 / 1557.23 ±25.32 / 1583.10 ms │    no change │
│ QQuery 19 │        35.46 / 36.92 ±1.54 / 39.90 ms │        37.68 / 40.05 ±2.04 / 43.12 ms │ 1.08x slower │
│ QQuery 20 │    706.43 / 719.98 ±12.13 / 735.29 ms │    713.52 / 727.19 ±11.83 / 744.28 ms │    no change │
│ QQuery 21 │     757.69 / 759.43 ±1.29 / 760.66 ms │     757.82 / 762.16 ±3.91 / 768.01 ms │    no change │
│ QQuery 22 │  1127.66 / 1136.90 ±7.76 / 1146.53 ms │  1128.36 / 1131.82 ±2.61 / 1136.12 ms │    no change │
│ QQuery 23 │ 3199.52 / 3226.19 ±21.37 / 3252.00 ms │ 3196.47 / 3214.97 ±11.69 / 3226.37 ms │    no change │
│ QQuery 24 │     102.94 / 104.75 ±1.44 / 106.89 ms │     105.44 / 108.02 ±2.36 / 111.90 ms │    no change │
│ QQuery 25 │     139.50 / 141.62 ±1.44 / 143.76 ms │     140.10 / 144.07 ±2.73 / 148.20 ms │    no change │
│ QQuery 26 │     103.37 / 104.07 ±0.62 / 105.01 ms │     103.40 / 106.36 ±1.50 / 107.45 ms │    no change │
│ QQuery 27 │     848.42 / 855.92 ±7.16 / 868.00 ms │     854.92 / 857.20 ±3.39 / 863.89 ms │    no change │
│ QQuery 28 │ 7723.91 / 7764.29 ±22.26 / 7790.93 ms │ 7708.08 / 7778.83 ±35.53 / 7801.68 ms │    no change │
│ QQuery 29 │     328.86 / 331.93 ±2.97 / 337.60 ms │    332.40 / 340.42 ±12.33 / 364.80 ms │    no change │
│ QQuery 30 │    354.11 / 371.19 ±11.94 / 386.69 ms │     368.80 / 380.46 ±8.16 / 388.94 ms │    no change │
│ QQuery 31 │    371.92 / 387.59 ±14.09 / 413.73 ms │     365.78 / 375.86 ±8.59 / 390.73 ms │    no change │
│ QQuery 32 │ 1070.85 / 1087.76 ±19.55 / 1125.34 ms │ 1086.96 / 1101.33 ±20.22 / 1141.42 ms │    no change │
│ QQuery 33 │ 1495.10 / 1509.10 ±10.82 / 1521.64 ms │  1510.08 / 1512.81 ±2.61 / 1516.26 ms │    no change │
│ QQuery 34 │ 1513.70 / 1543.01 ±34.55 / 1610.28 ms │ 1518.01 / 1604.46 ±54.19 / 1660.02 ms │    no change │
│ QQuery 35 │    418.41 / 437.61 ±16.17 / 466.79 ms │    413.53 / 429.75 ±12.94 / 444.17 ms │    no change │
│ QQuery 36 │     116.36 / 124.64 ±4.55 / 128.95 ms │    126.41 / 145.85 ±25.20 / 195.21 ms │ 1.17x slower │
│ QQuery 37 │        49.94 / 51.68 ±2.40 / 56.41 ms │        50.77 / 52.29 ±1.25 / 54.51 ms │    no change │
│ QQuery 38 │        74.58 / 75.51 ±0.75 / 76.38 ms │        84.82 / 85.88 ±1.19 / 88.20 ms │ 1.14x slower │
│ QQuery 39 │     218.29 / 230.33 ±8.34 / 240.22 ms │     234.80 / 243.12 ±8.72 / 259.92 ms │ 1.06x slower │
│ QQuery 40 │        24.24 / 26.64 ±2.15 / 29.90 ms │        25.93 / 27.91 ±1.31 / 29.28 ms │    no change │
│ QQuery 41 │        20.99 / 22.03 ±0.65 / 23.03 ms │        21.21 / 22.45 ±0.74 / 23.44 ms │    no change │
│ QQuery 42 │        20.49 / 20.86 ±0.48 / 21.79 ms │       21.24 / 32.97 ±22.09 / 77.14 ms │ 1.58x slower │
└───────────┴───────────────────────────────────────┴───────────────────────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary              ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 27833.37ms │
│ Total Time (join_vectorize2)   │ 28134.02ms │
│ Average Time (HEAD)            │   647.29ms │
│ Average Time (join_vectorize2) │   654.28ms │
│ Queries Faster                 │          0 │
│ Queries Slower                 │          6 │
│ Queries with No Change         │         37 │
│ Queries with Failure           │          0 │
└────────────────────────────────┴────────────┘

Resource Usage

clickbench_partitioned — base (merge-base)

Metric Value
Wall time 140.0s
Peak memory 38.1 GiB
Avg memory 31.9 GiB
CPU user 1322.7s
CPU sys 87.7s
Disk read 0 B
Disk write 4.6 GiB

clickbench_partitioned — branch

Metric Value
Wall time 141.2s
Peak memory 37.8 GiB
Avg memory 32.4 GiB
CPU user 1325.9s
CPU sys 94.4s
Disk read 0 B
Disk write 760.0 KiB

@Dandandan
Copy link
Contributor Author

run benchmarks

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062743227-283-xs942 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (56f1efb) to 9c3c01a (merge-base) diff using: clickbench_partitioned
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062743227-284-x954w 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (56f1efb) to 9c3c01a (merge-base) diff using: tpcds
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062743227-285-dp75k 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (56f1efb) to 9c3c01a (merge-base) diff using: tpch
Results will be posted here when complete

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpch_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                           HEAD ┃                join_vectorize2 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 46.54 / 47.31 ±0.80 / 48.80 ms │ 46.33 / 47.27 ±0.71 / 48.53 ms │     no change │
│ QQuery 2  │ 25.60 / 25.73 ±0.15 / 25.99 ms │ 24.87 / 25.26 ±0.32 / 25.78 ms │     no change │
│ QQuery 3  │ 34.15 / 34.62 ±0.49 / 35.49 ms │ 34.00 / 34.31 ±0.37 / 34.99 ms │     no change │
│ QQuery 4  │ 22.46 / 23.38 ±0.51 / 23.93 ms │ 22.18 / 23.29 ±1.09 / 24.85 ms │     no change │
│ QQuery 5  │ 51.06 / 53.35 ±2.52 / 56.95 ms │ 51.20 / 53.23 ±1.69 / 55.69 ms │     no change │
│ QQuery 6  │ 17.87 / 18.53 ±1.00 / 20.51 ms │ 17.74 / 18.26 ±0.47 / 19.10 ms │     no change │
│ QQuery 7  │ 57.85 / 59.46 ±1.33 / 61.88 ms │ 58.39 / 60.41 ±1.35 / 62.39 ms │     no change │
│ QQuery 8  │ 51.73 / 52.43 ±0.47 / 53.14 ms │ 52.31 / 52.79 ±0.44 / 53.54 ms │     no change │
│ QQuery 9  │ 57.69 / 59.16 ±0.87 / 60.18 ms │ 57.11 / 58.46 ±0.99 / 59.46 ms │     no change │
│ QQuery 10 │ 74.72 / 76.24 ±1.30 / 78.43 ms │ 74.78 / 75.78 ±0.55 / 76.26 ms │     no change │
│ QQuery 11 │ 17.39 / 18.86 ±1.06 / 19.75 ms │ 16.80 / 17.50 ±0.46 / 18.08 ms │ +1.08x faster │
│ QQuery 12 │ 29.43 / 29.96 ±0.42 / 30.50 ms │ 29.22 / 29.76 ±0.28 / 29.98 ms │     no change │
│ QQuery 13 │ 40.33 / 42.53 ±3.57 / 49.62 ms │ 40.93 / 41.59 ±0.46 / 42.13 ms │     no change │
│ QQuery 14 │ 29.81 / 30.26 ±0.32 / 30.75 ms │ 29.29 / 30.85 ±1.31 / 32.72 ms │     no change │
│ QQuery 15 │ 36.99 / 37.64 ±0.43 / 38.21 ms │ 36.51 / 37.43 ±0.95 / 39.00 ms │     no change │
│ QQuery 16 │ 18.41 / 18.77 ±0.42 / 19.56 ms │ 18.10 / 18.71 ±0.45 / 19.32 ms │     no change │
│ QQuery 17 │ 75.24 / 78.14 ±1.57 / 79.66 ms │ 75.40 / 79.19 ±3.11 / 82.88 ms │     no change │
│ QQuery 18 │ 83.46 / 84.38 ±1.03 / 86.35 ms │ 84.22 / 85.51 ±0.76 / 86.41 ms │     no change │
│ QQuery 19 │ 39.27 / 40.56 ±1.19 / 42.60 ms │ 39.27 / 40.53 ±0.97 / 42.22 ms │     no change │
│ QQuery 20 │ 43.59 / 44.69 ±0.67 / 45.68 ms │ 43.88 / 45.03 ±0.83 / 46.29 ms │     no change │
│ QQuery 21 │ 71.35 / 72.57 ±1.20 / 74.56 ms │ 70.23 / 72.72 ±2.19 / 75.61 ms │     no change │
│ QQuery 22 │ 20.50 / 21.40 ±0.57 / 22.16 ms │ 19.95 / 20.47 ±0.34 / 20.88 ms │     no change │
└───────────┴────────────────────────────────┴────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┓
┃ Benchmark Summary              ┃          ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━┩
│ Total Time (HEAD)              │ 969.96ms │
│ Total Time (join_vectorize2)   │ 968.34ms │
│ Average Time (HEAD)            │  44.09ms │
│ Average Time (join_vectorize2) │  44.02ms │
│ Queries Faster                 │        1 │
│ Queries Slower                 │        0 │
│ Queries with No Change         │       21 │
│ Queries with Failure           │        0 │
└────────────────────────────────┴──────────┘

Resource Usage

tpch — base (merge-base)

Metric Value
Wall time 5.2s
Peak memory 3.9 GiB
Avg memory 3.5 GiB
CPU user 34.4s
CPU sys 3.2s
Disk read 0 B
Disk write 148.0 KiB

tpch — branch

Metric Value
Wall time 5.1s
Peak memory 3.9 GiB
Avg memory 3.5 GiB
CPU user 34.8s
CPU sys 3.2s
Disk read 0 B
Disk write 56.0 KiB

@Dandandan
Copy link
Contributor Author

run benchmark tpch10

@adriangbot
Copy link

🤖 Benchmark running (GKE) | trigger
Linux bench-c4062762130-286-j7pmg 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing join_vectorize2 (56f1efb) to 9c3c01a (merge-base) diff using: tpch10
Results will be posted here when complete

Replace the linked-list chain storage in JoinHashMap with contiguous
flat storage using inline single-match optimization. First insert per
key is stored inline in the hash table entry (no extra allocation).
Duplicate keys go to an overflow buffer that is flattened into
contiguous storage in a single O(n) sequential pass.

Probe uses batched map.find() calls (4 at a time) for better
instruction-level parallelism, and iterates contiguous slices instead
of chasing linked-list pointers.

Benchmarks (8192 probes, 200K keys, shuffled build):
- Unique keys: 20% faster probe, ~0 flatten cost
- 4 dups/key: 8% faster probe
- 16 dups/key: 5.2x faster probe (cache-friendly vs scattered pointers)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpcds_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                     HEAD ┃                          join_vectorize2 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │           49.07 / 50.13 ±0.81 / 51.02 ms │           49.40 / 50.09 ±0.55 / 50.85 ms │     no change │
│ QQuery 2  │        156.18 / 157.55 ±0.93 / 158.63 ms │        158.84 / 159.93 ±1.15 / 162.11 ms │     no change │
│ QQuery 3  │        119.96 / 120.48 ±0.40 / 121.00 ms │        122.10 / 122.88 ±1.00 / 124.71 ms │     no change │
│ QQuery 4  │    1350.02 / 1407.67 ±36.82 / 1457.47 ms │    1388.24 / 1443.12 ±56.87 / 1545.75 ms │     no change │
│ QQuery 5  │        186.50 / 187.69 ±0.65 / 188.37 ms │        186.62 / 188.51 ±1.40 / 190.86 ms │     no change │
│ QQuery 6  │     992.90 / 1033.54 ±28.24 / 1060.32 ms │     975.85 / 1035.91 ±40.86 / 1074.74 ms │     no change │
│ QQuery 7  │        361.71 / 366.32 ±4.35 / 372.99 ms │        357.06 / 362.78 ±2.95 / 365.49 ms │     no change │
│ QQuery 8  │        123.51 / 124.68 ±0.72 / 125.51 ms │        125.24 / 126.89 ±1.09 / 128.00 ms │     no change │
│ QQuery 9  │        113.59 / 117.75 ±3.02 / 121.95 ms │        111.08 / 120.41 ±9.24 / 138.10 ms │     no change │
│ QQuery 10 │        117.18 / 117.78 ±0.72 / 119.17 ms │        117.19 / 118.26 ±0.89 / 119.26 ms │     no change │
│ QQuery 11 │      967.13 / 986.18 ±12.67 / 1006.67 ms │       977.78 / 990.69 ±8.50 / 1001.85 ms │     no change │
│ QQuery 12 │           47.39 / 48.78 ±1.13 / 50.03 ms │           48.33 / 49.46 ±1.03 / 51.14 ms │     no change │
│ QQuery 13 │        409.52 / 412.13 ±2.85 / 416.15 ms │        410.92 / 414.26 ±1.90 / 416.61 ms │     no change │
│ QQuery 14 │     1097.88 / 1107.15 ±4.69 / 1110.76 ms │     1086.38 / 1092.53 ±7.74 / 1107.49 ms │     no change │
│ QQuery 15 │           18.35 / 19.43 ±1.37 / 21.97 ms │           17.23 / 18.11 ±0.53 / 18.75 ms │ +1.07x faster │
│ QQuery 16 │           46.99 / 47.37 ±0.27 / 47.63 ms │           46.65 / 47.32 ±1.04 / 49.37 ms │     no change │
│ QQuery 17 │        251.83 / 253.17 ±1.26 / 255.31 ms │        246.58 / 248.96 ±1.49 / 250.97 ms │     no change │
│ QQuery 18 │        134.95 / 136.26 ±1.14 / 137.98 ms │        134.62 / 135.14 ±0.62 / 136.34 ms │     no change │
│ QQuery 19 │        165.57 / 166.33 ±0.80 / 167.78 ms │        165.49 / 166.66 ±1.24 / 168.92 ms │     no change │
│ QQuery 20 │           15.57 / 16.59 ±0.73 / 17.68 ms │           15.90 / 16.51 ±0.57 / 17.54 ms │     no change │
│ QQuery 21 │           24.63 / 25.07 ±0.35 / 25.61 ms │           23.44 / 24.16 ±0.54 / 25.00 ms │     no change │
│ QQuery 22 │        520.48 / 524.24 ±3.53 / 530.79 ms │        516.39 / 520.26 ±2.54 / 522.91 ms │     no change │
│ QQuery 23 │        957.66 / 970.96 ±9.21 / 982.65 ms │        943.88 / 952.22 ±9.52 / 970.33 ms │     no change │
│ QQuery 24 │        437.15 / 439.94 ±2.64 / 444.85 ms │        430.09 / 434.57 ±3.33 / 438.78 ms │     no change │
│ QQuery 25 │        366.49 / 369.94 ±2.44 / 373.84 ms │        364.07 / 365.03 ±1.41 / 367.80 ms │     no change │
│ QQuery 26 │           85.90 / 88.04 ±1.47 / 89.75 ms │           84.92 / 87.47 ±2.32 / 91.01 ms │     no change │
│ QQuery 27 │        362.18 / 370.38 ±4.14 / 373.08 ms │        353.44 / 357.25 ±2.23 / 359.59 ms │     no change │
│ QQuery 28 │        154.44 / 157.79 ±3.91 / 164.89 ms │        154.23 / 155.13 ±0.78 / 156.45 ms │     no change │
│ QQuery 29 │        313.34 / 315.71 ±1.96 / 318.60 ms │        306.49 / 309.08 ±1.63 / 311.57 ms │     no change │
│ QQuery 30 │           50.20 / 52.51 ±2.21 / 56.24 ms │           49.76 / 50.97 ±1.04 / 52.23 ms │     no change │
│ QQuery 31 │        187.20 / 190.26 ±1.96 / 193.31 ms │        188.38 / 190.51 ±1.17 / 191.84 ms │     no change │
│ QQuery 32 │           62.80 / 63.97 ±1.13 / 65.89 ms │           62.60 / 64.00 ±1.67 / 67.12 ms │     no change │
│ QQuery 33 │        152.92 / 154.35 ±1.50 / 156.83 ms │        152.01 / 154.45 ±1.40 / 155.89 ms │     no change │
│ QQuery 34 │        113.39 / 114.31 ±1.36 / 116.99 ms │        112.17 / 114.34 ±1.17 / 115.39 ms │     no change │
│ QQuery 35 │        117.12 / 119.49 ±1.39 / 121.33 ms │        118.94 / 121.09 ±1.42 / 122.78 ms │     no change │
│ QQuery 36 │        227.51 / 230.20 ±2.04 / 233.81 ms │        223.59 / 229.33 ±3.23 / 232.66 ms │     no change │
│ QQuery 37 │        188.75 / 191.68 ±3.13 / 197.43 ms │        184.41 / 186.85 ±1.48 / 188.20 ms │     no change │
│ QQuery 38 │          94.43 / 98.12 ±2.62 / 102.48 ms │         95.49 / 101.98 ±5.59 / 110.03 ms │     no change │
│ QQuery 39 │        139.97 / 143.76 ±2.00 / 145.86 ms │        135.76 / 140.12 ±2.40 / 142.95 ms │     no change │
│ QQuery 40 │        118.03 / 125.22 ±6.55 / 136.30 ms │        111.38 / 119.56 ±6.35 / 130.75 ms │     no change │
│ QQuery 41 │           17.71 / 19.43 ±1.21 / 21.40 ms │           17.43 / 18.49 ±0.90 / 20.10 ms │     no change │
│ QQuery 42 │        113.26 / 116.13 ±2.14 / 118.77 ms │        114.66 / 116.91 ±1.60 / 119.29 ms │     no change │
│ QQuery 43 │           89.10 / 89.97 ±0.79 / 91.41 ms │           89.89 / 90.49 ±0.50 / 91.22 ms │     no change │
│ QQuery 44 │           17.49 / 18.81 ±1.17 / 20.38 ms │           16.65 / 16.98 ±0.23 / 17.25 ms │ +1.11x faster │
│ QQuery 45 │           55.65 / 58.31 ±1.69 / 60.26 ms │           56.00 / 57.70 ±1.13 / 59.14 ms │     no change │
│ QQuery 46 │        242.80 / 245.25 ±2.20 / 248.29 ms │        238.64 / 242.25 ±3.56 / 247.11 ms │     no change │
│ QQuery 47 │        752.92 / 770.01 ±8.78 / 778.06 ms │       741.40 / 760.79 ±12.56 / 777.94 ms │     no change │
│ QQuery 48 │        293.49 / 296.85 ±2.89 / 301.95 ms │        300.16 / 301.32 ±0.92 / 302.90 ms │     no change │
│ QQuery 49 │        265.78 / 268.80 ±1.97 / 271.80 ms │        262.99 / 265.46 ±2.24 / 268.10 ms │     no change │
│ QQuery 50 │        247.28 / 250.59 ±2.64 / 254.02 ms │        235.98 / 240.63 ±4.77 / 248.56 ms │     no change │
│ QQuery 51 │        195.98 / 197.66 ±1.45 / 200.07 ms │        192.99 / 196.20 ±2.79 / 201.42 ms │     no change │
│ QQuery 52 │        112.93 / 114.66 ±1.34 / 117.03 ms │        112.81 / 113.66 ±0.76 / 115.05 ms │     no change │
│ QQuery 53 │        108.92 / 110.43 ±0.84 / 111.46 ms │        110.04 / 111.05 ±0.99 / 112.31 ms │     no change │
│ QQuery 54 │        154.55 / 155.95 ±0.79 / 156.94 ms │        156.72 / 158.76 ±1.37 / 160.43 ms │     no change │
│ QQuery 55 │        112.31 / 114.48 ±1.65 / 116.66 ms │        113.43 / 114.74 ±1.44 / 116.99 ms │     no change │
│ QQuery 56 │        152.75 / 155.34 ±1.62 / 157.08 ms │        152.14 / 154.08 ±1.57 / 156.44 ms │     no change │
│ QQuery 57 │        190.64 / 193.01 ±2.17 / 196.23 ms │        192.86 / 195.33 ±1.63 / 197.26 ms │     no change │
│ QQuery 58 │        314.57 / 321.70 ±7.17 / 334.42 ms │        329.74 / 338.14 ±8.17 / 349.23 ms │  1.05x slower │
│ QQuery 59 │        211.40 / 213.70 ±1.45 / 215.78 ms │        216.97 / 219.14 ±1.47 / 221.39 ms │     no change │
│ QQuery 60 │        153.57 / 155.07 ±1.28 / 157.19 ms │        156.35 / 158.09 ±1.46 / 160.77 ms │     no change │
│ QQuery 61 │        179.79 / 181.54 ±0.98 / 182.48 ms │        182.07 / 183.74 ±1.56 / 186.65 ms │     no change │
│ QQuery 62 │       882.34 / 917.01 ±35.18 / 975.03 ms │      904.20 / 959.24 ±42.21 / 1010.38 ms │     no change │
│ QQuery 63 │        111.46 / 112.88 ±1.10 / 114.79 ms │        110.92 / 113.56 ±2.68 / 118.32 ms │     no change │
│ QQuery 64 │        720.47 / 727.03 ±5.19 / 734.76 ms │        723.87 / 726.20 ±2.41 / 730.69 ms │     no change │
│ QQuery 65 │        260.38 / 265.80 ±3.48 / 271.02 ms │        265.19 / 267.95 ±1.58 / 269.50 ms │     no change │
│ QQuery 66 │        258.74 / 268.19 ±7.46 / 278.55 ms │        266.22 / 279.91 ±7.61 / 287.29 ms │     no change │
│ QQuery 67 │        343.60 / 352.01 ±6.96 / 362.36 ms │        342.84 / 349.40 ±4.78 / 354.08 ms │     no change │
│ QQuery 68 │        297.27 / 300.75 ±3.45 / 307.11 ms │        288.26 / 294.12 ±5.13 / 302.56 ms │     no change │
│ QQuery 69 │        115.06 / 118.02 ±1.64 / 119.88 ms │        115.00 / 116.78 ±1.47 / 119.16 ms │     no change │
│ QQuery 70 │       350.03 / 365.88 ±15.88 / 393.54 ms │       352.65 / 373.45 ±18.91 / 407.06 ms │     no change │
│ QQuery 71 │        140.93 / 145.69 ±4.40 / 153.99 ms │        142.05 / 144.60 ±2.67 / 149.34 ms │     no change │
│ QQuery 72 │        734.16 / 745.27 ±9.12 / 755.92 ms │        718.03 / 734.09 ±9.68 / 745.83 ms │     no change │
│ QQuery 73 │        109.69 / 112.71 ±1.61 / 114.44 ms │        108.22 / 110.83 ±1.58 / 112.88 ms │     no change │
│ QQuery 74 │        649.85 / 656.92 ±5.84 / 665.93 ms │        603.68 / 609.94 ±3.80 / 613.03 ms │ +1.08x faster │
│ QQuery 75 │        294.40 / 299.27 ±3.12 / 302.64 ms │        300.34 / 301.99 ±1.65 / 305.04 ms │     no change │
│ QQuery 76 │        138.79 / 140.12 ±1.51 / 142.51 ms │        138.84 / 140.13 ±1.03 / 141.47 ms │     no change │
│ QQuery 77 │        204.94 / 206.40 ±2.14 / 210.66 ms │        204.29 / 206.40 ±1.75 / 209.23 ms │     no change │
│ QQuery 78 │        373.62 / 378.95 ±3.56 / 383.00 ms │        363.51 / 371.52 ±4.88 / 377.71 ms │     no change │
│ QQuery 79 │        247.31 / 249.70 ±3.28 / 255.89 ms │        241.00 / 246.88 ±4.27 / 253.79 ms │     no change │
│ QQuery 80 │        346.20 / 348.09 ±1.42 / 350.55 ms │        341.40 / 345.86 ±2.46 / 348.01 ms │     no change │
│ QQuery 81 │           31.67 / 33.36 ±1.36 / 35.75 ms │           31.48 / 32.12 ±0.59 / 33.24 ms │     no change │
│ QQuery 82 │        209.71 / 212.43 ±1.59 / 214.69 ms │        209.65 / 211.57 ±1.73 / 213.88 ms │     no change │
│ QQuery 83 │           48.55 / 50.09 ±1.54 / 52.39 ms │           46.79 / 47.97 ±1.09 / 49.73 ms │     no change │
│ QQuery 84 │           52.93 / 53.81 ±0.69 / 55.02 ms │           52.38 / 53.70 ±1.16 / 55.54 ms │     no change │
│ QQuery 85 │        154.37 / 156.10 ±1.52 / 158.74 ms │        152.43 / 155.75 ±2.10 / 159.07 ms │     no change │
│ QQuery 86 │           42.66 / 43.37 ±0.54 / 44.15 ms │           42.44 / 43.98 ±2.07 / 47.96 ms │     no change │
│ QQuery 87 │          94.96 / 98.73 ±3.70 / 105.57 ms │        102.87 / 104.50 ±1.59 / 107.51 ms │  1.06x slower │
│ QQuery 88 │        115.03 / 116.75 ±1.15 / 117.93 ms │        114.67 / 116.00 ±1.16 / 118.04 ms │     no change │
│ QQuery 89 │        126.37 / 128.05 ±1.90 / 130.52 ms │        126.62 / 128.55 ±1.25 / 130.55 ms │     no change │
│ QQuery 90 │           29.33 / 29.67 ±0.27 / 30.10 ms │           29.32 / 29.97 ±0.54 / 30.72 ms │     no change │
│ QQuery 91 │           66.15 / 68.14 ±1.03 / 69.09 ms │           67.80 / 68.87 ±0.82 / 70.30 ms │     no change │
│ QQuery 92 │           63.33 / 64.15 ±0.80 / 65.56 ms │           62.99 / 64.26 ±1.07 / 65.83 ms │     no change │
│ QQuery 93 │        198.77 / 202.78 ±3.58 / 207.96 ms │        196.49 / 198.62 ±1.54 / 199.93 ms │     no change │
│ QQuery 94 │           68.23 / 69.09 ±0.52 / 69.71 ms │           67.88 / 68.72 ±0.91 / 70.37 ms │     no change │
│ QQuery 95 │        144.67 / 148.00 ±1.72 / 149.62 ms │        142.45 / 145.02 ±1.92 / 148.06 ms │     no change │
│ QQuery 96 │           82.54 / 82.96 ±0.37 / 83.48 ms │           80.34 / 83.89 ±2.10 / 86.42 ms │     no change │
│ QQuery 97 │        133.37 / 140.11 ±4.11 / 144.18 ms │        136.76 / 140.12 ±2.04 / 142.73 ms │     no change │
│ QQuery 98 │        160.53 / 162.72 ±1.39 / 164.76 ms │        160.67 / 161.79 ±0.77 / 163.03 ms │     no change │
│ QQuery 99 │ 10759.56 / 10805.78 ±48.88 / 10881.84 ms │ 10775.31 / 10804.76 ±29.95 / 10850.54 ms │     no change │
└───────────┴──────────────────────────────────────────┴──────────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary              ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 35047.44ms │
│ Total Time (join_vectorize2)   │ 34993.79ms │
│ Average Time (HEAD)            │   354.01ms │
│ Average Time (join_vectorize2) │   353.47ms │
│ Queries Faster                 │          3 │
│ Queries Slower                 │          2 │
│ Queries with No Change         │         94 │
│ Queries with Failure           │          0 │
└────────────────────────────────┴────────────┘

Resource Usage

tpcds — base (merge-base)

Metric Value
Wall time 175.6s
Peak memory 5.5 GiB
Avg memory 4.5 GiB
CPU user 279.0s
CPU sys 21.4s
Disk read 0 B
Disk write 636.4 MiB

tpcds — branch

Metric Value
Wall time 175.3s
Peak memory 5.8 GiB
Avg memory 4.6 GiB
CPU user 276.9s
CPU sys 21.3s
Disk read 0 B
Disk write 148.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃                                  HEAD ┃                       join_vectorize2 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │          1.64 / 4.97 ±6.43 / 17.84 ms │          1.64 / 5.01 ±6.55 / 18.10 ms │     no change │
│ QQuery 1  │        15.23 / 15.91 ±0.34 / 16.10 ms │        15.53 / 15.98 ±0.28 / 16.31 ms │     no change │
│ QQuery 2  │        56.63 / 57.27 ±0.39 / 57.75 ms │        59.87 / 60.20 ±0.31 / 60.74 ms │  1.05x slower │
│ QQuery 3  │        49.24 / 50.57 ±1.06 / 51.78 ms │        49.82 / 51.93 ±1.87 / 55.09 ms │     no change │
│ QQuery 4  │     313.81 / 320.87 ±5.01 / 327.36 ms │     322.76 / 328.64 ±4.00 / 334.67 ms │     no change │
│ QQuery 5  │     360.57 / 362.69 ±1.78 / 365.79 ms │     369.45 / 371.88 ±1.31 / 373.37 ms │     no change │
│ QQuery 6  │           5.37 / 5.70 ±0.27 / 6.02 ms │           5.64 / 6.39 ±0.59 / 7.29 ms │  1.12x slower │
│ QQuery 7  │        18.70 / 21.58 ±4.22 / 29.92 ms │        18.28 / 18.67 ±0.27 / 19.06 ms │ +1.16x faster │
│ QQuery 8  │     440.65 / 452.64 ±9.07 / 463.66 ms │     450.94 / 462.53 ±9.62 / 480.22 ms │     no change │
│ QQuery 9  │     701.13 / 710.83 ±7.99 / 724.10 ms │     742.06 / 748.63 ±7.56 / 761.37 ms │  1.05x slower │
│ QQuery 10 │       96.06 / 98.59 ±2.57 / 103.32 ms │      97.36 / 101.03 ±5.40 / 111.72 ms │     no change │
│ QQuery 11 │     110.31 / 111.85 ±0.91 / 113.17 ms │     110.27 / 112.63 ±2.38 / 115.74 ms │     no change │
│ QQuery 12 │     357.57 / 365.59 ±7.55 / 375.05 ms │     356.58 / 364.46 ±4.33 / 368.67 ms │     no change │
│ QQuery 13 │     468.79 / 473.87 ±3.26 / 477.75 ms │    474.24 / 492.06 ±13.27 / 510.11 ms │     no change │
│ QQuery 14 │     363.80 / 370.45 ±5.57 / 377.29 ms │     373.71 / 377.10 ±1.99 / 379.71 ms │     no change │
│ QQuery 15 │    384.08 / 394.83 ±12.12 / 416.76 ms │    385.60 / 411.84 ±26.63 / 456.09 ms │     no change │
│ QQuery 16 │    783.72 / 797.60 ±11.49 / 814.88 ms │    777.31 / 804.57 ±25.86 / 852.10 ms │     no change │
│ QQuery 17 │     758.31 / 770.48 ±7.41 / 776.90 ms │     765.69 / 770.15 ±4.17 / 777.24 ms │     no change │
│ QQuery 18 │ 1479.46 / 1527.05 ±38.75 / 1587.97 ms │  1548.51 / 1553.57 ±3.39 / 1557.48 ms │     no change │
│ QQuery 19 │        37.38 / 39.29 ±1.38 / 41.35 ms │        36.70 / 37.51 ±1.04 / 39.53 ms │     no change │
│ QQuery 20 │    713.50 / 729.48 ±13.60 / 747.40 ms │    711.32 / 725.97 ±17.10 / 758.16 ms │     no change │
│ QQuery 21 │     763.45 / 766.71 ±3.19 / 772.82 ms │     759.74 / 765.39 ±3.89 / 771.62 ms │     no change │
│ QQuery 22 │ 1141.78 / 1150.03 ±10.04 / 1169.70 ms │  1133.90 / 1141.00 ±4.87 / 1148.70 ms │     no change │
│ QQuery 23 │ 3241.21 / 3271.01 ±17.74 / 3290.11 ms │ 3205.07 / 3230.92 ±19.52 / 3262.49 ms │     no change │
│ QQuery 24 │     104.46 / 106.76 ±1.80 / 109.48 ms │     103.62 / 108.68 ±3.61 / 114.72 ms │     no change │
│ QQuery 25 │     140.86 / 143.20 ±1.57 / 145.21 ms │     140.05 / 142.37 ±1.71 / 145.31 ms │     no change │
│ QQuery 26 │     105.47 / 106.70 ±0.83 / 107.67 ms │     106.02 / 107.12 ±1.15 / 109.29 ms │     no change │
│ QQuery 27 │     860.02 / 864.59 ±5.10 / 873.57 ms │     857.54 / 861.27 ±5.12 / 871.31 ms │     no change │
│ QQuery 28 │ 7762.33 / 7815.62 ±31.12 / 7843.76 ms │ 7731.76 / 7819.69 ±49.96 / 7886.14 ms │     no change │
│ QQuery 29 │     333.89 / 337.33 ±5.09 / 347.29 ms │     336.28 / 341.41 ±8.33 / 358.04 ms │     no change │
│ QQuery 30 │     375.93 / 381.78 ±5.56 / 389.22 ms │     381.44 / 388.08 ±7.36 / 401.64 ms │     no change │
│ QQuery 31 │     377.24 / 392.24 ±9.48 / 404.19 ms │     380.58 / 391.41 ±7.53 / 402.13 ms │     no change │
│ QQuery 32 │ 1106.94 / 1134.86 ±26.06 / 1173.88 ms │ 1107.78 / 1135.32 ±32.03 / 1188.17 ms │     no change │
│ QQuery 33 │ 1530.46 / 1547.37 ±13.94 / 1571.97 ms │  1547.82 / 1554.17 ±7.00 / 1567.55 ms │     no change │
│ QQuery 34 │ 1542.43 / 1559.14 ±14.63 / 1580.58 ms │ 1535.58 / 1569.20 ±18.08 / 1589.64 ms │     no change │
│ QQuery 35 │     433.02 / 439.45 ±5.39 / 446.90 ms │    429.06 / 439.30 ±10.85 / 459.64 ms │     no change │
│ QQuery 36 │     128.76 / 132.02 ±1.72 / 133.35 ms │     124.76 / 128.07 ±1.95 / 130.68 ms │     no change │
│ QQuery 37 │        53.46 / 53.69 ±0.38 / 54.44 ms │        51.83 / 53.08 ±0.75 / 53.96 ms │     no change │
│ QQuery 38 │        75.87 / 76.71 ±0.60 / 77.51 ms │        77.29 / 79.86 ±2.18 / 83.44 ms │     no change │
│ QQuery 39 │    219.99 / 234.72 ±10.92 / 247.74 ms │     227.46 / 236.21 ±5.79 / 243.64 ms │     no change │
│ QQuery 40 │        25.50 / 29.20 ±2.61 / 33.69 ms │        26.85 / 28.65 ±1.58 / 31.23 ms │     no change │
│ QQuery 41 │        21.29 / 22.74 ±1.01 / 24.12 ms │        21.66 / 23.18 ±1.43 / 25.48 ms │     no change │
│ QQuery 42 │        22.08 / 22.58 ±0.28 / 22.90 ms │        22.09 / 22.61 ±0.38 / 23.18 ms │     no change │
└───────────┴───────────────────────────────────────┴───────────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary              ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 28270.57ms │
│ Total Time (join_vectorize2)   │ 28387.76ms │
│ Average Time (HEAD)            │   657.46ms │
│ Average Time (join_vectorize2) │   660.18ms │
│ Queries Faster                 │          1 │
│ Queries Slower                 │          3 │
│ Queries with No Change         │         39 │
│ Queries with Failure           │          0 │
└────────────────────────────────┴────────────┘

Resource Usage

clickbench_partitioned — base (merge-base)

Metric Value
Wall time 142.6s
Peak memory 42.5 GiB
Avg memory 33.4 GiB
CPU user 1342.5s
CPU sys 88.6s
Disk read 0 B
Disk write 4.5 GiB

clickbench_partitioned — branch

Metric Value
Wall time 143.0s
Peak memory 38.4 GiB
Avg memory 30.2 GiB
CPU user 1342.3s
CPU sys 92.5s
Disk read 0 B
Disk write 764.0 KiB

@adriangbot
Copy link

🤖 Benchmark completed (GKE) | trigger

Details

Comparing HEAD and join_vectorize2
--------------------
Benchmark tpch_sf10.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query     ┃                               HEAD ┃                    join_vectorize2 ┃       Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1  │  380.12 / 381.48 ±0.74 / 382.37 ms │  382.41 / 383.29 ±1.03 / 384.57 ms │    no change │
│ QQuery 2  │  145.65 / 147.78 ±1.36 / 149.57 ms │  143.78 / 147.48 ±1.92 / 148.86 ms │    no change │
│ QQuery 3  │  304.81 / 308.64 ±4.95 / 318.13 ms │  309.61 / 312.92 ±3.00 / 318.11 ms │    no change │
│ QQuery 4  │  160.06 / 162.82 ±2.08 / 165.83 ms │  163.69 / 165.42 ±2.40 / 170.10 ms │    no change │
│ QQuery 5  │  442.73 / 453.28 ±6.24 / 462.33 ms │  452.19 / 458.28 ±4.30 / 463.43 ms │    no change │
│ QQuery 6  │  132.75 / 133.68 ±0.73 / 134.89 ms │  135.96 / 136.96 ±0.96 / 138.55 ms │    no change │
│ QQuery 7  │ 578.31 / 589.17 ±10.97 / 608.90 ms │  602.08 / 608.52 ±5.31 / 617.95 ms │    no change │
│ QQuery 8  │  490.98 / 498.59 ±5.96 / 506.54 ms │  500.28 / 510.56 ±7.61 / 519.59 ms │    no change │
│ QQuery 9  │  709.64 / 714.12 ±4.02 / 721.64 ms │ 727.97 / 735.56 ±10.36 / 755.97 ms │    no change │
│ QQuery 10 │  338.96 / 352.72 ±7.69 / 361.96 ms │  347.19 / 351.52 ±6.32 / 364.06 ms │    no change │
│ QQuery 11 │  113.19 / 117.94 ±5.20 / 127.06 ms │  115.87 / 119.32 ±2.61 / 123.73 ms │    no change │
│ QQuery 12 │  209.50 / 214.16 ±4.32 / 222.03 ms │  212.98 / 217.85 ±3.55 / 223.09 ms │    no change │
│ QQuery 13 │  331.45 / 341.29 ±8.33 / 352.40 ms │  325.79 / 336.05 ±9.55 / 353.16 ms │    no change │
│ QQuery 14 │  184.62 / 187.87 ±3.35 / 192.45 ms │  188.19 / 190.08 ±1.24 / 191.90 ms │    no change │
│ QQuery 15 │  339.49 / 343.47 ±2.81 / 348.31 ms │  342.23 / 346.58 ±5.43 / 357.07 ms │    no change │
│ QQuery 16 │     91.83 / 94.77 ±2.14 / 98.31 ms │     91.06 / 94.96 ±3.17 / 99.39 ms │    no change │
│ QQuery 17 │  807.51 / 819.34 ±7.08 / 826.69 ms │ 804.42 / 828.01 ±12.11 / 837.70 ms │    no change │
│ QQuery 18 │ 854.36 / 903.55 ±24.76 / 920.38 ms │ 901.09 / 956.87 ±30.37 / 985.80 ms │ 1.06x slower │
│ QQuery 19 │ 271.09 / 279.10 ±12.09 / 302.64 ms │  278.16 / 283.47 ±7.41 / 297.74 ms │    no change │
│ QQuery 20 │  329.32 / 339.41 ±5.47 / 343.80 ms │  333.79 / 348.53 ±8.71 / 358.42 ms │    no change │
│ QQuery 21 │  873.57 / 882.30 ±7.27 / 892.86 ms │  899.26 / 908.93 ±9.93 / 922.99 ms │    no change │
│ QQuery 22 │     88.51 / 89.60 ±1.16 / 91.70 ms │     92.55 / 93.49 ±0.95 / 94.79 ms │    no change │
└───────────┴────────────────────────────────────┴────────────────────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary              ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)              │ 8355.08ms │
│ Total Time (join_vectorize2)   │ 8534.66ms │
│ Average Time (HEAD)            │  379.78ms │
│ Average Time (join_vectorize2) │  387.94ms │
│ Queries Faster                 │         0 │
│ Queries Slower                 │         1 │
│ Queries with No Change         │        21 │
│ Queries with Failure           │         0 │
└────────────────────────────────┴───────────┘

Resource Usage

tpch10 — base (merge-base)

Metric Value
Wall time 42.2s
Peak memory 9.7 GiB
Avg memory 7.3 GiB
CPU user 438.9s
CPU sys 29.9s
Disk read 0 B
Disk write 2.9 GiB

tpch10 — branch

Metric Value
Wall time 43.0s
Peak memory 9.0 GiB
Avg memory 7.2 GiB
CPU user 449.4s
CPU sys 30.0s
Disk read 0 B
Disk write 80.0 KiB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

physical-plan Changes to the physical-plan crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants