Skip to content

perf[array]: small vec for slots#7825

Draft
joseph-isaacs wants to merge 6 commits intodevelopfrom
ji/smallvec-array
Draft

perf[array]: small vec for slots#7825
joseph-isaacs wants to merge 6 commits intodevelopfrom
ji/smallvec-array

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

try out small vec for arrays (either 2 or 4), here we try 4

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 7, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/benchmark Trigger full benchmarks to run on this PR and removed action/benchmark Trigger full benchmarks to run on this PR labels May 7, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 7, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 760e55e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.020x ➖


datafusion / vortex-file-compressed (1.020x ➖, 0↑ 1↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 122320933 123402731 0.99
polarsignals_q01/datafusion:vortex-file-compressed 265637388 283046410 0.94
polarsignals_q02/datafusion:vortex-file-compressed 24659250 23993648 1.03
polarsignals_q03/datafusion:vortex-file-compressed 263325736 278565420 0.95
polarsignals_q04/datafusion:vortex-file-compressed 12349792 11641773 1.06
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17865089 15208556 1.17
polarsignals_q06/datafusion:vortex-file-compressed 19530778 18512506 1.06
polarsignals_q07/datafusion:vortex-file-compressed 14646513 13742818 1.07
polarsignals_q08/datafusion:vortex-file-compressed 424019975 405949392 1.04
polarsignals_q09/datafusion:vortex-file-compressed 10882502 11756145 0.93

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 7, 2026

Merging this PR will degrade performance by 23.21%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 29 improved benchmarks
❌ 8 regressed benchmarks
✅ 1169 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation take_search[(0.005, 0.05)] 167.8 µs 131.7 µs +27.41%
Simulation take_search[(0.005, 0.1)] 320.1 µs 247.4 µs +29.42%
Simulation take_search[(0.005, 0.5)] 1.5 ms 1.2 ms +31.01%
Simulation take_search[(0.005, 1.0)] 3.1 ms 2.3 ms +31.25%
Simulation take_search[(0.01, 0.05)] 178.9 µs 142.8 µs +25.28%
Simulation take_search[(0.01, 0.1)] 340.9 µs 268.2 µs +27.11%
Simulation take_search[(0.01, 0.5)] 1.6 ms 1.3 ms +28.56%
Simulation take_search[(0.01, 1.0)] 3.3 ms 2.5 ms +28.76%
Simulation take_search[(0.1, 0.05)] 248.9 µs 212.4 µs +17.16%
Simulation take_search[(0.1, 0.1)] 458.5 µs 385.6 µs +18.89%
Simulation take_search[(0.1, 0.5)] 2.2 ms 1.8 ms +20.4%
Simulation take_search[(0.1, 1.0)] 4.3 ms 3.5 ms +20.62%
Simulation take_search_chunked[(0.005, 0.05)] 192.9 µs 162 µs +19.05%
Simulation take_search_chunked[(0.005, 0.1)] 369 µs 307.2 µs +20.12%
Simulation take_search_chunked[(0.005, 0.5)] 1.8 ms 1.5 ms +21.06%
Simulation take_search_chunked[(0.005, 1.0)] 3.5 ms 2.9 ms +21.17%
Simulation take_search_chunked[(0.01, 0.05)] 205.9 µs 175.1 µs +17.63%
Simulation take_search_chunked[(0.01, 0.1)] 393.8 µs 331.9 µs +18.65%
Simulation take_search_chunked[(0.01, 0.5)] 1.9 ms 1.6 ms +19.49%
Simulation take_search_chunked[(0.01, 1.0)] 3.8 ms 3.2 ms +19.6%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/smallvec-array (5fc8ea8) with develop (2ff9ba4)

Open in CodSpeed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +2.4%


datafusion / vortex-file-compressed (1.043x ➖, 0↑ 2↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5338925 5240437 1.02
fineweb_q01/datafusion:vortex-file-compressed 🚨 21779317 18153299 1.20
fineweb_q02/datafusion:vortex-file-compressed 22388002 22276798 1.00
fineweb_q03/datafusion:vortex-file-compressed 🚨 84651243 71841428 1.18
fineweb_q04/datafusion:vortex-file-compressed 238062298 230610117 1.03
fineweb_q05/datafusion:vortex-file-compressed 217620484 217474354 1.00
fineweb_q06/datafusion:vortex-file-compressed 56074109 52447646 1.07
fineweb_q07/datafusion:vortex-file-compressed 57349086 57760278 0.99
fineweb_q08/datafusion:vortex-file-compressed 21111088 23037662 0.92
datafusion / vortex-compact (1.042x ➖, 0↑ 2↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6597575 5822199 1.13
fineweb_q01/datafusion:vortex-compact 132648427 125015824 1.06
fineweb_q02/datafusion:vortex-compact 130298799 127370506 1.02
fineweb_q03/datafusion:vortex-compact 1055171693 1034611154 1.02
fineweb_q04/datafusion:vortex-compact 1128858584 1106650099 1.02
fineweb_q05/datafusion:vortex-compact 966347757 945434365 1.02
fineweb_q06/datafusion:vortex-compact 527949235 531718283 0.99
fineweb_q07/datafusion:vortex-compact 539058994 538985213 1.00
fineweb_q08/datafusion:vortex-compact 🚨 19605472 17522147 1.12
datafusion / parquet (1.016x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6326240 6090788 1.04
fineweb_q01/datafusion:parquet 286692567 293771590 0.98
fineweb_q02/datafusion:parquet 292251372 288715952 1.01
fineweb_q03/datafusion:parquet 293722522 281631940 1.04
fineweb_q04/datafusion:parquet 309423936 300096112 1.03
fineweb_q05/datafusion:parquet 301150064 296467213 1.02
fineweb_q06/datafusion:parquet 293247340 296636369 0.99
fineweb_q07/datafusion:parquet 288716400 282343279 1.02
fineweb_q08/datafusion:parquet 282228913 277655583 1.02
duckdb / vortex-file-compressed (1.047x ➖, 0↑ 2↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3445827 3105144 1.11
fineweb_q01/duckdb:vortex-file-compressed 22282724 22069466 1.01
fineweb_q02/duckdb:vortex-file-compressed 24991261 24101855 1.04
fineweb_q03/duckdb:vortex-file-compressed 🚨 136348959 115070826 1.18
fineweb_q04/duckdb:vortex-file-compressed 225014900 218806463 1.03
fineweb_q05/duckdb:vortex-file-compressed 211532351 212871474 0.99
fineweb_q06/duckdb:vortex-file-compressed 52754404 51946802 1.02
fineweb_q07/duckdb:vortex-file-compressed 55213995 55328220 1.00
fineweb_q08/duckdb:vortex-file-compressed 23399491 22093382 1.06
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4041318 4098618 0.99
fineweb_q01/duckdb:vortex-compact 102710757 110192498 0.93
fineweb_q02/duckdb:vortex-compact 115912268 107362806 1.08
fineweb_q03/duckdb:vortex-compact 872776500 858268788 1.02
fineweb_q04/duckdb:vortex-compact 902475625 901297491 1.00
fineweb_q05/duckdb:vortex-compact 825762692 818236412 1.01
fineweb_q06/duckdb:vortex-compact 466172971 461451428 1.01
fineweb_q07/duckdb:vortex-compact 480365035 479660440 1.00
fineweb_q08/duckdb:vortex-compact 21272239 20918249 1.02
duckdb / parquet (1.040x ➖, 0↑ 1↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32421894 31509844 1.03
fineweb_q01/duckdb:parquet 84762711 82191426 1.03
fineweb_q02/duckdb:parquet 85662289 83049048 1.03
fineweb_q03/duckdb:parquet 314442260 310001613 1.01
fineweb_q04/duckdb:parquet 443729273 438683126 1.01
fineweb_q05/duckdb:parquet 413134665 411075453 1.01
fineweb_q06/duckdb:parquet 200727807 196711053 1.02
fineweb_q07/duckdb:parquet 212642215 207643158 1.02
fineweb_q08/duckdb:parquet 🚨 34743085 28910941 1.20
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +13.3% +3.4% +9.6% +49.3% ➖ noise
0 datafusion:vortex-file-compressed +1.9% +3.4% -1.5% +51.7% ➖ noise
0 duckdb:vortex-compact -1.4% +3.4% -4.6% +96.4% ➖ noise
0 duckdb:vortex-file-compressed +11.0% +3.4% +7.3% +83.3% ➖ noise
1 datafusion:vortex-compact +6.1% +0.3% +5.8% +13.8% ➖ noise
1 datafusion:vortex-file-compressed +20.0% +0.3% +19.6% +34.2% ➖ noise
1 duckdb:vortex-compact -6.8% +0.3% -7.1% +27.2% ➖ noise
1 duckdb:vortex-file-compressed +1.0% +0.3% +0.6% +64.2% ➖ noise
2 datafusion:vortex-compact +2.3% +2.2% +0.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.5% +2.2% -1.6% +20.7% ➖ noise
2 duckdb:vortex-compact +8.0% +2.2% +5.7% +13.5% ➖ noise
2 duckdb:vortex-file-compressed +3.7% +2.2% +1.5% +23.5% ➖ noise
3 datafusion:vortex-compact +2.0% +2.9% -0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +17.8% +2.9% +14.6% +28.0% ➖ noise
3 duckdb:vortex-compact +1.7% +2.9% -1.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +18.5% +2.9% +15.2% +38.0% ➖ noise
4 datafusion:vortex-compact +2.0% +2.1% -0.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.2% +2.1% +1.1% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% +2.1% -2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.8% +2.1% +0.7% +10.0% ➖ noise
5 datafusion:vortex-compact +2.2% +1.0% +1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +1.0% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +0.9% +1.0% -0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% +1.0% -1.7% +10.0% ➖ noise
6 datafusion:vortex-compact -0.7% +0.4% -1.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.9% +0.4% +6.4% +10.0% ➖ noise
6 duckdb:vortex-compact +1.0% +0.4% +0.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.6% +0.4% +1.1% +10.0% ➖ noise
7 datafusion:vortex-compact +0.0% +2.3% -2.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.7% +2.3% -3.0% +14.6% ➖ noise
7 duckdb:vortex-compact +0.1% +2.3% -2.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.2% +2.3% -2.5% +10.0% ➖ noise
8 datafusion:vortex-compact +11.9% +10.5% +1.2% +12.7% ➖ noise
8 datafusion:vortex-file-compressed -8.4% +10.5% -17.1% +18.5% ✅ faster
8 duckdb:vortex-compact +1.7% +10.5% -8.0% +14.8% ➖ noise
8 duckdb:vortex-file-compressed +5.9% +10.5% -4.2% +48.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.886x ✅
Parquet (geomean): 0.886x ✅
Shifts: Parquet (control) -11.4% · Median polish -10.9%


datafusion / vortex-file-compressed (0.873x ✅, 18↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51789867 55420292 0.93
tpch_q02/datafusion:vortex-file-compressed 🚀 21589787 24613980 0.88
tpch_q03/datafusion:vortex-file-compressed 🚀 28556538 32466751 0.88
tpch_q04/datafusion:vortex-file-compressed 🚀 20613163 23388320 0.88
tpch_q05/datafusion:vortex-file-compressed 🚀 47493646 58272735 0.82
tpch_q06/datafusion:vortex-file-compressed 🚀 12513403 14191106 0.88
tpch_q07/datafusion:vortex-file-compressed 🚀 54930188 66237477 0.83
tpch_q08/datafusion:vortex-file-compressed 🚀 39577726 46290556 0.85
tpch_q09/datafusion:vortex-file-compressed 53547302 59480088 0.90
tpch_q10/datafusion:vortex-file-compressed 🚀 40415769 46613632 0.87
tpch_q11/datafusion:vortex-file-compressed 🚀 15912958 18657371 0.85
tpch_q12/datafusion:vortex-file-compressed 🚀 25527526 28842239 0.89
tpch_q13/datafusion:vortex-file-compressed 🚀 25121862 28990339 0.87
tpch_q14/datafusion:vortex-file-compressed 🚀 17183627 20471306 0.84
tpch_q15/datafusion:vortex-file-compressed 🚀 26832336 29842948 0.90
tpch_q16/datafusion:vortex-file-compressed 🚀 19997201 22229467 0.90
tpch_q17/datafusion:vortex-file-compressed 🚀 65573552 79998302 0.82
tpch_q18/datafusion:vortex-file-compressed 🚀 81625058 93173766 0.88
tpch_q19/datafusion:vortex-file-compressed 23411304 25649224 0.91
tpch_q20/datafusion:vortex-file-compressed 31039432 34069126 0.91
tpch_q21/datafusion:vortex-file-compressed 🚀 70355176 82634492 0.85
tpch_q22/datafusion:vortex-file-compressed 🚀 12241872 13731544 0.89
datafusion / vortex-compact (0.896x ✅, 14↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58576671 62764996 0.93
tpch_q02/datafusion:vortex-compact 25172688 27462127 0.92
tpch_q03/datafusion:vortex-compact 🚀 29593794 33304161 0.89
tpch_q04/datafusion:vortex-compact 24326771 26227697 0.93
tpch_q05/datafusion:vortex-compact 🚀 49952305 58976681 0.85
tpch_q06/datafusion:vortex-compact 15069049 15851445 0.95
tpch_q07/datafusion:vortex-compact 🚀 59386724 67592871 0.88
tpch_q08/datafusion:vortex-compact 🚀 43999623 49413589 0.89
tpch_q09/datafusion:vortex-compact 🚀 56799380 63290793 0.90
tpch_q10/datafusion:vortex-compact 🚀 46700150 52871613 0.88
tpch_q11/datafusion:vortex-compact 🚀 16289126 18929647 0.86
tpch_q12/datafusion:vortex-compact 🚀 32632359 36344195 0.90
tpch_q13/datafusion:vortex-compact 32272232 34790025 0.93
tpch_q14/datafusion:vortex-compact 20294913 22169380 0.92
tpch_q15/datafusion:vortex-compact 🚀 31872990 35853327 0.89
tpch_q16/datafusion:vortex-compact 🚀 23391624 26024243 0.90
tpch_q17/datafusion:vortex-compact 🚀 68232503 76400835 0.89
tpch_q18/datafusion:vortex-compact 85542674 93957982 0.91
tpch_q19/datafusion:vortex-compact 30891479 32785688 0.94
tpch_q20/datafusion:vortex-compact 🚀 34657354 39780385 0.87
tpch_q21/datafusion:vortex-compact 🚀 77793199 91177918 0.85
tpch_q22/datafusion:vortex-compact 🚀 12648035 14847846 0.85
datafusion / parquet (0.873x ✅, 14↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 92798334 140905780 0.66
tpch_q02/datafusion:parquet 🚀 60759404 69313314 0.88
tpch_q03/datafusion:parquet 🚀 70484032 79638122 0.89
tpch_q04/datafusion:parquet 44441264 47458651 0.94
tpch_q05/datafusion:parquet 94205140 103652591 0.91
tpch_q06/datafusion:parquet 41662892 44747529 0.93
tpch_q07/datafusion:parquet 🚀 103701233 119441030 0.87
tpch_q08/datafusion:parquet 🚀 89539083 100361025 0.89
tpch_q09/datafusion:parquet 🚀 128018286 145278383 0.88
tpch_q10/datafusion:parquet 110879800 122051372 0.91
tpch_q11/datafusion:parquet 🚀 40721020 46344706 0.88
tpch_q12/datafusion:parquet 85064299 90121375 0.94
tpch_q13/datafusion:parquet 203411800 218646983 0.93
tpch_q14/datafusion:parquet 🚀 41314979 51985148 0.79
tpch_q15/datafusion:parquet 🚀 59302661 66482930 0.89
tpch_q16/datafusion:parquet 🚀 38982738 49352812 0.79
tpch_q17/datafusion:parquet 🚀 135514840 177079279 0.77
tpch_q18/datafusion:parquet 🚀 161903701 183226016 0.88
tpch_q19/datafusion:parquet 🚀 72018487 80520776 0.89
tpch_q20/datafusion:parquet 70077501 75253898 0.93
tpch_q21/datafusion:parquet 133728255 145636541 0.92
tpch_q22/datafusion:parquet 🚀 30291146 33914136 0.89
datafusion / arrow (0.865x ✅, 14↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 50213558 57892702 0.87
tpch_q02/datafusion:arrow 18660233 19695731 0.95
tpch_q03/datafusion:arrow 🚀 29918980 34615692 0.86
tpch_q04/datafusion:arrow 🚀 26172330 30005693 0.87
tpch_q05/datafusion:arrow 83612483 81881218 1.02
tpch_q06/datafusion:arrow 20623948 22667580 0.91
tpch_q07/datafusion:arrow 102966329 113138284 0.91
tpch_q08/datafusion:arrow 🚀 41146489 53141857 0.77
tpch_q09/datafusion:arrow 🚀 63088173 82819873 0.76
tpch_q10/datafusion:arrow 🚀 44636226 54827213 0.81
tpch_q11/datafusion:arrow 8936840 9831642 0.91
tpch_q12/datafusion:arrow 🚀 52546021 60275068 0.87
tpch_q13/datafusion:arrow 46888679 49415343 0.95
tpch_q14/datafusion:arrow 🚀 21660361 25507617 0.85
tpch_q15/datafusion:arrow 🚀 42775851 51925226 0.82
tpch_q16/datafusion:arrow 19330407 20978975 0.92
tpch_q17/datafusion:arrow 🚀 66370313 84816613 0.78
tpch_q18/datafusion:arrow 🚀 136081677 156494204 0.87
tpch_q19/datafusion:arrow 🚀 34938595 45448944 0.77
tpch_q20/datafusion:arrow 🚀 33779493 41402776 0.82
tpch_q21/datafusion:arrow 🚀 148826636 174695313 0.85
tpch_q22/datafusion:arrow 17412124 18981293 0.92
duckdb / vortex-file-compressed (0.857x ✅, 21↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32009079 34170214 0.94
tpch_q02/duckdb:vortex-file-compressed 🚀 24265102 28319493 0.86
tpch_q03/duckdb:vortex-file-compressed 🚀 28566848 34358590 0.83
tpch_q04/duckdb:vortex-file-compressed 🚀 29727506 33937877 0.88
tpch_q05/duckdb:vortex-file-compressed 🚀 32307103 37244595 0.87
tpch_q06/duckdb:vortex-file-compressed 🚀 10135193 11699187 0.87
tpch_q07/duckdb:vortex-file-compressed 🚀 36220011 42028063 0.86
tpch_q08/duckdb:vortex-file-compressed 🚀 37918906 43654533 0.87
tpch_q09/duckdb:vortex-file-compressed 🚀 73638781 87789055 0.84
tpch_q10/duckdb:vortex-file-compressed 🚀 34103108 38506886 0.89
tpch_q11/duckdb:vortex-file-compressed 🚀 14245367 16883016 0.84
tpch_q12/duckdb:vortex-file-compressed 🚀 21709686 24556100 0.88
tpch_q13/duckdb:vortex-file-compressed 🚀 34354044 41026051 0.84
tpch_q14/duckdb:vortex-file-compressed 🚀 22525242 25423047 0.89
tpch_q15/duckdb:vortex-file-compressed 🚀 16420550 19793085 0.83
tpch_q16/duckdb:vortex-file-compressed 🚀 28437195 33301671 0.85
tpch_q17/duckdb:vortex-file-compressed 🚀 24626221 29187934 0.84
tpch_q18/duckdb:vortex-file-compressed 🚀 49479374 55681579 0.89
tpch_q19/duckdb:vortex-file-compressed 🚀 29041598 36507867 0.80
tpch_q20/duckdb:vortex-file-compressed 🚀 33993914 40100471 0.85
tpch_q21/duckdb:vortex-file-compressed 🚀 106382225 131732766 0.81
tpch_q22/duckdb:vortex-file-compressed 🚀 18244498 21096378 0.86
duckdb / vortex-compact (0.920x ➖, 6↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39336088 41185497 0.96
tpch_q02/duckdb:vortex-compact 🚀 35839304 42073672 0.85
tpch_q03/duckdb:vortex-compact 33919352 36898596 0.92
tpch_q04/duckdb:vortex-compact 35739706 38716894 0.92
tpch_q05/duckdb:vortex-compact 40102885 41375381 0.97
tpch_q06/duckdb:vortex-compact 15061112 16136343 0.93
tpch_q07/duckdb:vortex-compact 44407861 47050018 0.94
tpch_q08/duckdb:vortex-compact 46663684 48956810 0.95
tpch_q09/duckdb:vortex-compact 🚀 85240954 99833988 0.85
tpch_q10/duckdb:vortex-compact 40753261 45008660 0.91
tpch_q11/duckdb:vortex-compact 20464651 21144710 0.97
tpch_q12/duckdb:vortex-compact 35391231 38474609 0.92
tpch_q13/duckdb:vortex-compact 🚀 45382931 50999161 0.89
tpch_q14/duckdb:vortex-compact 31185753 31994217 0.97
tpch_q15/duckdb:vortex-compact 19933326 21534063 0.93
tpch_q16/duckdb:vortex-compact 35263702 37829575 0.93
tpch_q17/duckdb:vortex-compact 30536475 33782330 0.90
tpch_q18/duckdb:vortex-compact 51355390 55530134 0.92
tpch_q19/duckdb:vortex-compact 🚀 35835604 40335568 0.89
tpch_q20/duckdb:vortex-compact 43828439 46867007 0.94
tpch_q21/duckdb:vortex-compact 🚀 118260968 134332815 0.88
tpch_q22/duckdb:vortex-compact 🚀 20733646 23134237 0.90
duckdb / parquet (0.898x ✅, 9↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 76741773 90438159 0.85
tpch_q02/duckdb:parquet 38777873 41890263 0.93
tpch_q03/duckdb:parquet 68876478 74165270 0.93
tpch_q04/duckdb:parquet 47058299 51453552 0.91
tpch_q05/duckdb:parquet 67138340 70706687 0.95
tpch_q06/duckdb:parquet 20117061 21996005 0.91
tpch_q07/duckdb:parquet 🚀 67114021 82490139 0.81
tpch_q08/duckdb:parquet 🚀 81071059 100907209 0.80
tpch_q09/duckdb:parquet 🚀 133972067 160365813 0.84
tpch_q10/duckdb:parquet 123617054 133526680 0.93
tpch_q11/duckdb:parquet 🚀 21081765 23617910 0.89
tpch_q12/duckdb:parquet 45842266 47811718 0.96
tpch_q13/duckdb:parquet 🚀 247243484 294877694 0.84
tpch_q14/duckdb:parquet 49054874 52911751 0.93
tpch_q15/duckdb:parquet 24566362 25829388 0.95
tpch_q16/duckdb:parquet 🚀 55152122 61680015 0.89
tpch_q17/duckdb:parquet 52307741 53374086 0.98
tpch_q18/duckdb:parquet 113909890 118690334 0.96
tpch_q19/duckdb:parquet 🚀 67837208 76439365 0.89
tpch_q20/duckdb:parquet 62171065 65987987 0.94
tpch_q21/duckdb:parquet 🚀 158714236 200522257 0.79
tpch_q22/duckdb:parquet 51349298 55836761 0.92
duckdb / duckdb (0.885x ✅, 13↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16214446 17562255 0.92
tpch_q02/duckdb:duckdb 🚀 12370162 14738189 0.84
tpch_q03/duckdb:duckdb 🚀 19457647 22076571 0.88
tpch_q04/duckdb:duckdb 18969352 20730285 0.92
tpch_q05/duckdb:duckdb 🚀 19998775 22315476 0.90
tpch_q06/duckdb:duckdb 5353163 5744100 0.93
tpch_q07/duckdb:duckdb 🚀 21758269 26424499 0.82
tpch_q08/duckdb:duckdb 21030902 23209296 0.91
tpch_q09/duckdb:duckdb 🚀 54384267 67206828 0.81
tpch_q10/duckdb:duckdb 46712418 48724874 0.96
tpch_q11/duckdb:duckdb 🚀 5867629 7114298 0.82
tpch_q12/duckdb:duckdb 🚀 14284337 16462642 0.87
tpch_q13/duckdb:duckdb 39466805 42703852 0.92
tpch_q14/duckdb:duckdb 🚀 16628893 19264182 0.86
tpch_q15/duckdb:duckdb 12584790 12749155 0.99
tpch_q16/duckdb:duckdb 🚀 23131081 26914600 0.86
tpch_q17/duckdb:duckdb 🚀 13809766 15959552 0.87
tpch_q18/duckdb:duckdb 38442949 41757473 0.92
tpch_q19/duckdb:duckdb 🚀 27991580 31498641 0.89
tpch_q20/duckdb:duckdb 🚀 22120846 25424894 0.87
tpch_q21/duckdb:duckdb 🚀 55205802 67904002 0.81
tpch_q22/duckdb:duckdb 24906993 27109775 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -13.3% -25.2% +16.0% +20.6% ➖ noise
1 datafusion:vortex-compact -6.7% -25.2% +24.8% +18.9% 🚨 regression
1 datafusion:vortex-file-compressed -6.6% -25.2% +25.0% +19.6% 🚨 regression
1 duckdb:duckdb -7.7% -25.2% +23.5% +18.6% 🚨 regression
1 duckdb:vortex-compact -4.5% -25.2% +27.8% +18.4% 🚨 regression
1 duckdb:vortex-file-compressed -6.3% -25.2% +25.3% +21.1% 🚨 regression
2 datafusion:arrow -5.3% -9.9% +5.2% +14.8% ➖ noise
2 datafusion:vortex-compact -8.3% -9.9% +1.8% +14.8% ➖ noise
2 datafusion:vortex-file-compressed -12.3% -9.9% -2.6% +14.8% ➖ noise
2 duckdb:duckdb -16.1% -9.9% -6.8% +14.8% ➖ noise
2 duckdb:vortex-compact -14.8% -9.9% -5.4% +14.8% ➖ noise
2 duckdb:vortex-file-compressed -14.3% -9.9% -4.9% +14.8% ➖ noise
3 datafusion:arrow -13.6% -9.3% -4.7% +14.8% ➖ noise
3 datafusion:vortex-compact -11.1% -9.3% -2.0% +14.8% ➖ noise
3 datafusion:vortex-file-compressed -12.0% -9.3% -3.0% +14.8% ➖ noise
3 duckdb:duckdb -11.9% -9.3% -2.8% +14.8% ➖ noise
3 duckdb:vortex-compact -8.1% -9.3% +1.4% +14.8% ➖ noise
3 duckdb:vortex-file-compressed -16.9% -9.3% -8.3% +15.4% ➖ noise
4 datafusion:arrow -12.8% -7.5% -5.7% +14.8% ➖ noise
4 datafusion:vortex-compact -7.2% -7.5% +0.2% +14.8% ➖ noise
4 datafusion:vortex-file-compressed -11.9% -7.5% -4.8% +14.8% ➖ noise
4 duckdb:duckdb -8.5% -7.5% -1.1% +14.8% ➖ noise
4 duckdb:vortex-compact -7.7% -7.5% -0.3% +14.8% ➖ noise
4 duckdb:vortex-file-compressed -12.4% -7.5% -5.3% +14.8% ➖ noise
5 datafusion:arrow +2.1% -7.1% +9.9% +14.8% ➖ noise
5 datafusion:vortex-compact -15.3% -7.1% -8.8% +14.8% ➖ noise
5 datafusion:vortex-file-compressed -18.5% -7.1% -12.3% +14.8% ➖ noise
5 duckdb:duckdb -10.4% -7.1% -3.5% +14.8% ➖ noise
5 duckdb:vortex-compact -3.1% -7.1% +4.3% +14.8% ➖ noise
5 duckdb:vortex-file-compressed -13.3% -7.1% -6.6% +14.8% ➖ noise
6 datafusion:arrow -9.0% -7.7% -1.4% +14.8% ➖ noise
6 datafusion:vortex-compact -4.9% -7.7% +3.0% +14.8% ➖ noise
6 datafusion:vortex-file-compressed -11.8% -7.7% -4.4% +14.8% ➖ noise
6 duckdb:duckdb -6.8% -7.7% +1.0% +15.8% ➖ noise
6 duckdb:vortex-compact -6.7% -7.7% +1.1% +14.8% ➖ noise
6 duckdb:vortex-file-compressed -13.4% -7.7% -6.1% +14.8% ➖ noise
7 datafusion:arrow -9.0% -16.0% +8.3% +14.8% ➖ noise
7 datafusion:vortex-compact -12.1% -16.0% +4.5% +14.8% ➖ noise
7 datafusion:vortex-file-compressed -17.1% -16.0% -1.3% +14.8% ➖ noise
7 duckdb:duckdb -17.7% -16.0% -2.0% +14.8% ➖ noise
7 duckdb:vortex-compact -5.6% -16.0% +12.3% +14.8% ➖ noise
7 duckdb:vortex-file-compressed -13.8% -16.0% +2.5% +14.8% ➖ noise
8 datafusion:arrow -22.6% -15.3% -8.5% +14.8% ➖ noise
8 datafusion:vortex-compact -11.0% -15.3% +5.2% +14.8% ➖ noise
8 datafusion:vortex-file-compressed -14.5% -15.3% +1.0% +14.8% ➖ noise
8 duckdb:duckdb -9.4% -15.3% +7.0% +14.8% ➖ noise
8 duckdb:vortex-compact -4.7% -15.3% +12.6% +14.8% ➖ noise
8 duckdb:vortex-file-compressed -13.1% -15.3% +2.6% +14.8% ➖ noise
9 datafusion:arrow -23.8% -14.2% -11.2% +14.8% ➖ noise
9 datafusion:vortex-compact -10.3% -14.2% +4.6% +14.8% ➖ noise
9 datafusion:vortex-file-compressed -10.0% -14.2% +4.9% +14.8% ➖ noise
9 duckdb:duckdb -19.1% -14.2% -5.7% +14.8% ➖ noise
9 duckdb:vortex-compact -14.6% -14.2% -0.5% +14.8% ➖ noise
9 duckdb:vortex-file-compressed -16.1% -14.2% -2.2% +14.8% ➖ noise
10 datafusion:arrow -18.6% -8.3% -11.2% +14.8% ➖ noise
10 datafusion:vortex-compact -11.7% -8.3% -3.7% +14.8% ➖ noise
10 datafusion:vortex-file-compressed -13.3% -8.3% -5.5% +14.8% ➖ noise
10 duckdb:duckdb -4.1% -8.3% +4.5% +14.8% ➖ noise
10 duckdb:vortex-compact -9.5% -8.3% -1.3% +14.8% ➖ noise
10 duckdb:vortex-file-compressed -11.4% -8.3% -3.4% +14.8% ➖ noise
11 datafusion:arrow -9.1% -11.4% +2.6% +14.8% ➖ noise
11 datafusion:vortex-compact -13.9% -11.4% -2.8% +14.8% ➖ noise
11 datafusion:vortex-file-compressed -14.7% -11.4% -3.7% +14.8% ➖ noise
11 duckdb:duckdb -17.5% -11.4% -6.9% +14.8% ➖ noise
11 duckdb:vortex-compact -3.2% -11.4% +9.3% +14.8% ➖ noise
11 duckdb:vortex-file-compressed -15.6% -11.4% -4.7% +14.8% ➖ noise
12 datafusion:arrow -12.8% -4.9% -8.4% +18.3% ➖ noise
12 datafusion:vortex-compact -10.2% -4.9% -5.6% +14.8% ➖ noise
12 datafusion:vortex-file-compressed -11.5% -4.9% -7.0% +14.8% ➖ noise
12 duckdb:duckdb -13.2% -4.9% -8.8% +16.5% ➖ noise
12 duckdb:vortex-compact -8.0% -4.9% -3.3% +14.8% ➖ noise
12 duckdb:vortex-file-compressed -11.6% -4.9% -7.1% +14.8% ➖ noise
13 datafusion:arrow -5.1% -11.7% +7.4% +15.0% ➖ noise
13 datafusion:vortex-compact -7.2% -11.7% +5.0% +14.8% ➖ noise
13 datafusion:vortex-file-compressed -13.3% -11.7% -1.9% +14.8% ➖ noise
13 duckdb:duckdb -7.6% -11.7% +4.6% +14.8% ➖ noise
13 duckdb:vortex-compact -11.0% -11.7% +0.8% +14.8% ➖ noise
13 duckdb:vortex-file-compressed -16.3% -11.7% -5.2% +14.8% ➖ noise
14 datafusion:arrow -15.1% -14.2% -1.1% +14.8% ➖ noise
14 datafusion:vortex-compact -8.5% -14.2% +6.6% +14.8% ➖ noise
14 datafusion:vortex-file-compressed -16.1% -14.2% -2.2% +14.8% ➖ noise
14 duckdb:duckdb -13.7% -14.2% +0.6% +15.9% ➖ noise
14 duckdb:vortex-compact -2.5% -14.2% +13.6% +14.8% ➖ noise
14 duckdb:vortex-file-compressed -11.4% -14.2% +3.2% +15.1% ➖ noise
15 datafusion:arrow -17.6% -7.9% -10.6% +14.8% ➖ noise
15 datafusion:vortex-compact -11.1% -7.9% -3.5% +14.8% ➖ noise
15 datafusion:vortex-file-compressed -10.1% -7.9% -2.4% +14.8% ➖ noise
15 duckdb:duckdb -1.3% -7.9% +7.2% +16.2% ➖ noise
15 duckdb:vortex-compact -7.4% -7.9% +0.5% +14.8% ➖ noise
15 duckdb:vortex-file-compressed -17.0% -7.9% -9.9% +14.8% ➖ noise
16 datafusion:arrow -7.9% -16.0% +9.6% +14.8% ➖ noise
16 datafusion:vortex-compact -10.1% -16.0% +7.0% +14.8% ➖ noise
16 datafusion:vortex-file-compressed -10.0% -16.0% +7.0% +14.8% ➖ noise
16 duckdb:duckdb -14.1% -16.0% +2.3% +14.8% ➖ noise
16 duckdb:vortex-compact -6.8% -16.0% +10.9% +14.8% ➖ noise
16 duckdb:vortex-file-compressed -14.6% -16.0% +1.6% +14.8% ➖ noise
17 datafusion:arrow -21.7% -13.4% -9.6% +14.8% ➖ noise
17 datafusion:vortex-compact -10.7% -13.4% +3.1% +14.8% ➖ noise
17 datafusion:vortex-file-compressed -18.0% -13.4% -5.3% +14.8% ➖ noise
17 duckdb:duckdb -13.5% -13.4% -0.1% +14.8% ➖ noise
17 duckdb:vortex-compact -9.6% -13.4% +4.4% +14.8% ➖ noise
17 duckdb:vortex-file-compressed -15.6% -13.4% -2.6% +14.8% ➖ noise
18 datafusion:arrow -13.0% -7.9% -5.6% +14.8% ➖ noise
18 datafusion:vortex-compact -9.0% -7.9% -1.1% +14.8% ➖ noise
18 datafusion:vortex-file-compressed -12.4% -7.9% -4.9% +14.8% ➖ noise
18 duckdb:duckdb -7.9% -7.9% -0.0% +14.8% ➖ noise
18 duckdb:vortex-compact -7.5% -7.9% +0.4% +14.8% ➖ noise
18 duckdb:vortex-file-compressed -11.1% -7.9% -3.5% +14.8% ➖ noise
19 datafusion:arrow -23.1% -10.9% -13.7% +14.8% ✅ faster
19 datafusion:vortex-compact -5.8% -10.9% +5.8% +14.8% ➖ noise
19 datafusion:vortex-file-compressed -8.7% -10.9% +2.4% +14.8% ➖ noise
19 duckdb:duckdb -11.1% -10.9% -0.3% +14.8% ➖ noise
19 duckdb:vortex-compact -11.2% -10.9% -0.3% +14.8% ➖ noise
19 duckdb:vortex-file-compressed -20.5% -10.9% -10.7% +14.8% ➖ noise
20 datafusion:arrow -18.4% -6.3% -12.9% +14.8% ✅ faster
20 datafusion:vortex-compact -12.9% -6.3% -7.0% +14.8% ➖ noise
20 datafusion:vortex-file-compressed -8.9% -6.3% -2.7% +14.8% ➖ noise
20 duckdb:duckdb -13.0% -6.3% -7.1% +14.8% ➖ noise
20 duckdb:vortex-compact -6.5% -6.3% -0.2% +14.8% ➖ noise
20 duckdb:vortex-file-compressed -15.2% -6.3% -9.5% +14.8% ➖ noise
21 datafusion:arrow -14.8% -14.7% -0.1% +14.8% ➖ noise
21 datafusion:vortex-compact -14.7% -14.7% +0.1% +14.8% ➖ noise
21 datafusion:vortex-file-compressed -14.9% -14.7% -0.1% +14.8% ➖ noise
21 duckdb:duckdb -18.7% -14.7% -4.6% +14.8% ➖ noise
21 duckdb:vortex-compact -12.0% -14.7% +3.3% +14.8% ➖ noise
21 duckdb:vortex-file-compressed -19.2% -14.7% -5.3% +14.8% ➖ noise
22 datafusion:arrow -8.3% -9.4% +1.2% +14.8% ➖ noise
22 datafusion:vortex-compact -14.8% -9.4% -6.0% +14.8% ➖ noise
22 datafusion:vortex-file-compressed -10.8% -9.4% -1.6% +14.8% ➖ noise
22 duckdb:duckdb -8.1% -9.4% +1.4% +14.8% ➖ noise
22 duckdb:vortex-compact -10.4% -9.4% -1.1% +14.8% ➖ noise
22 duckdb:vortex-file-compressed -13.5% -9.4% -4.6% +14.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
File Scale Format Base HEAD Change %
lineitem_115.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
lineitem_63.vortex 100 vortex-file-compressed 148.65 MB 0 B 148.65 MB -100.0%
lineitem_104.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
lineitem_116.vortex 100 vortex-file-compressed 148.20 MB 0 B 148.20 MB -100.0%
lineitem_45.vortex 100 vortex-file-compressed 146.88 MB 0 B 146.88 MB -100.0%
lineitem_14.vortex 100 vortex-file-compressed 147.79 MB 0 B 147.79 MB -100.0%
lineitem_32.vortex 100 vortex-file-compressed 148.90 MB 0 B 148.90 MB -100.0%
lineitem_73.vortex 100 vortex-file-compressed 148.32 MB 0 B 148.32 MB -100.0%
orders_5.vortex 100 vortex-file-compressed 180.03 MB 0 B 180.03 MB -100.0%
duckdb.db 100 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
partsupp_7.vortex 100 vortex-file-compressed 191.61 MB 0 B 191.61 MB -100.0%
lineitem_84.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
part_15.vortex 100 vortex-file-compressed 28.48 MB 0 B 28.48 MB -100.0%
lineitem_16.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_43.vortex 100 vortex-file-compressed 147.84 MB 0 B 147.84 MB -100.0%
part_8.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_33.vortex 100 vortex-file-compressed 147.74 MB 0 B 147.74 MB -100.0%
partsupp_16.vortex 100 vortex-file-compressed 191.25 MB 0 B 191.25 MB -100.0%
lineitem_10.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_78.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
nation_0.vortex 100 vortex-file-compressed 10.97 KB 0 B 10.97 KB -100.0%
lineitem_3.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_30.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_110.vortex 100 vortex-file-compressed 148.41 MB 0 B 148.41 MB -100.0%
lineitem_4.vortex 100 vortex-file-compressed 147.27 MB 0 B 147.27 MB -100.0%
lineitem_98.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
lineitem_83.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
lineitem_34.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
lineitem_40.vortex 100 vortex-file-compressed 147.97 MB 0 B 147.97 MB -100.0%
lineitem_90.vortex 100 vortex-file-compressed 147.82 MB 0 B 147.82 MB -100.0%
lineitem_64.vortex 100 vortex-file-compressed 147.72 MB 0 B 147.72 MB -100.0%
lineitem_41.vortex 100 vortex-file-compressed 146.66 MB 0 B 146.66 MB -100.0%
lineitem_52.vortex 100 vortex-file-compressed 146.97 MB 0 B 146.97 MB -100.0%
partsupp_9.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
lineitem_5.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_105.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
lineitem_1.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
lineitem_35.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_97.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
lineitem_11.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_59.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_2.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
lineitem_102.vortex 100 vortex-file-compressed 148.14 MB 0 B 148.14 MB -100.0%
lineitem_81.vortex 100 vortex-file-compressed 147.75 MB 0 B 147.75 MB -100.0%
lineitem_88.vortex 100 vortex-file-compressed 148.71 MB 0 B 148.71 MB -100.0%
lineitem_108.vortex 100 vortex-file-compressed 147.29 MB 0 B 147.29 MB -100.0%
lineitem_112.vortex 100 vortex-file-compressed 147.42 MB 0 B 147.42 MB -100.0%
lineitem_114.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_49.vortex 100 vortex-file-compressed 148.47 MB 0 B 148.47 MB -100.0%
lineitem_106.vortex 100 vortex-file-compressed 148.07 MB 0 B 148.07 MB -100.0%
partsupp_12.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
partsupp_6.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
lineitem_94.vortex 100 vortex-file-compressed 148.40 MB 0 B 148.40 MB -100.0%
lineitem_18.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_79.vortex 100 vortex-file-compressed 148.43 MB 0 B 148.43 MB -100.0%
lineitem_23.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
lineitem_66.vortex 100 vortex-file-compressed 148.09 MB 0 B 148.09 MB -100.0%
partsupp_4.vortex 100 vortex-file-compressed 191.40 MB 0 B 191.40 MB -100.0%
part_11.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
lineitem_120.vortex 100 vortex-file-compressed 147.10 MB 0 B 147.10 MB -100.0%
orders_1.vortex 100 vortex-file-compressed 179.92 MB 0 B 179.92 MB -100.0%
lineitem_25.vortex 100 vortex-file-compressed 148.52 MB 0 B 148.52 MB -100.0%
orders_24.vortex 100 vortex-file-compressed 179.56 MB 0 B 179.56 MB -100.0%
lineitem_37.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
lineitem_48.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
part_12.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_15.vortex 100 vortex-file-compressed 147.63 MB 0 B 147.63 MB -100.0%
lineitem_70.vortex 100 vortex-file-compressed 147.89 MB 0 B 147.89 MB -100.0%
part_7.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_72.vortex 100 vortex-file-compressed 147.99 MB 0 B 147.99 MB -100.0%
lineitem_6.vortex 100 vortex-file-compressed 147.90 MB 0 B 147.90 MB -100.0%
orders_17.vortex 100 vortex-file-compressed 180.01 MB 0 B 180.01 MB -100.0%
lineitem_42.vortex 100 vortex-file-compressed 148.38 MB 0 B 148.38 MB -100.0%
part_2.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
supplier_0.vortex 100 vortex-file-compressed 66.71 MB 0 B 66.71 MB -100.0%
lineitem_117.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
orders_2.vortex 100 vortex-file-compressed 180.35 MB 0 B 180.35 MB -100.0%
lineitem_119.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
lineitem_65.vortex 100 vortex-file-compressed 147.57 MB 0 B 147.57 MB -100.0%
lineitem_29.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
partsupp_2.vortex 100 vortex-file-compressed 191.39 MB 0 B 191.39 MB -100.0%
lineitem_21.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
partsupp_13.vortex 100 vortex-file-compressed 191.35 MB 0 B 191.35 MB -100.0%
lineitem_75.vortex 100 vortex-file-compressed 147.88 MB 0 B 147.88 MB -100.0%
orders_22.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
lineitem_38.vortex 100 vortex-file-compressed 149.09 MB 0 B 149.09 MB -100.0%
lineitem_61.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
lineitem_85.vortex 100 vortex-file-compressed 147.92 MB 0 B 147.92 MB -100.0%
lineitem_77.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
partsupp_14.vortex 100 vortex-file-compressed 191.62 MB 0 B 191.62 MB -100.0%
lineitem_36.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
lineitem_55.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_27.vortex 100 vortex-file-compressed 148.45 MB 0 B 148.45 MB -100.0%
lineitem_19.vortex 100 vortex-file-compressed 148.77 MB 0 B 148.77 MB -100.0%
orders_21.vortex 100 vortex-file-compressed 179.89 MB 0 B 179.89 MB -100.0%
orders_27.vortex 100 vortex-file-compressed 179.78 MB 0 B 179.78 MB -100.0%
orders_16.vortex 100 vortex-file-compressed 179.88 MB 0 B 179.88 MB -100.0%
orders_14.vortex 100 vortex-file-compressed 180.18 MB 0 B 180.18 MB -100.0%
lineitem_76.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
lineitem_91.vortex 100 vortex-file-compressed 148.27 MB 0 B 148.27 MB -100.0%
orders_26.vortex 100 vortex-file-compressed 179.99 MB 0 B 179.99 MB -100.0%
orders_3.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
partsupp_3.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
partsupp_11.vortex 100 vortex-file-compressed 191.43 MB 0 B 191.43 MB -100.0%
lineitem_57.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
lineitem_71.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
orders_7.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
lineitem_8.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
lineitem_118.vortex 100 vortex-file-compressed 147.83 MB 0 B 147.83 MB -100.0%
lineitem_7.vortex 100 vortex-file-compressed 147.86 MB 0 B 147.86 MB -100.0%
lineitem_58.vortex 100 vortex-file-compressed 148.72 MB 0 B 148.72 MB -100.0%
lineitem_99.vortex 100 vortex-file-compressed 147.26 MB 0 B 147.26 MB -100.0%
orders_15.vortex 100 vortex-file-compressed 180.19 MB 0 B 180.19 MB -100.0%
orders_0.vortex 100 vortex-file-compressed 180.00 MB 0 B 180.00 MB -100.0%
lineitem_46.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
part_10.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
part_5.vortex 100 vortex-file-compressed 28.38 MB 0 B 28.38 MB -100.0%
lineitem_60.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_50.vortex 100 vortex-file-compressed 148.88 MB 0 B 148.88 MB -100.0%
lineitem_67.vortex 100 vortex-file-compressed 148.84 MB 0 B 148.84 MB -100.0%
lineitem_93.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_22.vortex 100 vortex-file-compressed 147.32 MB 0 B 147.32 MB -100.0%
lineitem_26.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
orders_23.vortex 100 vortex-file-compressed 179.94 MB 0 B 179.94 MB -100.0%
partsupp_0.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
partsupp_1.vortex 100 vortex-file-compressed 191.69 MB 0 B 191.69 MB -100.0%
orders_13.vortex 100 vortex-file-compressed 179.83 MB 0 B 179.83 MB -100.0%
lineitem_28.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
lineitem_0.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
orders_18.vortex 100 vortex-file-compressed 180.45 MB 0 B 180.45 MB -100.0%
partsupp_8.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_20.vortex 100 vortex-file-compressed 148.78 MB 0 B 148.78 MB -100.0%
lineitem_109.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
part_13.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
customer_2.vortex 100 vortex-file-compressed 261.69 MB 0 B 261.69 MB -100.0%
lineitem_62.vortex 100 vortex-file-compressed 146.94 MB 0 B 146.94 MB -100.0%
orders_25.vortex 100 vortex-file-compressed 179.82 MB 0 B 179.82 MB -100.0%
lineitem_68.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_113.vortex 100 vortex-file-compressed 147.56 MB 0 B 147.56 MB -100.0%
lineitem_101.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_51.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
orders_19.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
orders_6.vortex 100 vortex-file-compressed 179.80 MB 0 B 179.80 MB -100.0%
orders_4.vortex 100 vortex-file-compressed 180.39 MB 0 B 180.39 MB -100.0%
lineitem_89.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
partsupp_15.vortex 100 vortex-file-compressed 191.52 MB 0 B 191.52 MB -100.0%
partsupp_10.vortex 100 vortex-file-compressed 191.59 MB 0 B 191.59 MB -100.0%
orders_10.vortex 100 vortex-file-compressed 180.14 MB 0 B 180.14 MB -100.0%
lineitem_103.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
part_1.vortex 100 vortex-file-compressed 28.49 MB 0 B 28.49 MB -100.0%
lineitem_107.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
orders_8.vortex 100 vortex-file-compressed 180.21 MB 0 B 180.21 MB -100.0%
customer_1.vortex 100 vortex-file-compressed 261.77 MB 0 B 261.77 MB -100.0%
orders_20.vortex 100 vortex-file-compressed 179.85 MB 0 B 179.85 MB -100.0%
part_14.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
lineitem_80.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_12.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
partsupp_5.vortex 100 vortex-file-compressed 191.41 MB 0 B 191.41 MB -100.0%
lineitem_95.vortex 100 vortex-file-compressed 147.49 MB 0 B 147.49 MB -100.0%
lineitem_39.vortex 100 vortex-file-compressed 147.38 MB 0 B 147.38 MB -100.0%
region_0.vortex 100 vortex-file-compressed 6.13 KB 0 B 6.13 KB -100.0%
lineitem_31.vortex 100 vortex-file-compressed 148.50 MB 0 B 148.50 MB -100.0%
lineitem_47.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
customer_0.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
lineitem_92.vortex 100 vortex-file-compressed 148.08 MB 0 B 148.08 MB -100.0%
partsupp_17.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_74.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_17.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
part_6.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
part_4.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
part_9.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
part_17.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
part_3.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
orders_11.vortex 100 vortex-file-compressed 180.08 MB 0 B 180.08 MB -100.0%
lineitem_100.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_82.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
lineitem_9.vortex 100 vortex-file-compressed 148.87 MB 0 B 148.87 MB -100.0%
lineitem_69.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
orders_12.vortex 100 vortex-file-compressed 180.32 MB 0 B 180.32 MB -100.0%
part_0.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
lineitem_111.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_56.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
lineitem_86.vortex 100 vortex-file-compressed 147.62 MB 0 B 147.62 MB -100.0%
customer_3.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
partsupp_18.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
orders_9.vortex 100 vortex-file-compressed 180.11 MB 0 B 180.11 MB -100.0%
lineitem_24.vortex 100 vortex-file-compressed 147.50 MB 0 B 147.50 MB -100.0%
lineitem_13.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
part_18.vortex 100 vortex-file-compressed 28.51 MB 0 B 28.51 MB -100.0%
lineitem_87.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_96.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_54.vortex 100 vortex-file-compressed 149.12 MB 0 B 149.12 MB -100.0%
part_16.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
lineitem_53.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_44.vortex 100 vortex-file-compressed 147.91 MB 0 B 147.91 MB -100.0%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (0.0%)
  • vortex-file-compressed: 27.85 GB → 266.60 MB (-99.1%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 1.021x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +2.1%


datafusion / vortex-file-compressed (1.010x ➖, 2↑ 1↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26621045 26184859 1.02
tpcds_q02/datafusion:vortex-file-compressed 47794300 47363066 1.01
tpcds_q03/datafusion:vortex-file-compressed 16178495 15380570 1.05
tpcds_q04/datafusion:vortex-file-compressed 260554592 252270791 1.03
tpcds_q05/datafusion:vortex-file-compressed 45688019 44567191 1.03
tpcds_q06/datafusion:vortex-file-compressed 61604628 61314628 1.00
tpcds_q07/datafusion:vortex-file-compressed 41871207 43484392 0.96
tpcds_q08/datafusion:vortex-file-compressed 29890230 29570475 1.01
tpcds_q09/datafusion:vortex-file-compressed 44506174 44255662 1.01
tpcds_q10/datafusion:vortex-file-compressed 39790985 39800500 1.00
tpcds_q11/datafusion:vortex-file-compressed 132595671 134352333 0.99
tpcds_q12/datafusion:vortex-file-compressed 20508052 21068444 0.97
tpcds_q13/datafusion:vortex-file-compressed 45351171 44642682 1.02
tpcds_q14/datafusion:vortex-file-compressed 173630674 170819696 1.02
tpcds_q15/datafusion:vortex-file-compressed 28950358 28563731 1.01
tpcds_q16/datafusion:vortex-file-compressed 30126735 29155338 1.03
tpcds_q17/datafusion:vortex-file-compressed 65864979 62511079 1.05
tpcds_q18/datafusion:vortex-file-compressed 71562496 71416772 1.00
tpcds_q19/datafusion:vortex-file-compressed 22748435 22355633 1.02
tpcds_q20/datafusion:vortex-file-compressed 22497853 21430841 1.05
tpcds_q21/datafusion:vortex-file-compressed 36219630 36041133 1.00
tpcds_q22/datafusion:vortex-file-compressed 121199522 121324985 1.00
tpcds_q23/datafusion:vortex-file-compressed 160367660 155080676 1.03
tpcds_q24/datafusion:vortex-file-compressed 86498147 85186085 1.02
tpcds_q25/datafusion:vortex-file-compressed 69770680 67090293 1.04
tpcds_q26/datafusion:vortex-file-compressed 35899550 34845137 1.03
tpcds_q27/datafusion:vortex-file-compressed 110571975 105264525 1.05
tpcds_q28/datafusion:vortex-file-compressed 41729969 41473317 1.01
tpcds_q29/datafusion:vortex-file-compressed 65965928 63571071 1.04
tpcds_q30/datafusion:vortex-file-compressed 24591057 23709233 1.04
tpcds_q31/datafusion:vortex-file-compressed 76618615 72998811 1.05
tpcds_q32/datafusion:vortex-file-compressed 20755495 20404640 1.02
tpcds_q33/datafusion:vortex-file-compressed 30241887 30459910 0.99
tpcds_q34/datafusion:vortex-file-compressed 24564969 24861511 0.99
tpcds_q35/datafusion:vortex-file-compressed 47834521 46343417 1.03
tpcds_q36/datafusion:vortex-file-compressed 64292433 59046052 1.09
tpcds_q37/datafusion:vortex-file-compressed 26049532 26394049 0.99
tpcds_q38/datafusion:vortex-file-compressed 46315905 43951455 1.05
tpcds_q39/datafusion:vortex-file-compressed 109963538 106337686 1.03
tpcds_q40/datafusion:vortex-file-compressed 32266190 33302288 0.97
tpcds_q41/datafusion:vortex-file-compressed 16104658 16021316 1.01
tpcds_q42/datafusion:vortex-file-compressed 14541155 14375778 1.01
tpcds_q43/datafusion:vortex-file-compressed 19875193 18952588 1.05
tpcds_q44/datafusion:vortex-file-compressed 32056079 31739030 1.01
tpcds_q45/datafusion:vortex-file-compressed 27618796 27730970 1.00
tpcds_q46/datafusion:vortex-file-compressed 37318541 34434837 1.08
tpcds_q47/datafusion:vortex-file-compressed 138114619 134377916 1.03
tpcds_q48/datafusion:vortex-file-compressed 39324275 39587364 0.99
tpcds_q49/datafusion:vortex-file-compressed 62582165 59481757 1.05
tpcds_q50/datafusion:vortex-file-compressed 43696843 39863455 1.10
tpcds_q51/datafusion:vortex-file-compressed 90629185 90441489 1.00
tpcds_q52/datafusion:vortex-file-compressed 14811660 14778182 1.00
tpcds_q53/datafusion:vortex-file-compressed 22124523 21225039 1.04
tpcds_q54/datafusion:vortex-file-compressed 35652642 35017087 1.02
tpcds_q55/datafusion:vortex-file-compressed 14034859 14087895 1.00
tpcds_q56/datafusion:vortex-file-compressed 30377306 30635804 0.99
tpcds_q57/datafusion:vortex-file-compressed 110010887 106006920 1.04
tpcds_q58/datafusion:vortex-file-compressed 53783636 54111782 0.99
tpcds_q59/datafusion:vortex-file-compressed 57995346 57328255 1.01
tpcds_q60/datafusion:vortex-file-compressed 29850106 30011972 0.99
tpcds_q61/datafusion:vortex-file-compressed 40833318 41405247 0.99
tpcds_q62/datafusion:vortex-file-compressed 22532056 22355613 1.01
tpcds_q63/datafusion:vortex-file-compressed 🚨 23052244 20904697 1.10
tpcds_q64/datafusion:vortex-file-compressed 429423928 419425398 1.02
tpcds_q65/datafusion:vortex-file-compressed 40811715 40543854 1.01
tpcds_q66/datafusion:vortex-file-compressed 74861859 73598310 1.02
tpcds_q67/datafusion:vortex-file-compressed 146870547 158788710 0.92
tpcds_q68/datafusion:vortex-file-compressed 32995136 35461742 0.93
tpcds_q69/datafusion:vortex-file-compressed 38236456 39412513 0.97
tpcds_q70/datafusion:vortex-file-compressed 90876203 91507754 0.99
tpcds_q71/datafusion:vortex-file-compressed 24126553 24187779 1.00
tpcds_q72/datafusion:vortex-file-compressed 🚀 2193914849 2545126305 0.86
tpcds_q73/datafusion:vortex-file-compressed 23447314 22612948 1.04
tpcds_q74/datafusion:vortex-file-compressed 87002704 85794339 1.01
tpcds_q75/datafusion:vortex-file-compressed 113164631 108266446 1.05
tpcds_q76/datafusion:vortex-file-compressed 25274977 24560544 1.03
tpcds_q77/datafusion:vortex-file-compressed 40721286 41221893 0.99
tpcds_q78/datafusion:vortex-file-compressed 131305929 127581766 1.03
tpcds_q79/datafusion:vortex-file-compressed 29922015 29113901 1.03
tpcds_q80/datafusion:vortex-file-compressed 98875362 99543403 0.99
tpcds_q81/datafusion:vortex-file-compressed 25504541 24455903 1.04
tpcds_q82/datafusion:vortex-file-compressed 27817307 26176525 1.06
tpcds_q83/datafusion:vortex-file-compressed 34367806 34698976 0.99
tpcds_q84/datafusion:vortex-file-compressed 13237634 12792457 1.03
tpcds_q85/datafusion:vortex-file-compressed 100762901 99960242 1.01
tpcds_q86/datafusion:vortex-file-compressed 🚀 16206816 18323783 0.88
tpcds_q87/datafusion:vortex-file-compressed 44437196 44171781 1.01
tpcds_q88/datafusion:vortex-file-compressed 58413357 59123600 0.99
tpcds_q89/datafusion:vortex-file-compressed 24967581 25220820 0.99
tpcds_q90/datafusion:vortex-file-compressed 14946925 15251941 0.98
tpcds_q91/datafusion:vortex-file-compressed 19728625 18698970 1.06
tpcds_q92/datafusion:vortex-file-compressed 18865274 18409434 1.02
tpcds_q93/datafusion:vortex-file-compressed 35327202 34433668 1.03
tpcds_q94/datafusion:vortex-file-compressed 24218351 23415869 1.03
tpcds_q95/datafusion:vortex-file-compressed 65576462 64503761 1.02
tpcds_q96/datafusion:vortex-file-compressed 13549245 14714025 0.92
tpcds_q97/datafusion:vortex-file-compressed 32384887 33924112 0.95
tpcds_q98/datafusion:vortex-file-compressed 24463940 25006660 0.98
tpcds_q99/datafusion:vortex-file-compressed 30155062 33117146 0.91
datafusion / vortex-compact (1.020x ➖, 2↑ 2↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 27320054 25220702 1.08
tpcds_q02/datafusion:vortex-compact 55140419 54673276 1.01
tpcds_q03/datafusion:vortex-compact 20219771 19881843 1.02
tpcds_q04/datafusion:vortex-compact 308929773 305801533 1.01
tpcds_q05/datafusion:vortex-compact 51604452 48572009 1.06
tpcds_q06/datafusion:vortex-compact 61342542 61501804 1.00
tpcds_q07/datafusion:vortex-compact 53328843 54018031 0.99
tpcds_q08/datafusion:vortex-compact 36735066 35900555 1.02
tpcds_q09/datafusion:vortex-compact 62714065 61783137 1.02
tpcds_q10/datafusion:vortex-compact 52315300 52158238 1.00
tpcds_q11/datafusion:vortex-compact 159606432 163969434 0.97
tpcds_q12/datafusion:vortex-compact 24649111 23463387 1.05
tpcds_q13/datafusion:vortex-compact 98925294 92549131 1.07
tpcds_q14/datafusion:vortex-compact 201547050 201767035 1.00
tpcds_q15/datafusion:vortex-compact 32389528 32319108 1.00
tpcds_q16/datafusion:vortex-compact 34596121 32442640 1.07
tpcds_q17/datafusion:vortex-compact 75247314 74646093 1.01
tpcds_q18/datafusion:vortex-compact 81846477 81751880 1.00
tpcds_q19/datafusion:vortex-compact 30605460 30436233 1.01
tpcds_q20/datafusion:vortex-compact 27043827 26746089 1.01
tpcds_q21/datafusion:vortex-compact 41889553 40466129 1.04
tpcds_q22/datafusion:vortex-compact 129363811 130263663 0.99
tpcds_q23/datafusion:vortex-compact 166301414 165637180 1.00
tpcds_q24/datafusion:vortex-compact 100440117 98045755 1.02
tpcds_q25/datafusion:vortex-compact 85475508 80887249 1.06
tpcds_q26/datafusion:vortex-compact 47287511 45570426 1.04
tpcds_q27/datafusion:vortex-compact 131406568 122796197 1.07
tpcds_q28/datafusion:vortex-compact 81012894 82021552 0.99
tpcds_q29/datafusion:vortex-compact 77767198 74839993 1.04
tpcds_q30/datafusion:vortex-compact 28650390 28237857 1.01
tpcds_q31/datafusion:vortex-compact 103181699 98180214 1.05
tpcds_q32/datafusion:vortex-compact 26498091 25963432 1.02
tpcds_q33/datafusion:vortex-compact 37712611 36456237 1.03
tpcds_q34/datafusion:vortex-compact 32243598 32190574 1.00
tpcds_q35/datafusion:vortex-compact 52930794 54614818 0.97
tpcds_q36/datafusion:vortex-compact 79029205 75196086 1.05
tpcds_q37/datafusion:vortex-compact 40517827 40521057 1.00
tpcds_q38/datafusion:vortex-compact 55142095 54413316 1.01
tpcds_q39/datafusion:vortex-compact 116722751 113755459 1.03
tpcds_q40/datafusion:vortex-compact 38525811 36835760 1.05
tpcds_q41/datafusion:vortex-compact 18239870 18783107 0.97
tpcds_q42/datafusion:vortex-compact 18791363 18800960 1.00
tpcds_q43/datafusion:vortex-compact 24756520 25286542 0.98
tpcds_q44/datafusion:vortex-compact 48449322 48298657 1.00
tpcds_q45/datafusion:vortex-compact 32347728 31530397 1.03
tpcds_q46/datafusion:vortex-compact 46623948 44161398 1.06
tpcds_q47/datafusion:vortex-compact 153903363 155761733 0.99
tpcds_q48/datafusion:vortex-compact 73825873 74027759 1.00
tpcds_q49/datafusion:vortex-compact 71194007 71751189 0.99
tpcds_q50/datafusion:vortex-compact 49147281 47507815 1.03
tpcds_q51/datafusion:vortex-compact 99549014 98452211 1.01
tpcds_q52/datafusion:vortex-compact 19137571 19585159 0.98
tpcds_q53/datafusion:vortex-compact 28679357 28690931 1.00
tpcds_q54/datafusion:vortex-compact 41752872 42509352 0.98
tpcds_q55/datafusion:vortex-compact 18511141 18184822 1.02
tpcds_q56/datafusion:vortex-compact 37182037 35738276 1.04
tpcds_q57/datafusion:vortex-compact 123641990 124189437 1.00
tpcds_q58/datafusion:vortex-compact 62860298 65008094 0.97
tpcds_q59/datafusion:vortex-compact 70492703 71474587 0.99
tpcds_q60/datafusion:vortex-compact 36145007 36207898 1.00
tpcds_q61/datafusion:vortex-compact 58071249 54810018 1.06
tpcds_q62/datafusion:vortex-compact 🚀 25322675 28189297 0.90
tpcds_q63/datafusion:vortex-compact 29186675 27656011 1.06
tpcds_q64/datafusion:vortex-compact 469796245 460363327 1.02
tpcds_q65/datafusion:vortex-compact 58094240 54218202 1.07
tpcds_q66/datafusion:vortex-compact 79882882 78156845 1.02
tpcds_q67/datafusion:vortex-compact 160266424 156828385 1.02
tpcds_q68/datafusion:vortex-compact 45686172 45594591 1.00
tpcds_q69/datafusion:vortex-compact 48856795 47998663 1.02
tpcds_q70/datafusion:vortex-compact 102765477 102064980 1.01
tpcds_q71/datafusion:vortex-compact 31224142 29601451 1.05
tpcds_q72/datafusion:vortex-compact 2214915404 2187087602 1.01
tpcds_q73/datafusion:vortex-compact 31320157 30595923 1.02
tpcds_q74/datafusion:vortex-compact 96347454 97283424 0.99
tpcds_q75/datafusion:vortex-compact 132240518 128516935 1.03
tpcds_q76/datafusion:vortex-compact 33435305 32218388 1.04
tpcds_q77/datafusion:vortex-compact 53209088 50789360 1.05
tpcds_q78/datafusion:vortex-compact 147772534 142172406 1.04
tpcds_q79/datafusion:vortex-compact 39891910 37418384 1.07
tpcds_q80/datafusion:vortex-compact 108352691 103079221 1.05
tpcds_q81/datafusion:vortex-compact 31491217 28785019 1.09
tpcds_q82/datafusion:vortex-compact 43636358 41873102 1.04
tpcds_q83/datafusion:vortex-compact 33923463 33279801 1.02
tpcds_q84/datafusion:vortex-compact 15487004 14693237 1.05
tpcds_q85/datafusion:vortex-compact 135132133 133196840 1.01
tpcds_q86/datafusion:vortex-compact 🚨 21371129 18465182 1.16
tpcds_q87/datafusion:vortex-compact 54062546 52474149 1.03
tpcds_q88/datafusion:vortex-compact 77667667 76668605 1.01
tpcds_q89/datafusion:vortex-compact 32516992 33214712 0.98
tpcds_q90/datafusion:vortex-compact 15801097 15084695 1.05
tpcds_q91/datafusion:vortex-compact 34779878 32521029 1.07
tpcds_q92/datafusion:vortex-compact 25789220 24570045 1.05
tpcds_q93/datafusion:vortex-compact 39986976 38491776 1.04
tpcds_q94/datafusion:vortex-compact 🚨 30292007 26602722 1.14
tpcds_q95/datafusion:vortex-compact 68276828 70368773 0.97
tpcds_q96/datafusion:vortex-compact 17582074 17204457 1.02
tpcds_q97/datafusion:vortex-compact 37821217 37656074 1.00
tpcds_q98/datafusion:vortex-compact 31315781 31485226 0.99
tpcds_q99/datafusion:vortex-compact 🚀 31264201 35691777 0.88
datafusion / parquet (1.031x ➖, 0↑ 7↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚨 32432733 29102026 1.11
tpcds_q02/datafusion:parquet 42203607 41472011 1.02
tpcds_q03/datafusion:parquet 13614174 12917463 1.05
tpcds_q04/datafusion:parquet 264970292 267750019 0.99
tpcds_q05/datafusion:parquet 43283148 42392892 1.02
tpcds_q06/datafusion:parquet 61882472 58853463 1.05
tpcds_q07/datafusion:parquet 80186212 75226675 1.07
tpcds_q08/datafusion:parquet 27078184 26433246 1.02
tpcds_q09/datafusion:parquet 45965095 43396224 1.06
tpcds_q10/datafusion:parquet 74689914 72844662 1.03
tpcds_q11/datafusion:parquet 🚨 163531142 146257056 1.12
tpcds_q12/datafusion:parquet 18623248 18051889 1.03
tpcds_q13/datafusion:parquet 78128915 74484767 1.05
tpcds_q14/datafusion:parquet 163720469 161020757 1.02
tpcds_q15/datafusion:parquet 21613571 21774420 0.99
tpcds_q16/datafusion:parquet 24081655 23453190 1.03
tpcds_q17/datafusion:parquet 64214785 66116247 0.97
tpcds_q18/datafusion:parquet 115636336 116945719 0.99
tpcds_q19/datafusion:parquet 22282812 22469075 0.99
tpcds_q20/datafusion:parquet 16413892 16189241 1.01
tpcds_q21/datafusion:parquet 18929473 18311040 1.03
tpcds_q22/datafusion:parquet 159923574 150260212 1.06
tpcds_q23/datafusion:parquet 144616087 140791637 1.03
tpcds_q24/datafusion:parquet 94740303 89786137 1.06
tpcds_q25/datafusion:parquet 67812591 63424893 1.07
tpcds_q26/datafusion:parquet 67688359 64215500 1.05
tpcds_q27/datafusion:parquet 152860906 146597012 1.04
tpcds_q28/datafusion:parquet 44678723 44181859 1.01
tpcds_q29/datafusion:parquet 64509872 63406842 1.02
tpcds_q30/datafusion:parquet 34091994 33729755 1.01
tpcds_q31/datafusion:parquet 66729207 67901912 0.98
tpcds_q32/datafusion:parquet 🚨 21004989 17981919 1.17
tpcds_q33/datafusion:parquet 🚨 29699287 25405465 1.17
tpcds_q34/datafusion:parquet 21527642 21689952 0.99
tpcds_q35/datafusion:parquet 72367688 67120139 1.08
tpcds_q36/datafusion:parquet 58816649 56618659 1.04
tpcds_q37/datafusion:parquet 19309118 19281131 1.00
tpcds_q38/datafusion:parquet 43593568 41702472 1.05
tpcds_q39/datafusion:parquet 77260192 74125429 1.04
tpcds_q40/datafusion:parquet 23480996 25012091 0.94
tpcds_q41/datafusion:parquet 14120967 13382493 1.06
tpcds_q42/datafusion:parquet 11490624 11870782 0.97
tpcds_q43/datafusion:parquet 16914806 17982610 0.94
tpcds_q44/datafusion:parquet 32410350 33225179 0.98
tpcds_q45/datafusion:parquet 28366034 27461806 1.03
tpcds_q46/datafusion:parquet 32218013 32426967 0.99
tpcds_q47/datafusion:parquet 127732875 124457171 1.03
tpcds_q48/datafusion:parquet 71253708 68135873 1.05
tpcds_q49/datafusion:parquet 58981974 54537749 1.08
tpcds_q50/datafusion:parquet 46164086 43586383 1.06
tpcds_q51/datafusion:parquet 87110165 85143459 1.02
tpcds_q52/datafusion:parquet 12071422 11634359 1.04
tpcds_q53/datafusion:parquet 17702556 17324961 1.02
tpcds_q54/datafusion:parquet 34765489 33873463 1.03
tpcds_q55/datafusion:parquet 12595297 11454558 1.10
tpcds_q56/datafusion:parquet 28559711 27309406 1.05
tpcds_q57/datafusion:parquet 🚨 110043920 92473629 1.19
tpcds_q58/datafusion:parquet 50095095 48459265 1.03
tpcds_q59/datafusion:parquet 58396923 57490537 1.02
tpcds_q60/datafusion:parquet 🚨 31242850 26382804 1.18
tpcds_q61/datafusion:parquet 43212044 41683120 1.04
tpcds_q62/datafusion:parquet 🚨 24956590 22062873 1.13
tpcds_q63/datafusion:parquet 18127078 17482768 1.04
tpcds_q64/datafusion:parquet 520574335 522680850 1.00
tpcds_q65/datafusion:parquet 39599370 37215587 1.06
tpcds_q66/datafusion:parquet 68604768 66402968 1.03
tpcds_q67/datafusion:parquet 149330045 147618772 1.01
tpcds_q68/datafusion:parquet 31980132 31664690 1.01
tpcds_q69/datafusion:parquet 65525852 65521920 1.00
tpcds_q70/datafusion:parquet 85202103 87312711 0.98
tpcds_q71/datafusion:parquet 22814203 21918768 1.04
tpcds_q72/datafusion:parquet 623290630 612368749 1.02
tpcds_q73/datafusion:parquet 20498432 21176949 0.97
tpcds_q74/datafusion:parquet 86678184 83416349 1.04
tpcds_q75/datafusion:parquet 101576728 99977986 1.02
tpcds_q76/datafusion:parquet 30719620 31312535 0.98
tpcds_q77/datafusion:parquet 38084675 37974038 1.00
tpcds_q78/datafusion:parquet 119875590 112277427 1.07
tpcds_q79/datafusion:parquet 27440761 26227902 1.05
tpcds_q80/datafusion:parquet 84046844 79322851 1.06
tpcds_q81/datafusion:parquet 32304115 31230245 1.03
tpcds_q82/datafusion:parquet 20159668 19629755 1.03
tpcds_q83/datafusion:parquet 38778938 36433036 1.06
tpcds_q84/datafusion:parquet 39101845 39107973 1.00
tpcds_q85/datafusion:parquet 150193175 147377588 1.02
tpcds_q86/datafusion:parquet 16124915 15857817 1.02
tpcds_q87/datafusion:parquet 42674313 41277091 1.03
tpcds_q88/datafusion:parquet 61578032 59494580 1.04
tpcds_q89/datafusion:parquet 22047375 21253092 1.04
tpcds_q90/datafusion:parquet 14867205 15219419 0.98
tpcds_q91/datafusion:parquet 60110801 58167836 1.03
tpcds_q92/datafusion:parquet 18629527 18503965 1.01
tpcds_q93/datafusion:parquet 32603672 31927419 1.02
tpcds_q94/datafusion:parquet 20283230 20492078 0.99
tpcds_q95/datafusion:parquet 62593006 60792788 1.03
tpcds_q96/datafusion:parquet 12344074 12082869 1.02
tpcds_q97/datafusion:parquet 30378442 29937733 1.01
tpcds_q98/datafusion:parquet 21438261 21869730 0.98
tpcds_q99/datafusion:parquet 26238185 26653805 0.98
duckdb / vortex-file-compressed (1.034x ➖, 2↑ 9↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21378121 20845146 1.03
tpcds_q02/duckdb:vortex-file-compressed 37721801 34815397 1.08
tpcds_q03/duckdb:vortex-file-compressed 32684564 31888918 1.02
tpcds_q04/duckdb:vortex-file-compressed 104573126 108058616 0.97
tpcds_q05/duckdb:vortex-file-compressed 36396223 35833766 1.02
tpcds_q06/duckdb:vortex-file-compressed 32694685 31784682 1.03
tpcds_q07/duckdb:vortex-file-compressed 20132234 19404502 1.04
tpcds_q08/duckdb:vortex-file-compressed 28434673 27155907 1.05
tpcds_q09/duckdb:vortex-file-compressed 37406915 36740007 1.02
tpcds_q10/duckdb:vortex-file-compressed 41195791 40939172 1.01
tpcds_q11/duckdb:vortex-file-compressed 64920433 60529775 1.07
tpcds_q12/duckdb:vortex-file-compressed 14170588 13694891 1.03
tpcds_q13/duckdb:vortex-file-compressed 34218874 32469219 1.05
tpcds_q14/duckdb:vortex-file-compressed 105098628 102231277 1.03
tpcds_q15/duckdb:vortex-file-compressed 27259264 26214342 1.04
tpcds_q16/duckdb:vortex-file-compressed 27721639 26872111 1.03
tpcds_q17/duckdb:vortex-file-compressed 44069670 41866170 1.05
tpcds_q18/duckdb:vortex-file-compressed 48120093 46137175 1.04
tpcds_q19/duckdb:vortex-file-compressed 33040039 32314360 1.02
tpcds_q20/duckdb:vortex-file-compressed 15600115 15498051 1.01
tpcds_q21/duckdb:vortex-file-compressed 18071682 17105603 1.06
tpcds_q22/duckdb:vortex-file-compressed 74748229 76238254 0.98
tpcds_q23/duckdb:vortex-file-compressed 110228363 110015337 1.00
tpcds_q24/duckdb:vortex-file-compressed 49038156 48661777 1.01
tpcds_q25/duckdb:vortex-file-compressed 49420990 48318771 1.02
tpcds_q26/duckdb:vortex-file-compressed 🚨 42823350 38919765 1.10
tpcds_q27/duckdb:vortex-file-compressed 50510712 48189459 1.05
tpcds_q28/duckdb:vortex-file-compressed 35831037 34805916 1.03
tpcds_q29/duckdb:vortex-file-compressed 🚨 46216064 40501018 1.14
tpcds_q30/duckdb:vortex-file-compressed 24012157 23687442 1.01
tpcds_q31/duckdb:vortex-file-compressed 37127769 35040944 1.06
tpcds_q32/duckdb:vortex-file-compressed 🚨 15386424 13830038 1.11
tpcds_q33/duckdb:vortex-file-compressed 24956340 23182593 1.08
tpcds_q34/duckdb:vortex-file-compressed 24925990 23351945 1.07
tpcds_q35/duckdb:vortex-file-compressed 67761458 64628409 1.05
tpcds_q36/duckdb:vortex-file-compressed 25430938 23856915 1.07
tpcds_q37/duckdb:vortex-file-compressed 🚨 16523269 14730183 1.12
tpcds_q38/duckdb:vortex-file-compressed 40085448 38405194 1.04
tpcds_q39/duckdb:vortex-file-compressed 36070729 34186287 1.06
tpcds_q40/duckdb:vortex-file-compressed 🚨 21251246 19073796 1.11
tpcds_q41/duckdb:vortex-file-compressed 13645383 13266106 1.03
tpcds_q42/duckdb:vortex-file-compressed 12393810 12951506 0.96
tpcds_q43/duckdb:vortex-file-compressed 23607555 25010545 0.94
tpcds_q44/duckdb:vortex-file-compressed 22478542 20555229 1.09
tpcds_q45/duckdb:vortex-file-compressed 30765193 30297441 1.02
tpcds_q46/duckdb:vortex-file-compressed 50540004 51522109 0.98
tpcds_q47/duckdb:vortex-file-compressed 50576847 47395381 1.07
tpcds_q48/duckdb:vortex-file-compressed 31785916 29595418 1.07
tpcds_q49/duckdb:vortex-file-compressed 33792040 32882726 1.03
tpcds_q50/duckdb:vortex-file-compressed 34362392 33917667 1.01
tpcds_q51/duckdb:vortex-file-compressed 98297614 98072878 1.00
tpcds_q52/duckdb:vortex-file-compressed 12328852 13484662 0.91
tpcds_q53/duckdb:vortex-file-compressed 23566934 22236906 1.06
tpcds_q54/duckdb:vortex-file-compressed 28991768 27502028 1.05
tpcds_q55/duckdb:vortex-file-compressed 13861629 13204220 1.05
tpcds_q56/duckdb:vortex-file-compressed 23932204 24524168 0.98
tpcds_q57/duckdb:vortex-file-compressed 40164566 40227913 1.00
tpcds_q58/duckdb:vortex-file-compressed 33490981 30885791 1.08
tpcds_q59/duckdb:vortex-file-compressed 68402292 68640769 1.00
tpcds_q60/duckdb:vortex-file-compressed 25999990 26323926 0.99
tpcds_q61/duckdb:vortex-file-compressed 🚨 37747994 30425169 1.24
tpcds_q62/duckdb:vortex-file-compressed 🚨 18934313 16964440 1.12
tpcds_q63/duckdb:vortex-file-compressed 21567165 20780141 1.04
tpcds_q64/duckdb:vortex-file-compressed 83537149 85426383 0.98
tpcds_q65/duckdb:vortex-file-compressed 23623735 21728677 1.09
tpcds_q66/duckdb:vortex-file-compressed 30008994 29632284 1.01
tpcds_q67/duckdb:vortex-file-compressed 142438600 136511190 1.04
tpcds_q68/duckdb:vortex-file-compressed 43119903 41731127 1.03
tpcds_q69/duckdb:vortex-file-compressed 43541733 41248891 1.06
tpcds_q70/duckdb:vortex-file-compressed 27144629 25590079 1.06
tpcds_q71/duckdb:vortex-file-compressed 21030349 21026463 1.00
tpcds_q72/duckdb:vortex-file-compressed 176677556 172621230 1.02
tpcds_q73/duckdb:vortex-file-compressed 23095907 23789802 0.97
tpcds_q74/duckdb:vortex-file-compressed 🚀 75853685 96012399 0.79
tpcds_q75/duckdb:vortex-file-compressed 59651301 56100527 1.06
tpcds_q76/duckdb:vortex-file-compressed 19829337 18285039 1.08
tpcds_q77/duckdb:vortex-file-compressed 🚨 26956847 24048200 1.12
tpcds_q78/duckdb:vortex-file-compressed 74029801 72172277 1.03
tpcds_q79/duckdb:vortex-file-compressed 35056340 33195913 1.06
tpcds_q80/duckdb:vortex-file-compressed 49225167 51980409 0.95
tpcds_q81/duckdb:vortex-file-compressed 29735993 28132214 1.06
tpcds_q82/duckdb:vortex-file-compressed 18087139 17287262 1.05
tpcds_q83/duckdb:vortex-file-compressed 24890501 23953389 1.04
tpcds_q84/duckdb:vortex-file-compressed 21212866 19487121 1.09
tpcds_q85/duckdb:vortex-file-compressed 44674963 45578391 0.98
tpcds_q86/duckdb:vortex-file-compressed 17221837 16180048 1.06
tpcds_q87/duckdb:vortex-file-compressed 🚨 44187078 39693888 1.11
tpcds_q88/duckdb:vortex-file-compressed 34471299 33330774 1.03
tpcds_q89/duckdb:vortex-file-compressed 23785694 21681990 1.10
tpcds_q90/duckdb:vortex-file-compressed 13376600 13082891 1.02
tpcds_q91/duckdb:vortex-file-compressed 31046516 30451129 1.02
tpcds_q92/duckdb:vortex-file-compressed 🚀 22424774 25023181 0.90
tpcds_q93/duckdb:vortex-file-compressed 28683675 28511972 1.01
tpcds_q94/duckdb:vortex-file-compressed 22758206 23332548 0.98
tpcds_q95/duckdb:vortex-file-compressed 153878520 140763777 1.09
tpcds_q96/duckdb:vortex-file-compressed 13378217 13160108 1.02
tpcds_q97/duckdb:vortex-file-compressed 38602378 38870003 0.99
tpcds_q98/duckdb:vortex-file-compressed 18769624 17951528 1.05
tpcds_q99/duckdb:vortex-file-compressed 28117846 27594311 1.02
duckdb / vortex-compact (1.019x ➖, 0↑ 3↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 25400502 23030231 1.10
tpcds_q02/duckdb:vortex-compact 40107812 40125708 1.00
tpcds_q03/duckdb:vortex-compact 56691446 56522491 1.00
tpcds_q04/duckdb:vortex-compact 126922620 126940297 1.00
tpcds_q05/duckdb:vortex-compact 53726825 51741765 1.04
tpcds_q06/duckdb:vortex-compact 42842905 40064288 1.07
tpcds_q07/duckdb:vortex-compact 35816714 33854235 1.06
tpcds_q08/duckdb:vortex-compact 46707729 46052121 1.01
tpcds_q09/duckdb:vortex-compact 58037870 57228779 1.01
tpcds_q10/duckdb:vortex-compact 62841289 59790864 1.05
tpcds_q11/duckdb:vortex-compact 74602233 69121457 1.08
tpcds_q12/duckdb:vortex-compact 23744534 23676506 1.00
tpcds_q13/duckdb:vortex-compact 60352717 59775585 1.01
tpcds_q14/duckdb:vortex-compact 130818969 129674249 1.01
tpcds_q15/duckdb:vortex-compact 33268675 30891992 1.08
tpcds_q16/duckdb:vortex-compact 32752039 31881288 1.03
tpcds_q17/duckdb:vortex-compact 55455811 56403746 0.98
tpcds_q18/duckdb:vortex-compact 60649552 58138027 1.04
tpcds_q19/duckdb:vortex-compact 51621137 51702798 1.00
tpcds_q20/duckdb:vortex-compact 21698239 20227065 1.07
tpcds_q21/duckdb:vortex-compact 🚨 22451879 19586122 1.15
tpcds_q22/duckdb:vortex-compact 81495615 76756124 1.06
tpcds_q23/duckdb:vortex-compact 120034955 117431748 1.02
tpcds_q24/duckdb:vortex-compact 63285047 64944915 0.97
tpcds_q25/duckdb:vortex-compact 84845290 81971068 1.04
tpcds_q26/duckdb:vortex-compact 51687066 52393771 0.99
tpcds_q27/duckdb:vortex-compact 72308282 70769902 1.02
tpcds_q28/duckdb:vortex-compact 86260078 85929762 1.00
tpcds_q29/duckdb:vortex-compact 55511209 54594054 1.02
tpcds_q30/duckdb:vortex-compact 31344457 30222716 1.04
tpcds_q31/duckdb:vortex-compact 46586279 45547541 1.02
tpcds_q32/duckdb:vortex-compact 24674026 23503834 1.05
tpcds_q33/duckdb:vortex-compact 36755612 35808415 1.03
tpcds_q34/duckdb:vortex-compact 38700299 38653408 1.00
tpcds_q35/duckdb:vortex-compact 84014635 80865780 1.04
tpcds_q36/duckdb:vortex-compact 40921461 40505307 1.01
tpcds_q37/duckdb:vortex-compact 24991227 23285728 1.07
tpcds_q38/duckdb:vortex-compact 48191051 48677738 0.99
tpcds_q39/duckdb:vortex-compact 37913187 36690548 1.03
tpcds_q40/duckdb:vortex-compact 25436876 24641774 1.03
tpcds_q41/duckdb:vortex-compact 16616906 15566057 1.07
tpcds_q42/duckdb:vortex-compact 23427079 21977949 1.07
tpcds_q43/duckdb:vortex-compact 35628686 36980255 0.96
tpcds_q44/duckdb:vortex-compact 29689969 28980271 1.02
tpcds_q45/duckdb:vortex-compact 🚨 41649396 37829379 1.10
tpcds_q46/duckdb:vortex-compact 72891250 70841206 1.03
tpcds_q47/duckdb:vortex-compact 63584600 62007261 1.03
tpcds_q48/duckdb:vortex-compact 53112574 52535665 1.01
tpcds_q49/duckdb:vortex-compact 58763086 55110021 1.07
tpcds_q50/duckdb:vortex-compact 47104436 45805671 1.03
tpcds_q51/duckdb:vortex-compact 109641382 108603077 1.01
tpcds_q52/duckdb:vortex-compact 22192309 22185443 1.00
tpcds_q53/duckdb:vortex-compact 37812102 38504396 0.98
tpcds_q54/duckdb:vortex-compact 42139760 40643664 1.04
tpcds_q55/duckdb:vortex-compact 23322994 22189662 1.05
tpcds_q56/duckdb:vortex-compact 35801162 35008596 1.02
tpcds_q57/duckdb:vortex-compact 44226956 43783539 1.01
tpcds_q58/duckdb:vortex-compact 42725360 40987916 1.04
tpcds_q59/duckdb:vortex-compact 90505392 92856637 0.97
tpcds_q60/duckdb:vortex-compact 39229549 37902958 1.03
tpcds_q61/duckdb:vortex-compact 63535918 61468758 1.03
tpcds_q62/duckdb:vortex-compact 28438590 26078533 1.09
tpcds_q63/duckdb:vortex-compact 38941025 37653229 1.03
tpcds_q64/duckdb:vortex-compact 118021210 116965998 1.01
tpcds_q65/duckdb:vortex-compact 33080472 33194710 1.00
tpcds_q66/duckdb:vortex-compact 39765173 41297299 0.96
tpcds_q67/duckdb:vortex-compact 157662873 155582200 1.01
tpcds_q68/duckdb:vortex-compact 60248551 62197130 0.97
tpcds_q69/duckdb:vortex-compact 64329581 62740708 1.03
tpcds_q70/duckdb:vortex-compact 35826518 37448220 0.96
tpcds_q71/duckdb:vortex-compact 35630649 33819928 1.05
tpcds_q72/duckdb:vortex-compact 196322536 196687085 1.00
tpcds_q73/duckdb:vortex-compact 39180016 37759834 1.04
tpcds_q74/duckdb:vortex-compact 89949274 88359586 1.02
tpcds_q75/duckdb:vortex-compact 72489897 74586316 0.97
tpcds_q76/duckdb:vortex-compact 36453292 35038812 1.04
tpcds_q77/duckdb:vortex-compact 43072993 45256354 0.95
tpcds_q78/duckdb:vortex-compact 92487707 88801079 1.04
tpcds_q79/duckdb:vortex-compact 54842596 55107029 1.00
tpcds_q80/duckdb:vortex-compact 80252026 84349127 0.95
tpcds_q81/duckdb:vortex-compact 33387908 36771768 0.91
tpcds_q82/duckdb:vortex-compact 27381038 27097747 1.01
tpcds_q83/duckdb:vortex-compact 33293335 34469318 0.97
tpcds_q84/duckdb:vortex-compact 28484051 27749139 1.03
tpcds_q85/duckdb:vortex-compact 58843786 61139251 0.96
tpcds_q86/duckdb:vortex-compact 24323732 24421084 1.00
tpcds_q87/duckdb:vortex-compact 50115182 52117688 0.96
tpcds_q88/duckdb:vortex-compact 40858296 40046837 1.02
tpcds_q89/duckdb:vortex-compact 38973807 37955725 1.03
tpcds_q90/duckdb:vortex-compact 15445510 15391286 1.00
tpcds_q91/duckdb:vortex-compact 52563287 49578632 1.06
tpcds_q92/duckdb:vortex-compact 55053249 55814672 0.99
tpcds_q93/duckdb:vortex-compact 31464991 32023207 0.98
tpcds_q94/duckdb:vortex-compact 33013807 32547936 1.01
tpcds_q95/duckdb:vortex-compact 165109586 163665164 1.01
tpcds_q96/duckdb:vortex-compact 17929224 17708285 1.01
tpcds_q97/duckdb:vortex-compact 44153064 46720115 0.95
tpcds_q98/duckdb:vortex-compact 29141179 28204665 1.03
tpcds_q99/duckdb:vortex-compact 34326149 32015245 1.07
duckdb / parquet (1.025x ➖, 1↑ 9↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28464623 30698995 0.93
tpcds_q02/duckdb:parquet 24832135 22913492 1.08
tpcds_q03/duckdb:parquet 12043041 11270820 1.07
tpcds_q04/duckdb:parquet 167865615 169572348 0.99
tpcds_q05/duckdb:parquet 30622715 27877649 1.10
tpcds_q06/duckdb:parquet 27858069 28000137 0.99
tpcds_q07/duckdb:parquet 21122207 21961999 0.96
tpcds_q08/duckdb:parquet 26709663 26607665 1.00
tpcds_q09/duckdb:parquet 39209491 39656023 0.99
tpcds_q10/duckdb:parquet 33113480 32483571 1.02
tpcds_q11/duckdb:parquet 🚨 93618210 80089036 1.17
tpcds_q12/duckdb:parquet 15016074 13726827 1.09
tpcds_q13/duckdb:parquet 33396351 33235193 1.00
tpcds_q14/duckdb:parquet 99685565 100794133 0.99
tpcds_q15/duckdb:parquet 31199290 31341219 1.00
tpcds_q16/duckdb:parquet 22638004 22070580 1.03
tpcds_q17/duckdb:parquet 38488387 38958163 0.99
tpcds_q18/duckdb:parquet 45553553 44013343 1.03
tpcds_q19/duckdb:parquet 29380588 29179710 1.01
tpcds_q20/duckdb:parquet 15970776 15134541 1.06
tpcds_q21/duckdb:parquet 🚀 10180613 11905376 0.86
tpcds_q22/duckdb:parquet 🚨 72215718 65543421 1.10
tpcds_q23/duckdb:parquet 81460026 79334251 1.03
tpcds_q24/duckdb:parquet 49010298 44895317 1.09
tpcds_q25/duckdb:parquet 🚨 37492396 32884496 1.14
tpcds_q26/duckdb:parquet 34410522 35248845 0.98
tpcds_q27/duckdb:parquet 49717646 49247175 1.01
tpcds_q28/duckdb:parquet 37885857 37092929 1.02
tpcds_q29/duckdb:parquet 36915052 36096357 1.02
tpcds_q30/duckdb:parquet 35620127 35210179 1.01
tpcds_q31/duckdb:parquet 23113102 23670215 0.98
tpcds_q32/duckdb:parquet 11326421 11695076 0.97
tpcds_q33/duckdb:parquet 21226358 20765322 1.02
tpcds_q34/duckdb:parquet 19854957 20012420 0.99
tpcds_q35/duckdb:parquet 57899927 59448795 0.97
tpcds_q36/duckdb:parquet 20246191 19566937 1.03
tpcds_q37/duckdb:parquet 12930837 12318047 1.05
tpcds_q38/duckdb:parquet 33790366 33126456 1.02
tpcds_q39/duckdb:parquet 30069383 29470331 1.02
tpcds_q40/duckdb:parquet 🚨 19360861 16992484 1.14
tpcds_q41/duckdb:parquet 7537649 7840915 0.96
tpcds_q42/duckdb:parquet 9826083 9771885 1.01
tpcds_q43/duckdb:parquet 15335446 15040258 1.02
tpcds_q44/duckdb:parquet 21514657 23123236 0.93
tpcds_q45/duckdb:parquet 27380095 26598717 1.03
tpcds_q46/duckdb:parquet 46318966 44271020 1.05
tpcds_q47/duckdb:parquet 47665149 44533644 1.07
tpcds_q48/duckdb:parquet 30476994 29007775 1.05
tpcds_q49/duckdb:parquet 25245883 23882075 1.06
tpcds_q50/duckdb:parquet 24496175 23968575 1.02
tpcds_q51/duckdb:parquet 96203475 94067148 1.02
tpcds_q52/duckdb:parquet 🚨 11286049 10074687 1.12
tpcds_q53/duckdb:parquet 14986028 14873369 1.01
tpcds_q54/duckdb:parquet 26011133 26229523 0.99
tpcds_q55/duckdb:parquet 10149247 9870986 1.03
tpcds_q56/duckdb:parquet 21418571 20175777 1.06
tpcds_q57/duckdb:parquet 35540256 34470754 1.03
tpcds_q58/duckdb:parquet 22498750 22263986 1.01
tpcds_q59/duckdb:parquet 34487556 35360132 0.98
tpcds_q60/duckdb:parquet 21426561 21778964 0.98
tpcds_q61/duckdb:parquet 30469290 30857397 0.99
tpcds_q62/duckdb:parquet 11943899 11475532 1.04
tpcds_q63/duckdb:parquet 14166211 14040654 1.01
tpcds_q64/duckdb:parquet 73879452 75160898 0.98
tpcds_q65/duckdb:parquet 20030250 19730370 1.02
tpcds_q66/duckdb:parquet 28326905 29855593 0.95
tpcds_q67/duckdb:parquet 136822749 134761470 1.02
tpcds_q68/duckdb:parquet 37480081 36475753 1.03
tpcds_q69/duckdb:parquet 36511547 36376641 1.00
tpcds_q70/duckdb:parquet 19286789 19071171 1.01
tpcds_q71/duckdb:parquet 19566653 19785132 0.99
tpcds_q72/duckdb:parquet 167131168 165982712 1.01
tpcds_q73/duckdb:parquet 17463854 17425637 1.00
tpcds_q74/duckdb:parquet 133422024 125190095 1.07
tpcds_q75/duckdb:parquet 54211729 54357861 1.00
tpcds_q76/duckdb:parquet 19282751 19138306 1.01
tpcds_q77/duckdb:parquet 21792370 21065039 1.03
tpcds_q78/duckdb:parquet 72549764 72997867 0.99
tpcds_q79/duckdb:parquet 26881060 26517895 1.01
tpcds_q80/duckdb:parquet 41757111 39458116 1.06
tpcds_q81/duckdb:parquet 32128170 31805568 1.01
tpcds_q82/duckdb:parquet 14756112 13516675 1.09
tpcds_q83/duckdb:parquet 16796093 15569703 1.08
tpcds_q84/duckdb:parquet 19821438 18319176 1.08
tpcds_q85/duckdb:parquet 40365830 38524647 1.05
tpcds_q86/duckdb:parquet 12170417 12635743 0.96
tpcds_q87/duckdb:parquet 🚨 39576641 35670240 1.11
tpcds_q88/duckdb:parquet 49744059 48888198 1.02
tpcds_q89/duckdb:parquet 🚨 17413846 15815399 1.10
tpcds_q90/duckdb:parquet 🚨 7846150 7086006 1.11
tpcds_q91/duckdb:parquet 22585459 22745000 0.99
tpcds_q92/duckdb:parquet 11787109 12162893 0.97
tpcds_q93/duckdb:parquet 29229117 28938387 1.01
tpcds_q94/duckdb:parquet 16018989 16664537 0.96
tpcds_q95/duckdb:parquet 🚨 146980057 116072897 1.27
tpcds_q96/duckdb:parquet 9025748 8397826 1.07
tpcds_q97/duckdb:parquet 35025710 34617139 1.01
tpcds_q98/duckdb:parquet 18408984 17468083 1.05
tpcds_q99/duckdb:parquet 20852182 19800593 1.05
duckdb / duckdb (1.009x ➖, 0↑ 3↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20988215 20077743 1.05
tpcds_q02/duckdb:duckdb 18923889 18427213 1.03
tpcds_q03/duckdb:duckdb 8994322 8889866 1.01
tpcds_q04/duckdb:duckdb 169368510 180966702 0.94
tpcds_q05/duckdb:duckdb 19607352 19096637 1.03
tpcds_q06/duckdb:duckdb 23100871 23333777 0.99
tpcds_q07/duckdb:duckdb 40122011 41260848 0.97
tpcds_q08/duckdb:duckdb 122163625 122277988 1.00
tpcds_q09/duckdb:duckdb 20371337 20443281 1.00
tpcds_q10/duckdb:duckdb 24774902 25182510 0.98
tpcds_q11/duckdb:duckdb 92002716 90128133 1.02
tpcds_q12/duckdb:duckdb 11475532 11728369 0.98
tpcds_q13/duckdb:duckdb 25957991 24745371 1.05
tpcds_q14/duckdb:duckdb 92375636 93985541 0.98
tpcds_q15/duckdb:duckdb 25498582 25619523 1.00
tpcds_q16/duckdb:duckdb 17758985 19232022 0.92
tpcds_q17/duckdb:duckdb 23527427 23241724 1.01
tpcds_q18/duckdb:duckdb 44627390 46116551 0.97
tpcds_q19/duckdb:duckdb 16725120 17571319 0.95
tpcds_q20/duckdb:duckdb 12899298 12869034 1.00
tpcds_q21/duckdb:duckdb 7167060 7858777 0.91
tpcds_q22/duckdb:duckdb 62198802 64724366 0.96
tpcds_q23/duckdb:duckdb 80738347 75759956 1.07
tpcds_q24/duckdb:duckdb 25553315 25484462 1.00
tpcds_q25/duckdb:duckdb 17679161 18292614 0.97
tpcds_q26/duckdb:duckdb 28291200 28057743 1.01
tpcds_q27/duckdb:duckdb 39728581 40500750 0.98
tpcds_q28/duckdb:duckdb 22256615 21722339 1.02
tpcds_q29/duckdb:duckdb 22096665 22832703 0.97
tpcds_q30/duckdb:duckdb 27500037 30306760 0.91
tpcds_q31/duckdb:duckdb 50926272 50193056 1.01
tpcds_q32/duckdb:duckdb 8200985 8145738 1.01
tpcds_q33/duckdb:duckdb 13992429 13406085 1.04
tpcds_q34/duckdb:duckdb 17126597 16435920 1.04
tpcds_q35/duckdb:duckdb 35037748 32346786 1.08
tpcds_q36/duckdb:duckdb 74496739 73181142 1.02
tpcds_q37/duckdb:duckdb 8583806 8306207 1.03
tpcds_q38/duckdb:duckdb 32619301 32504137 1.00
tpcds_q39/duckdb:duckdb 26441741 26195091 1.01
tpcds_q40/duckdb:duckdb 14937028 14116361 1.06
tpcds_q41/duckdb:duckdb 8629374 8690640 0.99
tpcds_q42/duckdb:duckdb 6585036 7287195 0.90
tpcds_q43/duckdb:duckdb 12563153 11530185 1.09
tpcds_q44/duckdb:duckdb 14164791 13905470 1.02
tpcds_q45/duckdb:duckdb 17801355 17450765 1.02
tpcds_q46/duckdb:duckdb 37307938 38381467 0.97
tpcds_q47/duckdb:duckdb 41192803 41049233 1.00
tpcds_q48/duckdb:duckdb 24020327 22237607 1.08
tpcds_q49/duckdb:duckdb 16836766 15999778 1.05
tpcds_q50/duckdb:duckdb 16111492 14758321 1.09
tpcds_q51/duckdb:duckdb 92329880 92190615 1.00
tpcds_q52/duckdb:duckdb 7820022 7688185 1.02
tpcds_q53/duckdb:duckdb 14125640 13397495 1.05
tpcds_q54/duckdb:duckdb 17750497 17424038 1.02
tpcds_q55/duckdb:duckdb 7312047 7466064 0.98
tpcds_q56/duckdb:duckdb 13484775 14402118 0.94
tpcds_q57/duckdb:duckdb 32524855 31936813 1.02
tpcds_q58/duckdb:duckdb 13897432 13424538 1.04
tpcds_q59/duckdb:duckdb 35900801 36378953 0.99
tpcds_q60/duckdb:duckdb 15099509 15826178 0.95
tpcds_q61/duckdb:duckdb 15026138 15305449 0.98
tpcds_q62/duckdb:duckdb 9966849 10162166 0.98
tpcds_q63/duckdb:duckdb 13005829 13061819 1.00
tpcds_q64/duckdb:duckdb 54680313 57734626 0.95
tpcds_q65/duckdb:duckdb 33949457 35942325 0.94
tpcds_q66/duckdb:duckdb 27032971 25713836 1.05
tpcds_q67/duckdb:duckdb 135559284 130002038 1.04
tpcds_q68/duckdb:duckdb 26501347 25699633 1.03
tpcds_q69/duckdb:duckdb 25743028 26238563 0.98
tpcds_q70/duckdb:duckdb 15261716 14824890 1.03
tpcds_q71/duckdb:duckdb 13574916 12721974 1.07
tpcds_q72/duckdb:duckdb 44174367 42454071 1.04
tpcds_q73/duckdb:duckdb 🚨 13763535 10862066 1.27
tpcds_q74/duckdb:duckdb 147755883 145030732 1.02
tpcds_q75/duckdb:duckdb 44621275 42665149 1.05
tpcds_q76/duckdb:duckdb 11551696 12294431 0.94
tpcds_q77/duckdb:duckdb 13344759 12668886 1.05
tpcds_q78/duckdb:duckdb 64966483 64806058 1.00
tpcds_q79/duckdb:duckdb 19237159 19550345 0.98
tpcds_q80/duckdb:duckdb 28684957 29117784 0.99
tpcds_q81/duckdb:duckdb 39840732 40650328 0.98
tpcds_q82/duckdb:duckdb 8935932 9323497 0.96
tpcds_q83/duckdb:duckdb 10144718 9920589 1.02
tpcds_q84/duckdb:duckdb 14131450 14877010 0.95
tpcds_q85/duckdb:duckdb 26672867 25139719 1.06
tpcds_q86/duckdb:duckdb 🚨 12424930 11023657 1.13
tpcds_q87/duckdb:duckdb 35439087 34270505 1.03
tpcds_q88/duckdb:duckdb 26919530 26502041 1.02
tpcds_q89/duckdb:duckdb 15312667 15194557 1.01
tpcds_q90/duckdb:duckdb 5777789 5943564 0.97
tpcds_q91/duckdb:duckdb 13658704 13831262 0.99
tpcds_q92/duckdb:duckdb 9308786 9151193 1.02
tpcds_q93/duckdb:duckdb 23680890 23651386 1.00
tpcds_q94/duckdb:duckdb 13964251 12792328 1.09
tpcds_q95/duckdb:duckdb 🚨 135017616 115517355 1.17
tpcds_q96/duckdb:duckdb 4915605 4960243 0.99
tpcds_q97/duckdb:duckdb 30805137 30379621 1.01
tpcds_q98/duckdb:duckdb 13748600 13404753 1.03
tpcds_q99/duckdb:duckdb 17897715 17271477 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +8.3% +1.7% +6.6% +19.1% ➖ noise
1 datafusion:vortex-file-compressed +1.7% +1.7% +0.0% +18.9% ➖ noise
1 duckdb:duckdb +4.5% +1.7% +2.8% +23.6% ➖ noise
1 duckdb:vortex-compact +10.3% +1.7% +8.5% +21.1% ➖ noise
1 duckdb:vortex-file-compressed +2.6% +1.7% +0.9% +36.7% ➖ noise
2 datafusion:vortex-compact +0.9% +5.0% -4.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.9% +5.0% -3.9% +10.0% ➖ noise
2 duckdb:duckdb +2.7% +5.0% -2.2% +10.0% ➖ noise
2 duckdb:vortex-compact -0.0% +5.0% -4.8% +24.3% ➖ noise
2 duckdb:vortex-file-compressed +8.3% +5.0% +3.2% +32.1% ➖ noise
3 datafusion:vortex-compact +1.7% +6.1% -4.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.2% +6.1% -0.9% +10.0% ➖ noise
3 duckdb:duckdb +1.2% +6.1% -4.7% +13.4% ➖ noise
3 duckdb:vortex-compact +0.3% +6.1% -5.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.5% +6.1% -3.4% +10.0% ➖ noise
4 datafusion:vortex-compact +1.0% -1.0% +2.1% +12.3% ➖ noise
4 datafusion:vortex-file-compressed +3.3% -1.0% +4.4% +10.0% ➖ noise
4 duckdb:duckdb -6.4% -1.0% -5.4% +10.0% ➖ noise
4 duckdb:vortex-compact -0.0% -1.0% +1.0% +12.3% ➖ noise
4 duckdb:vortex-file-compressed -3.2% -1.0% -2.2% +15.0% ➖ noise
5 datafusion:vortex-compact +6.2% +5.9% +0.3% +12.5% ➖ noise
5 datafusion:vortex-file-compressed +2.5% +5.9% -3.2% +13.9% ➖ noise
5 duckdb:duckdb +2.7% +5.9% -3.0% +15.8% ➖ noise
5 duckdb:vortex-compact +3.8% +5.9% -2.0% +11.1% ➖ noise
5 duckdb:vortex-file-compressed +1.6% +5.9% -4.1% +12.7% ➖ noise
6 datafusion:vortex-compact -0.3% +2.3% -2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.5% +2.3% -1.8% +10.0% ➖ noise
6 duckdb:duckdb -1.0% +2.3% -3.2% +12.1% ➖ noise
6 duckdb:vortex-compact +6.9% +2.3% +4.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.9% +2.3% +0.6% +10.0% ➖ noise
7 datafusion:vortex-compact -1.3% +1.3% -2.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -3.7% +1.3% -4.9% +10.0% ➖ noise
7 duckdb:duckdb -2.8% +1.3% -4.0% +24.0% ➖ noise
7 duckdb:vortex-compact +5.8% +1.3% +4.5% +17.3% ➖ noise
7 duckdb:vortex-file-compressed +3.8% +1.3% +2.5% +33.7% ➖ noise
8 datafusion:vortex-compact +2.3% +1.4% +0.9% +10.6% ➖ noise
8 datafusion:vortex-file-compressed +1.1% +1.4% -0.3% +10.5% ➖ noise
8 duckdb:duckdb -0.1% +1.4% -1.5% +10.0% ➖ noise
8 duckdb:vortex-compact +1.4% +1.4% +0.0% +15.6% ➖ noise
8 duckdb:vortex-file-compressed +4.7% +1.4% +3.3% +12.6% ➖ noise
9 datafusion:vortex-compact +1.5% +2.3% -0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.6% +2.3% -1.7% +10.0% ➖ noise
9 duckdb:duckdb -0.4% +2.3% -2.6% +10.0% ➖ noise
9 duckdb:vortex-compact +1.4% +2.3% -0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.8% +2.3% -0.5% +10.0% ➖ noise
10 datafusion:vortex-compact +0.3% +2.2% -1.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.0% +2.2% -2.2% +10.7% ➖ noise
10 duckdb:duckdb -1.6% +2.2% -3.8% +10.8% ➖ noise
10 duckdb:vortex-compact +5.1% +2.2% +2.8% +11.7% ➖ noise
10 duckdb:vortex-file-compressed +0.6% +2.2% -1.6% +10.5% ➖ noise
11 datafusion:vortex-compact -2.7% +14.3% -14.9% +10.0% ✅ faster
11 datafusion:vortex-file-compressed -1.3% +14.3% -13.7% +10.0% ✅ faster
11 duckdb:duckdb +2.1% +14.3% -10.7% +10.3% ✅ faster
11 duckdb:vortex-compact +7.9% +14.3% -5.6% +10.9% ➖ noise
11 duckdb:vortex-file-compressed +7.3% +14.3% -6.2% +11.9% ➖ noise
12 datafusion:vortex-compact +5.1% +6.2% -1.1% +16.6% ➖ noise
12 datafusion:vortex-file-compressed -2.7% +6.2% -8.4% +12.5% ➖ noise
12 duckdb:duckdb -2.2% +6.2% -7.9% +18.8% ➖ noise
12 duckdb:vortex-compact +0.3% +6.2% -5.6% +12.4% ➖ noise
12 duckdb:vortex-file-compressed +3.5% +6.2% -2.6% +13.8% ➖ noise
13 datafusion:vortex-compact +6.9% +2.7% +4.1% +17.1% ➖ noise
13 datafusion:vortex-file-compressed +1.6% +2.7% -1.1% +10.0% ➖ noise
13 duckdb:duckdb +4.9% +2.7% +2.2% +10.0% ➖ noise
13 duckdb:vortex-compact +1.0% +2.7% -1.7% +15.6% ➖ noise
13 duckdb:vortex-file-compressed +5.4% +2.7% +2.7% +10.0% ➖ noise
14 datafusion:vortex-compact -0.1% +0.3% -0.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.6% +0.3% +1.4% +10.0% ➖ noise
14 duckdb:duckdb -1.7% +0.3% -2.0% +10.0% ➖ noise
14 duckdb:vortex-compact +0.9% +0.3% +0.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.8% +0.3% +2.5% +10.0% ➖ noise
15 datafusion:vortex-compact +0.2% -0.6% +0.8% +17.9% ➖ noise
15 datafusion:vortex-file-compressed +1.4% -0.6% +2.0% +10.0% ➖ noise
15 duckdb:duckdb -0.5% -0.6% +0.1% +14.9% ➖ noise
15 duckdb:vortex-compact +7.7% -0.6% +8.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +4.0% -0.6% +4.6% +10.0% ➖ noise
16 datafusion:vortex-compact +6.6% +2.6% +3.9% +12.5% ➖ noise
16 datafusion:vortex-file-compressed +3.3% +2.6% +0.7% +10.0% ➖ noise
16 duckdb:duckdb -7.7% +2.6% -10.0% +16.5% ➖ noise
16 duckdb:vortex-compact +2.7% +2.6% +0.1% +11.9% ➖ noise
16 duckdb:vortex-file-compressed +3.2% +2.6% +0.5% +10.1% ➖ noise
17 datafusion:vortex-compact +0.8% -2.0% +2.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +5.4% -2.0% +7.6% +10.0% ➖ noise
17 duckdb:duckdb +1.2% -2.0% +3.3% +10.0% ➖ noise
17 duckdb:vortex-compact -1.7% -2.0% +0.4% +11.1% ➖ noise
17 duckdb:vortex-file-compressed +5.3% -2.0% +7.5% +17.0% ➖ noise
18 datafusion:vortex-compact +0.1% +1.2% -1.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.2% +1.2% -0.9% +10.0% ➖ noise
18 duckdb:duckdb -3.2% +1.2% -4.3% +10.0% ➖ noise
18 duckdb:vortex-compact +4.3% +1.2% +3.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.3% +1.2% +3.1% +11.6% ➖ noise
19 datafusion:vortex-compact +0.6% -0.1% +0.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.8% -0.1% +1.8% +10.0% ➖ noise
19 duckdb:duckdb -4.8% -0.1% -4.7% +10.7% ➖ noise
19 duckdb:vortex-compact -0.2% -0.1% -0.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.2% -0.1% +2.3% +10.0% ➖ noise
20 datafusion:vortex-compact +1.1% +3.4% -2.2% +11.2% ➖ noise
20 datafusion:vortex-file-compressed +5.0% +3.4% +1.5% +10.0% ➖ noise
20 duckdb:duckdb +0.2% +3.4% -3.1% +11.7% ➖ noise
20 duckdb:vortex-compact +7.3% +3.4% +3.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.7% +3.4% -2.7% +10.0% ➖ noise
21 datafusion:vortex-compact +3.5% -6.0% +10.1% +12.6% ➖ noise
21 datafusion:vortex-file-compressed +0.5% -6.0% +6.9% +13.0% ➖ noise
21 duckdb:duckdb -8.8% -6.0% -3.0% +22.1% ➖ noise
21 duckdb:vortex-compact +14.6% -6.0% +21.9% +14.9% 🚨 regression
21 duckdb:vortex-file-compressed +5.6% -6.0% +12.4% +17.1% ➖ noise
22 datafusion:vortex-compact -0.7% +8.3% -8.3% +23.9% ➖ noise
22 datafusion:vortex-file-compressed -0.1% +8.3% -7.8% +30.2% ➖ noise
22 duckdb:duckdb -3.9% +8.3% -11.3% +16.5% ➖ noise
22 duckdb:vortex-compact +6.2% +8.3% -2.0% +12.7% ➖ noise
22 duckdb:vortex-file-compressed -2.0% +8.3% -9.5% +13.0% ➖ noise
23 datafusion:vortex-compact +0.4% +2.7% -2.2% +11.0% ➖ noise
23 datafusion:vortex-file-compressed +3.4% +2.7% +0.7% +10.3% ➖ noise
23 duckdb:duckdb +6.6% +2.7% +3.8% +16.1% ➖ noise
23 duckdb:vortex-compact +2.2% +2.7% -0.5% +10.6% ➖ noise
23 duckdb:vortex-file-compressed +0.2% +2.7% -2.4% +15.0% ➖ noise
24 datafusion:vortex-compact +2.4% +7.3% -4.6% +10.6% ➖ noise
24 datafusion:vortex-file-compressed +1.5% +7.3% -5.4% +10.3% ➖ noise
24 duckdb:duckdb +0.3% +7.3% -6.6% +11.2% ➖ noise
24 duckdb:vortex-compact -2.6% +7.3% -9.2% +10.7% ➖ noise
24 duckdb:vortex-file-compressed +0.8% +7.3% -6.1% +14.8% ➖ noise
25 datafusion:vortex-compact +5.7% +10.4% -4.3% +11.6% ➖ noise
25 datafusion:vortex-file-compressed +4.0% +10.4% -5.8% +10.0% ➖ noise
25 duckdb:duckdb -3.4% +10.4% -12.5% +11.1% ✅ faster
25 duckdb:vortex-compact +3.5% +10.4% -6.3% +11.5% ➖ noise
25 duckdb:vortex-file-compressed +2.3% +10.4% -7.4% +10.0% ➖ noise
26 datafusion:vortex-compact +3.8% +1.4% +2.3% +14.7% ➖ noise
26 datafusion:vortex-file-compressed +3.0% +1.4% +1.6% +14.7% ➖ noise
26 duckdb:duckdb +0.8% +1.4% -0.6% +13.3% ➖ noise
26 duckdb:vortex-compact -1.3% +1.4% -2.7% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +10.0% +1.4% +8.5% +14.2% ➖ noise
27 datafusion:vortex-compact +7.0% +2.6% +4.3% +11.2% ➖ noise
27 datafusion:vortex-file-compressed +5.0% +2.6% +2.4% +10.7% ➖ noise
27 duckdb:duckdb -1.9% +2.6% -4.4% +16.5% ➖ noise
27 duckdb:vortex-compact +2.2% +2.6% -0.4% +10.2% ➖ noise
27 duckdb:vortex-file-compressed +4.8% +2.6% +2.2% +18.1% ➖ noise
28 datafusion:vortex-compact -1.2% +1.6% -2.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.6% +1.6% -1.0% +10.0% ➖ noise
28 duckdb:duckdb +2.5% +1.6% +0.8% +10.0% ➖ noise
28 duckdb:vortex-compact +0.4% +1.6% -1.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +2.9% +1.6% +1.3% +10.0% ➖ noise
29 datafusion:vortex-compact +3.9% +2.0% +1.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.8% +2.0% +1.7% +14.9% ➖ noise
29 duckdb:duckdb -3.2% +2.0% -5.1% +42.0% ➖ noise
29 duckdb:vortex-compact +1.7% +2.0% -0.3% +12.1% ➖ noise
29 duckdb:vortex-file-compressed +14.1% +2.0% +11.9% +20.0% ➖ noise
30 datafusion:vortex-compact +1.5% +1.1% +0.3% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +3.7% +1.1% +2.6% +10.0% ➖ noise
30 duckdb:duckdb -9.3% +1.1% -10.3% +10.0% ✅ faster
30 duckdb:vortex-compact +3.7% +1.1% +2.6% +10.8% ➖ noise
30 duckdb:vortex-file-compressed +1.4% +1.1% +0.2% +10.0% ➖ noise
31 datafusion:vortex-compact +5.1% -2.0% +7.3% +11.4% ➖ noise
31 datafusion:vortex-file-compressed +5.0% -2.0% +7.1% +10.0% ➖ noise
31 duckdb:duckdb +1.5% -2.0% +3.6% +10.6% ➖ noise
31 duckdb:vortex-compact +2.3% -2.0% +4.4% +10.7% ➖ noise
31 duckdb:vortex-file-compressed +6.0% -2.0% +8.2% +16.0% ➖ noise
32 datafusion:vortex-compact +2.1% +6.4% -4.0% +13.5% ➖ noise
32 datafusion:vortex-file-compressed +1.7% +6.4% -4.4% +15.4% ➖ noise
32 duckdb:duckdb +0.7% +6.4% -5.3% +14.8% ➖ noise
32 duckdb:vortex-compact +5.0% +6.4% -1.3% +16.7% ➖ noise
32 duckdb:vortex-file-compressed +11.3% +6.4% +4.6% +12.8% ➖ noise
33 datafusion:vortex-compact +3.4% +9.3% -5.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.7% +9.3% -9.2% +10.1% ✅ faster
33 duckdb:duckdb +4.4% +9.3% -4.5% +13.4% ➖ noise
33 duckdb:vortex-compact +2.6% +9.3% -6.1% +12.5% ➖ noise
33 duckdb:vortex-file-compressed +7.7% +9.3% -1.5% +10.5% ➖ noise
34 datafusion:vortex-compact +0.2% -0.8% +0.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -1.2% -0.8% -0.4% +10.0% ➖ noise
34 duckdb:duckdb +4.2% -0.8% +5.0% +12.8% ➖ noise
34 duckdb:vortex-compact +0.1% -0.8% +0.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +6.7% -0.8% +7.6% +11.4% ➖ noise
35 datafusion:vortex-compact -3.1% +2.5% -5.4% +12.0% ➖ noise
35 datafusion:vortex-file-compressed +3.2% +2.5% +0.7% +10.0% ➖ noise
35 duckdb:duckdb +8.3% +2.5% +5.7% +17.2% ➖ noise
35 duckdb:vortex-compact +3.9% +2.5% +1.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +4.8% +2.5% +2.3% +10.0% ➖ noise
36 datafusion:vortex-compact +5.1% +3.7% +1.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +8.9% +3.7% +5.0% +10.0% ➖ noise
36 duckdb:duckdb +1.8% +3.7% -1.8% +10.0% ➖ noise
36 duckdb:vortex-compact +1.0% +3.7% -2.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +6.6% +3.7% +2.8% +10.0% ➖ noise
37 datafusion:vortex-compact -0.0% +2.5% -2.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -1.3% +2.5% -3.7% +10.0% ➖ noise
37 duckdb:duckdb +3.3% +2.5% +0.8% +18.1% ➖ noise
37 duckdb:vortex-compact +7.3% +2.5% +4.7% +12.6% ➖ noise
37 duckdb:vortex-file-compressed +12.2% +2.5% +9.4% +10.5% ➖ noise
38 datafusion:vortex-compact +1.3% +3.3% -1.9% +13.8% ➖ noise
38 datafusion:vortex-file-compressed +5.4% +3.3% +2.1% +10.4% ➖ noise
38 duckdb:duckdb +0.4% +3.3% -2.8% +16.1% ➖ noise
38 duckdb:vortex-compact -1.0% +3.3% -4.1% +18.4% ➖ noise
38 duckdb:vortex-file-compressed +4.4% +3.3% +1.1% +13.6% ➖ noise
39 datafusion:vortex-compact +2.6% +3.1% -0.5% +10.1% ➖ noise
39 datafusion:vortex-file-compressed +3.4% +3.1% +0.3% +10.0% ➖ noise
39 duckdb:duckdb +0.9% +3.1% -2.1% +17.3% ➖ noise
39 duckdb:vortex-compact +3.3% +3.1% +0.2% +14.0% ➖ noise
39 duckdb:vortex-file-compressed +5.5% +3.1% +2.3% +12.9% ➖ noise
40 datafusion:vortex-compact +4.6% +3.4% +1.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -3.1% +3.4% -6.3% +10.0% ➖ noise
40 duckdb:duckdb +5.8% +3.4% +2.3% +10.0% ➖ noise
40 duckdb:vortex-compact +3.2% +3.4% -0.2% +10.2% ➖ noise
40 duckdb:vortex-file-compressed +11.4% +3.4% +7.7% +15.6% ➖ noise
41 datafusion:vortex-compact -2.9% +0.7% -3.6% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +0.5% +0.7% -0.2% +10.0% ➖ noise
41 duckdb:duckdb -0.7% +0.7% -1.4% +10.0% ➖ noise
41 duckdb:vortex-compact +6.8% +0.7% +6.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +2.9% +0.7% +2.1% +10.0% ➖ noise
42 datafusion:vortex-compact -0.1% -1.3% +1.3% +16.5% ➖ noise
42 datafusion:vortex-file-compressed +1.2% -1.3% +2.5% +12.6% ➖ noise
42 duckdb:duckdb -9.6% -1.3% -8.4% +16.4% ➖ noise
42 duckdb:vortex-compact +6.6% -1.3% +8.0% +13.2% ➖ noise
42 duckdb:vortex-file-compressed -4.3% -1.3% -3.0% +18.2% ➖ noise
43 datafusion:vortex-compact -2.1% -2.1% -0.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +4.9% -2.1% +7.1% +14.0% ➖ noise
43 duckdb:duckdb +9.0% -2.1% +11.3% +15.6% ➖ noise
43 duckdb:vortex-compact -3.7% -2.1% -1.6% +15.7% ➖ noise
43 duckdb:vortex-file-compressed -5.6% -2.1% -3.6% +10.0% ➖ noise
44 datafusion:vortex-compact +0.3% -4.7% +5.3% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.0% -4.7% +6.0% +15.1% ➖ noise
44 duckdb:duckdb +1.9% -4.7% +6.9% +12.4% ➖ noise
44 duckdb:vortex-compact +2.4% -4.7% +7.5% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +9.4% -4.7% +14.8% +10.0% 🚨 regression
45 datafusion:vortex-compact +2.6% +3.1% -0.5% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.4% +3.1% -3.4% +10.0% ➖ noise
45 duckdb:duckdb +2.0% +3.1% -1.1% +10.0% ➖ noise
45 duckdb:vortex-compact +10.1% +3.1% +6.8% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +1.5% +3.1% -1.5% +12.0% ➖ noise
46 datafusion:vortex-compact +5.6% +2.0% +3.6% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +8.4% +2.0% +6.3% +10.0% ➖ noise
46 duckdb:duckdb -2.8% +2.0% -4.7% +10.0% ➖ noise
46 duckdb:vortex-compact +2.9% +2.0% +0.9% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -1.9% +2.0% -3.8% +10.0% ➖ noise
47 datafusion:vortex-compact -1.2% +4.8% -5.7% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +2.8% +4.8% -1.9% +10.0% ➖ noise
47 duckdb:duckdb +0.3% +4.8% -4.3% +10.0% ➖ noise
47 duckdb:vortex-compact +2.5% +4.8% -2.2% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +6.7% +4.8% +1.8% +10.0% ➖ noise
48 datafusion:vortex-compact -0.3% +4.8% -4.9% +11.8% ➖ noise
48 datafusion:vortex-file-compressed -0.7% +4.8% -5.2% +10.0% ➖ noise
48 duckdb:duckdb +8.0% +4.8% +3.0% +10.0% ➖ noise
48 duckdb:vortex-compact +1.1% +4.8% -3.6% +12.2% ➖ noise
48 duckdb:vortex-file-compressed +7.4% +4.8% +2.5% +10.0% ➖ noise
49 datafusion:vortex-compact -0.8% +6.9% -7.2% +10.6% ➖ noise
49 datafusion:vortex-file-compressed +5.2% +6.9% -1.6% +10.0% ➖ noise
49 duckdb:duckdb +5.2% +6.9% -1.6% +17.0% ➖ noise
49 duckdb:vortex-compact +6.6% +6.9% -0.3% +11.2% ➖ noise
49 duckdb:vortex-file-compressed +2.8% +6.9% -3.9% +17.7% ➖ noise
50 datafusion:vortex-compact +3.5% +4.0% -0.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +9.6% +4.0% +5.4% +10.0% ➖ noise
50 duckdb:duckdb +9.2% +4.0% +4.9% +10.8% ➖ noise
50 duckdb:vortex-compact +2.8% +4.0% -1.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +1.3% +4.0% -2.6% +10.2% ➖ noise
51 datafusion:vortex-compact +1.1% +2.3% -1.2% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +0.2% +2.3% -2.0% +10.0% ➖ noise
51 duckdb:duckdb +0.2% +2.3% -2.1% +20.6% ➖ noise
51 duckdb:vortex-compact +1.0% +2.3% -1.3% +16.4% ➖ noise
51 duckdb:vortex-file-compressed +0.2% +2.3% -2.0% +10.0% ➖ noise
52 datafusion:vortex-compact -2.3% +7.8% -9.4% +10.7% ➖ noise
52 datafusion:vortex-file-compressed +0.2% +7.8% -7.0% +12.7% ➖ noise
52 duckdb:duckdb +1.7% +7.8% -5.7% +16.0% ➖ noise
52 duckdb:vortex-compact +0.0% +7.8% -7.2% +10.2% ➖ noise
52 duckdb:vortex-file-compressed -8.6% +7.8% -15.2% +11.4% ✅ faster
53 datafusion:vortex-compact -0.0% +1.5% -1.5% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +4.2% +1.5% +2.7% +10.0% ➖ noise
53 duckdb:duckdb +5.4% +1.5% +3.9% +11.3% ➖ noise
53 duckdb:vortex-compact -1.8% +1.5% -3.2% +13.1% ➖ noise
53 duckdb:vortex-file-compressed +6.0% +1.5% +4.4% +10.0% ➖ noise
54 datafusion:vortex-compact -1.8% +0.9% -2.6% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.8% +0.9% +0.9% +10.0% ➖ noise
54 duckdb:duckdb +1.9% +0.9% +1.0% +10.9% ➖ noise
54 duckdb:vortex-compact +3.7% +0.9% +2.8% +11.6% ➖ noise
54 duckdb:vortex-file-compressed +5.4% +0.9% +4.5% +10.0% ➖ noise
55 datafusion:vortex-compact +1.8% +6.3% -4.3% +12.5% ➖ noise
55 datafusion:vortex-file-compressed -0.4% +6.3% -6.3% +11.6% ➖ noise
55 duckdb:duckdb -2.1% +6.3% -7.9% +15.7% ➖ noise
55 duckdb:vortex-compact +5.1% +6.3% -1.1% +11.6% ➖ noise
55 duckdb:vortex-file-compressed +5.0% +6.3% -1.3% +12.5% ➖ noise
56 datafusion:vortex-compact +4.0% +5.4% -1.3% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.8% +5.4% -5.9% +10.0% ➖ noise
56 duckdb:duckdb -6.4% +5.4% -11.1% +10.7% ✅ faster
56 duckdb:vortex-compact +2.3% +5.4% -2.9% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -2.4% +5.4% -7.4% +21.5% ➖ noise
57 datafusion:vortex-compact -0.4% +10.8% -10.1% +10.2% ✅ faster
57 datafusion:vortex-file-compressed +3.8% +10.8% -6.3% +10.0% ➖ noise
57 duckdb:duckdb +1.8% +10.8% -8.1% +10.0% ➖ noise
57 duckdb:vortex-compact +1.0% +10.8% -8.8% +12.0% ➖ noise
57 duckdb:vortex-file-compressed -0.2% +10.8% -9.9% +11.5% ➖ noise
58 datafusion:vortex-compact -3.3% +2.2% -5.4% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -0.6% +2.2% -2.8% +10.0% ➖ noise
58 duckdb:duckdb +3.5% +2.2% +1.3% +16.6% ➖ noise
58 duckdb:vortex-compact +4.2% +2.2% +2.0% +15.8% ➖ noise
58 duckdb:vortex-file-compressed +8.4% +2.2% +6.1% +10.0% ➖ noise
59 datafusion:vortex-compact -1.4% -0.5% -0.9% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +1.2% -0.5% +1.6% +10.0% ➖ noise
59 duckdb:duckdb -1.3% -0.5% -0.9% +10.0% ➖ noise
59 duckdb:vortex-compact -2.5% -0.5% -2.1% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.3% -0.5% +0.1% +10.0% ➖ noise
60 datafusion:vortex-compact -0.2% +7.9% -7.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -0.5% +7.9% -7.9% +10.0% ➖ noise
60 duckdb:duckdb -4.6% +7.9% -11.6% +10.6% ✅ faster
60 duckdb:vortex-compact +3.5% +7.9% -4.1% +11.9% ➖ noise
60 duckdb:vortex-file-compressed -1.2% +7.9% -8.5% +10.0% ➖ noise
61 datafusion:vortex-compact +6.0% +1.2% +4.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.4% +1.2% -2.5% +10.0% ➖ noise
61 duckdb:duckdb -1.8% +1.2% -3.0% +10.0% ➖ noise
61 duckdb:vortex-compact +3.4% +1.2% +2.2% +10.9% ➖ noise
61 duckdb:vortex-file-compressed +24.1% +1.2% +22.6% +18.1% 🚨 regression
62 datafusion:vortex-compact -10.2% +8.5% -17.2% +26.4% ➖ noise
62 datafusion:vortex-file-compressed +0.8% +8.5% -7.1% +23.3% ➖ noise
62 duckdb:duckdb -1.9% +8.5% -9.6% +15.0% ➖ noise
62 duckdb:vortex-compact +9.0% +8.5% +0.5% +18.8% ➖ noise
62 duckdb:vortex-file-compressed +11.6% +8.5% +2.9% +19.5% ➖ noise
63 datafusion:vortex-compact +5.5% +2.3% +3.2% +14.3% ➖ noise
63 datafusion:vortex-file-compressed +10.3% +2.3% +7.8% +10.0% ➖ noise
63 duckdb:duckdb -0.4% +2.3% -2.6% +10.0% ➖ noise
63 duckdb:vortex-compact +3.4% +2.3% +1.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +3.8% +2.3% +1.5% +10.0% ➖ noise
64 datafusion:vortex-compact +2.0% -1.1% +3.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +2.4% -1.1% +3.5% +10.0% ➖ noise
64 duckdb:duckdb -5.3% -1.1% -4.3% +10.0% ➖ noise
64 duckdb:vortex-compact +0.9% -1.1% +2.0% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -2.2% -1.1% -1.2% +10.2% ➖ noise
65 datafusion:vortex-compact +7.1% +3.9% +3.1% +14.2% ➖ noise
65 datafusion:vortex-file-compressed +0.7% +3.9% -3.1% +11.7% ➖ noise
65 duckdb:duckdb -5.5% +3.9% -9.1% +13.4% ➖ noise
65 duckdb:vortex-compact -0.3% +3.9% -4.1% +13.1% ➖ noise
65 duckdb:vortex-file-compressed +8.7% +3.9% +4.6% +37.3% ➖ noise
66 datafusion:vortex-compact +2.2% -1.0% +3.2% +10.5% ➖ noise
66 datafusion:vortex-file-compressed +1.7% -1.0% +2.7% +11.4% ➖ noise
66 duckdb:duckdb +5.1% -1.0% +6.2% +12.2% ➖ noise
66 duckdb:vortex-compact -3.7% -1.0% -2.7% +12.0% ➖ noise
66 duckdb:vortex-file-compressed +1.3% -1.0% +2.3% +12.3% ➖ noise
67 datafusion:vortex-compact +2.2% +1.3% +0.8% +13.7% ➖ noise
67 datafusion:vortex-file-compressed -7.5% +1.3% -8.7% +10.0% ➖ noise
67 duckdb:duckdb +4.3% +1.3% +2.9% +15.1% ➖ noise
67 duckdb:vortex-compact +1.3% +1.3% -0.0% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +4.3% +1.3% +3.0% +11.2% ➖ noise
68 datafusion:vortex-compact +0.2% +1.9% -1.6% +11.7% ➖ noise
68 datafusion:vortex-file-compressed -7.0% +1.9% -8.7% +10.0% ➖ noise
68 duckdb:duckdb +3.1% +1.9% +1.2% +10.0% ➖ noise
68 duckdb:vortex-compact -3.1% +1.9% -4.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +3.3% +1.9% +1.4% +13.2% ➖ noise
69 datafusion:vortex-compact +1.8% +0.2% +1.6% +14.5% ➖ noise
69 datafusion:vortex-file-compressed -3.0% +0.2% -3.2% +11.0% ➖ noise
69 duckdb:duckdb -1.9% +0.2% -2.1% +10.8% ➖ noise
69 duckdb:vortex-compact +2.5% +0.2% +2.3% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +5.6% +0.2% +5.4% +10.0% ➖ noise
70 datafusion:vortex-compact +0.7% -0.7% +1.4% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -0.7% -0.7% -0.0% +12.6% ➖ noise
70 duckdb:duckdb +2.9% -0.7% +3.6% +11.0% ➖ noise
70 duckdb:vortex-compact -4.3% -0.7% -3.7% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +6.1% -0.7% +6.8% +11.7% ➖ noise
71 datafusion:vortex-compact +5.5% +1.5% +4.0% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -0.3% +1.5% -1.7% +10.0% ➖ noise
71 duckdb:duckdb +6.7% +1.5% +5.2% +13.5% ➖ noise
71 duckdb:vortex-compact +5.4% +1.5% +3.8% +12.9% ➖ noise
71 duckdb:vortex-file-compressed +0.0% +1.5% -1.4% +10.0% ➖ noise
72 datafusion:vortex-compact +1.3% +1.2% +0.0% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -13.8% +1.2% -14.9% +10.7% ✅ faster
72 duckdb:duckdb +4.1% +1.2% +2.8% +10.0% ➖ noise
72 duckdb:vortex-compact -0.2% +1.2% -1.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +2.3% +1.2% +1.1% +10.0% ➖ noise
73 datafusion:vortex-compact +2.4% -1.5% +3.9% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +3.7% -1.5% +5.3% +10.0% ➖ noise
73 duckdb:duckdb +26.7% -1.5% +28.7% +14.3% 🚨 regression
73 duckdb:vortex-compact +3.8% -1.5% +5.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -2.9% -1.5% -1.4% +25.0% ➖ noise
74 datafusion:vortex-compact -1.0% +5.2% -5.9% +10.7% ➖ noise
74 datafusion:vortex-file-compressed +1.4% +5.2% -3.6% +11.9% ➖ noise
74 duckdb:duckdb +1.9% +5.2% -3.2% +10.0% ➖ noise
74 duckdb:vortex-compact +1.8% +5.2% -3.3% +24.7% ➖ noise
74 duckdb:vortex-file-compressed -21.0% +5.2% -24.9% +27.1% ✅ faster
75 datafusion:vortex-compact +2.9% +0.7% +2.2% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +4.5% +0.7% +3.8% +10.0% ➖ noise
75 duckdb:duckdb +4.6% +0.7% +3.9% +10.6% ➖ noise
75 duckdb:vortex-compact -2.8% +0.7% -3.4% +10.6% ➖ noise
75 duckdb:vortex-file-compressed +6.3% +0.7% +5.6% +16.2% ➖ noise
76 datafusion:vortex-compact +3.8% -0.6% +4.4% +12.3% ➖ noise
76 datafusion:vortex-file-compressed +2.9% -0.6% +3.5% +23.3% ➖ noise
76 duckdb:duckdb -6.0% -0.6% -5.5% +16.6% ➖ noise
76 duckdb:vortex-compact +4.0% -0.6% +4.6% +14.7% ➖ noise
76 duckdb:vortex-file-compressed +8.4% -0.6% +9.1% +13.4% ➖ noise
77 datafusion:vortex-compact +4.8% +1.9% +2.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -1.2% +1.9% -3.0% +14.7% ➖ noise
77 duckdb:duckdb +5.3% +1.9% +3.4% +12.0% ➖ noise
77 duckdb:vortex-compact -4.8% +1.9% -6.6% +15.1% ➖ noise
77 duckdb:vortex-file-compressed +12.1% +1.9% +10.0% +12.1% ➖ noise
78 datafusion:vortex-compact +3.9% +3.0% +0.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +2.9% +3.0% -0.1% +10.0% ➖ noise
78 duckdb:duckdb +0.2% +3.0% -2.7% +10.0% ➖ noise
78 duckdb:vortex-compact +4.2% +3.0% +1.1% +11.9% ➖ noise
78 duckdb:vortex-file-compressed +2.6% +3.0% -0.4% +10.0% ➖ noise
79 datafusion:vortex-compact +6.6% +3.0% +3.5% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +2.8% +3.0% -0.2% +10.0% ➖ noise
79 duckdb:duckdb -1.6% +3.0% -4.5% +10.0% ➖ noise
79 duckdb:vortex-compact -0.5% +3.0% -3.4% +11.5% ➖ noise
79 duckdb:vortex-file-compressed +5.6% +3.0% +2.5% +20.5% ➖ noise
80 datafusion:vortex-compact +5.1% +5.9% -0.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -0.7% +5.9% -6.2% +10.0% ➖ noise
80 duckdb:duckdb -1.5% +5.9% -7.0% +12.5% ➖ noise
80 duckdb:vortex-compact -4.9% +5.9% -10.2% +10.0% ✅ faster
80 duckdb:vortex-file-compressed -5.3% +5.9% -10.6% +10.0% ✅ faster
81 datafusion:vortex-compact +9.4% +2.2% +7.0% +15.7% ➖ noise
81 datafusion:vortex-file-compressed +4.3% +2.2% +2.0% +10.0% ➖ noise
81 duckdb:duckdb -2.0% +2.2% -4.1% +11.7% ➖ noise
81 duckdb:vortex-compact -9.2% +2.2% -11.2% +12.1% ✅ faster
81 duckdb:vortex-file-compressed +5.7% +2.2% +3.4% +10.6% ➖ noise
82 datafusion:vortex-compact +4.2% +5.9% -1.6% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +6.3% +5.9% +0.4% +10.2% ➖ noise
82 duckdb:duckdb -4.2% +5.9% -9.5% +14.9% ➖ noise
82 duckdb:vortex-compact +1.0% +5.9% -4.6% +15.9% ➖ noise
82 duckdb:vortex-file-compressed +4.6% +5.9% -1.2% +10.2% ➖ noise
83 datafusion:vortex-compact +1.9% +7.2% -4.9% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -1.0% +7.2% -7.6% +10.0% ➖ noise
83 duckdb:duckdb +2.3% +7.2% -4.6% +14.1% ➖ noise
83 duckdb:vortex-compact -3.4% +7.2% -9.9% +15.7% ➖ noise
83 duckdb:vortex-file-compressed +3.9% +7.2% -3.0% +22.1% ➖ noise
84 datafusion:vortex-compact +5.4% +4.0% +1.3% +10.7% ➖ noise
84 datafusion:vortex-file-compressed +3.5% +4.0% -0.5% +10.0% ➖ noise
84 duckdb:duckdb -5.0% +4.0% -8.7% +10.0% ➖ noise
84 duckdb:vortex-compact +2.6% +4.0% -1.3% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +8.9% +4.0% +4.7% +10.0% ➖ noise
85 datafusion:vortex-compact +1.5% +3.3% -1.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.8% +3.3% -2.5% +10.0% ➖ noise
85 duckdb:duckdb +6.1% +3.3% +2.7% +11.8% ➖ noise
85 duckdb:vortex-compact -3.8% +3.3% -6.9% +11.3% ➖ noise
85 duckdb:vortex-file-compressed -2.0% +3.3% -5.1% +10.0% ➖ noise
86 datafusion:vortex-compact +15.7% -1.0% +16.9% +18.9% ➖ noise
86 datafusion:vortex-file-compressed -11.6% -1.0% -10.6% +14.4% ➖ noise
86 duckdb:duckdb +12.7% -1.0% +13.9% +21.6% ➖ noise
86 duckdb:vortex-compact -0.4% -1.0% +0.6% +11.7% ➖ noise
86 duckdb:vortex-file-compressed +6.4% -1.0% +7.6% +15.6% ➖ noise
87 datafusion:vortex-compact +3.0% +7.1% -3.8% +10.3% ➖ noise
87 datafusion:vortex-file-compressed +0.6% +7.1% -6.1% +10.0% ➖ noise
87 duckdb:duckdb +3.4% +7.1% -3.4% +20.7% ➖ noise
87 duckdb:vortex-compact -3.8% +7.1% -10.2% +10.8% ✅ faster
87 duckdb:vortex-file-compressed +11.3% +7.1% +3.9% +14.6% ➖ noise
88 datafusion:vortex-compact +1.3% +2.6% -1.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.2% +2.6% -3.7% +10.0% ➖ noise
88 duckdb:duckdb +1.6% +2.6% -1.0% +10.0% ➖ noise
88 duckdb:vortex-compact +2.0% +2.6% -0.6% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +3.4% +2.6% +0.8% +10.0% ➖ noise
89 datafusion:vortex-compact -2.1% +6.9% -8.4% +14.9% ➖ noise
89 datafusion:vortex-file-compressed -1.0% +6.9% -7.4% +10.0% ➖ noise
89 duckdb:duckdb +0.8% +6.9% -5.7% +10.2% ➖ noise
89 duckdb:vortex-compact +2.7% +6.9% -3.9% +16.2% ➖ noise
89 duckdb:vortex-file-compressed +9.7% +6.9% +2.6% +10.0% ➖ noise
90 datafusion:vortex-compact +4.7% +4.0% +0.7% +10.7% ➖ noise
90 datafusion:vortex-file-compressed -2.0% +4.0% -5.8% +10.0% ➖ noise
90 duckdb:duckdb -2.8% +4.0% -6.5% +10.8% ➖ noise
90 duckdb:vortex-compact +0.4% +4.0% -3.5% +11.2% ➖ noise
90 duckdb:vortex-file-compressed +2.2% +4.0% -1.7% +10.5% ➖ noise
91 datafusion:vortex-compact +6.9% +1.3% +5.6% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +5.5% +1.3% +4.2% +10.0% ➖ noise
91 duckdb:duckdb -1.2% +1.3% -2.5% +11.9% ➖ noise
91 duckdb:vortex-compact +6.0% +1.3% +4.7% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +2.0% +1.3% +0.6% +14.1% ➖ noise
92 datafusion:vortex-compact +5.0% -1.2% +6.3% +21.0% ➖ noise
92 datafusion:vortex-file-compressed +2.5% -1.2% +3.7% +10.2% ➖ noise
92 duckdb:duckdb +1.7% -1.2% +3.0% +14.0% ➖ noise
92 duckdb:vortex-compact -1.4% -1.2% -0.1% +23.4% ➖ noise
92 duckdb:vortex-file-compressed -10.4% -1.2% -9.3% +23.1% ➖ noise
93 datafusion:vortex-compact +3.9% +1.6% +2.3% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +2.6% +1.6% +1.0% +10.0% ➖ noise
93 duckdb:duckdb +0.1% +1.6% -1.4% +11.5% ➖ noise
93 duckdb:vortex-compact -1.7% +1.6% -3.3% +10.0% ➖ noise
93 duckdb:vortex-file-compressed +0.6% +1.6% -0.9% +10.6% ➖ noise
94 datafusion:vortex-compact +13.9% -2.5% +16.7% +13.6% 🚨 regression
94 datafusion:vortex-file-compressed +3.4% -2.5% +6.0% +16.4% ➖ noise
94 duckdb:duckdb +9.2% -2.5% +11.9% +10.7% 🚨 regression
94 duckdb:vortex-compact +1.4% -2.5% +4.0% +11.3% ➖ noise
94 duckdb:vortex-file-compressed -2.5% -2.5% -0.0% +13.4% ➖ noise
95 datafusion:vortex-compact -3.0% +14.2% -15.0% +12.6% ✅ faster
95 datafusion:vortex-file-compressed +1.7% +14.2% -11.0% +12.4% ➖ noise
95 duckdb:duckdb +16.9% +14.2% +2.4% +20.4% ➖ noise
95 duckdb:vortex-compact +0.9% +14.2% -11.6% +14.2% ➖ noise
95 duckdb:vortex-file-compressed +9.3% +14.2% -4.3% +20.0% ➖ noise
96 datafusion:vortex-compact +2.2% +4.8% -2.5% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -7.9% +4.8% -12.1% +12.1% ✅ faster
96 duckdb:duckdb -0.9% +4.8% -5.4% +11.7% ➖ noise
96 duckdb:vortex-compact +1.2% +4.8% -3.4% +13.4% ➖ noise
96 duckdb:vortex-file-compressed +1.7% +4.8% -3.0% +11.8% ➖ noise
97 datafusion:vortex-compact +0.4% +1.3% -0.9% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -4.5% +1.3% -5.8% +10.0% ➖ noise
97 duckdb:duckdb +1.4% +1.3% +0.1% +17.5% ➖ noise
97 duckdb:vortex-compact -5.5% +1.3% -6.7% +16.8% ➖ noise
97 duckdb:vortex-file-compressed -0.7% +1.3% -2.0% +10.0% ➖ noise
98 datafusion:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -2.2% +1.6% -3.7% +10.0% ➖ noise
98 duckdb:duckdb +2.6% +1.6% +0.9% +14.7% ➖ noise
98 duckdb:vortex-compact +3.3% +1.6% +1.7% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +4.6% +1.6% +2.9% +15.8% ➖ noise
99 datafusion:vortex-compact -12.4% +1.8% -14.0% +29.3% ➖ noise
99 datafusion:vortex-file-compressed -8.9% +1.8% -10.6% +27.5% ➖ noise
99 duckdb:duckdb +3.6% +1.8% +1.8% +28.2% ➖ noise
99 duckdb:vortex-compact +7.2% +1.8% +5.3% +27.2% ➖ noise
99 duckdb:vortex-file-compressed +1.9% +1.8% +0.1% +30.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.9%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 0.962x ➖
Shifts: Parquet (control) -3.8% · Median polish +1.7%


datafusion / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 33202534 39770585 0.83
fineweb_q01/datafusion:vortex-file-compressed 567127964 576462037 0.98
fineweb_q02/datafusion:vortex-file-compressed 416426324 487461392 0.85
fineweb_q03/datafusion:vortex-file-compressed 1493997355 1397919483 1.07
fineweb_q04/datafusion:vortex-file-compressed 1385711173 1372760924 1.01
fineweb_q05/datafusion:vortex-file-compressed 1376179305 1416250750 0.97
fineweb_q06/datafusion:vortex-file-compressed 1462810239 1535539363 0.95
fineweb_q07/datafusion:vortex-file-compressed 1467303779 1403939983 1.05
fineweb_q08/datafusion:vortex-file-compressed 536039708 501067459 1.07
datafusion / vortex-compact (1.049x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34486146 35479616 0.97
fineweb_q01/datafusion:vortex-compact 569830771 517095390 1.10
fineweb_q02/datafusion:vortex-compact 523528300 513413174 1.02
fineweb_q03/datafusion:vortex-compact 1459585910 1497333743 0.97
fineweb_q04/datafusion:vortex-compact 1770305873 1722511149 1.03
fineweb_q05/datafusion:vortex-compact 1441579829 1430143086 1.01
fineweb_q06/datafusion:vortex-compact 1640932858 1389300519 1.18
fineweb_q07/datafusion:vortex-compact 1279145990 1134328004 1.13
fineweb_q08/datafusion:vortex-compact 416391008 398432520 1.05
datafusion / parquet (0.920x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1205368062 1652969514 0.73
fineweb_q01/datafusion:parquet 1803309302 1841362594 0.98
fineweb_q02/datafusion:parquet 2071703225 1767989932 1.17
fineweb_q03/datafusion:parquet 1883084165 1779915853 1.06
fineweb_q04/datafusion:parquet 1732870556 1991414785 0.87
fineweb_q05/datafusion:parquet 1870525432 2258548474 0.83
fineweb_q06/datafusion:parquet 1935383776 1950534654 0.99
fineweb_q07/datafusion:parquet 1955083555 2673025061 0.73
fineweb_q08/datafusion:parquet 2007852120 1974993484 1.02
duckdb / vortex-file-compressed (1.022x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 94418372 84656123 1.12
fineweb_q01/duckdb:vortex-file-compressed 727791823 587505540 1.24
fineweb_q02/duckdb:vortex-file-compressed 631690175 611856046 1.03
fineweb_q03/duckdb:vortex-file-compressed 1469678014 1451420057 1.01
fineweb_q04/duckdb:vortex-file-compressed 1514118089 1526194833 0.99
fineweb_q05/duckdb:vortex-file-compressed 1509782485 1445895730 1.04
fineweb_q06/duckdb:vortex-file-compressed 1603970986 1646146636 0.97
fineweb_q07/duckdb:vortex-file-compressed 1451960574 1414215592 1.03
fineweb_q08/duckdb:vortex-file-compressed 598648178 736725821 0.81
duckdb / vortex-compact (1.030x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 60698749 85895370 0.71
fineweb_q01/duckdb:vortex-compact 646886288 554288184 1.17
fineweb_q02/duckdb:vortex-compact 742007764 570980971 1.30
fineweb_q03/duckdb:vortex-compact 1626879358 1580337661 1.03
fineweb_q04/duckdb:vortex-compact 1765027022 1748557591 1.01
fineweb_q05/duckdb:vortex-compact 1546825349 1449960215 1.07
fineweb_q06/duckdb:vortex-compact 1487832996 1408594959 1.06
fineweb_q07/duckdb:vortex-compact 1333292419 1340544358 0.99
fineweb_q08/duckdb:vortex-compact 521407838 497500808 1.05
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1084566177 1178489125 0.92
fineweb_q01/duckdb:parquet 1375458627 1434803290 0.96
fineweb_q02/duckdb:parquet 1353510092 1353057758 1.00
fineweb_q03/duckdb:parquet 3697310221 3946915358 0.94
fineweb_q04/duckdb:parquet 2084585410 1871136269 1.11
fineweb_q05/duckdb:parquet 2103534266 2088846129 1.01
fineweb_q06/duckdb:parquet 4522510082 4525604815 1.00
fineweb_q07/duckdb:parquet 2888537162 2578457445 1.12
fineweb_q08/duckdb:parquet 1134200244 1122949480 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -2.8% -18.1% +18.7% +196.8% ➖ noise
0 datafusion:vortex-file-compressed -16.5% -18.1% +1.9% +147.0% ➖ noise
0 duckdb:vortex-compact -29.3% -18.1% -13.7% +87.7% ➖ noise
0 duckdb:vortex-file-compressed +11.5% -18.1% +36.1% +49.9% ➖ noise
1 datafusion:vortex-compact +10.2% -3.1% +13.7% +76.2% ➖ noise
1 datafusion:vortex-file-compressed -1.6% -3.1% +1.5% +64.2% ➖ noise
1 duckdb:vortex-compact +16.7% -3.1% +20.4% +59.3% ➖ noise
1 duckdb:vortex-file-compressed +23.9% -3.1% +27.9% +51.0% ➖ noise
2 datafusion:vortex-compact +2.0% +8.3% -5.8% +37.6% ➖ noise
2 datafusion:vortex-file-compressed -14.6% +8.3% -21.1% +30.0% ➖ noise
2 duckdb:vortex-compact +30.0% +8.3% +20.0% +30.1% ➖ noise
2 duckdb:vortex-file-compressed +3.2% +8.3% -4.6% +77.0% ➖ noise
3 datafusion:vortex-compact -2.5% -0.4% -2.1% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +6.9% -0.4% +7.4% +30.0% ➖ noise
3 duckdb:vortex-compact +2.9% -0.4% +3.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% -0.4% +1.7% +30.0% ➖ noise
4 datafusion:vortex-compact +2.8% -1.5% +4.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.9% -1.5% +2.5% +30.0% ➖ noise
4 duckdb:vortex-compact +0.9% -1.5% +2.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% -1.5% +0.8% +30.0% ➖ noise
5 datafusion:vortex-compact +0.8% -8.7% +10.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.8% -8.7% +6.4% +30.0% ➖ noise
5 duckdb:vortex-compact +6.7% -8.7% +16.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +4.4% -8.7% +14.3% +30.0% ➖ noise
6 datafusion:vortex-compact +18.1% -0.4% +18.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.7% -0.4% -4.3% +30.0% ➖ noise
6 duckdb:vortex-compact +5.6% -0.4% +6.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -2.6% -0.4% -2.1% +30.0% ➖ noise
7 datafusion:vortex-compact +12.8% -9.5% +24.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +4.5% -9.5% +15.5% +30.0% ➖ noise
7 duckdb:vortex-compact -0.5% -9.5% +9.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +2.7% -9.5% +13.4% +30.0% ➖ noise
8 datafusion:vortex-compact +4.5% +1.3% +3.1% +30.8% ➖ noise
8 datafusion:vortex-file-compressed +7.0% +1.3% +5.6% +30.0% ➖ noise
8 duckdb:vortex-compact +4.8% +1.3% +3.4% +42.1% ➖ noise
8 duckdb:vortex-file-compressed -18.7% +1.3% -19.8% +61.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: Random Access

Vortex (geomean): 0.931x ➖
Parquet (geomean): 0.988x ➖


unknown / unknown (0.963x ➖, 4↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2385187 2409363 0.99
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1454301 1489314 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8204956390 8451898736 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8228030012 8377197276 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7581635 7884408 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6670323 7206443 0.93
random-access/feature-vectors/uniform/lance-tokio-local-disk 5754275 5795105 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6510912 6579455 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8258023578 8345008431 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8402578830 8429648060 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12903967 13263220 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12660769 13126572 0.96
random-access/lance-tokio-local-disk 742361 763691 0.97
random-access/lance-tokio-local-disk-footer 1287442 1322630 0.97
random-access/nested-lists/correlated/lance-tokio-local-disk 246689 250175 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 613776 626559 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk 125486873 128112427 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128430447 128154950 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 534202 592779 0.90
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 532488 561644 0.95
random-access/nested-lists/uniform/lance-tokio-local-disk 1077685 1124302 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1471784 1500752 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk 128290460 128109909 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128058636 127729601 1.00
random-access/nested-lists/uniform/vortex-tokio-local-disk 2042423 2092909 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2041939 2092742 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 389749 399044 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 582562 598415 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 20291093 21211885 0.96
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 20677779 20616655 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk 727765 751824 0.97
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 704845 766326 0.92
random-access/nested-structs/uniform/lance-tokio-local-disk 2651145 2783982 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2860440 2998310 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk 20546736 20565742 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 20599638 21188953 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk 1598665 1587028 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1577690 1658564 0.95
random-access/parquet-tokio-local-disk 164887620 165289419 1.00
random-access/parquet-tokio-local-disk-footer 163581030 165533078 0.99
random-access/taxi/correlated/lance-tokio-local-disk 924605 952004 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 1549660 1598348 0.97
random-access/taxi/correlated/parquet-tokio-local-disk 244831705 251566709 0.97
random-access/taxi/correlated/parquet-tokio-local-disk-footer 246322208 248488268 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1502806 1777352 0.85
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1666077 1789668 0.93
random-access/taxi/uniform/lance-tokio-local-disk 9574587 9950049 0.96
random-access/taxi/uniform/lance-tokio-local-disk-footer 🚀 10197378 11336563 0.90
random-access/taxi/uniform/parquet-tokio-local-disk 262644964 267216492 0.98
random-access/taxi/uniform/parquet-tokio-local-disk-footer 263542789 265241109 0.99
random-access/taxi/uniform/vortex-tokio-local-disk 4283813 4610144 0.93
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4254704 4601600 0.92
random-access/vortex-tokio-local-disk 🚀 1139375 1358686 0.84
random-access/vortex-tokio-local-disk-footer 🚀 1142624 1350856 0.85

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Vortex (geomean): 0.872x ✅
Parquet (geomean): 0.911x ➖
Shifts: Parquet (control) -8.9% · Median polish -12.1%


datafusion / vortex-file-compressed (0.852x ✅, 19↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 384303424 425130260 0.90
tpch_q02/datafusion:vortex-file-compressed 🚀 105007679 122093590 0.86
tpch_q03/datafusion:vortex-file-compressed 🚀 209939902 255249811 0.82
tpch_q04/datafusion:vortex-file-compressed 🚀 112558143 133336017 0.84
tpch_q05/datafusion:vortex-file-compressed 🚀 364605528 442338765 0.82
tpch_q06/datafusion:vortex-file-compressed 🚀 43418900 51093469 0.85
tpch_q07/datafusion:vortex-file-compressed 🚀 490966940 610015758 0.80
tpch_q08/datafusion:vortex-file-compressed 🚀 352020850 420593387 0.84
tpch_q09/datafusion:vortex-file-compressed 🚀 610761015 737353632 0.83
tpch_q10/datafusion:vortex-file-compressed 🚀 227229638 268752030 0.85
tpch_q11/datafusion:vortex-file-compressed 🚀 80416594 94171963 0.85
tpch_q12/datafusion:vortex-file-compressed 🚀 116934821 141227813 0.83
tpch_q13/datafusion:vortex-file-compressed 🚀 209231434 248449094 0.84
tpch_q14/datafusion:vortex-file-compressed 🚀 56041148 63096306 0.89
tpch_q15/datafusion:vortex-file-compressed 🚀 103008452 120678960 0.85
tpch_q16/datafusion:vortex-file-compressed 🚀 74133488 83391468 0.89
tpch_q17/datafusion:vortex-file-compressed 🚀 614708012 743251538 0.83
tpch_q18/datafusion:vortex-file-compressed 🚀 825330023 982740091 0.84
tpch_q19/datafusion:vortex-file-compressed 91703348 97388719 0.94
tpch_q20/datafusion:vortex-file-compressed 🚀 164317805 193806147 0.85
tpch_q21/datafusion:vortex-file-compressed 🚀 633344243 767761046 0.82
tpch_q22/datafusion:vortex-file-compressed 64021559 70421687 0.91
datafusion / vortex-compact (0.850x ✅, 21↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 434404464 497270805 0.87
tpch_q02/datafusion:vortex-compact 🚀 107770731 127912585 0.84
tpch_q03/datafusion:vortex-compact 🚀 212173701 258240617 0.82
tpch_q04/datafusion:vortex-compact 🚀 120014716 135454593 0.89
tpch_q05/datafusion:vortex-compact 🚀 363186536 442100325 0.82
tpch_q06/datafusion:vortex-compact 🚀 63297896 72039721 0.88
tpch_q07/datafusion:vortex-compact 🚀 506740141 623271283 0.81
tpch_q08/datafusion:vortex-compact 🚀 352939728 417996378 0.84
tpch_q09/datafusion:vortex-compact 🚀 614719140 754389088 0.81
tpch_q10/datafusion:vortex-compact 🚀 243331067 286721809 0.85
tpch_q11/datafusion:vortex-compact 🚀 82525584 95951583 0.86
tpch_q12/datafusion:vortex-compact 🚀 163835303 189732498 0.86
tpch_q13/datafusion:vortex-compact 🚀 258750571 295067542 0.88
tpch_q14/datafusion:vortex-compact 🚀 72581991 84799734 0.86
tpch_q15/datafusion:vortex-compact 🚀 158361775 181196994 0.87
tpch_q16/datafusion:vortex-compact 🚀 78259274 91581268 0.85
tpch_q17/datafusion:vortex-compact 🚀 617740002 775157120 0.80
tpch_q18/datafusion:vortex-compact 🚀 819893534 988383277 0.83
tpch_q19/datafusion:vortex-compact 131656438 141325660 0.93
tpch_q20/datafusion:vortex-compact 🚀 185302643 219271903 0.85
tpch_q21/datafusion:vortex-compact 🚀 645575991 791440657 0.82
tpch_q22/datafusion:vortex-compact 🚀 70657879 81129850 0.87
datafusion / parquet (0.881x ✅, 17↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 467055940 519225678 0.90
tpch_q02/datafusion:parquet 169427028 187680335 0.90
tpch_q03/datafusion:parquet 🚀 277929153 318197000 0.87
tpch_q04/datafusion:parquet 🚀 123165841 137456728 0.90
tpch_q05/datafusion:parquet 🚀 422276055 509821286 0.83
tpch_q06/datafusion:parquet 122523079 131703017 0.93
tpch_q07/datafusion:parquet 🚀 587197050 705023472 0.83
tpch_q08/datafusion:parquet 🚀 445861753 519378938 0.86
tpch_q09/datafusion:parquet 🚀 719692022 853448316 0.84
tpch_q10/datafusion:parquet 🚀 483848477 554329133 0.87
tpch_q11/datafusion:parquet 🚀 113102238 130551723 0.87
tpch_q12/datafusion:parquet 201382834 204039116 0.99
tpch_q13/datafusion:parquet 327553167 355858814 0.92
tpch_q14/datafusion:parquet 🚀 150787572 172901914 0.87
tpch_q15/datafusion:parquet 🚀 245371682 275911659 0.89
tpch_q16/datafusion:parquet 🚀 120625035 137893939 0.87
tpch_q17/datafusion:parquet 🚀 661689715 777447642 0.85
tpch_q18/datafusion:parquet 🚀 856203523 1005905653 0.85
tpch_q19/datafusion:parquet 🚀 244110438 280644967 0.87
tpch_q20/datafusion:parquet 🚀 281683148 319682014 0.88
tpch_q21/datafusion:parquet 🚀 673528680 789503668 0.85
tpch_q22/datafusion:parquet 210409096 221639315 0.95
datafusion / arrow (0.847x ✅, 20↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 588274738 675053666 0.87
tpch_q02/datafusion:arrow 🚀 165272585 185995091 0.89
tpch_q03/datafusion:arrow 🚀 449710485 551477519 0.82
tpch_q04/datafusion:arrow 🚀 329647552 401487323 0.82
tpch_q05/datafusion:arrow 🚀 919191411 1067000413 0.86
tpch_q06/datafusion:arrow 🚀 278787826 330194074 0.84
tpch_q07/datafusion:arrow 🚀 1133780825 1402678116 0.81
tpch_q08/datafusion:arrow 🚀 1119098437 1312007315 0.85
tpch_q09/datafusion:arrow 🚀 1321286057 1547313941 0.85
tpch_q10/datafusion:arrow 🚀 574695340 710958898 0.81
tpch_q11/datafusion:arrow 137461312 150783624 0.91
tpch_q12/datafusion:arrow 🚀 732858744 883241441 0.83
tpch_q13/datafusion:arrow 497934584 543202532 0.92
tpch_q14/datafusion:arrow 🚀 304448969 382819226 0.80
tpch_q15/datafusion:arrow 🚀 669058000 846196998 0.79
tpch_q16/datafusion:arrow 🚀 104859562 116859374 0.90
tpch_q17/datafusion:arrow 🚀 1316419551 1526852131 0.86
tpch_q18/datafusion:arrow 🚀 1829488358 2204053104 0.83
tpch_q19/datafusion:arrow 🚀 469694726 575396168 0.82
tpch_q20/datafusion:arrow 🚀 469702639 582903821 0.81
tpch_q21/datafusion:arrow 🚀 2961346192 3349100250 0.88
tpch_q22/datafusion:arrow 🚀 131942122 147182136 0.90
duckdb / vortex-file-compressed (0.881x ✅, 18↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169051509 180931842 0.93
tpch_q02/duckdb:vortex-file-compressed 51051267 56536467 0.90
tpch_q03/duckdb:vortex-file-compressed 🚀 121932685 145047977 0.84
tpch_q04/duckdb:vortex-file-compressed 🚀 148984645 178439691 0.83
tpch_q05/duckdb:vortex-file-compressed 🚀 125276679 142500477 0.88
tpch_q06/duckdb:vortex-file-compressed 🚀 46084590 53300661 0.86
tpch_q07/duckdb:vortex-file-compressed 🚀 141531334 167196288 0.85
tpch_q08/duckdb:vortex-file-compressed 🚀 165847820 198823340 0.83
tpch_q09/duckdb:vortex-file-compressed 🚀 314402159 354092187 0.89
tpch_q10/duckdb:vortex-file-compressed 🚀 139047613 159764460 0.87
tpch_q11/duckdb:vortex-file-compressed 🚀 31431716 35846487 0.88
tpch_q12/duckdb:vortex-file-compressed 🚀 90825369 104334091 0.87
tpch_q13/duckdb:vortex-file-compressed 🚀 222386657 249344206 0.89
tpch_q14/duckdb:vortex-file-compressed 🚀 65493633 72985738 0.90
tpch_q15/duckdb:vortex-file-compressed 🚀 84183507 95756951 0.88
tpch_q16/duckdb:vortex-file-compressed 🚀 76844846 85500513 0.90
tpch_q17/duckdb:vortex-file-compressed 🚀 95674973 107873747 0.89
tpch_q18/duckdb:vortex-file-compressed 🚀 281460844 316009226 0.89
tpch_q19/duckdb:vortex-file-compressed 83227368 89565604 0.93
tpch_q20/duckdb:vortex-file-compressed 🚀 153609053 173863251 0.88
tpch_q21/duckdb:vortex-file-compressed 🚀 559086897 648504501 0.86
tpch_q22/duckdb:vortex-file-compressed 70527408 76047894 0.93
duckdb / vortex-compact (0.905x ➖, 11↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227904821 238963860 0.95
tpch_q02/duckdb:vortex-compact 54514148 59605854 0.91
tpch_q03/duckdb:vortex-compact 🚀 136264159 154491190 0.88
tpch_q04/duckdb:vortex-compact 🚀 170397579 189464465 0.90
tpch_q05/duckdb:vortex-compact 🚀 141879724 158822091 0.89
tpch_q06/duckdb:vortex-compact 83523522 87571767 0.95
tpch_q07/duckdb:vortex-compact 195082291 212738451 0.92
tpch_q08/duckdb:vortex-compact 🚀 183030118 210964127 0.87
tpch_q09/duckdb:vortex-compact 349958567 383115453 0.91
tpch_q10/duckdb:vortex-compact 🚀 173552734 195039313 0.89
tpch_q11/duckdb:vortex-compact 🚀 39521131 44087028 0.90
tpch_q12/duckdb:vortex-compact 200929755 221372640 0.91
tpch_q13/duckdb:vortex-compact 🚀 274637572 305643177 0.90
tpch_q14/duckdb:vortex-compact 🚀 97064748 109139690 0.89
tpch_q15/duckdb:vortex-compact 110683218 122910690 0.90
tpch_q16/duckdb:vortex-compact 82097665 89493906 0.92
tpch_q17/duckdb:vortex-compact 🚀 110652529 124573029 0.89
tpch_q18/duckdb:vortex-compact 289805817 315849624 0.92
tpch_q19/duckdb:vortex-compact 105994350 113403957 0.93
tpch_q20/duckdb:vortex-compact 🚀 198075789 225291586 0.88
tpch_q21/duckdb:vortex-compact 🚀 603236661 686154411 0.88
tpch_q22/duckdb:vortex-compact 83864632 91485918 0.92
duckdb / parquet (0.941x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255407143 260882398 0.98
tpch_q02/duckdb:parquet 96622557 106147619 0.91
tpch_q03/duckdb:parquet 208590163 223022370 0.94
tpch_q04/duckdb:parquet 129851460 139896416 0.93
tpch_q05/duckdb:parquet 209965846 228911755 0.92
tpch_q06/duckdb:parquet 66871967 68245128 0.98
tpch_q07/duckdb:parquet 177689212 189698648 0.94
tpch_q08/duckdb:parquet 251387671 273392724 0.92
tpch_q09/duckdb:parquet 484209685 531966282 0.91
tpch_q10/duckdb:parquet 605712348 643478520 0.94
tpch_q11/duckdb:parquet 56295008 61659793 0.91
tpch_q12/duckdb:parquet 123483402 129525894 0.95
tpch_q13/duckdb:parquet 439615467 470613367 0.93
tpch_q14/duckdb:parquet 169312008 181720736 0.93
tpch_q15/duckdb:parquet 94982147 99990888 0.95
tpch_q16/duckdb:parquet 161167061 169967229 0.95
tpch_q17/duckdb:parquet 173843751 178917615 0.97
tpch_q18/duckdb:parquet 352142907 372585648 0.95
tpch_q19/duckdb:parquet 281031410 297507360 0.94
tpch_q20/duckdb:parquet 230542304 233081606 0.99
tpch_q21/duckdb:parquet 547792699 607247423 0.90
tpch_q22/duckdb:parquet 290004647 300237002 0.97
duckdb / duckdb (0.932x ➖, 3↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117089763 120712854 0.97
tpch_q02/duckdb:duckdb 47551735 52419945 0.91
tpch_q03/duckdb:duckdb 🚀 95187538 106372195 0.89
tpch_q04/duckdb:duckdb 130611235 144613391 0.90
tpch_q05/duckdb:duckdb 108821795 117971275 0.92
tpch_q06/duckdb:duckdb 37631403 40757822 0.92
tpch_q07/duckdb:duckdb 85955243 91130549 0.94
tpch_q08/duckdb:duckdb 109839864 117767503 0.93
tpch_q09/duckdb:duckdb 275033083 298852629 0.92
tpch_q10/duckdb:duckdb 🚀 201606181 225841015 0.89
tpch_q11/duckdb:duckdb 15776652 15975803 0.99
tpch_q12/duckdb:duckdb 84903743 89737366 0.95
tpch_q13/duckdb:duckdb 🚀 218900372 244391638 0.90
tpch_q14/duckdb:duckdb 71190795 75807235 0.94
tpch_q15/duckdb:duckdb 77377136 82311674 0.94
tpch_q16/duckdb:duckdb 73145807 79812186 0.92
tpch_q17/duckdb:duckdb 84776835 87861546 0.96
tpch_q18/duckdb:duckdb 210694481 225870026 0.93
tpch_q19/duckdb:duckdb 116399754 122984522 0.95
tpch_q20/duckdb:duckdb 112211364 117818721 0.95
tpch_q21/duckdb:duckdb 296195203 324041678 0.91
tpch_q22/duckdb:duckdb 68300696 70016389 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -12.9% -6.2% -7.1% +10.0% ➖ noise
1 datafusion:vortex-compact -12.6% -6.2% -6.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -9.6% -6.2% -3.7% +10.0% ➖ noise
1 duckdb:duckdb -3.0% -6.2% +3.4% +10.0% ➖ noise
1 duckdb:vortex-compact -4.6% -6.2% +1.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -6.6% -6.2% -0.4% +10.0% ➖ noise
2 datafusion:arrow -11.1% -9.4% -2.0% +10.0% ➖ noise
2 datafusion:vortex-compact -15.7% -9.4% -7.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -14.0% -9.4% -5.1% +10.0% ➖ noise
2 duckdb:duckdb -9.3% -9.4% +0.1% +10.0% ➖ noise
2 duckdb:vortex-compact -8.5% -9.4% +0.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -9.7% -9.4% -0.4% +12.8% ➖ noise
3 datafusion:arrow -18.5% -9.6% -9.8% +10.0% ✅ faster
3 datafusion:vortex-compact -17.8% -9.6% -9.1% +10.0% ✅ faster
3 datafusion:vortex-file-compressed -17.8% -9.6% -9.0% +10.0% ➖ noise
3 duckdb:duckdb -10.5% -9.6% -1.0% +10.0% ➖ noise
3 duckdb:vortex-compact -11.8% -9.6% -2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -15.9% -9.6% -7.0% +10.0% ➖ noise
4 datafusion:arrow -17.9% -8.8% -10.0% +10.0% ✅ faster
4 datafusion:vortex-compact -11.4% -8.8% -2.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -15.6% -8.8% -7.4% +10.0% ➖ noise
4 duckdb:duckdb -9.7% -8.8% -1.0% +10.0% ➖ noise
4 duckdb:vortex-compact -10.1% -8.8% -1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -16.5% -8.8% -8.4% +10.0% ➖ noise
5 datafusion:arrow -13.9% -12.8% -1.2% +10.0% ➖ noise
5 datafusion:vortex-compact -17.8% -12.8% -5.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -17.6% -12.8% -5.4% +10.0% ➖ noise
5 duckdb:duckdb -7.8% -12.8% +5.8% +10.0% ➖ noise
5 duckdb:vortex-compact -10.7% -12.8% +2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -12.1% -12.8% +0.9% +10.0% ➖ noise
6 datafusion:arrow -15.6% -4.5% -11.6% +10.0% ✅ faster
6 datafusion:vortex-compact -12.1% -4.5% -8.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -15.0% -4.5% -11.0% +10.0% ✅ faster
6 duckdb:duckdb -7.7% -4.5% -3.3% +10.0% ➖ noise
6 duckdb:vortex-compact -4.6% -4.5% -0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -13.5% -4.5% -9.4% +10.0% ✅ faster
7 datafusion:arrow -19.2% -11.7% -8.5% +10.0% ➖ noise
7 datafusion:vortex-compact -18.7% -11.7% -8.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -19.5% -11.7% -8.9% +10.0% ➖ noise
7 duckdb:duckdb -5.7% -11.7% +6.8% +10.0% ➖ noise
7 duckdb:vortex-compact -8.3% -11.7% +3.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -15.4% -11.7% -4.2% +10.0% ➖ noise
8 datafusion:arrow -14.7% -11.2% -4.0% +10.0% ➖ noise
8 datafusion:vortex-compact -15.6% -11.2% -5.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -16.3% -11.2% -5.8% +10.0% ➖ noise
8 duckdb:duckdb -6.7% -11.2% +5.0% +10.0% ➖ noise
8 duckdb:vortex-compact -13.2% -11.2% -2.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -16.6% -11.2% -6.1% +10.0% ➖ noise
9 datafusion:arrow -14.6% -12.4% -2.5% +10.0% ➖ noise
9 datafusion:vortex-compact -18.5% -12.4% -7.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -17.2% -12.4% -5.5% +10.0% ➖ noise
9 duckdb:duckdb -8.0% -12.4% +5.0% +10.0% ➖ noise
9 duckdb:vortex-compact -8.7% -12.4% +4.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -11.2% -12.4% +1.3% +10.0% ➖ noise
10 datafusion:arrow -19.2% -9.4% -10.8% +10.0% ✅ faster
10 datafusion:vortex-compact -15.1% -9.4% -6.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -15.5% -9.4% -6.7% +10.0% ➖ noise
10 duckdb:duckdb -10.7% -9.4% -1.5% +10.0% ➖ noise
10 duckdb:vortex-compact -11.0% -9.4% -1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -13.0% -9.4% -4.0% +10.0% ➖ noise
11 datafusion:arrow -8.8% -11.1% +2.5% +10.0% ➖ noise
11 datafusion:vortex-compact -14.0% -11.1% -3.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -14.6% -11.1% -4.0% +10.0% ➖ noise
11 duckdb:duckdb -1.2% -11.1% +11.0% +10.3% 🚨 regression
11 duckdb:vortex-compact -10.4% -11.1% +0.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -12.3% -11.1% -1.4% +16.1% ➖ noise
12 datafusion:arrow -17.0% -3.0% -14.5% +30.5% ➖ noise
12 datafusion:vortex-compact -13.6% -3.0% -11.0% +10.0% ✅ faster
12 datafusion:vortex-file-compressed -17.2% -3.0% -14.6% +10.0% ✅ faster
12 duckdb:duckdb -5.4% -3.0% -2.5% +10.0% ➖ noise
12 duckdb:vortex-compact -9.2% -3.0% -6.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -12.9% -3.0% -10.3% +10.0% ✅ faster
13 datafusion:arrow -8.3% -7.3% -1.1% +10.0% ➖ noise
13 datafusion:vortex-compact -12.3% -7.3% -5.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -15.8% -7.3% -9.2% +10.0% ✅ faster
13 duckdb:duckdb -10.4% -7.3% -3.4% +10.0% ➖ noise
13 duckdb:vortex-compact -10.1% -7.3% -3.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -10.8% -7.3% -3.8% +10.0% ➖ noise
14 datafusion:arrow -20.5% -9.9% -11.8% +10.0% ✅ faster
14 datafusion:vortex-compact -14.4% -9.9% -5.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -11.2% -9.9% -1.5% +10.0% ➖ noise
14 duckdb:duckdb -6.1% -9.9% +4.2% +10.0% ➖ noise
14 duckdb:vortex-compact -11.1% -9.9% -1.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -10.3% -9.9% -0.5% +10.0% ➖ noise
15 datafusion:arrow -20.9% -8.1% -14.0% +10.0% ✅ faster
15 datafusion:vortex-compact -12.6% -8.1% -4.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -14.6% -8.1% -7.1% +10.0% ➖ noise
15 duckdb:duckdb -6.0% -8.1% +2.3% +10.0% ➖ noise
15 duckdb:vortex-compact -9.9% -8.1% -2.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -12.1% -8.1% -4.3% +10.0% ➖ noise
16 datafusion:arrow -10.3% -8.9% -1.5% +10.0% ➖ noise
16 datafusion:vortex-compact -14.5% -8.9% -6.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -11.1% -8.9% -2.4% +10.0% ➖ noise
16 duckdb:duckdb -8.4% -8.9% +0.6% +10.0% ➖ noise
16 duckdb:vortex-compact -8.3% -8.9% +0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -10.1% -8.9% -1.3% +10.0% ➖ noise
17 datafusion:arrow -13.8% -9.1% -5.2% +10.0% ➖ noise
17 datafusion:vortex-compact -20.3% -9.1% -12.4% +10.0% ✅ faster
17 datafusion:vortex-file-compressed -17.3% -9.1% -9.1% +10.0% ➖ noise
17 duckdb:duckdb -3.5% -9.1% +6.1% +10.0% ➖ noise
17 duckdb:vortex-compact -11.2% -9.1% -2.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -11.3% -9.1% -2.5% +10.0% ➖ noise
18 datafusion:arrow -17.0% -10.3% -7.5% +10.0% ➖ noise
18 datafusion:vortex-compact -17.0% -10.3% -7.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -16.0% -10.3% -6.4% +10.0% ➖ noise
18 duckdb:duckdb -6.7% -10.3% +4.0% +10.0% ➖ noise
18 duckdb:vortex-compact -8.2% -10.3% +2.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -10.9% -10.3% -0.7% +10.0% ➖ noise
19 datafusion:arrow -18.4% -9.4% -9.9% +10.0% ✅ faster
19 datafusion:vortex-compact -6.8% -9.4% +2.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.8% -9.4% +3.9% +10.0% ➖ noise
19 duckdb:duckdb -5.4% -9.4% +4.4% +10.0% ➖ noise
19 duckdb:vortex-compact -6.5% -9.4% +3.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -7.1% -9.4% +2.5% +10.0% ➖ noise
20 datafusion:arrow -19.4% -6.6% -13.7% +10.0% ✅ faster
20 datafusion:vortex-compact -15.5% -6.6% -9.5% +10.0% ✅ faster
20 datafusion:vortex-file-compressed -15.2% -6.6% -9.2% +10.0% ✅ faster
20 duckdb:duckdb -4.8% -6.6% +2.0% +10.0% ➖ noise
20 duckdb:vortex-compact -12.1% -6.6% -5.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -11.6% -6.6% -5.4% +10.0% ➖ noise
21 datafusion:arrow -11.6% -12.3% +0.8% +10.0% ➖ noise
21 datafusion:vortex-compact -18.4% -12.3% -7.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -17.5% -12.3% -6.0% +10.0% ➖ noise
21 duckdb:duckdb -8.6% -12.3% +4.2% +10.0% ➖ noise
21 duckdb:vortex-compact -12.1% -12.3% +0.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -13.8% -12.3% -1.7% +10.0% ➖ noise
22 datafusion:arrow -10.4% -4.2% -6.4% +10.0% ➖ noise
22 datafusion:vortex-compact -12.9% -4.2% -9.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -9.1% -4.2% -5.1% +10.0% ➖ noise
22 duckdb:duckdb -2.5% -4.2% +1.9% +10.0% ➖ noise
22 duckdb:vortex-compact -8.3% -4.2% -4.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -7.3% -4.2% -3.2% +10.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.1%


duckdb / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 13132804 12155742 1.08
statpopgen_q01/duckdb:vortex-file-compressed 20628833 20585092 1.00
statpopgen_q02/duckdb:vortex-file-compressed 1421454153 1382684632 1.03
statpopgen_q03/duckdb:vortex-file-compressed 3175957505 3183435289 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3212276078 3174305647 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1497004500 1477776320 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2206624289 2163023512 1.02
statpopgen_q07/duckdb:vortex-file-compressed 215305288 222711028 0.97
statpopgen_q08/duckdb:vortex-file-compressed 252509237 255355837 0.99
statpopgen_q09/duckdb:vortex-file-compressed 3019912374 2975226827 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4916471911 4811791996 1.02
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11869834 11882043 1.00
statpopgen_q01/duckdb:vortex-compact 169457622 170691405 0.99
statpopgen_q02/duckdb:vortex-compact 1905280551 1854079475 1.03
statpopgen_q03/duckdb:vortex-compact 3670647228 3570080758 1.03
statpopgen_q04/duckdb:vortex-compact 3664055381 3759199222 0.97
statpopgen_q05/duckdb:vortex-compact 1911231751 1999783659 0.96
statpopgen_q06/duckdb:vortex-compact 2740804946 2770316413 0.99
statpopgen_q07/duckdb:vortex-compact 909793903 905914802 1.00
statpopgen_q08/duckdb:vortex-compact 947399646 939857914 1.01
statpopgen_q09/duckdb:vortex-compact 3454454818 3350946604 1.03
statpopgen_q10/duckdb:vortex-compact 5613156676 5449429268 1.03
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 336339120 331856786 1.01
statpopgen_q01/duckdb:parquet 420238057 415391731 1.01
statpopgen_q02/duckdb:parquet 1015692527 1013110197 1.00
statpopgen_q03/duckdb:parquet 1521421509 1505040485 1.01
statpopgen_q04/duckdb:parquet 1548515500 1510645216 1.03
statpopgen_q05/duckdb:parquet 1036667340 1032059514 1.00
statpopgen_q06/duckdb:parquet 1519484436 1508123916 1.01
statpopgen_q07/duckdb:parquet 1346602248 1309195977 1.03
statpopgen_q08/duckdb:parquet 1376437343 1316224538 1.05
statpopgen_q09/duckdb:parquet 1406307981 1397885578 1.01
statpopgen_q10/duckdb:parquet 2729789170 2721057817 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.1% +1.4% -1.4% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +8.0% +1.4% +6.6% +12.3% ➖ noise
1 duckdb:vortex-compact -0.7% +1.2% -1.9% +24.7% ➖ noise
1 duckdb:vortex-file-compressed +0.2% +1.2% -0.9% +208.9% ➖ noise
2 duckdb:vortex-compact +2.8% +0.3% +2.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.8% +0.3% +2.5% +10.0% ➖ noise
3 duckdb:vortex-compact +2.8% +1.1% +1.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.2% +1.1% -1.3% +10.0% ➖ noise
4 duckdb:vortex-compact -2.5% +2.5% -4.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.2% +2.5% -1.3% +10.0% ➖ noise
5 duckdb:vortex-compact -4.4% +0.4% -4.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.3% +0.4% +0.9% +10.0% ➖ noise
6 duckdb:vortex-compact -1.1% +0.8% -1.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.0% +0.8% +1.3% +10.0% ➖ noise
7 duckdb:vortex-compact +0.4% +2.9% -2.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.3% +2.9% -6.0% +10.0% ➖ noise
8 duckdb:vortex-compact +0.8% +4.6% -3.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.1% +4.6% -5.4% +10.0% ➖ noise
9 duckdb:vortex-compact +3.1% +0.6% +2.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.5% +0.6% +0.9% +10.0% ➖ noise
10 duckdb:vortex-compact +3.0% +0.3% +2.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.2% +0.3% +1.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.933x ➖
Parquet (geomean): 0.950x ➖
Shifts: Parquet (control) -5.0% · Median polish -6.5%


datafusion / vortex-file-compressed (0.945x ➖, 3↑ 1↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2272544 1712410 1.33
clickbench_q01/datafusion:vortex-file-compressed 20105626 19907930 1.01
clickbench_q02/datafusion:vortex-file-compressed 42247815 39567920 1.07
clickbench_q03/datafusion:vortex-file-compressed 41706714 43911729 0.95
clickbench_q04/datafusion:vortex-file-compressed 285206886 310773146 0.92
clickbench_q05/datafusion:vortex-file-compressed 297965851 330484595 0.90
clickbench_q06/datafusion:vortex-file-compressed 1726044 1907795 0.90
clickbench_q07/datafusion:vortex-file-compressed 22937631 22465777 1.02
clickbench_q08/datafusion:vortex-file-compressed 353306325 372748320 0.95
clickbench_q09/datafusion:vortex-file-compressed 527276639 585196971 0.90
clickbench_q10/datafusion:vortex-file-compressed 74932618 77404346 0.97
clickbench_q11/datafusion:vortex-file-compressed 83594570 90809724 0.92
clickbench_q12/datafusion:vortex-file-compressed 272601278 284100343 0.96
clickbench_q13/datafusion:vortex-file-compressed 403659736 440807416 0.92
clickbench_q14/datafusion:vortex-file-compressed 250145042 276776855 0.90
clickbench_q15/datafusion:vortex-file-compressed 325124698 346028390 0.94
clickbench_q16/datafusion:vortex-file-compressed 640695055 691281136 0.93
clickbench_q17/datafusion:vortex-file-compressed 625019495 682925931 0.92
clickbench_q18/datafusion:vortex-file-compressed 1284157115 1396288933 0.92
clickbench_q19/datafusion:vortex-file-compressed 28985684 31163744 0.93
clickbench_q20/datafusion:vortex-file-compressed 333359651 342671199 0.97
clickbench_q21/datafusion:vortex-file-compressed 363565944 395423746 0.92
clickbench_q22/datafusion:vortex-file-compressed 444281387 469868314 0.95
clickbench_q23/datafusion:vortex-file-compressed 745707381 702822132 1.06
clickbench_q24/datafusion:vortex-file-compressed 44389183 47029112 0.94
clickbench_q25/datafusion:vortex-file-compressed 70822853 75851027 0.93
clickbench_q26/datafusion:vortex-file-compressed 44776312 48850958 0.92
clickbench_q27/datafusion:vortex-file-compressed 706630719 730268408 0.97
clickbench_q28/datafusion:vortex-file-compressed 6579803800 6830418456 0.96
clickbench_q29/datafusion:vortex-file-compressed 232046115 240915693 0.96
clickbench_q30/datafusion:vortex-file-compressed 215611975 233661403 0.92
clickbench_q31/datafusion:vortex-file-compressed 252511847 275188022 0.92
clickbench_q32/datafusion:vortex-file-compressed 1093054694 1195931248 0.91
clickbench_q33/datafusion:vortex-file-compressed 1278874324 1367890391 0.93
clickbench_q34/datafusion:vortex-file-compressed 1254579939 1386964227 0.90
clickbench_q35/datafusion:vortex-file-compressed 442154100 472091560 0.94
clickbench_q36/datafusion:vortex-file-compressed 68743396 75946105 0.91
clickbench_q37/datafusion:vortex-file-compressed 🚀 33728129 38162846 0.88
clickbench_q38/datafusion:vortex-file-compressed 18593340 19751821 0.94
clickbench_q39/datafusion:vortex-file-compressed 131521766 137418156 0.96
clickbench_q40/datafusion:vortex-file-compressed 🚀 15108956 17169585 0.88
clickbench_q41/datafusion:vortex-file-compressed 🚀 14373374 16344442 0.88
clickbench_q42/datafusion:vortex-file-compressed 16346878 18038228 0.91
datafusion / parquet (0.933x ➖, 4↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1531291 1552967 0.99
clickbench_q01/datafusion:parquet 18344354 19195112 0.96
clickbench_q02/datafusion:parquet 46191789 48430563 0.95
clickbench_q03/datafusion:parquet 36440298 39565777 0.92
clickbench_q04/datafusion:parquet 🚀 289688251 328884679 0.88
clickbench_q05/datafusion:parquet 341761343 366982573 0.93
clickbench_q06/datafusion:parquet 1519311 1580351 0.96
clickbench_q07/datafusion:parquet 22312911 23169250 0.96
clickbench_q08/datafusion:parquet 366231430 395878246 0.93
clickbench_q09/datafusion:parquet 596763239 642875763 0.93
clickbench_q10/datafusion:parquet 103955124 110375578 0.94
clickbench_q11/datafusion:parquet 125865137 138234157 0.91
clickbench_q12/datafusion:parquet 332585872 356192329 0.93
clickbench_q13/datafusion:parquet 🚀 475120036 530887287 0.89
clickbench_q14/datafusion:parquet 336640380 361685664 0.93
clickbench_q15/datafusion:parquet 327799970 355572472 0.92
clickbench_q16/datafusion:parquet 639341588 703603268 0.91
clickbench_q17/datafusion:parquet 630844645 685528801 0.92
clickbench_q18/datafusion:parquet 1292043567 1406620162 0.92
clickbench_q19/datafusion:parquet 29101674 30002159 0.97
clickbench_q20/datafusion:parquet 591599020 634798229 0.93
clickbench_q21/datafusion:parquet 644688810 696237095 0.93
clickbench_q22/datafusion:parquet 953134170 1015171172 0.94
clickbench_q23/datafusion:parquet 3558044249 3851036985 0.92
clickbench_q24/datafusion:parquet 84195094 87719341 0.96
clickbench_q25/datafusion:parquet 131691342 140302613 0.94
clickbench_q26/datafusion:parquet 84617515 84847557 1.00
clickbench_q27/datafusion:parquet 1027338473 1112830637 0.92
clickbench_q28/datafusion:parquet 6267983990 6801845309 0.92
clickbench_q29/datafusion:parquet 🚀 220750140 246892916 0.89
clickbench_q30/datafusion:parquet 316175270 342747513 0.92
clickbench_q31/datafusion:parquet 358875247 384853084 0.93
clickbench_q32/datafusion:parquet 1190013406 1287988119 0.92
clickbench_q33/datafusion:parquet 1474817339 1596191479 0.92
clickbench_q34/datafusion:parquet 1443993301 1552278511 0.93
clickbench_q35/datafusion:parquet 450952830 492591066 0.92
clickbench_q36/datafusion:parquet 136342753 146399284 0.93
clickbench_q37/datafusion:parquet 55357010 58798981 0.94
clickbench_q38/datafusion:parquet 82092426 91014970 0.90
clickbench_q39/datafusion:parquet 254429599 268202816 0.95
clickbench_q40/datafusion:parquet 31104158 30934663 1.01
clickbench_q41/datafusion:parquet 27608425 28650994 0.96
clickbench_q42/datafusion:parquet 🚀 28229245 31403961 0.90
duckdb / vortex-file-compressed (0.921x ➖, 7↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 5796638 6869342 0.84
clickbench_q01/duckdb:vortex-file-compressed 13215770 13999478 0.94
clickbench_q02/duckdb:vortex-file-compressed 24970455 27076370 0.92
clickbench_q03/duckdb:vortex-file-compressed 28766444 30574173 0.94
clickbench_q04/duckdb:vortex-file-compressed 176615677 189053813 0.93
clickbench_q05/duckdb:vortex-file-compressed 167180700 180065997 0.93
clickbench_q06/duckdb:vortex-file-compressed 18937123 20853482 0.91
clickbench_q07/duckdb:vortex-file-compressed 14138647 14610591 0.97
clickbench_q08/duckdb:vortex-file-compressed 253703365 262083139 0.97
clickbench_q09/duckdb:vortex-file-compressed 328567862 351486799 0.93
clickbench_q10/duckdb:vortex-file-compressed 64471205 69034942 0.93
clickbench_q11/duckdb:vortex-file-compressed 74638538 80217252 0.93
clickbench_q12/duckdb:vortex-file-compressed 190398290 204634084 0.93
clickbench_q13/duckdb:vortex-file-compressed 388101179 412432035 0.94
clickbench_q14/duckdb:vortex-file-compressed 229893765 242181075 0.95
clickbench_q15/duckdb:vortex-file-compressed 240993484 252879162 0.95
clickbench_q16/duckdb:vortex-file-compressed 568568345 608771671 0.93
clickbench_q17/duckdb:vortex-file-compressed 478946289 492092882 0.97
clickbench_q18/duckdb:vortex-file-compressed 950010045 1020889480 0.93
clickbench_q19/duckdb:vortex-file-compressed 19828049 22028543 0.90
clickbench_q20/duckdb:vortex-file-compressed 329768737 355617259 0.93
clickbench_q21/duckdb:vortex-file-compressed 🚀 350616368 392756276 0.89
clickbench_q22/duckdb:vortex-file-compressed 561696604 616024958 0.91
clickbench_q23/duckdb:vortex-file-compressed 🚀 251881718 359456569 0.70
clickbench_q24/duckdb:vortex-file-compressed 🚀 34950804 41151948 0.85
clickbench_q25/duckdb:vortex-file-compressed 74803170 74265830 1.01
clickbench_q26/duckdb:vortex-file-compressed 🚀 47069867 52443180 0.90
clickbench_q27/duckdb:vortex-file-compressed 464111281 485740450 0.96
clickbench_q28/duckdb:vortex-file-compressed 2945869835 3066283219 0.96
clickbench_q29/duckdb:vortex-file-compressed 27186452 28375112 0.96
clickbench_q30/duckdb:vortex-file-compressed 186855248 196892981 0.95
clickbench_q31/duckdb:vortex-file-compressed 276308363 293874132 0.94
clickbench_q32/duckdb:vortex-file-compressed 1108366310 1166809941 0.95
clickbench_q33/duckdb:vortex-file-compressed 🚀 1092148508 1222934085 0.89
clickbench_q34/duckdb:vortex-file-compressed 1178283402 1272123994 0.93
clickbench_q35/duckdb:vortex-file-compressed 369163674 397608974 0.93
clickbench_q36/duckdb:vortex-file-compressed 26047136 28166211 0.92
clickbench_q37/duckdb:vortex-file-compressed 19779162 20938583 0.94
clickbench_q38/duckdb:vortex-file-compressed 20321418 22513923 0.90
clickbench_q39/duckdb:vortex-file-compressed 39889562 43662889 0.91
clickbench_q40/duckdb:vortex-file-compressed 19623544 21248452 0.92
clickbench_q41/duckdb:vortex-file-compressed 19885935 21282156 0.93
clickbench_q42/duckdb:vortex-file-compressed 🚀 18684930 23617669 0.79
duckdb / parquet (0.967x ➖, 1↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 27203592 26288269 1.03
clickbench_q01/duckdb:parquet 28031923 28210552 0.99
clickbench_q02/duckdb:parquet 48497907 49668587 0.98
clickbench_q03/duckdb:parquet 38314956 38969048 0.98
clickbench_q04/duckdb:parquet 199752397 210467253 0.95
clickbench_q05/duckdb:parquet 264972932 275573512 0.96
clickbench_q06/duckdb:parquet 45992745 46568642 0.99
clickbench_q07/duckdb:parquet 29679989 30227481 0.98
clickbench_q08/duckdb:parquet 264346784 274537791 0.96
clickbench_q09/duckdb:parquet 400922242 410253362 0.98
clickbench_q10/duckdb:parquet 79623240 83292420 0.96
clickbench_q11/duckdb:parquet 98797403 100514522 0.98
clickbench_q12/duckdb:parquet 290932344 297639084 0.98
clickbench_q13/duckdb:parquet 470806587 508476367 0.93
clickbench_q14/duckdb:parquet 320139880 331231296 0.97
clickbench_q15/duckdb:parquet 262433027 275367460 0.95
clickbench_q16/duckdb:parquet 640617054 673686444 0.95
clickbench_q17/duckdb:parquet 538125681 572234716 0.94
clickbench_q18/duckdb:parquet 1061590114 1136648169 0.93
clickbench_q19/duckdb:parquet 25523325 26395637 0.97
clickbench_q20/duckdb:parquet 422057377 442727390 0.95
clickbench_q21/duckdb:parquet 538061331 559288547 0.96
clickbench_q22/duckdb:parquet 933667848 959428104 0.97
clickbench_q23/duckdb:parquet 298392313 317741229 0.94
clickbench_q24/duckdb:parquet 68807897 68797715 1.00
clickbench_q25/duckdb:parquet 155493489 158502482 0.98
clickbench_q26/duckdb:parquet 47708624 49820549 0.96
clickbench_q27/duckdb:parquet 644428990 665386216 0.97
clickbench_q28/duckdb:parquet 4843071730 4957172498 0.98
clickbench_q29/duckdb:parquet 41008626 41081567 1.00
clickbench_q30/duckdb:parquet 299429983 311423833 0.96
clickbench_q31/duckdb:parquet 358929448 383161626 0.94
clickbench_q32/duckdb:parquet 1147482334 1175729173 0.98
clickbench_q33/duckdb:parquet 1257237805 1355208438 0.93
clickbench_q34/duckdb:parquet 1276387519 1387738183 0.92
clickbench_q35/duckdb:parquet 359984092 374036673 0.96
clickbench_q36/duckdb:parquet 43948534 48685040 0.90
clickbench_q37/duckdb:parquet 33503603 33513449 1.00
clickbench_q38/duckdb:parquet 35019134 33498550 1.05
clickbench_q39/duckdb:parquet 86459314 87512339 0.99
clickbench_q40/duckdb:parquet 🚀 17306105 19817914 0.87
clickbench_q41/duckdb:parquet 18440806 18429399 1.00
clickbench_q42/duckdb:parquet 21229365 20788853 1.02
duckdb / duckdb (1.003x ➖, 0↑ 8↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 19893505 17623014 1.13
clickbench_q01/duckdb:duckdb 🚨 36400755 32825705 1.11
clickbench_q02/duckdb:duckdb 48086248 45516257 1.06
clickbench_q03/duckdb:duckdb 50741099 46724959 1.09
clickbench_q04/duckdb:duckdb 187235696 197434524 0.95
clickbench_q05/duckdb:duckdb 263369519 271517227 0.97
clickbench_q06/duckdb:duckdb 38585932 36051335 1.07
clickbench_q07/duckdb:duckdb 🚨 38610908 35074383 1.10
clickbench_q08/duckdb:duckdb 249022033 251455160 0.99
clickbench_q09/duckdb:duckdb 364999165 376505546 0.97
clickbench_q10/duckdb:duckdb 100069523 100363608 1.00
clickbench_q11/duckdb:duckdb 109634695 109298953 1.00
clickbench_q12/duckdb:duckdb 236104827 247650339 0.95
clickbench_q13/duckdb:duckdb 455517001 492072631 0.93
clickbench_q14/duckdb:duckdb 272660806 284912162 0.96
clickbench_q15/duckdb:duckdb 218836469 233626348 0.94
clickbench_q16/duckdb:duckdb 620921373 655985797 0.95
clickbench_q17/duckdb:duckdb 520953069 560960924 0.93
clickbench_q18/duckdb:duckdb 1133754821 1204368333 0.94
clickbench_q19/duckdb:duckdb 🚨 38477433 34868293 1.10
clickbench_q20/duckdb:duckdb 876146636 927338772 0.94
clickbench_q21/duckdb:duckdb 925881409 1002931107 0.92
clickbench_q22/duckdb:duckdb 1034143349 1107920266 0.93
clickbench_q23/duckdb:duckdb 260982708 269769189 0.97
clickbench_q24/duckdb:duckdb 62923298 60943400 1.03
clickbench_q25/duckdb:duckdb 144713588 145442984 0.99
clickbench_q26/duckdb:duckdb 64016997 61158254 1.05
clickbench_q27/duckdb:duckdb 1022429894 1085611629 0.94
clickbench_q28/duckdb:duckdb 4658588753 4704742252 0.99
clickbench_q29/duckdb:duckdb 52418216 48841352 1.07
clickbench_q30/duckdb:duckdb 262707806 272041897 0.97
clickbench_q31/duckdb:duckdb 423300662 424751533 1.00
clickbench_q32/duckdb:duckdb 1465139154 1565210509 0.94
clickbench_q33/duckdb:duckdb 1936015954 2072398458 0.93
clickbench_q34/duckdb:duckdb 2065927409 2215795421 0.93
clickbench_q35/duckdb:duckdb 277193008 284579128 0.97
clickbench_q36/duckdb:duckdb 45295500 42627592 1.06
clickbench_q37/duckdb:duckdb 🚨 34946740 31381492 1.11
clickbench_q38/duckdb:duckdb 32676614 31249610 1.05
clickbench_q39/duckdb:duckdb 68213776 71673739 0.95
clickbench_q40/duckdb:duckdb 🚨 34860362 31668446 1.10
clickbench_q41/duckdb:duckdb 🚨 34126080 30672268 1.11
clickbench_q42/duckdb:duckdb 🚨 35137804 31691568 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +32.7% +1.0% +31.4% +728.3% ➖ noise
0 duckdb:duckdb +12.9% +1.0% +11.8% +288.9% ➖ noise
0 duckdb:vortex-file-compressed -15.6% +1.0% -16.5% +484.6% ➖ noise
1 datafusion:vortex-file-compressed +1.0% -2.6% +3.6% +27.9% ➖ noise
1 duckdb:duckdb +10.9% -2.6% +13.8% +55.4% ➖ noise
1 duckdb:vortex-file-compressed -5.6% -2.6% -3.1% +24.8% ➖ noise
2 datafusion:vortex-file-compressed +6.8% -3.5% +10.6% +16.7% ➖ noise
2 duckdb:duckdb +5.6% -3.5% +9.5% +17.6% ➖ noise
2 duckdb:vortex-file-compressed -7.8% -3.5% -4.4% +12.1% ➖ noise
3 datafusion:vortex-file-compressed -5.0% -4.8% -0.2% +142.1% ➖ noise
3 duckdb:duckdb +8.6% -4.8% +14.1% +32.6% ➖ noise
3 duckdb:vortex-file-compressed -5.9% -4.8% -1.1% +31.4% ➖ noise
4 datafusion:vortex-file-compressed -8.2% -8.6% +0.4% +10.0% ➖ noise
4 duckdb:duckdb -5.2% -8.6% +3.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.6% -8.6% +2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -9.8% -5.4% -4.7% +10.0% ➖ noise
5 duckdb:duckdb -3.0% -5.4% +2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -7.2% -5.4% -1.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -9.5% -2.6% -7.2% +83.5% ➖ noise
6 duckdb:duckdb +7.0% -2.6% +9.8% +28.8% ➖ noise
6 duckdb:vortex-file-compressed -9.2% -2.6% -6.8% +17.7% ➖ noise
7 datafusion:vortex-file-compressed +2.1% -2.8% +5.0% +10.5% ➖ noise
7 duckdb:duckdb +10.1% -2.8% +13.2% +10.4% 🚨 regression
7 duckdb:vortex-file-compressed -3.2% -2.8% -0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.2% -5.6% +0.4% +10.0% ➖ noise
8 duckdb:duckdb -1.0% -5.6% +4.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.2% -5.6% +2.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -9.9% -4.8% -5.4% +10.0% ➖ noise
9 duckdb:duckdb -3.1% -4.8% +1.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.5% -4.8% -1.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.2% -5.1% +2.0% +10.0% ➖ noise
10 duckdb:duckdb -0.3% -5.1% +5.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.6% -5.1% -1.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -7.9% -5.4% -2.7% +10.0% ➖ noise
11 duckdb:duckdb +0.3% -5.4% +6.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -7.0% -5.4% -1.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.0% -4.5% +0.4% +10.0% ➖ noise
12 duckdb:duckdb -4.7% -4.5% -0.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -7.0% -4.5% -2.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -8.4% -9.0% +0.6% +10.0% ➖ noise
13 duckdb:duckdb -7.4% -9.0% +1.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -5.9% -9.0% +3.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -9.6% -5.2% -4.7% +10.0% ➖ noise
14 duckdb:duckdb -4.3% -5.2% +0.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.1% -5.2% +0.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -6.0% -6.3% +0.2% +10.0% ➖ noise
15 duckdb:duckdb -6.3% -6.3% -0.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -4.7% -6.3% +1.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -7.3% -7.0% -0.3% +10.0% ➖ noise
16 duckdb:duckdb -5.3% -7.0% +1.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -6.6% -7.0% +0.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -8.5% -7.0% -1.6% +10.0% ➖ noise
17 duckdb:duckdb -7.1% -7.0% -0.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.7% -7.0% +4.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -8.0% -7.4% -0.7% +10.0% ➖ noise
18 duckdb:duckdb -5.9% -7.4% +1.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -6.9% -7.4% +0.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -7.0% -3.2% -4.0% +17.5% ➖ noise
19 duckdb:duckdb +10.4% -3.2% +13.9% +14.6% ➖ noise
19 duckdb:vortex-file-compressed -10.0% -3.2% -7.1% +19.4% ➖ noise
20 datafusion:vortex-file-compressed -2.7% -5.7% +3.2% +210.6% ➖ noise
20 duckdb:duckdb -5.5% -5.7% +0.2% +24.9% ➖ noise
20 duckdb:vortex-file-compressed -7.3% -5.7% -1.6% +38.7% ➖ noise
21 datafusion:vortex-file-compressed -8.1% -5.6% -2.6% +10.0% ➖ noise
21 duckdb:duckdb -7.7% -5.6% -2.2% +11.5% ➖ noise
21 duckdb:vortex-file-compressed -10.7% -5.6% -5.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.4% -4.4% -1.1% +13.6% ➖ noise
22 duckdb:duckdb -6.7% -4.4% -2.3% +12.8% ➖ noise
22 duckdb:vortex-file-compressed -8.8% -4.4% -4.6% +16.7% ➖ noise
23 datafusion:vortex-file-compressed +6.1% -6.9% +13.9% +32.1% ➖ noise
23 duckdb:duckdb -3.3% -6.9% +3.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -29.9% -6.9% -24.8% +10.0% ✅ faster
24 datafusion:vortex-file-compressed -5.6% -2.0% -3.7% +10.0% ➖ noise
24 duckdb:duckdb +3.2% -2.0% +5.4% +12.9% ➖ noise
24 duckdb:vortex-file-compressed -15.1% -2.0% -13.3% +16.1% ➖ noise
25 datafusion:vortex-file-compressed -6.6% -4.0% -2.7% +10.0% ➖ noise
25 duckdb:duckdb -0.5% -4.0% +3.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +0.7% -4.0% +5.0% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -8.3% -2.3% -6.2% +10.2% ➖ noise
26 duckdb:duckdb +4.7% -2.3% +7.1% +10.1% ➖ noise
26 duckdb:vortex-file-compressed -10.2% -2.3% -8.2% +26.2% ➖ noise
27 datafusion:vortex-file-compressed -3.2% -5.4% +2.3% +10.0% ➖ noise
27 duckdb:duckdb -5.8% -5.4% -0.4% +14.0% ➖ noise
27 duckdb:vortex-file-compressed -4.5% -5.4% +1.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -3.7% -5.1% +1.5% +11.6% ➖ noise
28 duckdb:duckdb -1.0% -5.1% +4.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -3.9% -5.1% +1.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.7% -5.5% +2.0% +10.0% ➖ noise
29 duckdb:duckdb +7.3% -5.5% +13.6% +10.3% 🚨 regression
29 duckdb:vortex-file-compressed -4.2% -5.5% +1.4% +14.6% ➖ noise
30 datafusion:vortex-file-compressed -7.7% -5.8% -2.0% +10.0% ➖ noise
30 duckdb:duckdb -3.4% -5.8% +2.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -5.1% -5.8% +0.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -8.2% -6.5% -1.8% +10.0% ➖ noise
31 duckdb:duckdb -0.3% -6.5% +6.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -6.0% -6.5% +0.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -8.6% -5.0% -3.8% +10.0% ➖ noise
32 duckdb:duckdb -6.4% -5.0% -1.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -5.0% -5.0% +0.0% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -6.5% -7.4% +1.0% +10.0% ➖ noise
33 duckdb:duckdb -6.6% -7.4% +0.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -10.7% -7.4% -3.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -9.5% -7.5% -2.2% +10.0% ➖ noise
34 duckdb:duckdb -6.8% -7.5% +0.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -7.4% -7.5% +0.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -6.3% -6.1% -0.2% +10.0% ➖ noise
35 duckdb:duckdb -2.6% -6.1% +3.8% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -7.2% -6.1% -1.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -9.5% -8.3% -1.3% +10.9% ➖ noise
36 duckdb:duckdb +6.3% -8.3% +15.9% +17.0% ➖ noise
36 duckdb:vortex-file-compressed -7.5% -8.3% +0.9% +13.1% ➖ noise
37 datafusion:vortex-file-compressed -11.6% -3.0% -8.9% +11.4% ➖ noise
37 duckdb:duckdb +11.4% -3.0% +14.8% +11.0% 🚨 regression
37 duckdb:vortex-file-compressed -5.5% -3.0% -2.6% +12.9% ➖ noise
38 datafusion:vortex-file-compressed -5.9% -2.9% -3.1% +13.6% ➖ noise
38 duckdb:duckdb +4.6% -2.9% +7.7% +13.0% ➖ noise
38 duckdb:vortex-file-compressed -9.7% -2.9% -7.0% +13.2% ➖ noise
39 datafusion:vortex-file-compressed -4.3% -3.2% -1.1% +10.0% ➖ noise
39 duckdb:duckdb -4.8% -3.2% -1.7% +18.0% ➖ noise
39 duckdb:vortex-file-compressed -8.6% -3.2% -5.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -12.0% -6.3% -6.1% +10.9% ➖ noise
40 duckdb:duckdb +10.1% -6.3% +17.5% +11.9% 🚨 regression
40 duckdb:vortex-file-compressed -7.6% -6.3% -1.4% +12.5% ➖ noise
41 datafusion:vortex-file-compressed -12.1% -1.8% -10.4% +10.0% ✅ faster
41 duckdb:duckdb +11.3% -1.8% +13.3% +11.8% 🚨 regression
41 duckdb:vortex-file-compressed -6.6% -1.8% -4.8% +13.2% ➖ noise
42 datafusion:vortex-file-compressed -9.4% -4.2% -5.4% +10.5% ➖ noise
42 duckdb:duckdb +10.9% -4.2% +15.7% +12.6% 🚨 regression
42 duckdb:vortex-file-compressed -20.9% -4.2% -17.4% +12.7% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.957x ➖
Parquet (geomean): 0.965x ➖
Shifts: Parquet (control) -3.5% · Median polish -3.2%


datafusion / vortex-file-compressed (0.898x ➖, 2↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 257369780 255958942 1.01
tpch_q02/datafusion:vortex-file-compressed 462947788 415420846 1.11
tpch_q03/datafusion:vortex-file-compressed 451122948 490899488 0.92
tpch_q04/datafusion:vortex-file-compressed 272168180 341807490 0.80
tpch_q05/datafusion:vortex-file-compressed 511263213 457966971 1.12
tpch_q06/datafusion:vortex-file-compressed 342846993 405040450 0.85
tpch_q07/datafusion:vortex-file-compressed 434030432 463481715 0.94
tpch_q08/datafusion:vortex-file-compressed 570797936 646491709 0.88
tpch_q09/datafusion:vortex-file-compressed 373787701 425662910 0.88
tpch_q10/datafusion:vortex-file-compressed 506687080 486795047 1.04
tpch_q11/datafusion:vortex-file-compressed 292622394 308161031 0.95
tpch_q12/datafusion:vortex-file-compressed 520656796 554962023 0.94
tpch_q13/datafusion:vortex-file-compressed 167405775 212122722 0.79
tpch_q14/datafusion:vortex-file-compressed 253843244 288233330 0.88
tpch_q15/datafusion:vortex-file-compressed 482852201 543078385 0.89
tpch_q16/datafusion:vortex-file-compressed 🚀 191089978 300408567 0.64
tpch_q17/datafusion:vortex-file-compressed 397930626 464107818 0.86
tpch_q18/datafusion:vortex-file-compressed 349776146 385172005 0.91
tpch_q19/datafusion:vortex-file-compressed 561756662 524706375 1.07
tpch_q20/datafusion:vortex-file-compressed 451989053 514447995 0.88
tpch_q21/datafusion:vortex-file-compressed 562521453 614034993 0.92
tpch_q22/datafusion:vortex-file-compressed 🚀 111429394 164302793 0.68
datafusion / vortex-compact (1.007x ➖, 1↑ 2↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 393546155 257458158 1.53
tpch_q02/datafusion:vortex-compact 523431100 458007683 1.14
tpch_q03/datafusion:vortex-compact 376584725 439320518 0.86
tpch_q04/datafusion:vortex-compact 400145388 462503389 0.87
tpch_q05/datafusion:vortex-compact 814536539 750538260 1.09
tpch_q06/datafusion:vortex-compact 437951610 426398480 1.03
tpch_q07/datafusion:vortex-compact 🚨 624111949 417289327 1.50
tpch_q08/datafusion:vortex-compact 554829146 613853528 0.90
tpch_q09/datafusion:vortex-compact 418394611 486526050 0.86
tpch_q10/datafusion:vortex-compact 494047456 680148223 0.73
tpch_q11/datafusion:vortex-compact 303751125 326060158 0.93
tpch_q12/datafusion:vortex-compact 519431772 487432071 1.07
tpch_q13/datafusion:vortex-compact 🚀 176777838 255596306 0.69
tpch_q14/datafusion:vortex-compact 327269144 291628844 1.12
tpch_q15/datafusion:vortex-compact 504122966 440326483 1.14
tpch_q16/datafusion:vortex-compact 181714805 185633100 0.98
tpch_q17/datafusion:vortex-compact 410602381 423925717 0.97
tpch_q18/datafusion:vortex-compact 327251381 310002429 1.06
tpch_q19/datafusion:vortex-compact 476570805 462164322 1.03
tpch_q20/datafusion:vortex-compact 453017048 479351205 0.95
tpch_q21/datafusion:vortex-compact 555213752 574341609 0.97
tpch_q22/datafusion:vortex-compact 112138309 97712211 1.15
datafusion / parquet (0.978x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 257406168 224625995 1.15
tpch_q02/datafusion:parquet 380731467 414015172 0.92
tpch_q03/datafusion:parquet 307422364 308850612 1.00
tpch_q04/datafusion:parquet 165446863 164342477 1.01
tpch_q05/datafusion:parquet 455460848 481541217 0.95
tpch_q06/datafusion:parquet 142884066 165975058 0.86
tpch_q07/datafusion:parquet 470521185 498744603 0.94
tpch_q08/datafusion:parquet 556368324 572016952 0.97
tpch_q09/datafusion:parquet 469663148 473878299 0.99
tpch_q10/datafusion:parquet 541479489 521350889 1.04
tpch_q11/datafusion:parquet 369659013 436614200 0.85
tpch_q12/datafusion:parquet 255334726 275003899 0.93
tpch_q13/datafusion:parquet 437971352 455205985 0.96
tpch_q14/datafusion:parquet 204028284 206764986 0.99
tpch_q15/datafusion:parquet 308237514 338003205 0.91
tpch_q16/datafusion:parquet 175052340 194589339 0.90
tpch_q17/datafusion:parquet 477348473 371186313 1.29
tpch_q18/datafusion:parquet 503419519 465734529 1.08
tpch_q19/datafusion:parquet 383383967 366527535 1.05
tpch_q20/datafusion:parquet 312454287 318347806 0.98
tpch_q21/datafusion:parquet 582400293 586543601 0.99
tpch_q22/datafusion:parquet 143846615 166657703 0.86
duckdb / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 311092466 297913860 1.04
tpch_q02/duckdb:vortex-file-compressed 975754557 993101434 0.98
tpch_q03/duckdb:vortex-file-compressed 739609546 734220457 1.01
tpch_q04/duckdb:vortex-file-compressed 397961162 398305330 1.00
tpch_q05/duckdb:vortex-file-compressed 887154690 1033810854 0.86
tpch_q06/duckdb:vortex-file-compressed 434275628 402253018 1.08
tpch_q07/duckdb:vortex-file-compressed 847522078 831931167 1.02
tpch_q08/duckdb:vortex-file-compressed 1002334141 1003093781 1.00
tpch_q09/duckdb:vortex-file-compressed 919615393 872320013 1.05
tpch_q10/duckdb:vortex-file-compressed 738439048 787693370 0.94
tpch_q11/duckdb:vortex-file-compressed 477198578 524231270 0.91
tpch_q12/duckdb:vortex-file-compressed 443243893 520420294 0.85
tpch_q13/duckdb:vortex-file-compressed 471201822 481575789 0.98
tpch_q14/duckdb:vortex-file-compressed 491857747 536513724 0.92
tpch_q15/duckdb:vortex-file-compressed 254080984 288169330 0.88
tpch_q16/duckdb:vortex-file-compressed 402735265 396346088 1.02
tpch_q17/duckdb:vortex-file-compressed 769269962 686629348 1.12
tpch_q18/duckdb:vortex-file-compressed 554937100 528410614 1.05
tpch_q19/duckdb:vortex-file-compressed 431766024 443879445 0.97
tpch_q20/duckdb:vortex-file-compressed 839530285 851752891 0.99
tpch_q21/duckdb:vortex-file-compressed 1058486968 1113926803 0.95
tpch_q22/duckdb:vortex-file-compressed 376663891 393650314 0.96
duckdb / vortex-compact (0.947x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 313844034 285732369 1.10
tpch_q02/duckdb:vortex-compact 928435623 932143922 1.00
tpch_q03/duckdb:vortex-compact 608118835 653287287 0.93
tpch_q04/duckdb:vortex-compact 374655226 392770302 0.95
tpch_q05/duckdb:vortex-compact 847526638 923177413 0.92
tpch_q06/duckdb:vortex-compact 419279429 448028499 0.94
tpch_q07/duckdb:vortex-compact 784559686 861465639 0.91
tpch_q08/duckdb:vortex-compact 947125618 968135484 0.98
tpch_q09/duckdb:vortex-compact 872340330 970732780 0.90
tpch_q10/duckdb:vortex-compact 679573809 679775642 1.00
tpch_q11/duckdb:vortex-compact 451855202 457795192 0.99
tpch_q12/duckdb:vortex-compact 449782698 483940815 0.93
tpch_q13/duckdb:vortex-compact 462831001 448926207 1.03
tpch_q14/duckdb:vortex-compact 464862080 500230979 0.93
tpch_q15/duckdb:vortex-compact 360795894 306908140 1.18
tpch_q16/duckdb:vortex-compact 380022340 410500228 0.93
tpch_q17/duckdb:vortex-compact 637921230 653548143 0.98
tpch_q18/duckdb:vortex-compact 486885391 514183106 0.95
tpch_q19/duckdb:vortex-compact 424480229 561347957 0.76
tpch_q20/duckdb:vortex-compact 733821201 867965940 0.85
tpch_q21/duckdb:vortex-compact 1048408002 1127667947 0.93
tpch_q22/duckdb:vortex-compact 317448300 371143342 0.86
duckdb / parquet (0.953x ➖, 0↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 474512977 479271499 0.99
tpch_q02/duckdb:parquet 1120711463 1146445615 0.98
tpch_q03/duckdb:parquet 1076165473 1058153226 1.02
tpch_q04/duckdb:parquet 632782989 646942683 0.98
tpch_q05/duckdb:parquet 1234782232 1276672447 0.97
tpch_q06/duckdb:parquet 370107728 486895208 0.76
tpch_q07/duckdb:parquet 1141411333 1103721461 1.03
tpch_q08/duckdb:parquet 1464986922 1644767166 0.89
tpch_q09/duckdb:parquet 1269373223 1576431913 0.81
tpch_q10/duckdb:parquet 1289234466 1316196403 0.98
tpch_q11/duckdb:parquet 679528348 744961074 0.91
tpch_q12/duckdb:parquet 716175988 729556978 0.98
tpch_q13/duckdb:parquet 851401398 929506567 0.92
tpch_q14/duckdb:parquet 600965316 653190782 0.92
tpch_q15/duckdb:parquet 503265542 515897297 0.98
tpch_q16/duckdb:parquet 690194892 689163067 1.00
tpch_q17/duckdb:parquet 771724664 826561335 0.93
tpch_q18/duckdb:parquet 836467975 865198795 0.97
tpch_q19/duckdb:parquet 761610809 813154953 0.94
tpch_q20/duckdb:parquet 1124914439 1124536815 1.00
tpch_q21/duckdb:parquet 1099303055 1066407864 1.03
tpch_q22/duckdb:parquet 597482342 566369906 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +52.9% +6.5% +43.5% +68.6% ➖ noise
1 datafusion:vortex-file-compressed +0.6% +6.5% -5.6% +65.9% ➖ noise
1 duckdb:vortex-compact +9.8% +6.5% +3.1% +44.1% ➖ noise
1 duckdb:vortex-file-compressed +4.4% +6.5% -2.0% +49.0% ➖ noise
2 datafusion:vortex-compact +14.3% -5.2% +20.5% +33.9% ➖ noise
2 datafusion:vortex-file-compressed +11.4% -5.2% +17.5% +30.0% ➖ noise
2 duckdb:vortex-compact -0.4% -5.2% +5.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -1.7% -5.2% +3.6% +30.0% ➖ noise
3 datafusion:vortex-compact -14.3% +0.6% -14.8% +52.2% ➖ noise
3 datafusion:vortex-file-compressed -8.1% +0.6% -8.7% +48.9% ➖ noise
3 duckdb:vortex-compact -6.9% +0.6% -7.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +0.7% +0.6% +0.1% +30.0% ➖ noise
4 datafusion:vortex-compact -13.5% -0.8% -12.8% +56.0% ➖ noise
4 datafusion:vortex-file-compressed -20.4% -0.8% -19.8% +47.9% ➖ noise
4 duckdb:vortex-compact -4.6% -0.8% -3.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -0.1% -0.8% +0.7% +30.0% ➖ noise
5 datafusion:vortex-compact +8.5% -4.4% +13.5% +59.3% ➖ noise
5 datafusion:vortex-file-compressed +11.6% -4.4% +16.7% +30.0% ➖ noise
5 duckdb:vortex-compact -8.2% -4.4% -4.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -14.2% -4.4% -10.3% +30.0% ➖ noise
6 datafusion:vortex-compact +2.7% -19.1% +27.0% +37.1% ➖ noise
6 datafusion:vortex-file-compressed -15.4% -19.1% +4.6% +30.0% ➖ noise
6 duckdb:vortex-compact -6.4% -19.1% +15.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +8.0% -19.1% +33.5% +30.0% 🚨 regression
7 datafusion:vortex-compact +49.6% -1.2% +51.4% +46.8% 🚨 regression
7 datafusion:vortex-file-compressed -6.4% -1.2% -5.2% +30.0% ➖ noise
7 duckdb:vortex-compact -8.9% -1.2% -7.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% -1.2% +3.1% +30.0% ➖ noise
8 datafusion:vortex-compact -9.6% -6.9% -2.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -11.7% -6.9% -5.1% +30.0% ➖ noise
8 duckdb:vortex-compact -2.2% -6.9% +5.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% -6.9% +7.4% +30.0% ➖ noise
9 datafusion:vortex-compact -14.0% -10.7% -3.7% +37.5% ➖ noise
9 datafusion:vortex-file-compressed -12.2% -10.7% -1.7% +30.0% ➖ noise
9 duckdb:vortex-compact -10.1% -10.7% +0.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +5.4% -10.7% +18.0% +30.0% ➖ noise
10 datafusion:vortex-compact -27.4% +0.9% -28.0% +38.1% ✅ faster
10 datafusion:vortex-file-compressed +4.1% +0.9% +3.2% +30.0% ➖ noise
10 duckdb:vortex-compact -0.0% +0.9% -0.9% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -6.3% +0.9% -7.1% +30.0% ➖ noise
11 datafusion:vortex-compact -6.8% -12.1% +6.0% +33.6% ➖ noise
11 datafusion:vortex-file-compressed -5.0% -12.1% +8.1% +30.0% ➖ noise
11 duckdb:vortex-compact -1.3% -12.1% +12.3% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -9.0% -12.1% +3.6% +30.0% ➖ noise
12 datafusion:vortex-compact +6.6% -4.5% +11.6% +35.0% ➖ noise
12 datafusion:vortex-file-compressed -6.2% -4.5% -1.7% +30.0% ➖ noise
12 duckdb:vortex-compact -7.1% -4.5% -2.6% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -14.8% -4.5% -10.8% +30.0% ➖ noise
13 datafusion:vortex-compact -30.8% -6.1% -26.3% +56.0% ➖ noise
13 datafusion:vortex-file-compressed -21.1% -6.1% -15.9% +45.7% ➖ noise
13 duckdb:vortex-compact +3.1% -6.1% +9.8% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -2.2% -6.1% +4.2% +30.0% ➖ noise
14 datafusion:vortex-compact +12.2% -4.7% +17.8% +31.3% ➖ noise
14 datafusion:vortex-file-compressed -11.9% -4.7% -7.6% +30.0% ➖ noise
14 duckdb:vortex-compact -7.1% -4.7% -2.5% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -8.3% -4.7% -3.8% +30.0% ➖ noise
15 datafusion:vortex-compact +14.5% -5.7% +21.4% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -11.1% -5.7% -5.7% +30.0% ➖ noise
15 duckdb:vortex-compact +17.6% -5.7% +24.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -11.8% -5.7% -6.5% +30.0% ➖ noise
16 datafusion:vortex-compact -2.1% -5.1% +3.1% +30.6% ➖ noise
16 datafusion:vortex-file-compressed -36.4% -5.1% -33.0% +33.8% ✅ faster
16 duckdb:vortex-compact -7.4% -5.1% -2.5% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +1.6% -5.1% +7.1% +30.5% ➖ noise
17 datafusion:vortex-compact -3.1% +9.6% -11.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -14.3% +9.6% -21.8% +30.0% ➖ noise
17 duckdb:vortex-compact -2.4% +9.6% -10.9% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +12.0% +9.6% +2.2% +30.0% ➖ noise
18 datafusion:vortex-compact +5.6% +2.2% +3.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -9.2% +2.2% -11.2% +30.0% ➖ noise
18 duckdb:vortex-compact -5.3% +2.2% -7.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +5.0% +2.2% +2.7% +30.0% ➖ noise
19 datafusion:vortex-compact +3.1% -1.0% +4.2% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +7.1% -1.0% +8.2% +30.0% ➖ noise
19 duckdb:vortex-compact -24.4% -1.0% -23.6% +30.0% ✅ faster
19 duckdb:vortex-file-compressed -2.7% -1.0% -1.7% +30.0% ➖ noise
20 datafusion:vortex-compact -5.5% -0.9% -4.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -12.1% -0.9% -11.3% +30.0% ➖ noise
20 duckdb:vortex-compact -15.5% -0.9% -14.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -1.4% -0.9% -0.5% +30.0% ➖ noise
21 datafusion:vortex-compact -3.3% +1.2% -4.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -8.4% +1.2% -9.5% +30.0% ➖ noise
21 duckdb:vortex-compact -7.0% +1.2% -8.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -5.0% +1.2% -6.1% +30.0% ➖ noise
22 datafusion:vortex-compact +14.8% -4.6% +20.3% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -32.2% -4.6% -28.9% +39.0% ✅ faster
22 duckdb:vortex-compact -14.5% -4.6% -10.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.3% -4.6% +0.3% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: Compression

Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.995x ➖


unknown / unknown (0.993x ➖, 2↑ 0↓)
name PR 760e55e (ns) base eda8c2c (ns) ratio (PR/base)
compress time/Arade 1127176345 1132211167 1.00
compress time/Bimbo 6664853188 6905971377 0.97
compress time/CMSprovider 2851109082 2854572254 1.00
compress time/Euro2016 419949882 432244538 0.97
compress time/Food 386580451 395309946 0.98
compress time/HashTags 795987307 827735538 0.96
compress time/TPC-H l_comment canonical 1239747477 1309547144 0.95
compress time/TPC-H l_comment chunked 1279710685 1307406556 0.98
compress time/taxi 701646235 717188510 0.98
compress time/wide table cols=100 chunks=1 rows=1000 12811721 11708979 1.09
compress time/wide table cols=100 chunks=50 rows=1000 11362357 11942692 0.95
compress time/wide table cols=1000 chunks=1 rows=1000 128088053 132720428 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 135734857 129759097 1.05
compress time/wide table cols=10000 chunks=1 rows=1000 1402100542 1427418785 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1411925839 1462705500 0.97
decompress time/Arade 25091407 25660918 0.98
decompress time/Bimbo 76121988 81003277 0.94
decompress time/CMSprovider 76818797 74153567 1.04
decompress time/Euro2016 19021775 18315572 1.04
decompress time/Food 7889022 7949861 0.99
decompress time/HashTags 69705225 69710959 1.00
decompress time/TPC-H l_comment canonical 38987861 39080444 1.00
decompress time/TPC-H l_comment chunked 39604911 39227947 1.01
decompress time/taxi 🚀 14102478 16906881 0.83
decompress time/wide table cols=100 chunks=1 rows=1000 2292687 2380075 0.96
decompress time/wide table cols=100 chunks=50 rows=1000 2499531 2422821 1.03
decompress time/wide table cols=1000 chunks=1 rows=1000 23237335 22614972 1.03
decompress time/wide table cols=1000 chunks=50 rows=1000 23366788 22709462 1.03
decompress time/wide table cols=10000 chunks=1 rows=1000 250278384 252205106 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 237815584 261694312 0.91
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2582525892 2635948553 0.98
parquet_rs-zstd compress time/Bimbo 12716940737 12623939810 1.01
parquet_rs-zstd compress time/CMSprovider 6715493294 6777851624 0.99
parquet_rs-zstd compress time/Euro2016 1295486078 1295501878 1.00
parquet_rs-zstd compress time/Food 796511075 789518088 1.01
parquet_rs-zstd compress time/HashTags 2122728134 2124649174 1.00
parquet_rs-zstd compress time/TPC-H l_comment canonical 3152244306 3161765521 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3126607385 3138465573 1.00
parquet_rs-zstd compress time/taxi 1199465441 1203645132 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6020752 6020093 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 5979065 6141940 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 73548656 73759588 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74499983 73424143 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 769135792 789082101 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 762439774 806014981 0.95
parquet_rs-zstd decompress time/Arade 612935585 629557428 0.97
parquet_rs-zstd decompress time/Bimbo 1677738459 1679079170 1.00
parquet_rs-zstd decompress time/CMSprovider 1673103003 1689325886 0.99
parquet_rs-zstd decompress time/Euro2016 371915277 372475899 1.00
parquet_rs-zstd decompress time/Food 197712519 197295756 1.00
parquet_rs-zstd decompress time/HashTags 616304251 616511702 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 582305045 589301567 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 584135765 584158824 1.00
parquet_rs-zstd decompress time/taxi 244477541 247148674 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2765227 2777299 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2764916 2855851 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31903769 32118713 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32665768 32731332 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 339367642 345497896 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 341255895 342171710 1.00
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163395292 163757340 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.02
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.97
vortex:parquet-zstd ratio compress time/Food 0 0 0.97
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.00
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.94
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.05
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio decompress time/Food 0 0 0.99
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.91
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.982x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -1.9%


datafusion / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR 760e55e (ns) base 115b3ba (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 688486484 736604894 0.93
tpch_q02/datafusion:vortex-file-compressed 911059046 929413527 0.98
tpch_q03/datafusion:vortex-file-compressed 1166133742 953419092 1.22
tpch_q04/datafusion:vortex-file-compressed 654545990 712993221 0.92
tpch_q05/datafusion:vortex-file-compressed 992019014 1009617955 0.98
tpch_q06/datafusion:vortex-file-compressed 637425904 654076276 0.97
tpch_q07/datafusion:vortex-file-compressed 982665128 1093802559 0.90
tpch_q08/datafusion:vortex-file-compressed 1216199686 1295258729 0.94
tpch_q09/datafusion:vortex-file-compressed 1336408743 1261917209 1.06
tpch_q10/datafusion:vortex-file-compressed 921884675 983567278 0.94
tpch_q11/datafusion:vortex-file-compressed 555552412 539696849 1.03
tpch_q12/datafusion:vortex-file-compressed 892583227 1036893910 0.86
tpch_q13/datafusion:vortex-file-compressed 408030889 426614677 0.96
tpch_q14/datafusion:vortex-file-compressed 580151552 661694176 0.88
tpch_q15/datafusion:vortex-file-compressed 1166101235 1102539209 1.06
tpch_q16/datafusion:vortex-file-compressed 421858438 403882483 1.04
tpch_q17/datafusion:vortex-file-compressed 1172507040 1187606554 0.99
tpch_q18/datafusion:vortex-file-compressed 1320479719 1251072634 1.06
tpch_q19/datafusion:vortex-file-compressed 991996349 783235097 1.27
tpch_q20/datafusion:vortex-file-compressed 1095507295 1088376463 1.01
tpch_q21/datafusion:vortex-file-compressed 1709124908 1603078496 1.07
tpch_q22/datafusion:vortex-file-compressed 410822188 380472336 1.08
datafusion / vortex-compact (0.938x ➖, 0↑ 0↓)
name PR 760e55e (ns) base 115b3ba (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 667842429 687855791 0.97
tpch_q02/datafusion:vortex-compact 625972567 665829929 0.94
tpch_q03/datafusion:vortex-compact 682016783 827100636 0.82
tpch_q04/datafusion:vortex-compact 616161496 631121393 0.98
tpch_q05/datafusion:vortex-compact 1042077664 1114483945 0.94
tpch_q06/datafusion:vortex-compact 700140865 642776786 1.09
tpch_q07/datafusion:vortex-compact 1026379479 966812818 1.06
tpch_q08/datafusion:vortex-compact 1040860942 1126046754 0.92
tpch_q09/datafusion:vortex-compact 1222461140 1193108557 1.02
tpch_q10/datafusion:vortex-compact 934629749 939009224 1.00
tpch_q11/datafusion:vortex-compact 378807586 530957033 0.71
tpch_q12/datafusion:vortex-compact 732561049 941613516 0.78
tpch_q13/datafusion:vortex-compact 425571767 392001467 1.09
tpch_q14/datafusion:vortex-compact 541154905 586995788 0.92
tpch_q15/datafusion:vortex-compact 1024597508 1070498158 0.96
tpch_q16/datafusion:vortex-compact 330333280 393981162 0.84
tpch_q17/datafusion:vortex-compact 1150275350 1136402003 1.01
tpch_q18/datafusion:vortex-compact 1137838245 1090049018 1.04
tpch_q19/datafusion:vortex-compact 815032868 919423863 0.89
tpch_q20/datafusion:vortex-compact 892158586 876273171 1.02
tpch_q21/datafusion:vortex-compact 1320923771 1444444288 0.91
tpch_q22/datafusion:vortex-compact 355917133 423552108 0.84
datafusion / parquet (1.034x ➖, 1↑ 2↓)
name PR 760e55e (ns) base 115b3ba (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 810911603 913235138 0.89
tpch_q02/datafusion:parquet 🚀 690132512 1024061019 0.67
tpch_q03/datafusion:parquet 1036883831 1033910413 1.00
tpch_q04/datafusion:parquet 570151411 474713620 1.20
tpch_q05/datafusion:parquet 1211891289 1083417106 1.12
tpch_q06/datafusion:parquet 511602994 544982439 0.94
tpch_q07/datafusion:parquet 1189767196 1317843387 0.90
tpch_q08/datafusion:parquet 1712627437 1682500739 1.02
tpch_q09/datafusion:parquet 1808728002 1792300705 1.01
tpch_q10/datafusion:parquet 1973910773 1934180083 1.02
tpch_q11/datafusion:parquet 🚨 849208216 549906969 1.54
tpch_q12/datafusion:parquet 776264327 639681141 1.21
tpch_q13/datafusion:parquet 769595321 662418805 1.16
tpch_q14/datafusion:parquet 767198209 745864963 1.03
tpch_q15/datafusion:parquet 1296585141 1249493033 1.04
tpch_q16/datafusion:parquet 🚨 527716275 326350586 1.62
tpch_q17/datafusion:parquet 1369055726 1349895166 1.01
tpch_q18/datafusion:parquet 1477170947 1608615615 0.92
tpch_q19/datafusion:parquet 862604572 913393723 0.94
tpch_q20/datafusion:parquet 1087391926 1255408912 0.87
tpch_q21/datafusion:parquet 1837033844 1879848122 0.98
tpch_q22/datafusion:parquet 785989297 756759771 1.04
duckdb / vortex-file-compressed (0.959x ➖, 0↑ 0↓)
name PR 760e55e (ns) base 115b3ba (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 596886552 604446990 0.99
tpch_q02/duckdb:vortex-file-compressed 1091270524 1181254407 0.92
tpch_q03/duckdb:vortex-file-compressed 855905577 1031224172 0.83
tpch_q04/duckdb:vortex-file-compressed 580978171 701470514 0.83
tpch_q05/duckdb:vortex-file-compressed 977905639 1072905519 0.91
tpch_q06/duckdb:vortex-file-compressed 750675210 857946004 0.87
tpch_q07/duckdb:vortex-file-compressed 1142478387 1149413155 0.99
tpch_q08/duckdb:vortex-file-compressed 1387166195 1334534957 1.04
tpch_q09/duckdb:vortex-file-compressed 1362577322 1358165705 1.00
tpch_q10/duckdb:vortex-file-compressed 1099741150 1053364411 1.04
tpch_q11/duckdb:vortex-file-compressed 661140183 663566836 1.00
tpch_q12/duckdb:vortex-file-compressed 691279750 714500641 0.97
tpch_q13/duckdb:vortex-file-compressed 968064274 1009137667 0.96
tpch_q14/duckdb:vortex-file-compressed 858413298 879376452 0.98
tpch_q15/duckdb:vortex-file-compressed 510204757 526550428 0.97
tpch_q16/duckdb:vortex-file-compressed 481654613 460653324 1.05
tpch_q17/duckdb:vortex-file-compressed 933110785 941644112 0.99
tpch_q18/duckdb:vortex-file-compressed 891373032 871408293 1.02
tpch_q19/duckdb:vortex-file-compressed 727994004 725714648 1.00
tpch_q20/duckdb:vortex-file-compressed 1106629588 1213406201 0.91
tpch_q21/duckdb:vortex-file-compressed 1846607161 1933934507 0.95
tpch_q22/duckdb:vortex-file-compressed 567523817 626104152 0.91
duckdb / vortex-compact (1.033x ➖, 0↑ 0↓)
name PR 760e55e (ns) base 115b3ba (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 571923084 593616198 0.96
tpch_q02/duckdb:vortex-compact 1068710955 1001783841 1.07
tpch_q03/duckdb:vortex-compact 967362219 805200739 1.20
tpch_q04/duckdb:vortex-compact 516610240 523522768 0.99
tpch_q05/duckdb:vortex-compact 958940385 979597719 0.98
tpch_q06/duckdb:vortex-compact 706130651 697302649 1.01
tpch_q07/duckdb:vortex-compact 1034559096 1053046693 0.98
tpch_q08/duckdb:vortex-compact 1428966680 1289407232 1.11
tpch_q09/duckdb:vortex-compact 1338321554 1372885517 0.97
tpch_q10/duckdb:vortex-compact 1077205146 1073534399 1.00
tpch_q11/duckdb:vortex-compact 647500801 622509683 1.04
tpch_q12/duckdb:vortex-compact 646810238 627798631 1.03
tpch_q13/duckdb:vortex-compact 858374523 841491680 1.02
tpch_q14/duckdb:vortex-compact 803724545 808823047 0.99
tpch_q15/duckdb:vortex-compact 576691270 518375994 1.11
tpch_q16/duckdb:vortex-compact 414711841 432032859 0.96
tpch_q17/duckdb:vortex-compact 886941174 871438894 1.02
tpch_q18/duckdb:vortex-compact 769230710 716077237 1.07
tpch_q19/duckdb:vortex-compact 716079112 710678926 1.01
tpch_q20/duckdb:vortex-compact 1206577317 1134773424 1.06
tpch_q21/duckdb:vortex-compact 1818986953 1626026939 1.12
tpch_q22/duckdb:vortex-compact 648450114 620506084 1.05
duckdb / parquet (0.972x ➖, 0↑ 0↓)
name PR 760e55e (ns) base 115b3ba (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 867893932 813641510 1.07
tpch_q02/duckdb:parquet 1317720335 1309679237 1.01
tpch_q03/duckdb:parquet 1712063356 1597570101 1.07
tpch_q04/duckdb:parquet 924115167 1071954194 0.86
tpch_q05/duckdb:parquet 1835649538 1916357423 0.96
tpch_q06/duckdb:parquet 830980772 663915368 1.25
tpch_q07/duckdb:parquet 1693547709 1791459205 0.95
tpch_q08/duckdb:parquet 2215646966 2434657058 0.91
tpch_q09/duckdb:parquet 2476834461 2566409958 0.97
tpch_q10/duckdb:parquet 2886675913 3005648682 0.96
tpch_q11/duckdb:parquet 831970246 918390625 0.91
tpch_q12/duckdb:parquet 1031705017 1178315953 0.88
tpch_q13/duckdb:parquet 1114898846 1206941245 0.92
tpch_q14/duckdb:parquet 1198974432 1196422796 1.00
tpch_q15/duckdb:parquet 847985011 883118654 0.96
tpch_q16/duckdb:parquet 843257595 856070722 0.99
tpch_q17/duckdb:parquet 1180759710 1260025621 0.94
tpch_q18/duckdb:parquet 1253270961 1442335138 0.87
tpch_q19/duckdb:parquet 1407727049 1585942810 0.89
tpch_q20/duckdb:parquet 1789570225 1865700921 0.96
tpch_q21/duckdb:parquet 1750047435 1653915543 1.06
tpch_q22/duckdb:parquet 1135967055 1021599697 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.9% -2.7% -0.2% +38.7% ➖ noise
1 datafusion:vortex-file-compressed -6.5% -2.7% -4.0% +45.1% ➖ noise
1 duckdb:vortex-compact -3.7% -2.7% -1.0% +30.6% ➖ noise
1 duckdb:vortex-file-compressed -1.3% -2.7% +1.5% +30.0% ➖ noise
2 datafusion:vortex-compact -6.0% -17.7% +14.2% +36.1% ➖ noise
2 datafusion:vortex-file-compressed -2.0% -17.7% +19.0% +40.3% ➖ noise
2 duckdb:vortex-compact +6.7% -17.7% +29.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -7.6% -17.7% +12.2% +31.8% ➖ noise
3 datafusion:vortex-compact -17.5% +3.7% -20.5% +47.1% ➖ noise
3 datafusion:vortex-file-compressed +22.3% +3.7% +18.0% +48.6% ➖ noise
3 duckdb:vortex-compact +20.1% +3.7% +15.9% +35.9% ➖ noise
3 duckdb:vortex-file-compressed -17.0% +3.7% -19.9% +40.9% ➖ noise
4 datafusion:vortex-compact -2.4% +1.8% -4.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -8.2% +1.8% -9.8% +30.0% ➖ noise
4 duckdb:vortex-compact -1.3% +1.8% -3.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -17.2% +1.8% -18.6% +30.0% ➖ noise
5 datafusion:vortex-compact -6.5% +3.5% -9.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.7% +3.5% -5.1% +30.0% ➖ noise
5 duckdb:vortex-compact -2.1% +3.5% -5.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.9% +3.5% -11.9% +30.0% ➖ noise
6 datafusion:vortex-compact +8.9% +8.4% +0.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.5% +8.4% -10.1% +30.0% ➖ noise
6 duckdb:vortex-compact +1.3% +8.4% -6.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -12.5% +8.4% -19.3% +30.0% ➖ noise
7 datafusion:vortex-compact +6.2% -7.6% +14.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -10.2% -7.6% -2.8% +30.0% ➖ noise
7 duckdb:vortex-compact -1.8% -7.6% +6.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -0.6% -7.6% +7.6% +30.0% ➖ noise
8 datafusion:vortex-compact -7.6% -3.8% -4.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -6.1% -3.8% -2.4% +30.0% ➖ noise
8 duckdb:vortex-compact +10.8% -3.8% +15.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.9% -3.8% +8.0% +30.0% ➖ noise
9 datafusion:vortex-compact +2.5% -1.3% +3.8% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +5.9% -1.3% +7.3% +30.0% ➖ noise
9 duckdb:vortex-compact -2.5% -1.3% -1.2% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +0.3% -1.3% +1.7% +30.0% ➖ noise
10 datafusion:vortex-compact -0.5% -1.0% +0.5% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -6.3% -1.0% -5.3% +30.0% ➖ noise
10 duckdb:vortex-compact +0.3% -1.0% +1.4% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +4.4% -1.0% +5.5% +30.0% ➖ noise
11 datafusion:vortex-compact -28.7% +18.3% -39.7% +30.0% ✅ faster
11 datafusion:vortex-file-compressed +2.9% +18.3% -13.0% +30.0% ➖ noise
11 duckdb:vortex-compact +4.0% +18.3% -12.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -0.4% +18.3% -15.8% +30.0% ➖ noise
12 datafusion:vortex-compact -22.2% +3.1% -24.5% +30.0% ✅ faster
12 datafusion:vortex-file-compressed -13.9% +3.1% -16.5% +30.0% ➖ noise
12 duckdb:vortex-compact +3.0% +3.1% -0.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -3.2% +3.1% -6.1% +30.0% ➖ noise
13 datafusion:vortex-compact +8.6% +3.6% +4.8% +30.8% ➖ noise
13 datafusion:vortex-file-compressed -4.4% +3.6% -7.7% +30.0% ➖ noise
13 duckdb:vortex-compact +2.0% +3.6% -1.5% +39.6% ➖ noise
13 duckdb:vortex-file-compressed -4.1% +3.6% -7.4% +37.1% ➖ noise
14 datafusion:vortex-compact -7.8% +1.5% -9.2% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -12.3% +1.5% -13.6% +30.0% ➖ noise
14 duckdb:vortex-compact -0.6% +1.5% -2.1% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -2.4% +1.5% -3.9% +30.0% ➖ noise
15 datafusion:vortex-compact -4.3% -0.2% -4.1% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +5.8% -0.2% +6.0% +30.0% ➖ noise
15 duckdb:vortex-compact +11.2% -0.2% +11.5% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -3.1% -0.2% -2.9% +30.0% ➖ noise
16 datafusion:vortex-compact -16.2% +26.2% -33.6% +46.9% ✅ faster
16 datafusion:vortex-file-compressed +4.5% +26.2% -17.2% +30.0% ➖ noise
16 duckdb:vortex-compact -4.0% +26.2% -23.9% +30.7% ✅ faster
16 duckdb:vortex-file-compressed +4.6% +26.2% -17.2% +30.0% ➖ noise
17 datafusion:vortex-compact +1.2% -2.5% +3.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -1.3% -2.5% +1.3% +30.0% ➖ noise
17 duckdb:vortex-compact +1.8% -2.5% +4.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -0.9% -2.5% +1.6% +30.0% ➖ noise
18 datafusion:vortex-compact +4.4% -10.7% +16.9% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +5.5% -10.7% +18.2% +30.0% ➖ noise
18 duckdb:vortex-compact +7.4% -10.7% +20.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +2.3% -10.7% +14.5% +30.0% ➖ noise
19 datafusion:vortex-compact -11.4% -8.4% -3.2% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +26.7% -8.4% +38.3% +30.0% 🚨 regression
19 duckdb:vortex-compact +0.8% -8.4% +10.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +0.3% -8.4% +9.6% +30.0% ➖ noise
20 datafusion:vortex-compact +1.8% -8.9% +11.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +0.7% -8.9% +10.4% +30.0% ➖ noise
20 duckdb:vortex-compact +6.3% -8.9% +16.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -8.8% -8.9% +0.1% +30.0% ➖ noise
21 datafusion:vortex-compact -8.6% +1.7% -10.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +6.6% +1.7% +4.8% +30.0% ➖ noise
21 duckdb:vortex-compact +11.9% +1.7% +10.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -4.5% +1.7% -6.1% +30.0% ➖ noise
22 datafusion:vortex-compact -16.0% +7.5% -21.8% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +8.0% +7.5% +0.5% +36.9% ➖ noise
22 duckdb:vortex-compact +4.5% +7.5% -2.8% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -9.4% +7.5% -15.7% +30.0% ➖ noise

u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
u
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant