Skip to content

Late materialization support for duckdb#7631

Open
myrrc wants to merge 1 commit intodevelopfrom
myrrc/duckdb-row-id-columns
Open

Late materialization support for duckdb#7631
myrrc wants to merge 1 commit intodevelopfrom
myrrc/duckdb-row-id-columns

Conversation

@myrrc
Copy link
Copy Markdown
Contributor

@myrrc myrrc commented Apr 24, 2026

Add file_index, file_row_number virtual columns.
Add file-based filtering (range, selection) to ScanRequest.
Add partition index method (TODO hacky).
Add late materialization support and row id columns support in duckdb.

@myrrc myrrc added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 24, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels Apr 24, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 696cff3 1 Explore Profiling Data
Previous Runs (4)
Status Commit Job Attempt Link
🟢 Done 8325606 2 Explore Profiling Data
🟢 Done 8325606 1 Explore Profiling Data
🟢 Done b0f2e4a 1 Explore Profiling Data
🟢 Done a3e6376 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.939x ➖


datafusion / vortex-file-compressed (0.939x ➖, 1↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 118357800 129069071 0.92
polarsignals_q01/datafusion:vortex-file-compressed 🚀 260261803 325245783 0.80
polarsignals_q02/datafusion:vortex-file-compressed 24848713 26373058 0.94
polarsignals_q03/datafusion:vortex-file-compressed 288307342 304420320 0.95
polarsignals_q04/datafusion:vortex-file-compressed 12724316 13962703 0.91
polarsignals_q05/datafusion:vortex-file-compressed 16609589 17361311 0.96
polarsignals_q06/datafusion:vortex-file-compressed 19860489 19597663 1.01
polarsignals_q07/datafusion:vortex-file-compressed 15282883 16064556 0.95
polarsignals_q08/datafusion:vortex-file-compressed 379464552 401769803 0.94
polarsignals_q09/datafusion:vortex-file-compressed 13229634 12851188 1.03

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +1.2%


datafusion / vortex-file-compressed (1.052x ➖, 0↑ 3↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5692615 5086568 1.12
fineweb_q01/datafusion:vortex-file-compressed 22448736 22287053 1.01
fineweb_q02/datafusion:vortex-file-compressed 🚨 24289323 21644072 1.12
fineweb_q03/datafusion:vortex-file-compressed 83179245 80232470 1.04
fineweb_q04/datafusion:vortex-file-compressed 237074260 239972465 0.99
fineweb_q05/datafusion:vortex-file-compressed 216783675 216686024 1.00
fineweb_q06/datafusion:vortex-file-compressed 56831714 52751297 1.08
fineweb_q07/datafusion:vortex-file-compressed 🚨 62763480 56174685 1.12
fineweb_q08/datafusion:vortex-file-compressed 22942837 22777786 1.01
datafusion / vortex-compact (1.021x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6259325 5810395 1.08
fineweb_q01/datafusion:vortex-compact 127900009 125966974 1.02
fineweb_q02/datafusion:vortex-compact 133026021 129618676 1.03
fineweb_q03/datafusion:vortex-compact 1037231729 1021719005 1.02
fineweb_q04/datafusion:vortex-compact 1112913998 1123827113 0.99
fineweb_q05/datafusion:vortex-compact 960767096 954750276 1.01
fineweb_q06/datafusion:vortex-compact 537267624 529633640 1.01
fineweb_q07/datafusion:vortex-compact 554786026 550267290 1.01
fineweb_q08/datafusion:vortex-compact 19498330 18737858 1.04
datafusion / parquet (1.021x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6392475 6240996 1.02
fineweb_q01/datafusion:parquet 281349632 283756447 0.99
fineweb_q02/datafusion:parquet 290035999 284948129 1.02
fineweb_q03/datafusion:parquet 294222873 279009113 1.05
fineweb_q04/datafusion:parquet 303002028 295556972 1.03
fineweb_q05/datafusion:parquet 297947528 299273651 1.00
fineweb_q06/datafusion:parquet 290035543 288319831 1.01
fineweb_q07/datafusion:parquet 292115682 277594474 1.05
fineweb_q08/datafusion:parquet 279125195 272534427 1.02
duckdb / vortex-file-compressed (0.992x ➖, 2↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3424589 2950086 1.16
fineweb_q01/duckdb:vortex-file-compressed 23903017 22528135 1.06
fineweb_q02/duckdb:vortex-file-compressed 23607000 23412352 1.01
fineweb_q03/duckdb:vortex-file-compressed 🚀 120370510 154980727 0.78
fineweb_q04/duckdb:vortex-file-compressed 221231985 223033995 0.99
fineweb_q05/duckdb:vortex-file-compressed 213368094 215361759 0.99
fineweb_q06/duckdb:vortex-file-compressed 52811347 51720200 1.02
fineweb_q07/duckdb:vortex-file-compressed 58209582 54169341 1.07
fineweb_q08/duckdb:vortex-file-compressed 🚀 22584276 25203273 0.90
duckdb / vortex-compact (0.997x ➖, 1↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3890133 3733273 1.04
fineweb_q01/duckdb:vortex-compact 108827209 101569148 1.07
fineweb_q02/duckdb:vortex-compact 118012141 112502287 1.05
fineweb_q03/duckdb:vortex-compact 870155351 856836912 1.02
fineweb_q04/duckdb:vortex-compact 904394486 897434127 1.01
fineweb_q05/duckdb:vortex-compact 807435976 811031426 1.00
fineweb_q06/duckdb:vortex-compact 449998423 454996653 0.99
fineweb_q07/duckdb:vortex-compact 473839317 468767285 1.01
fineweb_q08/duckdb:vortex-compact 🚀 22208207 27186343 0.82
duckdb / parquet (1.020x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 27778046 26812763 1.04
fineweb_q01/duckdb:parquet 84576705 81440654 1.04
fineweb_q02/duckdb:parquet 84948141 83458095 1.02
fineweb_q03/duckdb:parquet 309889016 306738601 1.01
fineweb_q04/duckdb:parquet 440626765 437764304 1.01
fineweb_q05/duckdb:parquet 410526476 407952352 1.01
fineweb_q06/duckdb:parquet 198177955 197789425 1.00
fineweb_q07/duckdb:parquet 208985771 207833289 1.01
fineweb_q08/duckdb:parquet 34419126 32542086 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +7.7% +3.0% +4.6% +52.5% ➖ noise
0 datafusion:vortex-file-compressed +11.9% +3.0% +8.6% +54.5% ➖ noise
0 duckdb:vortex-compact +4.2% +3.0% +1.2% +49.0% ➖ noise
0 duckdb:vortex-file-compressed +16.1% +3.0% +12.7% +80.9% ➖ noise
1 datafusion:vortex-compact +1.5% +1.5% +0.1% +17.3% ➖ noise
1 datafusion:vortex-file-compressed +0.7% +1.5% -0.7% +21.6% ➖ noise
1 duckdb:vortex-compact +7.1% +1.5% +5.6% +23.4% ➖ noise
1 duckdb:vortex-file-compressed +6.1% +1.5% +4.6% +60.1% ➖ noise
2 datafusion:vortex-compact +2.6% +1.8% +0.8% +15.5% ➖ noise
2 datafusion:vortex-file-compressed +12.2% +1.8% +10.3% +12.6% ➖ noise
2 duckdb:vortex-compact +4.9% +1.8% +3.1% +11.9% ➖ noise
2 duckdb:vortex-file-compressed +0.8% +1.8% -0.9% +12.6% ➖ noise
3 datafusion:vortex-compact +1.5% +3.2% -1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.7% +3.2% +0.4% +43.6% ➖ noise
3 duckdb:vortex-compact +1.6% +3.2% -1.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -22.3% +3.2% -24.8% +21.7% ✅ faster
4 datafusion:vortex-compact -1.0% +1.6% -2.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.2% +1.6% -2.7% +10.0% ➖ noise
4 duckdb:vortex-compact +0.8% +1.6% -0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +1.6% -2.4% +10.0% ➖ noise
5 datafusion:vortex-compact +0.6% +0.1% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.0% +0.1% -0.0% +10.0% ➖ noise
5 duckdb:vortex-compact -0.4% +0.1% -0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.9% +0.1% -1.0% +10.0% ➖ noise
6 datafusion:vortex-compact +1.4% +0.4% +1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +7.7% +0.4% +7.3% +10.0% ➖ noise
6 duckdb:vortex-compact -1.1% +0.4% -1.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.1% +0.4% +1.7% +10.0% ➖ noise
7 datafusion:vortex-compact +0.8% +2.9% -2.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +11.7% +2.9% +8.6% +29.6% ➖ noise
7 duckdb:vortex-compact +1.1% +2.9% -1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +7.5% +2.9% +4.5% +18.8% ➖ noise
8 datafusion:vortex-compact +4.1% +4.1% -0.0% +14.9% ➖ noise
8 datafusion:vortex-file-compressed +0.7% +4.1% -3.2% +14.7% ➖ noise
8 duckdb:vortex-compact -18.3% +4.1% -21.5% +22.3% ✅ faster
8 duckdb:vortex-file-compressed -10.4% +4.1% -13.9% +22.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Vortex (geomean): 1.068x ➖
Parquet (geomean): 1.057x ➖
Shifts: Parquet (control) +5.7% · Median polish +6.2%


datafusion / vortex-file-compressed (1.084x ➖, 0↑ 7↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 54279695 51701935 1.05
tpch_q02/datafusion:vortex-file-compressed 23423835 21766800 1.08
tpch_q03/datafusion:vortex-file-compressed 🚨 31186438 28215603 1.11
tpch_q04/datafusion:vortex-file-compressed 22901124 21408488 1.07
tpch_q05/datafusion:vortex-file-compressed 🚨 53879896 48897163 1.10
tpch_q06/datafusion:vortex-file-compressed 14209720 13431546 1.06
tpch_q07/datafusion:vortex-file-compressed 60973002 55772261 1.09
tpch_q08/datafusion:vortex-file-compressed 42606954 40180755 1.06
tpch_q09/datafusion:vortex-file-compressed 55304834 52394729 1.06
tpch_q10/datafusion:vortex-file-compressed 43046969 39916877 1.08
tpch_q11/datafusion:vortex-file-compressed 17731343 16405869 1.08
tpch_q12/datafusion:vortex-file-compressed 28284216 27040718 1.05
tpch_q13/datafusion:vortex-file-compressed 26760834 26653397 1.00
tpch_q14/datafusion:vortex-file-compressed 18558205 17134221 1.08
tpch_q15/datafusion:vortex-file-compressed 🚨 29700836 26546397 1.12
tpch_q16/datafusion:vortex-file-compressed 🚨 21188042 19131786 1.11
tpch_q17/datafusion:vortex-file-compressed 🚨 76879725 68882006 1.12
tpch_q18/datafusion:vortex-file-compressed 🚨 95902942 80896129 1.19
tpch_q19/datafusion:vortex-file-compressed 26389053 24013175 1.10
tpch_q20/datafusion:vortex-file-compressed 33275401 31002360 1.07
tpch_q21/datafusion:vortex-file-compressed 81674972 75210214 1.09
tpch_q22/datafusion:vortex-file-compressed 🚨 13937462 12451262 1.12
datafusion / vortex-compact (1.082x ➖, 0↑ 6↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63688419 58911640 1.08
tpch_q02/datafusion:vortex-compact 27683295 25498829 1.09
tpch_q03/datafusion:vortex-compact 🚨 33592184 30090389 1.12
tpch_q04/datafusion:vortex-compact 26506154 25005717 1.06
tpch_q05/datafusion:vortex-compact 56714193 51795157 1.09
tpch_q06/datafusion:vortex-compact 16381800 14939545 1.10
tpch_q07/datafusion:vortex-compact 🚨 66625558 60468939 1.10
tpch_q08/datafusion:vortex-compact 🚨 49029253 43822665 1.12
tpch_q09/datafusion:vortex-compact 60796676 57605148 1.06
tpch_q10/datafusion:vortex-compact 🚨 52279181 47265945 1.11
tpch_q11/datafusion:vortex-compact 18114523 16934912 1.07
tpch_q12/datafusion:vortex-compact 35907636 33992765 1.06
tpch_q13/datafusion:vortex-compact 33626340 31429701 1.07
tpch_q14/datafusion:vortex-compact 21992990 20453807 1.08
tpch_q15/datafusion:vortex-compact 35269478 33437517 1.05
tpch_q16/datafusion:vortex-compact 24573100 23947595 1.03
tpch_q17/datafusion:vortex-compact 🚨 77212675 68084150 1.13
tpch_q18/datafusion:vortex-compact 91832029 85860684 1.07
tpch_q19/datafusion:vortex-compact 32941967 31206502 1.06
tpch_q20/datafusion:vortex-compact 🚨 38580150 34915779 1.10
tpch_q21/datafusion:vortex-compact 87109882 80187536 1.09
tpch_q22/datafusion:vortex-compact 13901478 12713587 1.09
datafusion / parquet (1.083x ➖, 0↑ 6↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 139868370 102011945 1.37
tpch_q02/datafusion:parquet 🚨 70019969 62394395 1.12
tpch_q03/datafusion:parquet 76001990 73333414 1.04
tpch_q04/datafusion:parquet 47449543 44687944 1.06
tpch_q05/datafusion:parquet 103056435 94794064 1.09
tpch_q06/datafusion:parquet 🚨 44238187 35721842 1.24
tpch_q07/datafusion:parquet 112172735 104937122 1.07
tpch_q08/datafusion:parquet 101195411 100420083 1.01
tpch_q09/datafusion:parquet 138388786 131044730 1.06
tpch_q10/datafusion:parquet 123553110 112999663 1.09
tpch_q11/datafusion:parquet 🚨 46849453 41731251 1.12
tpch_q12/datafusion:parquet 86219557 83825047 1.03
tpch_q13/datafusion:parquet 204436354 192743090 1.06
tpch_q14/datafusion:parquet 48955163 49211289 0.99
tpch_q15/datafusion:parquet 64277397 58646509 1.10
tpch_q16/datafusion:parquet 47069604 44873169 1.05
tpch_q17/datafusion:parquet 🚨 149248871 126048624 1.18
tpch_q18/datafusion:parquet 🚨 181259456 161420549 1.12
tpch_q19/datafusion:parquet 82492799 88221373 0.94
tpch_q20/datafusion:parquet 73728968 70003443 1.05
tpch_q21/datafusion:parquet 145093667 142018872 1.02
tpch_q22/datafusion:parquet 32893433 30418539 1.08
datafusion / arrow (1.165x ❌, 0↑ 17↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 57534217 50640310 1.14
tpch_q02/datafusion:arrow 19778397 19213686 1.03
tpch_q03/datafusion:arrow 🚨 35770779 30025930 1.19
tpch_q04/datafusion:arrow 🚨 30929907 25141724 1.23
tpch_q05/datafusion:arrow 🚨 95240325 73813132 1.29
tpch_q06/datafusion:arrow 🚨 26079636 19873221 1.31
tpch_q07/datafusion:arrow 🚨 117619156 101485765 1.16
tpch_q08/datafusion:arrow 🚨 53862744 45313646 1.19
tpch_q09/datafusion:arrow 73352010 67338458 1.09
tpch_q10/datafusion:arrow 🚨 56286698 49531459 1.14
tpch_q11/datafusion:arrow 10077460 9360583 1.08
tpch_q12/datafusion:arrow 🚨 58177067 51544948 1.13
tpch_q13/datafusion:arrow 50570052 48163768 1.05
tpch_q14/datafusion:arrow 🚨 25304754 22481543 1.13
tpch_q15/datafusion:arrow 🚨 52041564 46784357 1.11
tpch_q16/datafusion:arrow 20563361 19186743 1.07
tpch_q17/datafusion:arrow 🚨 79669581 67823816 1.17
tpch_q18/datafusion:arrow 🚨 156952148 134700534 1.17
tpch_q19/datafusion:arrow 🚨 46680642 34557644 1.35
tpch_q20/datafusion:arrow 🚨 45453443 33609654 1.35
tpch_q21/datafusion:arrow 🚨 171613778 141565832 1.21
tpch_q22/datafusion:arrow 🚨 19145390 17162222 1.12
duckdb / vortex-file-compressed (1.055x ➖, 0↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31875531 31491178 1.01
tpch_q02/duckdb:vortex-file-compressed 24867019 24910951 1.00
tpch_q03/duckdb:vortex-file-compressed 29832008 28923635 1.03
tpch_q04/duckdb:vortex-file-compressed 29620187 28932925 1.02
tpch_q05/duckdb:vortex-file-compressed 33500390 32076500 1.04
tpch_q06/duckdb:vortex-file-compressed 11011887 10443908 1.05
tpch_q07/duckdb:vortex-file-compressed 38278517 36301189 1.05
tpch_q08/duckdb:vortex-file-compressed 38378851 37608867 1.02
tpch_q09/duckdb:vortex-file-compressed 77005831 72697207 1.06
tpch_q10/duckdb:vortex-file-compressed 35793671 34219771 1.05
tpch_q11/duckdb:vortex-file-compressed 15580633 14384563 1.08
tpch_q12/duckdb:vortex-file-compressed 23182222 22060886 1.05
tpch_q13/duckdb:vortex-file-compressed 36806977 34210954 1.08
tpch_q14/duckdb:vortex-file-compressed 🚨 23620335 19890205 1.19
tpch_q15/duckdb:vortex-file-compressed 17382720 16184279 1.07
tpch_q16/duckdb:vortex-file-compressed 29680971 27666918 1.07
tpch_q17/duckdb:vortex-file-compressed 25719918 24636787 1.04
tpch_q18/duckdb:vortex-file-compressed 51385959 49239591 1.04
tpch_q19/duckdb:vortex-file-compressed 30897137 28878807 1.07
tpch_q20/duckdb:vortex-file-compressed 36465671 34171488 1.07
tpch_q21/duckdb:vortex-file-compressed 112262400 105982800 1.06
tpch_q22/duckdb:vortex-file-compressed 18067652 17214737 1.05
duckdb / vortex-compact (1.052x ➖, 0↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39328184 38384018 1.02
tpch_q02/duckdb:vortex-compact 36907694 36064848 1.02
tpch_q03/duckdb:vortex-compact 33778621 31745645 1.06
tpch_q04/duckdb:vortex-compact 35641245 33890784 1.05
tpch_q05/duckdb:vortex-compact 39712443 36795106 1.08
tpch_q06/duckdb:vortex-compact 15281844 15086822 1.01
tpch_q07/duckdb:vortex-compact 45160651 41726310 1.08
tpch_q08/duckdb:vortex-compact 45652820 45309190 1.01
tpch_q09/duckdb:vortex-compact 89840864 82678083 1.09
tpch_q10/duckdb:vortex-compact 40730385 38367901 1.06
tpch_q11/duckdb:vortex-compact 19778020 18903834 1.05
tpch_q12/duckdb:vortex-compact 36201131 34650010 1.04
tpch_q13/duckdb:vortex-compact 45642914 43272691 1.05
tpch_q14/duckdb:vortex-compact 30910044 29351572 1.05
tpch_q15/duckdb:vortex-compact 20519462 19291794 1.06
tpch_q16/duckdb:vortex-compact 36353790 33602347 1.08
tpch_q17/duckdb:vortex-compact 🚨 33141007 29726567 1.11
tpch_q18/duckdb:vortex-compact 51195254 49465187 1.03
tpch_q19/duckdb:vortex-compact 36883219 35544326 1.04
tpch_q20/duckdb:vortex-compact 43712411 42528837 1.03
tpch_q21/duckdb:vortex-compact 119579061 111430265 1.07
tpch_q22/duckdb:vortex-compact 20227842 19549629 1.03
duckdb / parquet (1.032x ➖, 1↑ 2↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 78561737 89630140 0.88
tpch_q02/duckdb:parquet 41280663 38682124 1.07
tpch_q03/duckdb:parquet 72976543 69003524 1.06
tpch_q04/duckdb:parquet 49899470 47045120 1.06
tpch_q05/duckdb:parquet 71539484 67452206 1.06
tpch_q06/duckdb:parquet 20822869 20388812 1.02
tpch_q07/duckdb:parquet 71314057 71459660 1.00
tpch_q08/duckdb:parquet 🚨 89574701 80081678 1.12
tpch_q09/duckdb:parquet 149863709 144322124 1.04
tpch_q10/duckdb:parquet 124060553 123275063 1.01
tpch_q11/duckdb:parquet 24537761 22421825 1.09
tpch_q12/duckdb:parquet 47339359 45849374 1.03
tpch_q13/duckdb:parquet 🚨 277222982 248291979 1.12
tpch_q14/duckdb:parquet 50454283 49996557 1.01
tpch_q15/duckdb:parquet 25126696 24965861 1.01
tpch_q16/duckdb:parquet 58262784 56143831 1.04
tpch_q17/duckdb:parquet 51556872 50950918 1.01
tpch_q18/duckdb:parquet 113558843 113947102 1.00
tpch_q19/duckdb:parquet 66499740 65057372 1.02
tpch_q20/duckdb:parquet 64980612 64779932 1.00
tpch_q21/duckdb:parquet 173325701 160341877 1.08
tpch_q22/duckdb:parquet 51312411 51011259 1.01
duckdb / duckdb (1.040x ➖, 0↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16206692 16093704 1.01
tpch_q02/duckdb:duckdb 13408563 12196039 1.10
tpch_q03/duckdb:duckdb 🚨 20207316 18151937 1.11
tpch_q04/duckdb:duckdb 19532667 19724918 0.99
tpch_q05/duckdb:duckdb 20724817 19635718 1.06
tpch_q06/duckdb:duckdb 5513721 5486892 1.00
tpch_q07/duckdb:duckdb 23249726 22193669 1.05
tpch_q08/duckdb:duckdb 21367080 20932399 1.02
tpch_q09/duckdb:duckdb 57719036 52890587 1.09
tpch_q10/duckdb:duckdb 44761124 44492177 1.01
tpch_q11/duckdb:duckdb 6181049 5946669 1.04
tpch_q12/duckdb:duckdb 14010423 14087253 0.99
tpch_q13/duckdb:duckdb 38059309 37237935 1.02
tpch_q14/duckdb:duckdb 18621292 17355581 1.07
tpch_q15/duckdb:duckdb 12549512 12172407 1.03
tpch_q16/duckdb:duckdb 24101684 23965884 1.01
tpch_q17/duckdb:duckdb 14323016 14200424 1.01
tpch_q18/duckdb:duckdb 39325255 38152107 1.03
tpch_q19/duckdb:duckdb 30061594 27675066 1.09
tpch_q20/duckdb:duckdb 23430675 22419399 1.05
tpch_q21/duckdb:duckdb 61478743 56281386 1.09
tpch_q22/duckdb:duckdb 25495842 24619712 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +13.6% +9.6% +3.6% +20.8% ➖ noise
1 datafusion:vortex-compact +8.1% +9.6% -1.4% +18.6% ➖ noise
1 datafusion:vortex-file-compressed +5.0% +9.6% -4.2% +20.4% ➖ noise
1 duckdb:duckdb +0.7% +9.6% -8.1% +19.5% ➖ noise
1 duckdb:vortex-compact +2.5% +9.6% -6.5% +18.7% ➖ noise
1 duckdb:vortex-file-compressed +1.2% +9.6% -7.7% +21.8% ➖ noise
2 datafusion:arrow +2.9% +9.4% -5.9% +10.0% ➖ noise
2 datafusion:vortex-compact +8.6% +9.4% -0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +7.6% +9.4% -1.7% +10.0% ➖ noise
2 duckdb:duckdb +9.9% +9.4% +0.5% +10.0% ➖ noise
2 duckdb:vortex-compact +2.3% +9.4% -6.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.2% +9.4% -8.8% +10.0% ➖ noise
3 datafusion:arrow +19.1% +4.7% +13.8% +10.0% 🚨 regression
3 datafusion:vortex-compact +11.6% +4.7% +6.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +10.5% +4.7% +5.6% +10.0% ➖ noise
3 duckdb:duckdb +11.3% +4.7% +6.3% +11.6% ➖ noise
3 duckdb:vortex-compact +6.4% +4.7% +1.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.1% +4.7% -1.5% +11.7% ➖ noise
4 datafusion:arrow +23.0% +6.1% +15.9% +10.0% 🚨 regression
4 datafusion:vortex-compact +6.0% +6.1% -0.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +7.0% +6.1% +0.8% +10.0% ➖ noise
4 duckdb:duckdb -1.0% +6.1% -6.7% +10.0% ➖ noise
4 duckdb:vortex-compact +5.2% +6.1% -0.9% +12.5% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +6.1% -3.5% +10.0% ➖ noise
5 datafusion:arrow +29.0% +7.4% +20.2% +10.0% 🚨 regression
5 datafusion:vortex-compact +9.5% +7.4% +2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +10.2% +7.4% +2.6% +10.0% ➖ noise
5 duckdb:duckdb +5.5% +7.4% -1.7% +10.3% ➖ noise
5 duckdb:vortex-compact +7.9% +7.4% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.4% +7.4% -2.7% +14.5% ➖ noise
6 datafusion:arrow +31.2% +12.5% +16.7% +17.7% ➖ noise
6 datafusion:vortex-compact +9.7% +12.5% -2.5% +15.8% ➖ noise
6 datafusion:vortex-file-compressed +5.8% +12.5% -5.9% +14.9% ➖ noise
6 duckdb:duckdb +0.5% +12.5% -10.6% +14.7% ➖ noise
6 duckdb:vortex-compact +1.3% +12.5% -9.9% +22.2% ➖ noise
6 duckdb:vortex-file-compressed +5.4% +12.5% -6.2% +14.2% ➖ noise
7 datafusion:arrow +15.9% +3.3% +12.2% +11.6% 🚨 regression
7 datafusion:vortex-compact +10.2% +3.3% +6.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +9.3% +3.3% +5.8% +10.0% ➖ noise
7 duckdb:duckdb +4.8% +3.3% +1.4% +10.0% ➖ noise
7 duckdb:vortex-compact +8.2% +3.3% +4.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.4% +3.3% +2.1% +10.0% ➖ noise
8 datafusion:arrow +18.9% +6.2% +12.0% +10.2% 🚨 regression
8 datafusion:vortex-compact +11.9% +6.2% +5.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +6.0% +6.2% -0.1% +10.0% ➖ noise
8 duckdb:duckdb +2.1% +6.2% -3.9% +10.0% ➖ noise
8 duckdb:vortex-compact +0.8% +6.2% -5.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.0% +6.2% -3.9% +11.5% ➖ noise
9 datafusion:arrow +8.9% +4.7% +4.0% +10.2% ➖ noise
9 datafusion:vortex-compact +5.5% +4.7% +0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +5.6% +4.7% +0.8% +10.0% ➖ noise
9 duckdb:duckdb +9.1% +4.7% +4.2% +10.0% ➖ noise
9 duckdb:vortex-compact +8.7% +4.7% +3.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +5.9% +4.7% +1.2% +10.0% ➖ noise
10 datafusion:arrow +13.6% +4.9% +8.3% +10.8% ➖ noise
10 datafusion:vortex-compact +10.6% +4.9% +5.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +7.8% +4.9% +2.8% +10.0% ➖ noise
10 duckdb:duckdb +0.6% +4.9% -4.1% +11.2% ➖ noise
10 duckdb:vortex-compact +6.2% +4.9% +1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.6% +4.9% -0.3% +10.0% ➖ noise
11 datafusion:arrow +7.7% +10.8% -2.9% +10.0% ➖ noise
11 datafusion:vortex-compact +7.0% +10.8% -3.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +8.1% +10.8% -2.5% +10.0% ➖ noise
11 duckdb:duckdb +3.9% +10.8% -6.2% +10.0% ➖ noise
11 duckdb:vortex-compact +4.6% +10.8% -5.6% +11.1% ➖ noise
11 duckdb:vortex-file-compressed +8.3% +10.8% -2.3% +13.1% ➖ noise
12 datafusion:arrow +12.9% +3.1% +9.5% +18.3% ➖ noise
12 datafusion:vortex-compact +5.6% +3.1% +2.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.6% +3.1% +1.5% +11.9% ➖ noise
12 duckdb:duckdb -0.5% +3.1% -3.5% +10.3% ➖ noise
12 duckdb:vortex-compact +4.5% +3.1% +1.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +5.1% +3.1% +2.0% +11.9% ➖ noise
13 datafusion:arrow +5.0% +8.8% -3.5% +10.0% ➖ noise
13 datafusion:vortex-compact +7.0% +8.8% -1.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.4% +8.8% -7.7% +10.0% ➖ noise
13 duckdb:duckdb +2.2% +8.8% -6.1% +10.6% ➖ noise
13 duckdb:vortex-compact +5.5% +8.8% -3.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +7.6% +8.8% -1.1% +10.0% ➖ noise
14 datafusion:arrow +12.6% +0.2% +12.3% +10.9% 🚨 regression
14 datafusion:vortex-compact +7.5% +0.2% +7.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +8.3% +0.2% +8.1% +10.0% ➖ noise
14 duckdb:duckdb +7.3% +0.2% +7.1% +17.7% ➖ noise
14 duckdb:vortex-compact +5.3% +0.2% +5.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +18.8% +0.2% +18.5% +13.9% 🚨 regression
15 datafusion:arrow +11.2% +5.0% +5.9% +11.7% ➖ noise
15 datafusion:vortex-compact +5.5% +5.0% +0.4% +11.5% ➖ noise
15 datafusion:vortex-file-compressed +11.9% +5.0% +6.5% +14.3% ➖ noise
15 duckdb:duckdb +3.1% +5.0% -1.8% +13.1% ➖ noise
15 duckdb:vortex-compact +6.4% +5.0% +1.3% +14.2% ➖ noise
15 duckdb:vortex-file-compressed +7.4% +5.0% +2.3% +12.8% ➖ noise
16 datafusion:arrow +7.2% +4.3% +2.7% +10.0% ➖ noise
16 datafusion:vortex-compact +2.6% +4.3% -1.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +10.7% +4.3% +6.1% +10.0% ➖ noise
16 duckdb:duckdb +0.6% +4.3% -3.6% +10.0% ➖ noise
16 duckdb:vortex-compact +8.2% +4.3% +3.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +7.3% +4.3% +2.8% +10.0% ➖ noise
17 datafusion:arrow +17.5% +9.5% +7.3% +12.5% ➖ noise
17 datafusion:vortex-compact +13.4% +9.5% +3.6% +10.7% ➖ noise
17 datafusion:vortex-file-compressed +11.6% +9.5% +2.0% +13.0% ➖ noise
17 duckdb:duckdb +0.9% +9.5% -7.9% +11.1% ➖ noise
17 duckdb:vortex-compact +11.5% +9.5% +1.9% +13.7% ➖ noise
17 duckdb:vortex-file-compressed +4.4% +9.5% -4.6% +12.4% ➖ noise
18 datafusion:arrow +16.5% +5.8% +10.1% +10.0% 🚨 regression
18 datafusion:vortex-compact +7.0% +5.8% +1.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +18.6% +5.8% +12.1% +10.0% 🚨 regression
18 duckdb:duckdb +3.1% +5.8% -2.6% +10.0% ➖ noise
18 duckdb:vortex-compact +3.5% +5.8% -2.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.4% +5.8% -1.3% +10.0% ➖ noise
19 datafusion:arrow +35.1% -2.2% +38.2% +15.1% 🚨 regression
19 datafusion:vortex-compact +5.6% -2.2% +8.0% +12.8% ➖ noise
19 datafusion:vortex-file-compressed +9.9% -2.2% +12.4% +13.8% ➖ noise
19 duckdb:duckdb +8.6% -2.2% +11.1% +12.3% ➖ noise
19 duckdb:vortex-compact +3.8% -2.2% +6.1% +13.0% ➖ noise
19 duckdb:vortex-file-compressed +7.0% -2.2% +9.4% +14.1% ➖ noise
20 datafusion:arrow +35.2% +2.8% +31.6% +10.3% 🚨 regression
20 datafusion:vortex-compact +10.5% +2.8% +7.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +7.3% +2.8% +4.4% +10.0% ➖ noise
20 duckdb:duckdb +4.5% +2.8% +1.7% +10.0% ➖ noise
20 duckdb:vortex-compact +2.8% +2.8% -0.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +6.7% +2.8% +3.8% +11.2% ➖ noise
21 datafusion:arrow +21.2% +5.1% +15.4% +10.0% 🚨 regression
21 datafusion:vortex-compact +8.6% +5.1% +3.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +8.6% +5.1% +3.3% +10.0% ➖ noise
21 duckdb:duckdb +9.2% +5.1% +3.9% +10.0% ➖ noise
21 duckdb:vortex-compact +7.3% +5.1% +2.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +5.9% +5.1% +0.8% +10.0% ➖ noise
22 datafusion:arrow +11.6% +4.3% +7.0% +10.0% ➖ noise
22 datafusion:vortex-compact +9.3% +4.3% +4.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +11.9% +4.3% +7.3% +10.0% ➖ noise
22 duckdb:duckdb +3.6% +4.3% -0.7% +10.0% ➖ noise
22 duckdb:vortex-compact +3.5% +4.3% -0.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +5.0% +4.3% +0.6% +12.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.1%
Vortex (geomean): 1.114x ❌
Parquet (geomean): 1.075x ➖
Shifts: Parquet (control) +7.5% · Median polish +10.5%


datafusion / vortex-file-compressed (1.113x ❌, 1↑ 58↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 27559918 24387919 1.13
tpcds_q02/datafusion:vortex-file-compressed 49474097 46279587 1.07
tpcds_q03/datafusion:vortex-file-compressed 16319296 15803959 1.03
tpcds_q04/datafusion:vortex-file-compressed 🚨 277930962 246343696 1.13
tpcds_q05/datafusion:vortex-file-compressed 47865959 44265986 1.08
tpcds_q06/datafusion:vortex-file-compressed 60151536 58856973 1.02
tpcds_q07/datafusion:vortex-file-compressed 🚨 44874824 39851219 1.13
tpcds_q08/datafusion:vortex-file-compressed 32212490 29985875 1.07
tpcds_q09/datafusion:vortex-file-compressed 47546441 45439832 1.05
tpcds_q10/datafusion:vortex-file-compressed 40700033 37556331 1.08
tpcds_q11/datafusion:vortex-file-compressed 🚨 147097679 130699736 1.13
tpcds_q12/datafusion:vortex-file-compressed 20435753 19780883 1.03
tpcds_q13/datafusion:vortex-file-compressed 45094435 43834680 1.03
tpcds_q14/datafusion:vortex-file-compressed 182530839 167569084 1.09
tpcds_q15/datafusion:vortex-file-compressed 29052839 26937267 1.08
tpcds_q16/datafusion:vortex-file-compressed 🚨 31849101 28005993 1.14
tpcds_q17/datafusion:vortex-file-compressed 🚨 67587756 60362989 1.12
tpcds_q18/datafusion:vortex-file-compressed 70319606 68936477 1.02
tpcds_q19/datafusion:vortex-file-compressed 23130172 21592104 1.07
tpcds_q20/datafusion:vortex-file-compressed 🚨 23871434 20333786 1.17
tpcds_q21/datafusion:vortex-file-compressed 🚨 39792861 34798383 1.14
tpcds_q22/datafusion:vortex-file-compressed 151133414 148554846 1.02
tpcds_q23/datafusion:vortex-file-compressed 🚨 163755691 147487935 1.11
tpcds_q24/datafusion:vortex-file-compressed 🚨 90319918 81220400 1.11
tpcds_q25/datafusion:vortex-file-compressed 🚨 73573981 65302712 1.13
tpcds_q26/datafusion:vortex-file-compressed 34788989 34171320 1.02
tpcds_q27/datafusion:vortex-file-compressed 110699261 103677002 1.07
tpcds_q28/datafusion:vortex-file-compressed 43460873 42983949 1.01
tpcds_q29/datafusion:vortex-file-compressed 🚨 69960142 62243956 1.12
tpcds_q30/datafusion:vortex-file-compressed 25132547 22933705 1.10
tpcds_q31/datafusion:vortex-file-compressed 🚨 81895583 72550434 1.13
tpcds_q32/datafusion:vortex-file-compressed 🚨 22328016 20111850 1.11
tpcds_q33/datafusion:vortex-file-compressed 31968603 29570022 1.08
tpcds_q34/datafusion:vortex-file-compressed 25503301 23659013 1.08
tpcds_q35/datafusion:vortex-file-compressed 🚨 48508814 43754606 1.11
tpcds_q36/datafusion:vortex-file-compressed 61888042 57103299 1.08
tpcds_q37/datafusion:vortex-file-compressed 🚨 28760507 24802708 1.16
tpcds_q38/datafusion:vortex-file-compressed 🚨 48065078 43117790 1.11
tpcds_q39/datafusion:vortex-file-compressed 🚨 121702432 102206037 1.19
tpcds_q40/datafusion:vortex-file-compressed 34922933 32320738 1.08
tpcds_q41/datafusion:vortex-file-compressed 🚨 18017578 15447054 1.17
tpcds_q42/datafusion:vortex-file-compressed 🚨 16087034 13716884 1.17
tpcds_q43/datafusion:vortex-file-compressed 20208886 18889164 1.07
tpcds_q44/datafusion:vortex-file-compressed 34306037 32964018 1.04
tpcds_q45/datafusion:vortex-file-compressed 28655142 26668880 1.07
tpcds_q46/datafusion:vortex-file-compressed 🚨 40424912 34798021 1.16
tpcds_q47/datafusion:vortex-file-compressed 🚨 144593722 129365106 1.12
tpcds_q48/datafusion:vortex-file-compressed 🚨 41297092 37436728 1.10
tpcds_q49/datafusion:vortex-file-compressed 🚨 63125535 57187730 1.10
tpcds_q50/datafusion:vortex-file-compressed 42542150 39006015 1.09
tpcds_q51/datafusion:vortex-file-compressed 93413288 87265267 1.07
tpcds_q52/datafusion:vortex-file-compressed 15332275 14337833 1.07
tpcds_q53/datafusion:vortex-file-compressed 🚨 23186762 21038160 1.10
tpcds_q54/datafusion:vortex-file-compressed 37505072 35746284 1.05
tpcds_q55/datafusion:vortex-file-compressed 🚨 15052583 13628348 1.10
tpcds_q56/datafusion:vortex-file-compressed 30760975 29802997 1.03
tpcds_q57/datafusion:vortex-file-compressed 108881896 113296055 0.96
tpcds_q58/datafusion:vortex-file-compressed 56049812 52352134 1.07
tpcds_q59/datafusion:vortex-file-compressed 58939241 56985437 1.03
tpcds_q60/datafusion:vortex-file-compressed 32321274 30311561 1.07
tpcds_q61/datafusion:vortex-file-compressed 43940660 40925611 1.07
tpcds_q62/datafusion:vortex-file-compressed 🚀 24809692 27610248 0.90
tpcds_q63/datafusion:vortex-file-compressed 🚨 23536137 20652564 1.14
tpcds_q64/datafusion:vortex-file-compressed 436073718 420506287 1.04
tpcds_q65/datafusion:vortex-file-compressed 🚨 44358100 39192833 1.13
tpcds_q66/datafusion:vortex-file-compressed 78597346 73262837 1.07
tpcds_q67/datafusion:vortex-file-compressed 154062011 142563446 1.08
tpcds_q68/datafusion:vortex-file-compressed 🚨 37699772 32614927 1.16
tpcds_q69/datafusion:vortex-file-compressed 🚨 39709239 35577129 1.12
tpcds_q70/datafusion:vortex-file-compressed 91718981 86455201 1.06
tpcds_q71/datafusion:vortex-file-compressed 24673350 23627243 1.04
tpcds_q72/datafusion:vortex-file-compressed 🚨 2336500988 2113101523 1.11
tpcds_q73/datafusion:vortex-file-compressed 🚨 25436602 22527907 1.13
tpcds_q74/datafusion:vortex-file-compressed 🚨 96586901 77501596 1.25
tpcds_q75/datafusion:vortex-file-compressed 🚨 127466604 107935437 1.18
tpcds_q76/datafusion:vortex-file-compressed 🚨 27133874 23514979 1.15
tpcds_q77/datafusion:vortex-file-compressed 🚨 44812220 38588686 1.16
tpcds_q78/datafusion:vortex-file-compressed 🚨 145059456 122355836 1.19
tpcds_q79/datafusion:vortex-file-compressed 🚨 33577816 28139710 1.19
tpcds_q80/datafusion:vortex-file-compressed 🚨 105859430 94106536 1.12
tpcds_q81/datafusion:vortex-file-compressed 🚨 30364597 23673794 1.28
tpcds_q82/datafusion:vortex-file-compressed 🚨 31076744 26021111 1.19
tpcds_q83/datafusion:vortex-file-compressed 🚨 41164104 32815770 1.25
tpcds_q84/datafusion:vortex-file-compressed 🚨 15522816 12653879 1.23
tpcds_q85/datafusion:vortex-file-compressed 🚨 100578931 89856742 1.12
tpcds_q86/datafusion:vortex-file-compressed 🚨 19998232 15325871 1.30
tpcds_q87/datafusion:vortex-file-compressed 🚨 51731498 43724815 1.18
tpcds_q88/datafusion:vortex-file-compressed 🚨 62782863 54743093 1.15
tpcds_q89/datafusion:vortex-file-compressed 🚨 27959365 24939671 1.12
tpcds_q90/datafusion:vortex-file-compressed 🚨 17810551 14598356 1.22
tpcds_q91/datafusion:vortex-file-compressed 🚨 23100533 18065482 1.28
tpcds_q92/datafusion:vortex-file-compressed 🚨 22526974 18416944 1.22
tpcds_q93/datafusion:vortex-file-compressed 🚨 42696108 32949259 1.30
tpcds_q94/datafusion:vortex-file-compressed 🚨 27291258 22950026 1.19
tpcds_q95/datafusion:vortex-file-compressed 🚨 67907842 58984745 1.15
tpcds_q96/datafusion:vortex-file-compressed 🚨 16776679 13533429 1.24
tpcds_q97/datafusion:vortex-file-compressed 🚨 37836359 33397041 1.13
tpcds_q98/datafusion:vortex-file-compressed 🚨 27460651 24439446 1.12
tpcds_q99/datafusion:vortex-file-compressed 🚨 35879279 31149758 1.15
datafusion / vortex-compact (1.137x ❌, 0↑ 83↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 28399023 24673482 1.15
tpcds_q02/datafusion:vortex-compact 🚨 58224687 52865221 1.10
tpcds_q03/datafusion:vortex-compact 🚨 21851585 19323052 1.13
tpcds_q04/datafusion:vortex-compact 321032350 298184943 1.08
tpcds_q05/datafusion:vortex-compact 🚨 53544914 46999971 1.14
tpcds_q06/datafusion:vortex-compact 64435570 62261157 1.03
tpcds_q07/datafusion:vortex-compact 🚨 62645872 54532805 1.15
tpcds_q08/datafusion:vortex-compact 🚨 38851241 35277258 1.10
tpcds_q09/datafusion:vortex-compact 🚨 69301909 62109271 1.12
tpcds_q10/datafusion:vortex-compact 🚨 56931595 48607122 1.17
tpcds_q11/datafusion:vortex-compact 🚨 174018311 157618569 1.10
tpcds_q12/datafusion:vortex-compact 🚨 28957281 22177550 1.31
tpcds_q13/datafusion:vortex-compact 93592799 94344683 0.99
tpcds_q14/datafusion:vortex-compact 224337377 204410774 1.10
tpcds_q15/datafusion:vortex-compact 🚨 35138485 30067425 1.17
tpcds_q16/datafusion:vortex-compact 35725022 32536413 1.10
tpcds_q17/datafusion:vortex-compact 🚨 89017835 72750677 1.22
tpcds_q18/datafusion:vortex-compact 🚨 87037038 77429327 1.12
tpcds_q19/datafusion:vortex-compact 🚨 33841413 30447102 1.11
tpcds_q20/datafusion:vortex-compact 🚨 28002935 25175303 1.11
tpcds_q21/datafusion:vortex-compact 🚨 45332288 40241240 1.13
tpcds_q22/datafusion:vortex-compact 139013571 127947586 1.09
tpcds_q23/datafusion:vortex-compact 🚨 190520073 161970093 1.18
tpcds_q24/datafusion:vortex-compact 🚨 109900937 95936219 1.15
tpcds_q25/datafusion:vortex-compact 🚨 89593421 79526769 1.13
tpcds_q26/datafusion:vortex-compact 🚨 48658355 43721039 1.11
tpcds_q27/datafusion:vortex-compact 🚨 141746450 126563069 1.12
tpcds_q28/datafusion:vortex-compact 80817935 78330171 1.03
tpcds_q29/datafusion:vortex-compact 🚨 84566983 72881885 1.16
tpcds_q30/datafusion:vortex-compact 30640774 30405778 1.01
tpcds_q31/datafusion:vortex-compact 🚨 110569560 95378567 1.16
tpcds_q32/datafusion:vortex-compact 🚨 27562219 25052966 1.10
tpcds_q33/datafusion:vortex-compact 🚨 42054089 35948545 1.17
tpcds_q34/datafusion:vortex-compact 34416844 32876571 1.05
tpcds_q35/datafusion:vortex-compact 🚨 57986804 50706419 1.14
tpcds_q36/datafusion:vortex-compact 🚨 84653165 72550249 1.17
tpcds_q37/datafusion:vortex-compact 🚨 44297816 39860859 1.11
tpcds_q38/datafusion:vortex-compact 🚨 60372598 52125671 1.16
tpcds_q39/datafusion:vortex-compact 🚨 133721387 114321447 1.17
tpcds_q40/datafusion:vortex-compact 🚨 44307604 36165251 1.23
tpcds_q41/datafusion:vortex-compact 🚨 21944060 18213091 1.20
tpcds_q42/datafusion:vortex-compact 🚨 21135601 18303917 1.15
tpcds_q43/datafusion:vortex-compact 🚨 27256618 24383496 1.12
tpcds_q44/datafusion:vortex-compact 🚨 53529117 48452971 1.10
tpcds_q45/datafusion:vortex-compact 🚨 36489362 30133323 1.21
tpcds_q46/datafusion:vortex-compact 🚨 49966755 44171772 1.13
tpcds_q47/datafusion:vortex-compact 🚨 167917204 150062557 1.12
tpcds_q48/datafusion:vortex-compact 74694797 69440338 1.08
tpcds_q49/datafusion:vortex-compact 🚨 82053326 68615626 1.20
tpcds_q50/datafusion:vortex-compact 🚨 54617059 46162067 1.18
tpcds_q51/datafusion:vortex-compact 🚨 107572142 97715345 1.10
tpcds_q52/datafusion:vortex-compact 🚨 20770817 18549038 1.12
tpcds_q53/datafusion:vortex-compact 🚨 31684903 28303980 1.12
tpcds_q54/datafusion:vortex-compact 🚨 47063928 42047265 1.12
tpcds_q55/datafusion:vortex-compact 🚨 20656181 18095301 1.14
tpcds_q56/datafusion:vortex-compact 🚨 40304374 35536316 1.13
tpcds_q57/datafusion:vortex-compact 🚨 135451455 114642396 1.18
tpcds_q58/datafusion:vortex-compact 67506190 63253255 1.07
tpcds_q59/datafusion:vortex-compact 77225002 70269409 1.10
tpcds_q60/datafusion:vortex-compact 🚨 41350784 35495535 1.16
tpcds_q61/datafusion:vortex-compact 🚨 60422071 53440568 1.13
tpcds_q62/datafusion:vortex-compact 🚨 31652977 24493672 1.29
tpcds_q63/datafusion:vortex-compact 🚨 31265449 28421489 1.10
tpcds_q64/datafusion:vortex-compact 🚨 514102809 443160670 1.16
tpcds_q65/datafusion:vortex-compact 🚨 60447122 53894605 1.12
tpcds_q66/datafusion:vortex-compact 🚨 88278790 78167737 1.13
tpcds_q67/datafusion:vortex-compact 🚨 164570508 147262193 1.12
tpcds_q68/datafusion:vortex-compact 🚨 54176819 44848537 1.21
tpcds_q69/datafusion:vortex-compact 52010863 47319450 1.10
tpcds_q70/datafusion:vortex-compact 🚨 112714156 98785088 1.14
tpcds_q71/datafusion:vortex-compact 🚨 34146974 30686971 1.11
tpcds_q72/datafusion:vortex-compact 🚨 2482196000 2130861066 1.16
tpcds_q73/datafusion:vortex-compact 🚨 34193173 30735058 1.11
tpcds_q74/datafusion:vortex-compact 🚨 106147165 92874683 1.14
tpcds_q75/datafusion:vortex-compact 🚨 139594463 125771072 1.11
tpcds_q76/datafusion:vortex-compact 🚨 37221856 33401632 1.11
tpcds_q77/datafusion:vortex-compact 🚨 57912592 50752144 1.14
tpcds_q78/datafusion:vortex-compact 🚨 165248611 135568150 1.22
tpcds_q79/datafusion:vortex-compact 🚨 44177331 38994956 1.13
tpcds_q80/datafusion:vortex-compact 🚨 125204390 104200307 1.20
tpcds_q81/datafusion:vortex-compact 🚨 32786888 29159629 1.12
tpcds_q82/datafusion:vortex-compact 🚨 45568072 40850862 1.12
tpcds_q83/datafusion:vortex-compact 🚨 38655452 32513096 1.19
tpcds_q84/datafusion:vortex-compact 🚨 18326889 13861335 1.32
tpcds_q85/datafusion:vortex-compact 🚨 141677904 125315769 1.13
tpcds_q86/datafusion:vortex-compact 21196343 21906383 0.97
tpcds_q87/datafusion:vortex-compact 🚨 61473663 52185897 1.18
tpcds_q88/datafusion:vortex-compact 🚨 89403186 75926401 1.18
tpcds_q89/datafusion:vortex-compact 🚨 34757437 30845161 1.13
tpcds_q90/datafusion:vortex-compact 🚨 17726023 15031124 1.18
tpcds_q91/datafusion:vortex-compact 36605242 33434647 1.09
tpcds_q92/datafusion:vortex-compact 🚨 28789426 23304812 1.24
tpcds_q93/datafusion:vortex-compact 🚨 43721532 38209897 1.14
tpcds_q94/datafusion:vortex-compact 🚨 33230513 26107302 1.27
tpcds_q95/datafusion:vortex-compact 67055026 64702428 1.04
tpcds_q96/datafusion:vortex-compact 🚨 19870854 16907627 1.18
tpcds_q97/datafusion:vortex-compact 🚨 41913615 36622461 1.14
tpcds_q98/datafusion:vortex-compact 🚨 33498621 29682139 1.13
tpcds_q99/datafusion:vortex-compact 🚨 37754935 31707244 1.19
datafusion / parquet (1.073x ➖, 0↑ 28↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚨 32996454 29468939 1.12
tpcds_q02/datafusion:parquet 43639310 41266457 1.06
tpcds_q03/datafusion:parquet 🚨 15348066 13629813 1.13
tpcds_q04/datafusion:parquet 291682658 277646694 1.05
tpcds_q05/datafusion:parquet 🚨 45502615 40913804 1.11
tpcds_q06/datafusion:parquet 60091603 60719499 0.99
tpcds_q07/datafusion:parquet 🚨 88778241 79248657 1.12
tpcds_q08/datafusion:parquet 29095237 27485233 1.06
tpcds_q09/datafusion:parquet 🚨 51394496 42875826 1.20
tpcds_q10/datafusion:parquet 🚨 79684473 71504598 1.11
tpcds_q11/datafusion:parquet 155096100 143573958 1.08
tpcds_q12/datafusion:parquet 19075455 17423067 1.09
tpcds_q13/datafusion:parquet 80332000 74615538 1.08
tpcds_q14/datafusion:parquet 176247767 162075637 1.09
tpcds_q15/datafusion:parquet 22877732 20914629 1.09
tpcds_q16/datafusion:parquet 24464329 25258994 0.97
tpcds_q17/datafusion:parquet 67268329 66630966 1.01
tpcds_q18/datafusion:parquet 122661411 115300581 1.06
tpcds_q19/datafusion:parquet 🚨 25414900 22748259 1.12
tpcds_q20/datafusion:parquet 🚨 18434305 16158466 1.14
tpcds_q21/datafusion:parquet 🚨 21144884 18568480 1.14
tpcds_q22/datafusion:parquet 🚨 146395274 126187136 1.16
tpcds_q23/datafusion:parquet 153484203 143937000 1.07
tpcds_q24/datafusion:parquet 🚨 97352740 88334933 1.10
tpcds_q25/datafusion:parquet 69172650 63302212 1.09
tpcds_q26/datafusion:parquet 72297132 66442672 1.09
tpcds_q27/datafusion:parquet 158851060 147990897 1.07
tpcds_q28/datafusion:parquet 47998172 44612641 1.08
tpcds_q29/datafusion:parquet 69256588 66170982 1.05
tpcds_q30/datafusion:parquet 🚨 39023352 34193612 1.14
tpcds_q31/datafusion:parquet 69306323 66149191 1.05
tpcds_q32/datafusion:parquet 🚨 19799211 17858377 1.11
tpcds_q33/datafusion:parquet 28246647 26311310 1.07
tpcds_q34/datafusion:parquet 22809939 23612870 0.97
tpcds_q35/datafusion:parquet 76383917 71940398 1.06
tpcds_q36/datafusion:parquet 60437844 55711434 1.08
tpcds_q37/datafusion:parquet 20285039 18475598 1.10
tpcds_q38/datafusion:parquet 43946969 42359025 1.04
tpcds_q39/datafusion:parquet 🚨 81322912 70212334 1.16
tpcds_q40/datafusion:parquet 25576926 23393136 1.09
tpcds_q41/datafusion:parquet 🚨 15182088 13018642 1.17
tpcds_q42/datafusion:parquet 12765567 12269861 1.04
tpcds_q43/datafusion:parquet 17716980 17109469 1.04
tpcds_q44/datafusion:parquet 34395599 33489176 1.03
tpcds_q45/datafusion:parquet 29580851 27906241 1.06
tpcds_q46/datafusion:parquet 33611240 31629202 1.06
tpcds_q47/datafusion:parquet 🚨 135714055 121942636 1.11
tpcds_q48/datafusion:parquet 74535712 69974280 1.07
tpcds_q49/datafusion:parquet 57995727 55406414 1.05
tpcds_q50/datafusion:parquet 46499202 44223543 1.05
tpcds_q51/datafusion:parquet 86323815 86146447 1.00
tpcds_q52/datafusion:parquet 🚨 13360927 11757378 1.14
tpcds_q53/datafusion:parquet 18723893 17683977 1.06
tpcds_q54/datafusion:parquet 34624315 34014866 1.02
tpcds_q55/datafusion:parquet 🚨 12814414 11505812 1.11
tpcds_q56/datafusion:parquet 28553380 27147213 1.05
tpcds_q57/datafusion:parquet 104813289 97130153 1.08
tpcds_q58/datafusion:parquet 50636496 49436621 1.02
tpcds_q59/datafusion:parquet 55141300 53008357 1.04
tpcds_q60/datafusion:parquet 🚨 30500150 27122338 1.12
tpcds_q61/datafusion:parquet 44807747 43290267 1.04
tpcds_q62/datafusion:parquet 20990921 19483842 1.08
tpcds_q63/datafusion:parquet 🚨 19838606 17433868 1.14
tpcds_q64/datafusion:parquet 549160028 509590192 1.08
tpcds_q65/datafusion:parquet 39603647 36968390 1.07
tpcds_q66/datafusion:parquet 74195037 70711985 1.05
tpcds_q67/datafusion:parquet 147230992 141872592 1.04
tpcds_q68/datafusion:parquet 33347879 31883741 1.05
tpcds_q69/datafusion:parquet 🚨 77106685 69336151 1.11
tpcds_q70/datafusion:parquet 93864719 85749020 1.09
tpcds_q71/datafusion:parquet 23274861 22577972 1.03
tpcds_q72/datafusion:parquet 637451887 603565653 1.06
tpcds_q73/datafusion:parquet 22818501 21587151 1.06
tpcds_q74/datafusion:parquet 90166987 83256707 1.08
tpcds_q75/datafusion:parquet 103521197 99211012 1.04
tpcds_q76/datafusion:parquet 32570999 29640302 1.10
tpcds_q77/datafusion:parquet 40424444 37405025 1.08
tpcds_q78/datafusion:parquet 🚨 123605380 111047916 1.11
tpcds_q79/datafusion:parquet 27011391 25477028 1.06
tpcds_q80/datafusion:parquet 🚨 84227007 76298419 1.10
tpcds_q81/datafusion:parquet 35000056 33372988 1.05
tpcds_q82/datafusion:parquet 20764428 19623316 1.06
tpcds_q83/datafusion:parquet 🚨 38927923 35264681 1.10
tpcds_q84/datafusion:parquet 40890723 38585944 1.06
tpcds_q85/datafusion:parquet 155690890 149662177 1.04
tpcds_q86/datafusion:parquet 🚨 18206629 15782217 1.15
tpcds_q87/datafusion:parquet 42377873 39918717 1.06
tpcds_q88/datafusion:parquet 62658595 59092736 1.06
tpcds_q89/datafusion:parquet 21920202 22560899 0.97
tpcds_q90/datafusion:parquet 15706669 14704011 1.07
tpcds_q91/datafusion:parquet 64073166 59004518 1.09
tpcds_q92/datafusion:parquet 🚨 20332412 18286046 1.11
tpcds_q93/datafusion:parquet 33636389 31182487 1.08
tpcds_q94/datafusion:parquet 🚨 21816638 19789808 1.10
tpcds_q95/datafusion:parquet 59625560 58410512 1.02
tpcds_q96/datafusion:parquet 12464835 11843799 1.05
tpcds_q97/datafusion:parquet 🚨 33236302 29064965 1.14
tpcds_q98/datafusion:parquet 21743584 21700388 1.00
tpcds_q99/datafusion:parquet 26306958 28444535 0.92
duckdb / vortex-file-compressed (1.089x ➖, 0↑ 40↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 23250291 20769706 1.12
tpcds_q02/duckdb:vortex-file-compressed 34208702 36965117 0.93
tpcds_q03/duckdb:vortex-file-compressed 33438038 32605988 1.03
tpcds_q04/duckdb:vortex-file-compressed 114916301 107964463 1.06
tpcds_q05/duckdb:vortex-file-compressed 36968120 36075091 1.02
tpcds_q06/duckdb:vortex-file-compressed 33933460 31654803 1.07
tpcds_q07/duckdb:vortex-file-compressed 🚨 23510947 19340814 1.22
tpcds_q08/duckdb:vortex-file-compressed 28759376 27714098 1.04
tpcds_q09/duckdb:vortex-file-compressed 40015497 39800724 1.01
tpcds_q10/duckdb:vortex-file-compressed 44403603 40446682 1.10
tpcds_q11/duckdb:vortex-file-compressed 🚨 69448658 59681574 1.16
tpcds_q12/duckdb:vortex-file-compressed 15841299 14683240 1.08
tpcds_q13/duckdb:vortex-file-compressed 35533737 33488000 1.06
tpcds_q14/duckdb:vortex-file-compressed 106396251 104573803 1.02
tpcds_q15/duckdb:vortex-file-compressed 🚨 29700459 26790992 1.11
tpcds_q16/duckdb:vortex-file-compressed 29722387 27832885 1.07
tpcds_q17/duckdb:vortex-file-compressed 🚨 47476658 42885155 1.11
tpcds_q18/duckdb:vortex-file-compressed 49960946 46538346 1.07
tpcds_q19/duckdb:vortex-file-compressed 🚨 36822423 32707508 1.13
tpcds_q20/duckdb:vortex-file-compressed 🚨 17526301 14937069 1.17
tpcds_q21/duckdb:vortex-file-compressed 🚨 19213182 16567153 1.16
tpcds_q22/duckdb:vortex-file-compressed 80066097 76977240 1.04
tpcds_q23/duckdb:vortex-file-compressed 115578681 107618274 1.07
tpcds_q24/duckdb:vortex-file-compressed 52699960 48878173 1.08
tpcds_q25/duckdb:vortex-file-compressed 53662539 49233189 1.09
tpcds_q26/duckdb:vortex-file-compressed 42954040 40443526 1.06
tpcds_q27/duckdb:vortex-file-compressed 51647883 48767662 1.06
tpcds_q28/duckdb:vortex-file-compressed 36731591 34960618 1.05
tpcds_q29/duckdb:vortex-file-compressed 44390903 43292452 1.03
tpcds_q30/duckdb:vortex-file-compressed 🚨 27290709 23915022 1.14
tpcds_q31/duckdb:vortex-file-compressed 🚨 38897322 34690087 1.12
tpcds_q32/duckdb:vortex-file-compressed 🚨 15601163 14028309 1.11
tpcds_q33/duckdb:vortex-file-compressed 24879534 25027230 0.99
tpcds_q34/duckdb:vortex-file-compressed 24177774 23160276 1.04
tpcds_q35/duckdb:vortex-file-compressed 🚨 73025692 63525469 1.15
tpcds_q36/duckdb:vortex-file-compressed 26174920 25084932 1.04
tpcds_q37/duckdb:vortex-file-compressed 16412247 15305487 1.07
tpcds_q38/duckdb:vortex-file-compressed 🚨 40186724 35239896 1.14
tpcds_q39/duckdb:vortex-file-compressed 35283358 35497692 0.99
tpcds_q40/duckdb:vortex-file-compressed 🚨 22309498 19587541 1.14
tpcds_q41/duckdb:vortex-file-compressed 🚨 14232501 12805108 1.11
tpcds_q42/duckdb:vortex-file-compressed 14434468 13286893 1.09
tpcds_q43/duckdb:vortex-file-compressed 23314604 22820787 1.02
tpcds_q44/duckdb:vortex-file-compressed 🚨 22977484 20878433 1.10
tpcds_q45/duckdb:vortex-file-compressed 29636264 27537513 1.08
tpcds_q46/duckdb:vortex-file-compressed 56401192 51332938 1.10
tpcds_q47/duckdb:vortex-file-compressed 50998106 47770629 1.07
tpcds_q48/duckdb:vortex-file-compressed 33735549 31895602 1.06
tpcds_q49/duckdb:vortex-file-compressed 🚨 38839233 30786907 1.26
tpcds_q50/duckdb:vortex-file-compressed 35373242 34183618 1.03
tpcds_q51/duckdb:vortex-file-compressed 102155087 98456712 1.04
tpcds_q52/duckdb:vortex-file-compressed 🚨 14019147 12432433 1.13
tpcds_q53/duckdb:vortex-file-compressed 24256787 22135521 1.10
tpcds_q54/duckdb:vortex-file-compressed 🚨 31261935 28368542 1.10
tpcds_q55/duckdb:vortex-file-compressed 14093494 12986134 1.09
tpcds_q56/duckdb:vortex-file-compressed 25836192 25629958 1.01
tpcds_q57/duckdb:vortex-file-compressed 41057341 38293819 1.07
tpcds_q58/duckdb:vortex-file-compressed 33274643 31339418 1.06
tpcds_q59/duckdb:vortex-file-compressed 68556167 67325517 1.02
tpcds_q60/duckdb:vortex-file-compressed 🚨 27779952 24360384 1.14
tpcds_q61/duckdb:vortex-file-compressed 🚨 40398633 34647755 1.17
tpcds_q62/duckdb:vortex-file-compressed 18655001 17395598 1.07
tpcds_q63/duckdb:vortex-file-compressed 🚨 23187013 21041087 1.10
tpcds_q64/duckdb:vortex-file-compressed 87322753 80744516 1.08
tpcds_q65/duckdb:vortex-file-compressed 22502556 22881162 0.98
tpcds_q66/duckdb:vortex-file-compressed 30013265 29172258 1.03
tpcds_q67/duckdb:vortex-file-compressed 145735698 140073244 1.04
tpcds_q68/duckdb:vortex-file-compressed 🚨 47162400 40404482 1.17
tpcds_q69/duckdb:vortex-file-compressed 45753243 42438907 1.08
tpcds_q70/duckdb:vortex-file-compressed 27911671 26275603 1.06
tpcds_q71/duckdb:vortex-file-compressed 🚨 23454568 21205519 1.11
tpcds_q72/duckdb:vortex-file-compressed 179587902 175391924 1.02
tpcds_q73/duckdb:vortex-file-compressed 🚨 26108825 23620262 1.11
tpcds_q74/duckdb:vortex-file-compressed 77658742 74340141 1.04
tpcds_q75/duckdb:vortex-file-compressed 🚨 63969046 56880209 1.12
tpcds_q76/duckdb:vortex-file-compressed 🚨 21686016 18628739 1.16
tpcds_q77/duckdb:vortex-file-compressed 27493943 25166728 1.09
tpcds_q78/duckdb:vortex-file-compressed 🚨 85173958 72560538 1.17
tpcds_q79/duckdb:vortex-file-compressed 🚨 35503796 32238997 1.10
tpcds_q80/duckdb:vortex-file-compressed 🚨 56949455 48742457 1.17
tpcds_q81/duckdb:vortex-file-compressed 32301958 29572561 1.09
tpcds_q82/duckdb:vortex-file-compressed 🚨 19281568 16365330 1.18
tpcds_q83/duckdb:vortex-file-compressed 26582865 24470249 1.09
tpcds_q84/duckdb:vortex-file-compressed 🚨 23126327 20093790 1.15
tpcds_q85/duckdb:vortex-file-compressed 🚨 51379779 45484358 1.13
tpcds_q86/duckdb:vortex-file-compressed 18055107 16485410 1.10
tpcds_q87/duckdb:vortex-file-compressed 42043268 38409157 1.09
tpcds_q88/duckdb:vortex-file-compressed 🚨 38401519 33277630 1.15
tpcds_q89/duckdb:vortex-file-compressed 🚨 25728472 22431340 1.15
tpcds_q90/duckdb:vortex-file-compressed 🚨 14228250 12911807 1.10
tpcds_q91/duckdb:vortex-file-compressed 33803357 30759756 1.10
tpcds_q92/duckdb:vortex-file-compressed 23690219 21750218 1.09
tpcds_q93/duckdb:vortex-file-compressed 🚨 30603870 27791811 1.10
tpcds_q94/duckdb:vortex-file-compressed 🚨 26628055 23000651 1.16
tpcds_q95/duckdb:vortex-file-compressed 161958664 148162262 1.09
tpcds_q96/duckdb:vortex-file-compressed 14043308 13432311 1.05
tpcds_q97/duckdb:vortex-file-compressed 🚨 44235683 36832446 1.20
tpcds_q98/duckdb:vortex-file-compressed 🚨 21007588 18233066 1.15
tpcds_q99/duckdb:vortex-file-compressed 29082289 27899554 1.04
duckdb / vortex-compact (1.117x ❌, 0↑ 60↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 30440144 23891779 1.27
tpcds_q02/duckdb:vortex-compact 44280203 44897093 0.99
tpcds_q03/duckdb:vortex-compact 59482151 57941949 1.03
tpcds_q04/duckdb:vortex-compact 130544100 123047072 1.06
tpcds_q05/duckdb:vortex-compact 🚨 56618439 48942179 1.16
tpcds_q06/duckdb:vortex-compact 🚨 47396299 39679932 1.19
tpcds_q07/duckdb:vortex-compact 35595505 34832413 1.02
tpcds_q08/duckdb:vortex-compact 49809033 45595402 1.09
tpcds_q09/duckdb:vortex-compact 🚨 65625663 57689731 1.14
tpcds_q10/duckdb:vortex-compact 🚨 72077610 63250815 1.14
tpcds_q11/duckdb:vortex-compact 🚨 83530747 74269020 1.12
tpcds_q12/duckdb:vortex-compact 🚨 26024509 22534839 1.15
tpcds_q13/duckdb:vortex-compact 🚨 66774508 59944539 1.11
tpcds_q14/duckdb:vortex-compact 147202558 137386119 1.07
tpcds_q15/duckdb:vortex-compact 🚨 36609834 30668815 1.19
tpcds_q16/duckdb:vortex-compact 34126186 31072445 1.10
tpcds_q17/duckdb:vortex-compact 🚨 60386983 54776905 1.10
tpcds_q18/duckdb:vortex-compact 🚨 70257413 59448030 1.18
tpcds_q19/duckdb:vortex-compact 55046804 51788286 1.06
tpcds_q20/duckdb:vortex-compact 🚨 24835452 20356777 1.22
tpcds_q21/duckdb:vortex-compact 🚨 22037582 18787233 1.17
tpcds_q22/duckdb:vortex-compact 🚨 93238012 78180511 1.19
tpcds_q23/duckdb:vortex-compact 128362004 118773982 1.08
tpcds_q24/duckdb:vortex-compact 🚨 69038284 62258958 1.11
tpcds_q25/duckdb:vortex-compact 82944945 81111703 1.02
tpcds_q26/duckdb:vortex-compact 🚨 65761064 52581933 1.25
tpcds_q27/duckdb:vortex-compact 77561272 70724321 1.10
tpcds_q28/duckdb:vortex-compact 89246332 84130043 1.06
tpcds_q29/duckdb:vortex-compact 57923502 55215092 1.05
tpcds_q30/duckdb:vortex-compact 🚨 34669533 29345025 1.18
tpcds_q31/duckdb:vortex-compact 🚨 51786035 45297612 1.14
tpcds_q32/duckdb:vortex-compact 🚨 25426533 23098377 1.10
tpcds_q33/duckdb:vortex-compact 🚨 40524731 34875817 1.16
tpcds_q34/duckdb:vortex-compact 41166154 38971582 1.06
tpcds_q35/duckdb:vortex-compact 🚨 90276193 81691064 1.11
tpcds_q36/duckdb:vortex-compact 46597376 42496067 1.10
tpcds_q37/duckdb:vortex-compact 🚨 28127474 23301008 1.21
tpcds_q38/duckdb:vortex-compact 50435712 45862479 1.10
tpcds_q39/duckdb:vortex-compact 🚨 41269888 37153112 1.11
tpcds_q40/duckdb:vortex-compact 🚨 29456769 25064471 1.18
tpcds_q41/duckdb:vortex-compact 🚨 18120703 15914306 1.14
tpcds_q42/duckdb:vortex-compact 🚨 25003522 22149521 1.13
tpcds_q43/duckdb:vortex-compact 37836852 38200597 0.99
tpcds_q44/duckdb:vortex-compact 30661647 30929954 0.99
tpcds_q45/duckdb:vortex-compact 🚨 47455536 38149733 1.24
tpcds_q46/duckdb:vortex-compact 🚨 81275005 71554612 1.14
tpcds_q47/duckdb:vortex-compact 🚨 70103224 62046199 1.13
tpcds_q48/duckdb:vortex-compact 🚨 60509851 53331439 1.13
tpcds_q49/duckdb:vortex-compact 🚨 62545566 55970354 1.12
tpcds_q50/duckdb:vortex-compact 🚨 52639885 47152989 1.12
tpcds_q51/duckdb:vortex-compact 118035428 108731019 1.09
tpcds_q52/duckdb:vortex-compact 🚨 24828429 22382921 1.11
tpcds_q53/duckdb:vortex-compact 41331764 39476606 1.05
tpcds_q54/duckdb:vortex-compact 🚨 44954101 40835814 1.10
tpcds_q55/duckdb:vortex-compact 🚨 26361463 22908950 1.15
tpcds_q56/duckdb:vortex-compact 🚨 40673098 35509960 1.15
tpcds_q57/duckdb:vortex-compact 48334572 44043506 1.10
tpcds_q58/duckdb:vortex-compact 🚨 46761466 42021964 1.11
tpcds_q59/duckdb:vortex-compact 92558834 94778152 0.98
tpcds_q60/duckdb:vortex-compact 🚨 43915924 38826274 1.13
tpcds_q61/duckdb:vortex-compact 69765482 63637928 1.10
tpcds_q62/duckdb:vortex-compact 🚨 32928126 26096926 1.26
tpcds_q63/duckdb:vortex-compact 🚨 42973008 37414701 1.15
tpcds_q64/duckdb:vortex-compact 128496117 119173315 1.08
tpcds_q65/duckdb:vortex-compact 🚨 36134296 32539792 1.11
tpcds_q66/duckdb:vortex-compact 🚨 43249838 38803717 1.11
tpcds_q67/duckdb:vortex-compact 168313130 153262240 1.10
tpcds_q68/duckdb:vortex-compact 🚨 69659555 62725277 1.11
tpcds_q69/duckdb:vortex-compact 70166591 64107427 1.09
tpcds_q70/duckdb:vortex-compact 39993400 37843736 1.06
tpcds_q71/duckdb:vortex-compact 38073214 34872478 1.09
tpcds_q72/duckdb:vortex-compact 202114665 195179228 1.04
tpcds_q73/duckdb:vortex-compact 40901827 39082733 1.05
tpcds_q74/duckdb:vortex-compact 🚨 90848894 80124180 1.13
tpcds_q75/duckdb:vortex-compact 🚨 84568856 70351884 1.20
tpcds_q76/duckdb:vortex-compact 37176829 35567571 1.05
tpcds_q77/duckdb:vortex-compact 44986414 41836128 1.08
tpcds_q78/duckdb:vortex-compact 🚨 100741191 88057776 1.14
tpcds_q79/duckdb:vortex-compact 58726271 55365508 1.06
tpcds_q80/duckdb:vortex-compact 🚨 96909094 81776258 1.19
tpcds_q81/duckdb:vortex-compact 🚨 38819271 33214846 1.17
tpcds_q82/duckdb:vortex-compact 🚨 28736582 24668564 1.16
tpcds_q83/duckdb:vortex-compact 🚨 36067885 31589154 1.14
tpcds_q84/duckdb:vortex-compact 🚨 28462124 25467599 1.12
tpcds_q85/duckdb:vortex-compact 🚨 68264795 58877079 1.16
tpcds_q86/duckdb:vortex-compact 🚨 28261083 24171987 1.17
tpcds_q87/duckdb:vortex-compact 55415935 51881837 1.07
tpcds_q88/duckdb:vortex-compact 🚨 45874819 39761547 1.15
tpcds_q89/duckdb:vortex-compact 40778048 38609712 1.06
tpcds_q90/duckdb:vortex-compact 🚨 16591813 14770202 1.12
tpcds_q91/duckdb:vortex-compact 🚨 57122464 50595214 1.13
tpcds_q92/duckdb:vortex-compact 59799468 55756955 1.07
tpcds_q93/duckdb:vortex-compact 🚨 35656875 31328563 1.14
tpcds_q94/duckdb:vortex-compact 🚨 37413344 30667642 1.22
tpcds_q95/duckdb:vortex-compact 160452955 149927813 1.07
tpcds_q96/duckdb:vortex-compact 19790788 18690716 1.06
tpcds_q97/duckdb:vortex-compact 🚨 50944953 44397806 1.15
tpcds_q98/duckdb:vortex-compact 31925421 29160960 1.09
tpcds_q99/duckdb:vortex-compact 🚨 40573463 31365986 1.29
duckdb / parquet (1.077x ➖, 0↑ 28↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨 32639277 29072047 1.12
tpcds_q02/duckdb:parquet 24702413 23054500 1.07
tpcds_q03/duckdb:parquet 🚨 12579748 11354298 1.11
tpcds_q04/duckdb:parquet 182965639 167800244 1.09
tpcds_q05/duckdb:parquet 🚨 34067019 30410257 1.12
tpcds_q06/duckdb:parquet 🚨 30466956 26989523 1.13
tpcds_q07/duckdb:parquet 22689006 20840980 1.09
tpcds_q08/duckdb:parquet 28533083 28239973 1.01
tpcds_q09/duckdb:parquet 40946286 39561792 1.03
tpcds_q10/duckdb:parquet 35704888 32585014 1.10
tpcds_q11/duckdb:parquet 97765074 89278851 1.10
tpcds_q12/duckdb:parquet 🚨 16054220 14501433 1.11
tpcds_q13/duckdb:parquet 34820153 33010239 1.05
tpcds_q14/duckdb:parquet 104158427 100265371 1.04
tpcds_q15/duckdb:parquet 🚨 33172720 29517205 1.12
tpcds_q16/duckdb:parquet 🚨 24611081 20684961 1.19
tpcds_q17/duckdb:parquet 39452102 38143955 1.03
tpcds_q18/duckdb:parquet 46960320 46156649 1.02
tpcds_q19/duckdb:parquet 🚨 32375661 28113947 1.15
tpcds_q20/duckdb:parquet 🚨 16852937 14915668 1.13
tpcds_q21/duckdb:parquet 🚨 11390037 10129106 1.12
tpcds_q22/duckdb:parquet 🚨 76892568 64770245 1.19
tpcds_q23/duckdb:parquet 85658379 80199919 1.07
tpcds_q24/duckdb:parquet 48378523 44937061 1.08
tpcds_q25/duckdb:parquet 35370524 33535868 1.05
tpcds_q26/duckdb:parquet 🚨 40420130 35210403 1.15
tpcds_q27/duckdb:parquet 52778033 49582909 1.06
tpcds_q28/duckdb:parquet 39066258 37992090 1.03
tpcds_q29/duckdb:parquet 37510652 36063388 1.04
tpcds_q30/duckdb:parquet 37524739 34376306 1.09
tpcds_q31/duckdb:parquet 25138045 23221935 1.08
tpcds_q32/duckdb:parquet 11632390 11367273 1.02
tpcds_q33/duckdb:parquet 22356058 20758506 1.08
tpcds_q34/duckdb:parquet 21403905 20127588 1.06
tpcds_q35/duckdb:parquet 🚨 64309777 56851759 1.13
tpcds_q36/duckdb:parquet 20874291 20150857 1.04
tpcds_q37/duckdb:parquet 🚨 13687000 12028284 1.14
tpcds_q38/duckdb:parquet 🚨 38570730 33321888 1.16
tpcds_q39/duckdb:parquet 31131193 30479026 1.02
tpcds_q40/duckdb:parquet 🚨 20486578 17364802 1.18
tpcds_q41/duckdb:parquet 🚨 9040019 7504181 1.20
tpcds_q42/duckdb:parquet 10360252 9481781 1.09
tpcds_q43/duckdb:parquet 16101109 15152796 1.06
tpcds_q44/duckdb:parquet 22971356 21618332 1.06
tpcds_q45/duckdb:parquet 🚨 30495657 26595413 1.15
tpcds_q46/duckdb:parquet 47044952 43611359 1.08
tpcds_q47/duckdb:parquet 48070300 44037590 1.09
tpcds_q48/duckdb:parquet 31939753 29500475 1.08
tpcds_q49/duckdb:parquet 24921765 23618912 1.06
tpcds_q50/duckdb:parquet 24387484 24506234 1.00
tpcds_q51/duckdb:parquet 100437393 94523609 1.06
tpcds_q52/duckdb:parquet 🚨 11335590 10095315 1.12
tpcds_q53/duckdb:parquet 🚨 16238625 14735692 1.10
tpcds_q54/duckdb:parquet 26109305 25189022 1.04
tpcds_q55/duckdb:parquet 10236461 9752833 1.05
tpcds_q56/duckdb:parquet 21910333 20123802 1.09
tpcds_q57/duckdb:parquet 35244526 33892719 1.04
tpcds_q58/duckdb:parquet 24335459 22401637 1.09
tpcds_q59/duckdb:parquet 36038705 35180831 1.02
tpcds_q60/duckdb:parquet 22926087 20946810 1.09
tpcds_q61/duckdb:parquet 32846940 30293788 1.08
tpcds_q62/duckdb:parquet 12636934 11762164 1.07
tpcds_q63/duckdb:parquet 14595303 13768775 1.06
tpcds_q64/duckdb:parquet 76397920 75212619 1.02
tpcds_q65/duckdb:parquet 20977309 19697968 1.06
tpcds_q66/duckdb:parquet 31627190 29667689 1.07
tpcds_q67/duckdb:parquet 144943737 134069712 1.08
tpcds_q68/duckdb:parquet 38832121 36248856 1.07
tpcds_q69/duckdb:parquet 37362733 35356129 1.06
tpcds_q70/duckdb:parquet 20564874 19992736 1.03
tpcds_q71/duckdb:parquet 🚨 20834429 18543875 1.12
tpcds_q72/duckdb:parquet 168162700 160163519 1.05
tpcds_q73/duckdb:parquet 🚨 19297556 17426929 1.11
tpcds_q74/duckdb:parquet 130194212 127881233 1.02
tpcds_q75/duckdb:parquet 56670216 54405410 1.04
tpcds_q76/duckdb:parquet 20047912 19777408 1.01
tpcds_q77/duckdb:parquet 22884365 21365358 1.07
tpcds_q78/duckdb:parquet 78705725 74740863 1.05
tpcds_q79/duckdb:parquet 27923243 26856947 1.04
tpcds_q80/duckdb:parquet 43289429 40073399 1.08
tpcds_q81/duckdb:parquet 🚨 33463089 29746816 1.12
tpcds_q82/duckdb:parquet 🚨 14824615 12867820 1.15
tpcds_q83/duckdb:parquet 17198191 16296363 1.06
tpcds_q84/duckdb:parquet 18489853 19272091 0.96
tpcds_q85/duckdb:parquet 39309854 37354763 1.05
tpcds_q86/duckdb:parquet 🚨 14155251 12070881 1.17
tpcds_q87/duckdb:parquet 36702287 38142296 0.96
tpcds_q88/duckdb:parquet 49873880 48257554 1.03
tpcds_q89/duckdb:parquet 🚨 17834081 15876505 1.12
tpcds_q90/duckdb:parquet 7464316 7440114 1.00
tpcds_q91/duckdb:parquet 23563433 22487749 1.05
tpcds_q92/duckdb:parquet 🚨 12833780 11040335 1.16
tpcds_q93/duckdb:parquet 30389399 28886529 1.05
tpcds_q94/duckdb:parquet 16841789 15673874 1.07
tpcds_q95/duckdb:parquet 136035292 130574071 1.04
tpcds_q96/duckdb:parquet 9246868 8618117 1.07
tpcds_q97/duckdb:parquet 🚨 38858043 32917531 1.18
tpcds_q98/duckdb:parquet 17888711 17820555 1.00
tpcds_q99/duckdb:parquet 20817323 19142248 1.09
duckdb / duckdb (1.139x ❌, 0↑ 74↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚨 24275227 20411181 1.19
tpcds_q02/duckdb:duckdb 19750872 18818898 1.05
tpcds_q03/duckdb:duckdb 🚨 10509948 8477734 1.24
tpcds_q04/duckdb:duckdb 193124921 176579986 1.09
tpcds_q05/duckdb:duckdb 20349332 20049487 1.01
tpcds_q06/duckdb:duckdb 🚨 27303506 22433397 1.22
tpcds_q07/duckdb:duckdb 🚨 43433581 37900138 1.15
tpcds_q08/duckdb:duckdb 122927476 120171808 1.02
tpcds_q09/duckdb:duckdb 21162225 20086063 1.05
tpcds_q10/duckdb:duckdb 🚨 27333583 23405459 1.17
tpcds_q11/duckdb:duckdb 🚨 101702527 85583678 1.19
tpcds_q12/duckdb:duckdb 🚨 13129177 11170515 1.18
tpcds_q13/duckdb:duckdb 26162570 24726811 1.06
tpcds_q14/duckdb:duckdb 97027857 91894050 1.06
tpcds_q15/duckdb:duckdb 🚨 29942640 23969617 1.25
tpcds_q16/duckdb:duckdb 🚨 21800700 17478403 1.25
tpcds_q17/duckdb:duckdb 🚨 24641230 22117925 1.11
tpcds_q18/duckdb:duckdb 🚨 50676817 43357911 1.17
tpcds_q19/duckdb:duckdb 🚨 18861605 16135759 1.17
tpcds_q20/duckdb:duckdb 12688745 11990363 1.06
tpcds_q21/duckdb:duckdb 🚨 7813554 7047940 1.11
tpcds_q22/duckdb:duckdb 🚨 73776776 63837393 1.16
tpcds_q23/duckdb:duckdb 80412118 74868890 1.07
tpcds_q24/duckdb:duckdb 26418948 24316853 1.09
tpcds_q25/duckdb:duckdb 🚨 19549680 16542253 1.18
tpcds_q26/duckdb:duckdb 🚨 30494660 23656713 1.29
tpcds_q27/duckdb:duckdb 🚨 44002914 38884767 1.13
tpcds_q28/duckdb:duckdb 22313266 22122631 1.01
tpcds_q29/duckdb:duckdb 🚨 22910085 20762377 1.10
tpcds_q30/duckdb:duckdb 🚨 32461232 29015062 1.12
tpcds_q31/duckdb:duckdb 🚨 55579500 47303122 1.17
tpcds_q32/duckdb:duckdb 🚨 8583809 7088467 1.21
tpcds_q33/duckdb:duckdb 🚨 14475978 12927731 1.12
tpcds_q34/duckdb:duckdb 🚨 16844081 14212618 1.19
tpcds_q35/duckdb:duckdb 🚨 36559925 33011966 1.11
tpcds_q36/duckdb:duckdb 🚨 81726528 66388721 1.23
tpcds_q37/duckdb:duckdb 🚨 8567240 7651595 1.12
tpcds_q38/duckdb:duckdb 🚨 34774217 29676908 1.17
tpcds_q39/duckdb:duckdb 🚨 27619158 24282443 1.14
tpcds_q40/duckdb:duckdb 🚨 15176533 12426606 1.22
tpcds_q41/duckdb:duckdb 🚨 9670006 8111970 1.19
tpcds_q42/duckdb:duckdb 🚨 7725192 6292128 1.23
tpcds_q43/duckdb:duckdb 🚨 12705699 10893544 1.17
tpcds_q44/duckdb:duckdb 14625387 13492275 1.08
tpcds_q45/duckdb:duckdb 🚨 20130613 16636415 1.21
tpcds_q46/duckdb:duckdb 🚨 41104503 36055409 1.14
tpcds_q47/duckdb:duckdb 🚨 45347362 39773873 1.14
tpcds_q48/duckdb:duckdb 24526439 22910432 1.07
tpcds_q49/duckdb:duckdb 🚨 18118176 15894207 1.14
tpcds_q50/duckdb:duckdb 🚨 16366696 13792658 1.19
tpcds_q51/duckdb:duckdb 97938201 93774917 1.04
tpcds_q52/duckdb:duckdb 🚨 8202870 7398555 1.11
tpcds_q53/duckdb:duckdb 🚨 14940794 13353540 1.12
tpcds_q54/duckdb:duckdb 🚨 20834249 16549413 1.26
tpcds_q55/duckdb:duckdb 🚨 8049850 7064984 1.14
tpcds_q56/duckdb:duckdb 🚨 15437602 13273475 1.16
tpcds_q57/duckdb:duckdb 35257506 32233758 1.09
tpcds_q58/duckdb:duckdb 🚨 14214572 12131838 1.17
tpcds_q59/duckdb:duckdb 🚨 37991335 34473107 1.10
tpcds_q60/duckdb:duckdb 🚨 16585080 14791024 1.12
tpcds_q61/duckdb:duckdb 🚨 16082237 14267597 1.13
tpcds_q62/duckdb:duckdb 🚨 10828818 9253812 1.17
tpcds_q63/duckdb:duckdb 🚨 14018325 12089117 1.16
tpcds_q64/duckdb:duckdb 🚨 60894934 53708709 1.13
tpcds_q65/duckdb:duckdb 🚨 39459822 33019614 1.20
tpcds_q66/duckdb:duckdb 🚨 29344408 25618424 1.15
tpcds_q67/duckdb:duckdb 🚨 141830977 128072893 1.11
tpcds_q68/duckdb:duckdb 27570261 25346292 1.09
tpcds_q69/duckdb:duckdb 27124810 25498630 1.06
tpcds_q70/duckdb:duckdb 16221134 15137241 1.07
tpcds_q71/duckdb:duckdb 🚨 13472407 11828994 1.14
tpcds_q72/duckdb:duckdb 45520708 42452744 1.07
tpcds_q73/duckdb:duckdb 🚨 12148604 10786679 1.13
tpcds_q74/duckdb:duckdb 155889997 144681011 1.08
tpcds_q75/duckdb:duckdb 🚨 48696395 42222661 1.15
tpcds_q76/duckdb:duckdb 13398565 12486069 1.07
tpcds_q77/duckdb:duckdb 🚨 13938286 12564356 1.11
tpcds_q78/duckdb:duckdb 🚨 70227990 61701146 1.14
tpcds_q79/duckdb:duckdb 🚨 20750279 18104172 1.15
tpcds_q80/duckdb:duckdb 🚨 32394771 27411538 1.18
tpcds_q81/duckdb:duckdb 🚨 43459036 35880485 1.21
tpcds_q82/duckdb:duckdb 🚨 9837002 8292807 1.19
tpcds_q83/duckdb:duckdb 🚨 10597824 9405243 1.13
tpcds_q84/duckdb:duckdb 14279283 13575297 1.05
tpcds_q85/duckdb:duckdb 28356156 25798966 1.10
tpcds_q86/duckdb:duckdb 🚨 12602361 10505508 1.20
tpcds_q87/duckdb:duckdb 🚨 40339392 32303984 1.25
tpcds_q88/duckdb:duckdb 28082181 25923850 1.08
tpcds_q89/duckdb:duckdb 🚨 16238137 14655436 1.11
tpcds_q90/duckdb:duckdb 🚨 6744024 5636807 1.20
tpcds_q91/duckdb:duckdb 🚨 14623074 12459408 1.17
tpcds_q92/duckdb:duckdb 🚨 11979497 8536959 1.40
tpcds_q93/duckdb:duckdb 🚨 25652674 21158911 1.21
tpcds_q94/duckdb:duckdb 🚨 14361725 12400055 1.16
tpcds_q95/duckdb:duckdb 117853125 125770902 0.94
tpcds_q96/duckdb:duckdb 🚨 5415330 4679507 1.16
tpcds_q97/duckdb:duckdb 🚨 33880500 29295195 1.16
tpcds_q98/duckdb:duckdb 🚨 15860103 13982811 1.13
tpcds_q99/duckdb:duckdb 🚨 18545211 16597892 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +15.1% +12.1% +2.7% +22.5% ➖ noise
1 datafusion:vortex-file-compressed +13.0% +12.1% +0.8% +21.9% ➖ noise
1 duckdb:duckdb +18.9% +12.1% +6.1% +28.1% ➖ noise
1 duckdb:vortex-compact +27.4% +12.1% +13.6% +23.2% ➖ noise
1 duckdb:vortex-file-compressed +11.9% +12.1% -0.2% +33.8% ➖ noise
2 datafusion:vortex-compact +10.1% +6.4% +3.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +6.9% +6.4% +0.4% +10.0% ➖ noise
2 duckdb:duckdb +5.0% +6.4% -1.4% +14.3% ➖ noise
2 duckdb:vortex-compact -1.4% +6.4% -7.3% +29.3% ➖ noise
2 duckdb:vortex-file-compressed -7.5% +6.4% -13.1% +24.4% ➖ noise
3 datafusion:vortex-compact +13.1% +11.7% +1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.3% +11.7% -7.6% +12.2% ➖ noise
3 duckdb:duckdb +24.0% +11.7% +11.0% +14.0% ➖ noise
3 duckdb:vortex-compact +2.7% +11.7% -8.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.6% +11.7% -8.2% +11.4% ➖ noise
4 datafusion:vortex-compact +7.7% +7.0% +0.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +12.8% +7.0% +5.4% +10.0% ➖ noise
4 duckdb:duckdb +9.4% +7.0% +2.2% +10.0% ➖ noise
4 duckdb:vortex-compact +6.1% +7.0% -0.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +6.4% +7.0% -0.6% +11.7% ➖ noise
5 datafusion:vortex-compact +13.9% +11.6% +2.1% +16.2% ➖ noise
5 datafusion:vortex-file-compressed +8.1% +11.6% -3.1% +12.8% ➖ noise
5 duckdb:duckdb +1.5% +11.6% -9.1% +13.8% ➖ noise
5 duckdb:vortex-compact +15.7% +11.6% +3.6% +11.7% ➖ noise
5 duckdb:vortex-file-compressed +2.5% +11.6% -8.2% +12.7% ➖ noise
6 datafusion:vortex-compact +3.5% +5.7% -2.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.2% +5.7% -3.3% +10.0% ➖ noise
6 duckdb:duckdb +21.7% +5.7% +15.1% +12.0% 🚨 regression
6 duckdb:vortex-compact +19.4% +5.7% +13.0% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +7.2% +5.7% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact +14.9% +10.4% +4.0% +16.1% ➖ noise
7 datafusion:vortex-file-compressed +12.6% +10.4% +2.0% +10.0% ➖ noise
7 duckdb:duckdb +14.6% +10.4% +3.8% +12.9% ➖ noise
7 duckdb:vortex-compact +2.2% +10.4% -7.5% +12.3% ➖ noise
7 duckdb:vortex-file-compressed +21.6% +10.4% +10.1% +30.5% ➖ noise
8 datafusion:vortex-compact +10.1% +3.4% +6.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +7.4% +3.4% +3.9% +15.4% ➖ noise
8 duckdb:duckdb +2.3% +3.4% -1.1% +10.0% ➖ noise
8 duckdb:vortex-compact +9.2% +3.4% +5.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.8% +3.4% +0.3% +10.0% ➖ noise
9 datafusion:vortex-compact +11.6% +11.4% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.6% +11.4% -6.1% +10.0% ➖ noise
9 duckdb:duckdb +5.4% +11.4% -5.4% +10.2% ➖ noise
9 duckdb:vortex-compact +13.8% +11.4% +2.1% +13.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% +11.4% -9.7% +10.0% ✅ faster
10 datafusion:vortex-compact +17.1% +10.5% +6.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +8.4% +10.5% -1.9% +10.0% ➖ noise
10 duckdb:duckdb +16.8% +10.5% +5.7% +10.0% ➖ noise
10 duckdb:vortex-compact +14.0% +10.5% +3.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +9.8% +10.5% -0.7% +10.9% ➖ noise
11 datafusion:vortex-compact +10.4% +8.8% +1.5% +13.8% ➖ noise
11 datafusion:vortex-file-compressed +12.5% +8.8% +3.5% +11.0% ➖ noise
11 duckdb:duckdb +18.8% +8.8% +9.3% +10.3% ➖ noise
11 duckdb:vortex-compact +12.5% +8.8% +3.4% +11.5% ➖ noise
11 duckdb:vortex-file-compressed +16.4% +8.8% +7.0% +14.4% ➖ noise
12 datafusion:vortex-compact +30.6% +10.1% +18.6% +14.3% 🚨 regression
12 datafusion:vortex-file-compressed +3.3% +10.1% -6.2% +12.9% ➖ noise
12 duckdb:duckdb +17.5% +10.1% +6.8% +13.7% ➖ noise
12 duckdb:vortex-compact +15.5% +10.1% +4.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +7.9% +10.1% -2.0% +10.2% ➖ noise
13 datafusion:vortex-compact -0.8% +6.6% -6.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.9% +6.6% -3.5% +10.0% ➖ noise
13 duckdb:duckdb +5.8% +6.6% -0.7% +10.0% ➖ noise
13 duckdb:vortex-compact +11.4% +6.6% +4.5% +12.4% ➖ noise
13 duckdb:vortex-file-compressed +6.1% +6.6% -0.4% +10.0% ➖ noise
14 datafusion:vortex-compact +9.7% +6.3% +3.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +8.9% +6.3% +2.5% +10.0% ➖ noise
14 duckdb:duckdb +5.6% +6.3% -0.7% +10.0% ➖ noise
14 duckdb:vortex-compact +7.1% +6.3% +0.8% +12.2% ➖ noise
14 duckdb:vortex-file-compressed +1.7% +6.3% -4.3% +10.0% ➖ noise
15 datafusion:vortex-compact +16.9% +10.9% +5.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +7.9% +10.9% -2.7% +10.0% ➖ noise
15 duckdb:duckdb +24.9% +10.9% +12.7% +17.4% ➖ noise
15 duckdb:vortex-compact +19.4% +10.9% +7.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +10.9% +10.9% -0.0% +10.5% ➖ noise
16 datafusion:vortex-compact +9.8% +7.3% +2.3% +11.7% ➖ noise
16 datafusion:vortex-file-compressed +13.7% +7.3% +5.9% +13.4% ➖ noise
16 duckdb:duckdb +24.7% +7.3% +16.2% +17.2% ➖ noise
16 duckdb:vortex-compact +9.8% +7.3% +2.3% +13.6% ➖ noise
16 duckdb:vortex-file-compressed +6.8% +7.3% -0.5% +17.7% ➖ noise
17 datafusion:vortex-compact +22.4% +2.2% +19.7% +12.6% 🚨 regression
17 datafusion:vortex-file-compressed +12.0% +2.2% +9.6% +16.2% ➖ noise
17 duckdb:duckdb +11.4% +2.2% +9.0% +10.0% ➖ noise
17 duckdb:vortex-compact +10.2% +2.2% +7.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +10.7% +2.2% +8.3% +10.0% ➖ noise
18 datafusion:vortex-compact +12.4% +4.0% +8.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.0% +4.0% -2.0% +10.0% ➖ noise
18 duckdb:duckdb +16.9% +4.0% +12.3% +10.0% 🚨 regression
18 duckdb:vortex-compact +18.2% +4.0% +13.6% +10.0% 🚨 regression
18 duckdb:vortex-file-compressed +7.4% +4.0% +3.2% +10.0% ➖ noise
19 datafusion:vortex-compact +11.1% +13.4% -2.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +7.1% +13.4% -5.6% +10.0% ➖ noise
19 duckdb:duckdb +16.9% +13.4% +3.1% +11.4% ➖ noise
19 duckdb:vortex-compact +6.3% +13.4% -6.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +12.6% +13.4% -0.7% +11.3% ➖ noise
20 datafusion:vortex-compact +11.2% +13.5% -2.0% +14.0% ➖ noise
20 datafusion:vortex-file-compressed +17.4% +13.5% +3.4% +15.4% ➖ noise
20 duckdb:duckdb +5.8% +13.5% -6.8% +16.4% ➖ noise
20 duckdb:vortex-compact +22.0% +13.5% +7.5% +12.3% ➖ noise
20 duckdb:vortex-file-compressed +17.3% +13.5% +3.3% +12.5% ➖ noise
21 datafusion:vortex-compact +12.7% +13.2% -0.4% +12.4% ➖ noise
21 datafusion:vortex-file-compressed +14.4% +13.2% +1.1% +12.9% ➖ noise
21 duckdb:duckdb +10.9% +13.2% -2.0% +21.6% ➖ noise
21 duckdb:vortex-compact +17.3% +13.2% +3.7% +20.8% ➖ noise
21 duckdb:vortex-file-compressed +16.0% +13.2% +2.5% +14.0% ➖ noise
22 datafusion:vortex-compact +8.6% +17.4% -7.4% +23.5% ➖ noise
22 datafusion:vortex-file-compressed +1.7% +17.4% -13.3% +34.3% ➖ noise
22 duckdb:duckdb +15.6% +17.4% -1.5% +15.3% ➖ noise
22 duckdb:vortex-compact +19.3% +17.4% +1.6% +14.4% ➖ noise
22 duckdb:vortex-file-compressed +4.0% +17.4% -11.4% +13.2% ➖ noise
23 datafusion:vortex-compact +17.6% +6.7% +10.2% +10.0% 🚨 regression
23 datafusion:vortex-file-compressed +11.0% +6.7% +4.0% +10.0% ➖ noise
23 duckdb:duckdb +7.4% +6.7% +0.6% +16.4% ➖ noise
23 duckdb:vortex-compact +8.1% +6.7% +1.3% +18.5% ➖ noise
23 duckdb:vortex-file-compressed +7.4% +6.7% +0.6% +10.0% ➖ noise
24 datafusion:vortex-compact +14.6% +8.9% +5.2% +10.2% ➖ noise
24 datafusion:vortex-file-compressed +11.2% +8.9% +2.1% +10.0% ➖ noise
24 duckdb:duckdb +8.6% +8.9% -0.3% +11.0% ➖ noise
24 duckdb:vortex-compact +10.9% +8.9% +1.8% +12.0% ➖ noise
24 duckdb:vortex-file-compressed +7.8% +8.9% -1.0% +12.6% ➖ noise
25 datafusion:vortex-compact +12.7% +7.4% +4.9% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +12.7% +7.4% +4.9% +10.0% ➖ noise
25 duckdb:duckdb +18.2% +7.4% +10.1% +16.6% ➖ noise
25 duckdb:vortex-compact +2.3% +7.4% -4.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +9.0% +7.4% +1.5% +10.0% ➖ noise
26 datafusion:vortex-compact +11.3% +11.8% -0.4% +14.1% ➖ noise
26 datafusion:vortex-file-compressed +1.8% +11.8% -8.9% +15.3% ➖ noise
26 duckdb:duckdb +28.9% +11.8% +15.3% +17.7% ➖ noise
26 duckdb:vortex-compact +25.1% +11.8% +11.9% +12.1% ➖ noise
26 duckdb:vortex-file-compressed +6.2% +11.8% -5.0% +10.0% ➖ noise
27 datafusion:vortex-compact +12.0% +6.9% +4.8% +12.3% ➖ noise
27 datafusion:vortex-file-compressed +6.8% +6.9% -0.1% +11.7% ➖ noise
27 duckdb:duckdb +13.2% +6.9% +5.9% +17.5% ➖ noise
27 duckdb:vortex-compact +9.7% +6.9% +2.6% +12.9% ➖ noise
27 duckdb:vortex-file-compressed +5.9% +6.9% -0.9% +14.5% ➖ noise
28 datafusion:vortex-compact +3.2% +5.2% -1.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.1% +5.2% -3.9% +12.7% ➖ noise
28 duckdb:duckdb +0.9% +5.2% -4.1% +10.0% ➖ noise
28 duckdb:vortex-compact +6.1% +5.2% +0.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +5.1% +5.2% -0.1% +10.0% ➖ noise
29 datafusion:vortex-compact +16.0% +4.3% +11.2% +10.0% 🚨 regression
29 datafusion:vortex-file-compressed +12.4% +4.3% +7.7% +13.3% ➖ noise
29 duckdb:duckdb +10.3% +4.3% +5.8% +10.0% ➖ noise
29 duckdb:vortex-compact +4.9% +4.3% +0.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.5% +4.3% -1.7% +10.0% ➖ noise
30 datafusion:vortex-compact +0.8% +11.6% -9.7% +16.9% ➖ noise
30 datafusion:vortex-file-compressed +9.6% +11.6% -1.8% +10.0% ➖ noise
30 duckdb:duckdb +11.9% +11.6% +0.2% +10.0% ➖ noise
30 duckdb:vortex-compact +18.1% +11.6% +5.9% +17.2% ➖ noise
30 duckdb:vortex-file-compressed +14.1% +11.6% +2.2% +11.7% ➖ noise
31 datafusion:vortex-compact +15.9% +6.5% +8.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +12.9% +6.5% +6.0% +10.0% ➖ noise
31 duckdb:duckdb +17.5% +6.5% +10.3% +10.1% 🚨 regression
31 duckdb:vortex-compact +14.3% +6.5% +7.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +12.1% +6.5% +5.3% +10.2% ➖ noise
32 datafusion:vortex-compact +10.0% +6.5% +3.3% +14.8% ➖ noise
32 datafusion:vortex-file-compressed +11.0% +6.5% +4.2% +10.0% ➖ noise
32 duckdb:duckdb +21.1% +6.5% +13.7% +18.7% ➖ noise
32 duckdb:vortex-compact +10.1% +6.5% +3.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +11.2% +6.5% +4.4% +10.0% ➖ noise
33 datafusion:vortex-compact +17.0% +7.5% +8.8% +11.3% ➖ noise
33 datafusion:vortex-file-compressed +8.1% +7.5% +0.5% +10.0% ➖ noise
33 duckdb:duckdb +12.0% +7.5% +4.1% +11.5% ➖ noise
33 duckdb:vortex-compact +16.2% +7.5% +8.1% +18.1% ➖ noise
33 duckdb:vortex-file-compressed -0.6% +7.5% -7.5% +12.0% ➖ noise
34 datafusion:vortex-compact +4.7% +1.4% +3.3% +18.9% ➖ noise
34 datafusion:vortex-file-compressed +7.8% +1.4% +6.4% +14.1% ➖ noise
34 duckdb:duckdb +18.5% +1.4% +16.9% +13.2% 🚨 regression
34 duckdb:vortex-compact +5.6% +1.4% +4.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +4.4% +1.4% +3.0% +10.0% ➖ noise
35 datafusion:vortex-compact +14.4% +9.6% +4.3% +15.1% ➖ noise
35 datafusion:vortex-file-compressed +10.9% +9.6% +1.2% +10.0% ➖ noise
35 duckdb:duckdb +10.7% +9.6% +1.1% +19.2% ➖ noise
35 duckdb:vortex-compact +10.5% +9.6% +0.8% +13.5% ➖ noise
35 duckdb:vortex-file-compressed +15.0% +9.6% +4.9% +12.3% ➖ noise
36 datafusion:vortex-compact +16.7% +6.0% +10.1% +10.0% 🚨 regression
36 datafusion:vortex-file-compressed +8.4% +6.0% +2.2% +10.0% ➖ noise
36 duckdb:duckdb +23.1% +6.0% +16.1% +10.0% 🚨 regression
36 duckdb:vortex-compact +9.7% +6.0% +3.4% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +4.3% +6.0% -1.6% +10.0% ➖ noise
37 datafusion:vortex-compact +11.1% +11.8% -0.6% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +16.0% +11.8% +3.7% +10.0% ➖ noise
37 duckdb:duckdb +12.0% +11.8% +0.2% +11.5% ➖ noise
37 duckdb:vortex-compact +20.7% +11.8% +8.0% +10.1% ➖ noise
37 duckdb:vortex-file-compressed +7.2% +11.8% -4.1% +10.0% ➖ noise
38 datafusion:vortex-compact +15.8% +9.6% +5.7% +11.0% ➖ noise
38 datafusion:vortex-file-compressed +11.5% +9.6% +1.7% +10.0% ➖ noise
38 duckdb:duckdb +17.2% +9.6% +6.9% +12.5% ➖ noise
38 duckdb:vortex-compact +10.0% +9.6% +0.4% +12.1% ➖ noise
38 duckdb:vortex-file-compressed +14.0% +9.6% +4.1% +10.5% ➖ noise
39 datafusion:vortex-compact +17.0% +8.8% +7.5% +11.2% ➖ noise
39 datafusion:vortex-file-compressed +19.1% +8.8% +9.5% +14.9% ➖ noise
39 duckdb:duckdb +13.7% +8.8% +4.6% +20.2% ➖ noise
39 duckdb:vortex-compact +11.1% +8.8% +2.1% +11.0% ➖ noise
39 duckdb:vortex-file-compressed -0.6% +8.8% -8.6% +12.6% ➖ noise
40 datafusion:vortex-compact +22.5% +13.6% +7.9% +10.7% ➖ noise
40 datafusion:vortex-file-compressed +8.1% +13.6% -4.9% +10.0% ➖ noise
40 duckdb:duckdb +22.1% +13.6% +7.5% +11.6% ➖ noise
40 duckdb:vortex-compact +17.5% +13.6% +3.5% +12.5% ➖ noise
40 duckdb:vortex-file-compressed +13.9% +13.6% +0.3% +15.7% ➖ noise
41 datafusion:vortex-compact +20.5% +18.5% +1.7% +15.6% ➖ noise
41 datafusion:vortex-file-compressed +16.6% +18.5% -1.6% +10.0% ➖ noise
41 duckdb:duckdb +19.2% +18.5% +0.6% +10.0% ➖ noise
41 duckdb:vortex-compact +13.9% +18.5% -3.9% +10.6% ➖ noise
41 duckdb:vortex-file-compressed +11.1% +18.5% -6.2% +10.0% ➖ noise
42 datafusion:vortex-compact +15.5% +6.6% +8.3% +10.1% ➖ noise
42 datafusion:vortex-file-compressed +17.3% +6.6% +10.0% +10.0% ➖ noise
42 duckdb:duckdb +22.8% +6.6% +15.2% +14.3% 🚨 regression
42 duckdb:vortex-compact +12.9% +6.6% +5.9% +18.0% ➖ noise
42 duckdb:vortex-file-compressed +8.6% +6.6% +1.9% +17.0% ➖ noise
43 datafusion:vortex-compact +11.8% +4.9% +6.6% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +7.0% +4.9% +2.0% +15.3% ➖ noise
43 duckdb:duckdb +16.6% +4.9% +11.2% +10.0% 🚨 regression
43 duckdb:vortex-compact -1.0% +4.9% -5.6% +12.6% ➖ noise
43 duckdb:vortex-file-compressed +2.2% +4.9% -2.6% +10.0% ➖ noise
44 datafusion:vortex-compact +10.5% +4.5% +5.8% +12.4% ➖ noise
44 datafusion:vortex-file-compressed +4.1% +4.5% -0.4% +15.6% ➖ noise
44 duckdb:duckdb +8.4% +4.5% +3.8% +16.3% ➖ noise
44 duckdb:vortex-compact -0.9% +4.5% -5.1% +12.9% ➖ noise
44 duckdb:vortex-file-compressed +10.1% +4.5% +5.3% +16.0% ➖ noise
45 datafusion:vortex-compact +21.1% +10.2% +9.8% +12.8% ➖ noise
45 datafusion:vortex-file-compressed +7.4% +10.2% -2.5% +10.0% ➖ noise
45 duckdb:duckdb +21.0% +10.2% +9.8% +11.2% ➖ noise
45 duckdb:vortex-compact +24.4% +10.2% +12.8% +12.5% 🚨 regression
45 duckdb:vortex-file-compressed +7.6% +10.2% -2.4% +12.0% ➖ noise
46 datafusion:vortex-compact +13.1% +7.1% +5.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +16.2% +7.1% +8.5% +11.1% ➖ noise
46 duckdb:duckdb +14.0% +7.1% +6.5% +10.0% ➖ noise
46 duckdb:vortex-compact +13.6% +7.1% +6.1% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +9.9% +7.1% +2.6% +10.0% ➖ noise
47 datafusion:vortex-compact +11.9% +10.2% +1.5% +10.5% ➖ noise
47 datafusion:vortex-file-compressed +11.8% +10.2% +1.4% +10.0% ➖ noise
47 duckdb:duckdb +14.0% +10.2% +3.4% +10.0% ➖ noise
47 duckdb:vortex-compact +13.0% +10.2% +2.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +6.8% +10.2% -3.1% +11.8% ➖ noise
48 datafusion:vortex-compact +7.6% +7.4% +0.2% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +10.3% +7.4% +2.7% +10.0% ➖ noise
48 duckdb:duckdb +7.1% +7.4% -0.3% +10.1% ➖ noise
48 duckdb:vortex-compact +13.5% +7.4% +5.7% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +5.8% +7.4% -1.5% +10.0% ➖ noise
49 datafusion:vortex-compact +19.6% +5.1% +13.8% +10.1% 🚨 regression
49 datafusion:vortex-file-compressed +10.4% +5.1% +5.0% +10.2% ➖ noise
49 duckdb:duckdb +14.0% +5.1% +8.5% +14.2% ➖ noise
49 duckdb:vortex-compact +11.7% +5.1% +6.3% +12.9% ➖ noise
49 duckdb:vortex-file-compressed +26.2% +5.1% +20.0% +17.9% 🚨 regression
50 datafusion:vortex-compact +18.3% +2.3% +15.7% +11.6% 🚨 regression
50 datafusion:vortex-file-compressed +9.1% +2.3% +6.6% +10.0% ➖ noise
50 duckdb:duckdb +18.7% +2.3% +16.0% +10.0% 🚨 regression
50 duckdb:vortex-compact +11.6% +2.3% +9.1% +12.0% ➖ noise
50 duckdb:vortex-file-compressed +3.5% +2.3% +1.2% +11.5% ➖ noise
51 datafusion:vortex-compact +10.1% +3.2% +6.7% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +7.0% +3.2% +3.7% +12.0% ➖ noise
51 duckdb:duckdb +4.4% +3.2% +1.2% +16.3% ➖ noise
51 duckdb:vortex-compact +8.6% +3.2% +5.2% +18.1% ➖ noise
51 duckdb:vortex-file-compressed +3.8% +3.2% +0.6% +15.8% ➖ noise
52 datafusion:vortex-compact +12.0% +13.0% -0.9% +10.0% ➖ noise
52 datafusion:vortex-file-compressed +6.9% +13.0% -5.3% +10.4% ➖ noise
52 duckdb:duckdb +10.9% +13.0% -1.8% +20.5% ➖ noise
52 duckdb:vortex-compact +10.9% +13.0% -1.8% +11.5% ➖ noise
52 duckdb:vortex-file-compressed +12.8% +13.0% -0.2% +14.3% ➖ noise
53 datafusion:vortex-compact +11.9% +8.0% +3.6% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +10.2% +8.0% +2.0% +10.0% ➖ noise
53 duckdb:duckdb +11.9% +8.0% +3.6% +11.3% ➖ noise
53 duckdb:vortex-compact +4.7% +8.0% -3.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +9.6% +8.0% +1.4% +14.2% ➖ noise
54 datafusion:vortex-compact +11.9% +2.7% +9.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +4.9% +2.7% +2.1% +10.0% ➖ noise
54 duckdb:duckdb +25.9% +2.7% +22.6% +10.0% 🚨 regression
54 duckdb:vortex-compact +10.1% +2.7% +7.2% +22.2% ➖ noise
54 duckdb:vortex-file-compressed +10.2% +2.7% +7.3% +10.0% ➖ noise
55 datafusion:vortex-compact +14.2% +8.1% +5.6% +10.2% ➖ noise
55 datafusion:vortex-file-compressed +10.5% +8.1% +2.2% +13.1% ➖ noise
55 duckdb:duckdb +13.9% +8.1% +5.4% +16.9% ➖ noise
55 duckdb:vortex-compact +15.1% +8.1% +6.4% +10.0% ➖ noise
55 duckdb:vortex-file-compressed +8.5% +8.1% +0.4% +10.0% ➖ noise
56 datafusion:vortex-compact +13.4% +7.0% +6.0% +11.9% ➖ noise
56 datafusion:vortex-file-compressed +3.2% +7.0% -3.5% +10.0% ➖ noise
56 duckdb:duckdb +16.3% +7.0% +8.7% +10.8% ➖ noise
56 duckdb:vortex-compact +14.5% +7.0% +7.0% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +0.8% +7.0% -5.8% +10.0% ➖ noise
57 datafusion:vortex-compact +18.2% +5.9% +11.5% +10.0% 🚨 regression
57 datafusion:vortex-file-compressed -3.9% +5.9% -9.3% +10.0% ✅ faster
57 duckdb:duckdb +9.4% +5.9% +3.3% +11.7% ➖ noise
57 duckdb:vortex-compact +9.7% +5.9% +3.6% +14.1% ➖ noise
57 duckdb:vortex-file-compressed +7.2% +5.9% +1.2% +10.0% ➖ noise
58 datafusion:vortex-compact +6.7% +5.5% +1.2% +11.0% ➖ noise
58 datafusion:vortex-file-compressed +7.1% +5.5% +1.5% +10.0% ➖ noise
58 duckdb:duckdb +17.2% +5.5% +11.1% +11.0% 🚨 regression
58 duckdb:vortex-compact +11.3% +5.5% +5.5% +14.8% ➖ noise
58 duckdb:vortex-file-compressed +6.2% +5.5% +0.7% +15.7% ➖ noise
59 datafusion:vortex-compact +9.9% +3.2% +6.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +3.4% +3.2% +0.2% +10.0% ➖ noise
59 duckdb:duckdb +10.2% +3.2% +6.8% +10.0% ➖ noise
59 duckdb:vortex-compact -2.3% +3.2% -5.4% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +1.8% +3.2% -1.4% +10.0% ➖ noise
60 datafusion:vortex-compact +16.5% +10.9% +5.0% +14.8% ➖ noise
60 datafusion:vortex-file-compressed +6.6% +10.9% -3.9% +13.3% ➖ noise
60 duckdb:duckdb +12.1% +10.9% +1.1% +17.6% ➖ noise
60 duckdb:vortex-compact +13.1% +10.9% +2.0% +13.3% ➖ noise
60 duckdb:vortex-file-compressed +14.0% +10.9% +2.8% +12.8% ➖ noise
61 datafusion:vortex-compact +13.1% +5.9% +6.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +7.4% +5.9% +1.3% +10.0% ➖ noise
61 duckdb:duckdb +12.7% +5.9% +6.4% +10.8% ➖ noise
61 duckdb:vortex-compact +9.6% +5.9% +3.5% +12.6% ➖ noise
61 duckdb:vortex-file-compressed +16.6% +5.9% +10.1% +12.9% ➖ noise
62 datafusion:vortex-compact +29.2% +7.6% +20.1% +21.0% ➖ noise
62 datafusion:vortex-file-compressed -10.1% +7.6% -16.5% +21.7% ➖ noise
62 duckdb:duckdb +17.0% +7.6% +8.8% +11.3% ➖ noise
62 duckdb:vortex-compact +26.2% +7.6% +17.3% +16.2% 🚨 regression
62 duckdb:vortex-file-compressed +7.2% +7.6% -0.3% +13.2% ➖ noise
63 datafusion:vortex-compact +10.0% +9.8% +0.2% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +14.0% +9.8% +3.8% +10.0% ➖ noise
63 duckdb:duckdb +16.0% +9.8% +5.6% +10.0% ➖ noise
63 duckdb:vortex-compact +14.9% +9.8% +4.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +10.2% +9.8% +0.3% +10.0% ➖ noise
64 datafusion:vortex-compact +16.0% +4.6% +10.9% +10.0% 🚨 regression
64 datafusion:vortex-file-compressed +3.7% +4.6% -0.9% +10.0% ➖ noise
64 duckdb:duckdb +13.4% +4.6% +8.4% +10.0% ➖ noise
64 duckdb:vortex-compact +7.8% +4.6% +3.1% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +8.1% +4.6% +3.4% +10.0% ➖ noise
65 datafusion:vortex-compact +12.2% +6.8% +5.0% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +13.2% +6.8% +6.0% +10.0% ➖ noise
65 duckdb:duckdb +19.5% +6.8% +11.9% +12.5% ➖ noise
65 duckdb:vortex-compact +11.0% +6.8% +4.0% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -1.7% +6.8% -7.9% +10.0% ➖ noise
66 datafusion:vortex-compact +12.9% +5.8% +6.8% +15.8% ➖ noise
66 datafusion:vortex-file-compressed +7.3% +5.8% +1.4% +14.9% ➖ noise
66 duckdb:duckdb +14.5% +5.8% +8.3% +16.3% ➖ noise
66 duckdb:vortex-compact +11.5% +5.8% +5.4% +10.9% ➖ noise
66 duckdb:vortex-file-compressed +2.9% +5.8% -2.7% +12.4% ➖ noise
67 datafusion:vortex-compact +11.8% +5.9% +5.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +8.1% +5.9% +2.0% +10.0% ➖ noise
67 duckdb:duckdb +10.7% +5.9% +4.6% +10.0% ➖ noise
67 duckdb:vortex-compact +9.8% +5.9% +3.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +4.0% +5.9% -1.8% +10.0% ➖ noise
68 datafusion:vortex-compact +20.8% +5.9% +14.1% +14.9% ➖ noise
68 datafusion:vortex-file-compressed +15.6% +5.9% +9.2% +13.5% ➖ noise
68 duckdb:duckdb +8.8% +5.9% +2.8% +11.7% ➖ noise
68 duckdb:vortex-compact +11.1% +5.9% +4.9% +11.0% ➖ noise
68 duckdb:vortex-file-compressed +16.7% +5.9% +10.3% +12.0% ➖ noise
69 datafusion:vortex-compact +9.9% +8.4% +1.4% +12.4% ➖ noise
69 datafusion:vortex-file-compressed +11.6% +8.4% +3.0% +10.0% ➖ noise
69 duckdb:duckdb +6.4% +8.4% -1.9% +10.0% ➖ noise
69 duckdb:vortex-compact +9.5% +8.4% +1.0% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +7.8% +8.4% -0.6% +10.0% ➖ noise
70 datafusion:vortex-compact +14.1% +6.1% +7.5% +12.1% ➖ noise
70 datafusion:vortex-file-compressed +6.1% +6.1% -0.0% +10.0% ➖ noise
70 duckdb:duckdb +7.2% +6.1% +1.0% +13.9% ➖ noise
70 duckdb:vortex-compact +5.7% +6.1% -0.4% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +6.2% +6.1% +0.1% +11.4% ➖ noise
71 datafusion:vortex-compact +11.3% +7.6% +3.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +4.4% +7.6% -3.0% +17.2% ➖ noise
71 duckdb:duckdb +13.9% +7.6% +5.8% +17.2% ➖ noise
71 duckdb:vortex-compact +9.2% +7.6% +1.4% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +10.6% +7.6% +2.8% +18.8% ➖ noise
72 datafusion:vortex-compact +16.5% +5.3% +10.6% +10.0% 🚨 regression
72 datafusion:vortex-file-compressed +10.6% +5.3% +5.0% +10.0% ➖ noise
72 duckdb:duckdb +7.2% +5.3% +1.8% +10.2% ➖ noise
72 duckdb:vortex-compact +3.6% +5.3% -1.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +2.4% +5.3% -2.8% +10.0% ➖ noise
73 datafusion:vortex-compact +11.3% +8.2% +2.8% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +12.9% +8.2% +4.4% +10.3% ➖ noise
73 duckdb:duckdb +12.6% +8.2% +4.1% +13.5% ➖ noise
73 duckdb:vortex-compact +4.7% +8.2% -3.3% +13.7% ➖ noise
73 duckdb:vortex-file-compressed +10.5% +8.2% +2.2% +21.7% ➖ noise
74 datafusion:vortex-compact +14.3% +5.0% +8.8% +10.8% ➖ noise
74 datafusion:vortex-file-compressed +24.6% +5.0% +18.7% +14.1% 🚨 regression
74 duckdb:duckdb +7.7% +5.0% +2.6% +10.0% ➖ noise
74 duckdb:vortex-compact +13.4% +5.0% +8.0% +22.9% ➖ noise
74 duckdb:vortex-file-compressed +4.5% +5.0% -0.5% +18.7% ➖ noise
75 datafusion:vortex-compact +11.0% +4.3% +6.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +18.1% +4.3% +13.3% +12.5% 🚨 regression
75 duckdb:duckdb +15.3% +4.3% +10.6% +10.7% ➖ noise
75 duckdb:vortex-compact +20.2% +4.3% +15.3% +13.4% 🚨 regression
75 duckdb:vortex-file-compressed +12.5% +4.3% +7.9% +10.9% ➖ noise
76 datafusion:vortex-compact +11.4% +5.5% +5.6% +11.6% ➖ noise
76 datafusion:vortex-file-compressed +15.4% +5.5% +9.3% +10.0% ➖ noise
76 duckdb:duckdb +7.3% +5.5% +1.7% +16.5% ➖ noise
76 duckdb:vortex-compact +4.5% +5.5% -1.0% +13.2% ➖ noise
76 duckdb:vortex-file-compressed +16.4% +5.5% +10.3% +14.5% ➖ noise
77 datafusion:vortex-compact +14.1% +7.6% +6.1% +21.2% ➖ noise
77 datafusion:vortex-file-compressed +16.1% +7.6% +7.9% +10.5% ➖ noise
77 duckdb:duckdb +10.9% +7.6% +3.1% +14.0% ➖ noise
77 duckdb:vortex-compact +7.5% +7.6% -0.1% +14.9% ➖ noise
77 duckdb:vortex-file-compressed +9.2% +7.6% +1.5% +16.4% ➖ noise
78 datafusion:vortex-compact +21.9% +8.3% +12.6% +10.0% 🚨 regression
78 datafusion:vortex-file-compressed +18.6% +8.3% +9.5% +11.3% ➖ noise
78 duckdb:duckdb +13.8% +8.3% +5.1% +12.3% ➖ noise
78 duckdb:vortex-compact +14.4% +8.3% +5.7% +11.1% ➖ noise
78 duckdb:vortex-file-compressed +17.4% +8.3% +8.4% +10.0% ➖ noise
79 datafusion:vortex-compact +13.3% +5.0% +7.9% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +19.3% +5.0% +13.7% +10.0% 🚨 regression
79 duckdb:duckdb +14.6% +5.0% +9.2% +12.1% ➖ noise
79 duckdb:vortex-compact +6.1% +5.0% +1.0% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +10.1% +5.0% +4.9% +10.0% ➖ noise
80 datafusion:vortex-compact +20.2% +9.2% +10.0% +10.0% 🚨 regression
80 datafusion:vortex-file-compressed +12.5% +9.2% +3.0% +10.0% ➖ noise
80 duckdb:duckdb +18.2% +9.2% +8.2% +14.6% ➖ noise
80 duckdb:vortex-compact +18.5% +9.2% +8.5% +10.9% ➖ noise
80 duckdb:vortex-file-compressed +16.8% +9.2% +7.0% +11.4% ➖ noise
81 datafusion:vortex-compact +12.4% +8.6% +3.5% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +28.3% +8.6% +18.1% +16.3% 🚨 regression
81 duckdb:duckdb +21.1% +8.6% +11.5% +10.4% 🚨 regression
81 duckdb:vortex-compact +16.9% +8.6% +7.6% +16.6% ➖ noise
81 duckdb:vortex-file-compressed +9.2% +8.6% +0.6% +11.2% ➖ noise
82 datafusion:vortex-compact +11.5% +10.4% +1.0% +10.2% ➖ noise
82 datafusion:vortex-file-compressed +19.4% +10.4% +8.2% +11.7% ➖ noise
82 duckdb:duckdb +18.6% +10.4% +7.4% +17.4% ➖ noise
82 duckdb:vortex-compact +16.5% +10.4% +5.5% +11.4% ➖ noise
82 duckdb:vortex-file-compressed +17.8% +10.4% +6.7% +10.8% ➖ noise
83 datafusion:vortex-compact +18.9% +7.9% +10.2% +10.0% 🚨 regression
83 datafusion:vortex-file-compressed +25.4% +7.9% +16.2% +11.4% 🚨 regression
83 duckdb:duckdb +12.7% +7.9% +4.4% +11.6% ➖ noise
83 duckdb:vortex-compact +14.2% +7.9% +5.8% +24.5% ➖ noise
83 duckdb:vortex-file-compressed +8.6% +7.9% +0.6% +10.3% ➖ noise
84 datafusion:vortex-compact +32.2% +0.8% +31.1% +20.9% 🚨 regression
84 datafusion:vortex-file-compressed +22.7% +0.8% +21.7% +10.0% 🚨 regression
84 duckdb:duckdb +5.2% +0.8% +4.3% +11.8% ➖ noise
84 duckdb:vortex-compact +11.8% +0.8% +10.8% +10.4% 🚨 regression
84 duckdb:vortex-file-compressed +15.1% +0.8% +14.1% +14.8% ➖ noise
85 datafusion:vortex-compact +13.1% +4.6% +8.1% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +11.9% +4.6% +7.0% +10.0% ➖ noise
85 duckdb:duckdb +9.9% +4.6% +5.0% +10.8% ➖ noise
85 duckdb:vortex-compact +15.9% +4.6% +10.8% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +13.0% +4.6% +8.0% +10.0% ➖ noise
86 datafusion:vortex-compact -3.2% +16.3% -16.8% +15.3% ✅ faster
86 datafusion:vortex-file-compressed +30.5% +16.3% +12.2% +16.5% ➖ noise
86 duckdb:duckdb +20.0% +16.3% +3.1% +18.3% ➖ noise
86 duckdb:vortex-compact +16.9% +16.3% +0.5% +14.4% ➖ noise
86 duckdb:vortex-file-compressed +9.5% +16.3% -5.8% +10.0% ➖ noise
87 datafusion:vortex-compact +17.8% +1.1% +16.5% +10.0% 🚨 regression
87 datafusion:vortex-file-compressed +18.3% +1.1% +17.1% +10.0% 🚨 regression
87 duckdb:duckdb +24.9% +1.1% +23.6% +10.8% 🚨 regression
87 duckdb:vortex-compact +6.8% +1.1% +5.7% +13.0% ➖ noise
87 duckdb:vortex-file-compressed +9.5% +1.1% +8.3% +10.3% ➖ noise
88 datafusion:vortex-compact +17.7% +4.7% +12.5% +10.0% 🚨 regression
88 datafusion:vortex-file-compressed +14.7% +4.7% +9.6% +10.0% ➖ noise
88 duckdb:duckdb +8.3% +4.7% +3.5% +10.0% ➖ noise
88 duckdb:vortex-compact +15.4% +4.7% +10.2% +10.9% ➖ noise
88 duckdb:vortex-file-compressed +15.4% +4.7% +10.2% +10.0% 🚨 regression
89 datafusion:vortex-compact +12.7% +4.5% +7.9% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +12.1% +4.5% +7.3% +10.0% ➖ noise
89 duckdb:duckdb +10.8% +4.5% +6.1% +10.0% ➖ noise
89 duckdb:vortex-compact +5.6% +4.5% +1.1% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +14.7% +4.5% +9.8% +10.0% ➖ noise
90 datafusion:vortex-compact +17.9% +3.5% +13.9% +10.0% 🚨 regression
90 datafusion:vortex-file-compressed +22.0% +3.5% +17.9% +17.6% 🚨 regression
90 duckdb:duckdb +19.6% +3.5% +15.6% +10.0% 🚨 regression
90 duckdb:vortex-compact +12.3% +3.5% +8.5% +10.9% ➖ noise
90 duckdb:vortex-file-compressed +10.2% +3.5% +6.4% +33.3% ➖ noise
91 datafusion:vortex-compact +9.5% +6.7% +2.6% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +27.9% +6.7% +19.9% +16.6% 🚨 regression
91 duckdb:duckdb +17.4% +6.7% +10.0% +15.7% ➖ noise
91 duckdb:vortex-compact +12.9% +6.7% +5.8% +11.0% ➖ noise
91 duckdb:vortex-file-compressed +9.9% +6.7% +3.0% +15.3% ➖ noise
92 datafusion:vortex-compact +23.5% +13.7% +8.7% +11.6% ➖ noise
92 datafusion:vortex-file-compressed +22.3% +13.7% +7.6% +10.1% ➖ noise
92 duckdb:duckdb +40.3% +13.7% +23.4% +20.0% 🚨 regression
92 duckdb:vortex-compact +7.3% +13.7% -5.7% +25.3% ➖ noise
92 duckdb:vortex-file-compressed +8.9% +13.7% -4.2% +15.2% ➖ noise
93 datafusion:vortex-compact +14.4% +6.5% +7.4% +12.0% ➖ noise
93 datafusion:vortex-file-compressed +29.6% +6.5% +21.6% +15.0% 🚨 regression
93 duckdb:duckdb +21.2% +6.5% +13.8% +13.4% 🚨 regression
93 duckdb:vortex-compact +13.8% +6.5% +6.8% +10.9% ➖ noise
93 duckdb:vortex-file-compressed +10.1% +6.5% +3.4% +12.4% ➖ noise
94 datafusion:vortex-compact +27.3% +8.8% +16.9% +11.3% 🚨 regression
94 datafusion:vortex-file-compressed +18.9% +8.8% +9.3% +11.8% ➖ noise
94 duckdb:duckdb +15.8% +8.8% +6.4% +11.4% ➖ noise
94 duckdb:vortex-compact +22.0% +8.8% +12.1% +10.0% 🚨 regression
94 duckdb:vortex-file-compressed +15.8% +8.8% +6.4% +11.7% ➖ noise
95 datafusion:vortex-compact +3.6% +3.1% +0.5% +10.9% ➖ noise
95 datafusion:vortex-file-compressed +15.1% +3.1% +11.6% +10.4% 🚨 regression
95 duckdb:duckdb -6.3% +3.1% -9.1% +20.4% ➖ noise
95 duckdb:vortex-compact +7.0% +3.1% +3.8% +14.1% ➖ noise
95 duckdb:vortex-file-compressed +9.3% +3.1% +6.0% +17.9% ➖ noise
96 datafusion:vortex-compact +17.5% +6.3% +10.6% +13.9% ➖ noise
96 datafusion:vortex-file-compressed +24.0% +6.3% +16.7% +11.9% 🚨 regression
96 duckdb:duckdb +15.7% +6.3% +8.9% +16.7% ➖ noise
96 duckdb:vortex-compact +5.9% +6.3% -0.4% +14.1% ➖ noise
96 duckdb:vortex-file-compressed +4.5% +6.3% -1.6% +14.1% ➖ noise
97 datafusion:vortex-compact +14.4% +16.2% -1.5% +12.4% ➖ noise
97 datafusion:vortex-file-compressed +13.3% +16.2% -2.5% +13.4% ➖ noise
97 duckdb:duckdb +15.7% +16.2% -0.5% +11.0% ➖ noise
97 duckdb:vortex-compact +14.7% +16.2% -1.2% +10.0% ➖ noise
97 duckdb:vortex-file-compressed +20.1% +16.2% +3.4% +14.0% ➖ noise
98 datafusion:vortex-compact +12.9% +0.3% +12.5% +13.6% ➖ noise
98 datafusion:vortex-file-compressed +12.4% +0.3% +12.0% +16.6% ➖ noise
98 duckdb:duckdb +13.4% +0.3% +13.1% +14.8% ➖ noise
98 duckdb:vortex-compact +9.5% +0.3% +9.2% +12.4% ➖ noise
98 duckdb:vortex-file-compressed +15.2% +0.3% +14.9% +14.0% 🚨 regression
99 datafusion:vortex-compact +19.1% +0.3% +18.7% +19.5% ➖ noise
99 datafusion:vortex-file-compressed +15.2% +0.3% +14.9% +19.0% ➖ noise
99 duckdb:duckdb +11.7% +0.3% +11.4% +25.1% ➖ noise
99 duckdb:vortex-compact +29.4% +0.3% +29.0% +14.8% 🚨 regression
99 duckdb:vortex-file-compressed +4.2% +0.3% +3.9% +23.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.1%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 0.968x ➖
Shifts: Parquet (control) -3.2% · Median polish -1.5%


datafusion / vortex-file-compressed (0.959x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 35605288 30778944 1.16
fineweb_q01/datafusion:vortex-file-compressed 515855843 535886879 0.96
fineweb_q02/datafusion:vortex-file-compressed 420601439 556662240 0.76
fineweb_q03/datafusion:vortex-file-compressed 1383284850 1452089911 0.95
fineweb_q04/datafusion:vortex-file-compressed 1432944279 1397974178 1.03
fineweb_q05/datafusion:vortex-file-compressed 1356288559 1372744026 0.99
fineweb_q06/datafusion:vortex-file-compressed 1549961776 1643455664 0.94
fineweb_q07/datafusion:vortex-file-compressed 1353492248 1428054606 0.95
fineweb_q08/datafusion:vortex-file-compressed 537923896 571205943 0.94
datafusion / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 37149843 39843490 0.93
fineweb_q01/datafusion:vortex-compact 594606334 649717458 0.92
fineweb_q02/datafusion:vortex-compact 654538649 590906819 1.11
fineweb_q03/datafusion:vortex-compact 1485661082 1509545603 0.98
fineweb_q04/datafusion:vortex-compact 1867699909 1908325589 0.98
fineweb_q05/datafusion:vortex-compact 1524900276 1571079703 0.97
fineweb_q06/datafusion:vortex-compact 1362152560 1394437968 0.98
fineweb_q07/datafusion:vortex-compact 1223269512 1282655540 0.95
fineweb_q08/datafusion:vortex-compact 389122504 410348272 0.95
datafusion / parquet (0.978x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1135794641 1320861094 0.86
fineweb_q01/datafusion:parquet 1826131541 1744856679 1.05
fineweb_q02/datafusion:parquet 2213972683 1975127080 1.12
fineweb_q03/datafusion:parquet 2236035549 2238143168 1.00
fineweb_q04/datafusion:parquet 2065416747 2210429084 0.93
fineweb_q05/datafusion:parquet 1837093881 2105785518 0.87
fineweb_q06/datafusion:parquet 2366612473 2344668614 1.01
fineweb_q07/datafusion:parquet 2253324992 1998258510 1.13
fineweb_q08/datafusion:parquet 1730404097 1974828420 0.88
duckdb / vortex-file-compressed (1.060x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 84903847 73725400 1.15
fineweb_q01/duckdb:vortex-file-compressed 652692606 691737122 0.94
fineweb_q02/duckdb:vortex-file-compressed 448719120 498336794 0.90
fineweb_q03/duckdb:vortex-file-compressed 1622625367 1568959248 1.03
fineweb_q04/duckdb:vortex-file-compressed 1778364754 1502236597 1.18
fineweb_q05/duckdb:vortex-file-compressed 1615718959 1437393415 1.12
fineweb_q06/duckdb:vortex-file-compressed 1787736811 1658037712 1.08
fineweb_q07/duckdb:vortex-file-compressed 1659318476 1450225773 1.14
fineweb_q08/duckdb:vortex-file-compressed 640959014 632587110 1.01
duckdb / vortex-compact (1.041x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 86056323 86899328 0.99
fineweb_q01/duckdb:vortex-compact 574544505 586965162 0.98
fineweb_q02/duckdb:vortex-compact 597243268 604836955 0.99
fineweb_q03/duckdb:vortex-compact 1800724086 1679430668 1.07
fineweb_q04/duckdb:vortex-compact 1916448205 1848194863 1.04
fineweb_q05/duckdb:vortex-compact 1683200058 1751705860 0.96
fineweb_q06/duckdb:vortex-compact 1581508956 1451562920 1.09
fineweb_q07/duckdb:vortex-compact 1442907313 1412461473 1.02
fineweb_q08/duckdb:vortex-compact 543811184 431272048 1.26
duckdb / parquet (0.957x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1194811571 1263634623 0.95
fineweb_q01/duckdb:parquet 1363006480 1436503763 0.95
fineweb_q02/duckdb:parquet 1470683102 1466942776 1.00
fineweb_q03/duckdb:parquet 3610212244 4004347793 0.90
fineweb_q04/duckdb:parquet 1888907602 1958015577 0.96
fineweb_q05/duckdb:parquet 2102886255 2178045469 0.97
fineweb_q06/duckdb:parquet 4275707845 4478185504 0.95
fineweb_q07/duckdb:parquet 2643396661 2743544222 0.96
fineweb_q08/duckdb:parquet 1123036756 1157276564 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -6.8% -9.8% +3.4% +225.4% ➖ noise
0 datafusion:vortex-file-compressed +15.7% -9.8% +28.3% +175.5% ➖ noise
0 duckdb:vortex-compact -1.0% -9.8% +9.8% +107.0% ➖ noise
0 duckdb:vortex-file-compressed +15.2% -9.8% +27.7% +43.8% ➖ noise
1 datafusion:vortex-compact -8.5% -0.3% -8.2% +70.9% ➖ noise
1 datafusion:vortex-file-compressed -3.7% -0.3% -3.4% +86.8% ➖ noise
1 duckdb:vortex-compact -2.1% -0.3% -1.8% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -5.6% -0.3% -5.3% +30.9% ➖ noise
2 datafusion:vortex-compact +10.8% +6.0% +4.5% +33.3% ➖ noise
2 datafusion:vortex-file-compressed -24.4% +6.0% -28.7% +82.3% ➖ noise
2 duckdb:vortex-compact -1.3% +6.0% -6.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -10.0% +6.0% -15.1% +30.5% ➖ noise
3 datafusion:vortex-compact -1.6% -5.1% +3.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -4.7% -5.1% +0.4% +30.0% ➖ noise
3 duckdb:vortex-compact +7.2% -5.1% +13.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.4% -5.1% +9.0% +30.0% ➖ noise
4 datafusion:vortex-compact -2.1% -5.1% +3.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +2.5% -5.1% +8.0% +30.0% ➖ noise
4 duckdb:vortex-compact +3.7% -5.1% +9.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +18.4% -5.1% +24.7% +30.0% ➖ noise
5 datafusion:vortex-compact -2.9% -8.2% +5.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.2% -8.2% +7.7% +30.0% ➖ noise
5 duckdb:vortex-compact -3.9% -8.2% +4.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +12.4% -8.2% +22.5% +30.0% ➖ noise
6 datafusion:vortex-compact -2.3% -1.8% -0.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -5.7% -1.8% -3.9% +32.3% ➖ noise
6 duckdb:vortex-compact +9.0% -1.8% +11.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.8% -1.8% +9.8% +30.0% ➖ noise
7 datafusion:vortex-compact -4.6% +4.2% -8.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -5.2% +4.2% -9.1% +30.0% ➖ noise
7 duckdb:vortex-compact +2.2% +4.2% -2.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +14.4% +4.2% +9.8% +30.0% ➖ noise
8 datafusion:vortex-compact -5.2% -7.8% +2.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -5.8% -7.8% +2.1% +30.0% ➖ noise
8 duckdb:vortex-compact +26.1% -7.8% +36.7% +31.2% 🚨 regression
8 duckdb:vortex-file-compressed +1.3% -7.8% +9.9% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.967x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.4%


datafusion / vortex-file-compressed (0.979x ➖, 0↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1672510 1761018 0.95
clickbench_q01/datafusion:vortex-file-compressed 19143281 19674376 0.97
clickbench_q02/datafusion:vortex-file-compressed 37931861 39317247 0.96
clickbench_q03/datafusion:vortex-file-compressed 42565680 46260954 0.92
clickbench_q04/datafusion:vortex-file-compressed 289219372 297565477 0.97
clickbench_q05/datafusion:vortex-file-compressed 295463433 314627852 0.94
clickbench_q06/datafusion:vortex-file-compressed 1711094 1642898 1.04
clickbench_q07/datafusion:vortex-file-compressed 23938721 23296485 1.03
clickbench_q08/datafusion:vortex-file-compressed 350311389 359248293 0.98
clickbench_q09/datafusion:vortex-file-compressed 556824136 589313920 0.94
clickbench_q10/datafusion:vortex-file-compressed 75461031 75362023 1.00
clickbench_q11/datafusion:vortex-file-compressed 87016458 92539381 0.94
clickbench_q12/datafusion:vortex-file-compressed 266244284 261634234 1.02
clickbench_q13/datafusion:vortex-file-compressed 408263152 416856524 0.98
clickbench_q14/datafusion:vortex-file-compressed 252825891 261846735 0.97
clickbench_q15/datafusion:vortex-file-compressed 325284233 327980986 0.99
clickbench_q16/datafusion:vortex-file-compressed 647673341 647884007 1.00
clickbench_q17/datafusion:vortex-file-compressed 634281907 645403177 0.98
clickbench_q18/datafusion:vortex-file-compressed 1283937779 1310088980 0.98
clickbench_q19/datafusion:vortex-file-compressed 🚨 36270166 30142998 1.20
clickbench_q20/datafusion:vortex-file-compressed 343209575 342113017 1.00
clickbench_q21/datafusion:vortex-file-compressed 363872453 368952998 0.99
clickbench_q22/datafusion:vortex-file-compressed 441939146 457753534 0.97
clickbench_q23/datafusion:vortex-file-compressed 664632424 676050756 0.98
clickbench_q24/datafusion:vortex-file-compressed 46512365 48722633 0.95
clickbench_q25/datafusion:vortex-file-compressed 69342332 71810564 0.97
clickbench_q26/datafusion:vortex-file-compressed 46452373 47265040 0.98
clickbench_q27/datafusion:vortex-file-compressed 730648336 729685970 1.00
clickbench_q28/datafusion:vortex-file-compressed 6849183710 6870266429 1.00
clickbench_q29/datafusion:vortex-file-compressed 247029645 242613026 1.02
clickbench_q30/datafusion:vortex-file-compressed 220243558 225884684 0.98
clickbench_q31/datafusion:vortex-file-compressed 254433350 266689917 0.95
clickbench_q32/datafusion:vortex-file-compressed 1093393661 1145368683 0.95
clickbench_q33/datafusion:vortex-file-compressed 1262223565 1321642790 0.96
clickbench_q34/datafusion:vortex-file-compressed 1276879614 1298136869 0.98
clickbench_q35/datafusion:vortex-file-compressed 441106317 450823656 0.98
clickbench_q36/datafusion:vortex-file-compressed 70192991 73132817 0.96
clickbench_q37/datafusion:vortex-file-compressed 34409676 35847122 0.96
clickbench_q38/datafusion:vortex-file-compressed 18526832 19277026 0.96
clickbench_q39/datafusion:vortex-file-compressed 129378315 133264535 0.97
clickbench_q40/datafusion:vortex-file-compressed 15925900 16399969 0.97
clickbench_q41/datafusion:vortex-file-compressed 14753603 15748664 0.94
clickbench_q42/datafusion:vortex-file-compressed 16838865 17681517 0.95
datafusion / parquet (0.982x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1543575 1549307 1.00
clickbench_q01/datafusion:parquet 18994216 20387335 0.93
clickbench_q02/datafusion:parquet 46165205 48717827 0.95
clickbench_q03/datafusion:parquet 38598819 37281195 1.04
clickbench_q04/datafusion:parquet 292494378 300002685 0.97
clickbench_q05/datafusion:parquet 356031165 349581787 1.02
clickbench_q06/datafusion:parquet 1573233 1585059 0.99
clickbench_q07/datafusion:parquet 22558322 22034714 1.02
clickbench_q08/datafusion:parquet 362398071 366993117 0.99
clickbench_q09/datafusion:parquet 607523706 616937108 0.98
clickbench_q10/datafusion:parquet 110597891 112572885 0.98
clickbench_q11/datafusion:parquet 137986791 135908990 1.02
clickbench_q12/datafusion:parquet 345482732 345647674 1.00
clickbench_q13/datafusion:parquet 491292794 505877011 0.97
clickbench_q14/datafusion:parquet 352446019 346513744 1.02
clickbench_q15/datafusion:parquet 332474290 337703302 0.98
clickbench_q16/datafusion:parquet 657728298 664386334 0.99
clickbench_q17/datafusion:parquet 645778311 663741069 0.97
clickbench_q18/datafusion:parquet 1298144469 1354438060 0.96
clickbench_q19/datafusion:parquet 29259568 29904574 0.98
clickbench_q20/datafusion:parquet 592057401 609448805 0.97
clickbench_q21/datafusion:parquet 661810570 670645201 0.99
clickbench_q22/datafusion:parquet 981437729 993856458 0.99
clickbench_q23/datafusion:parquet 3750850914 3751379875 1.00
clickbench_q24/datafusion:parquet 84740260 90332682 0.94
clickbench_q25/datafusion:parquet 137020695 138273493 0.99
clickbench_q26/datafusion:parquet 84111597 85901672 0.98
clickbench_q27/datafusion:parquet 1050763154 1077700153 0.98
clickbench_q28/datafusion:parquet 6700123141 6773764837 0.99
clickbench_q29/datafusion:parquet 240540220 240943671 1.00
clickbench_q30/datafusion:parquet 331997952 342638362 0.97
clickbench_q31/datafusion:parquet 372425939 372477975 1.00
clickbench_q32/datafusion:parquet 1186427775 1225728645 0.97
clickbench_q33/datafusion:parquet 1461235602 1513722729 0.97
clickbench_q34/datafusion:parquet 1454303637 1502049612 0.97
clickbench_q35/datafusion:parquet 455547280 472906484 0.96
clickbench_q36/datafusion:parquet 138677721 143675727 0.97
clickbench_q37/datafusion:parquet 57434693 57331115 1.00
clickbench_q38/datafusion:parquet 84973753 86364491 0.98
clickbench_q39/datafusion:parquet 258306856 261774295 0.99
clickbench_q40/datafusion:parquet 29747750 30601131 0.97
clickbench_q41/datafusion:parquet 27331646 28182362 0.97
clickbench_q42/datafusion:parquet 29006102 30766831 0.94
duckdb / vortex-file-compressed (0.955x ➖, 3↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6019794 6080378 0.99
clickbench_q01/duckdb:vortex-file-compressed 12946343 13844532 0.94
clickbench_q02/duckdb:vortex-file-compressed 26108536 26500844 0.99
clickbench_q03/duckdb:vortex-file-compressed 29074596 29455755 0.99
clickbench_q04/duckdb:vortex-file-compressed 180294234 182260750 0.99
clickbench_q05/duckdb:vortex-file-compressed 170309749 173585852 0.98
clickbench_q06/duckdb:vortex-file-compressed 18007852 18737426 0.96
clickbench_q07/duckdb:vortex-file-compressed 14902162 15244386 0.98
clickbench_q08/duckdb:vortex-file-compressed 255833498 258440883 0.99
clickbench_q09/duckdb:vortex-file-compressed 334695799 335778702 1.00
clickbench_q10/duckdb:vortex-file-compressed 65261726 68768473 0.95
clickbench_q11/duckdb:vortex-file-compressed 77256031 77602011 1.00
clickbench_q12/duckdb:vortex-file-compressed 189905776 203258748 0.93
clickbench_q13/duckdb:vortex-file-compressed 399479745 409240350 0.98
clickbench_q14/duckdb:vortex-file-compressed 226209030 240851903 0.94
clickbench_q15/duckdb:vortex-file-compressed 236950021 240869799 0.98
clickbench_q16/duckdb:vortex-file-compressed 579509931 582651795 0.99
clickbench_q17/duckdb:vortex-file-compressed 480401934 474152011 1.01
clickbench_q18/duckdb:vortex-file-compressed 970432263 989161046 0.98
clickbench_q19/duckdb:vortex-file-compressed 21069795 21337621 0.99
clickbench_q20/duckdb:vortex-file-compressed 318874757 340582715 0.94
clickbench_q21/duckdb:vortex-file-compressed 368613388 361922364 1.02
clickbench_q22/duckdb:vortex-file-compressed 486979975 501991465 0.97
clickbench_q23/duckdb:vortex-file-compressed 🚀 273724421 736844746 0.37
clickbench_q24/duckdb:vortex-file-compressed 38759027 41175604 0.94
clickbench_q25/duckdb:vortex-file-compressed 83240601 77344285 1.08
clickbench_q26/duckdb:vortex-file-compressed 🚨 52206901 45374675 1.15
clickbench_q27/duckdb:vortex-file-compressed 464346634 475689948 0.98
clickbench_q28/duckdb:vortex-file-compressed 2954991412 2972398311 0.99
clickbench_q29/duckdb:vortex-file-compressed 28449765 31288931 0.91
clickbench_q30/duckdb:vortex-file-compressed 189449029 190220216 1.00
clickbench_q31/duckdb:vortex-file-compressed 277853971 283697461 0.98
clickbench_q32/duckdb:vortex-file-compressed 1132512696 1227156205 0.92
clickbench_q33/duckdb:vortex-file-compressed 1131601671 1180630616 0.96
clickbench_q34/duckdb:vortex-file-compressed 1186830909 1274331510 0.93
clickbench_q35/duckdb:vortex-file-compressed 381784816 384590071 0.99
clickbench_q36/duckdb:vortex-file-compressed 28625315 28450275 1.01
clickbench_q37/duckdb:vortex-file-compressed 22953676 21763022 1.05
clickbench_q38/duckdb:vortex-file-compressed 23248035 23253352 1.00
clickbench_q39/duckdb:vortex-file-compressed 42360834 40925035 1.04
clickbench_q40/duckdb:vortex-file-compressed 🚀 20152072 23795284 0.85
clickbench_q41/duckdb:vortex-file-compressed 🚀 19517708 21845559 0.89
clickbench_q42/duckdb:vortex-file-compressed 21770231 23499328 0.93
duckdb / parquet (0.990x ➖, 1↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26023571 24368929 1.07
clickbench_q01/duckdb:parquet 28023157 27476441 1.02
clickbench_q02/duckdb:parquet 48175487 48571702 0.99
clickbench_q03/duckdb:parquet 38456006 38197725 1.01
clickbench_q04/duckdb:parquet 197861014 205852538 0.96
clickbench_q05/duckdb:parquet 262843226 265629832 0.99
clickbench_q06/duckdb:parquet 45480032 45803401 0.99
clickbench_q07/duckdb:parquet 29319433 29255373 1.00
clickbench_q08/duckdb:parquet 264469973 267666710 0.99
clickbench_q09/duckdb:parquet 396596009 397739192 1.00
clickbench_q10/duckdb:parquet 80123476 79441778 1.01
clickbench_q11/duckdb:parquet 98989884 99961307 0.99
clickbench_q12/duckdb:parquet 291156092 294257894 0.99
clickbench_q13/duckdb:parquet 478500103 487099575 0.98
clickbench_q14/duckdb:parquet 322132720 329170160 0.98
clickbench_q15/duckdb:parquet 262487033 258538764 1.02
clickbench_q16/duckdb:parquet 635619867 652950139 0.97
clickbench_q17/duckdb:parquet 537343945 538199021 1.00
clickbench_q18/duckdb:parquet 1062786239 1080775765 0.98
clickbench_q19/duckdb:parquet 26191103 25895468 1.01
clickbench_q20/duckdb:parquet 427247523 426727599 1.00
clickbench_q21/duckdb:parquet 539661105 548341605 0.98
clickbench_q22/duckdb:parquet 930652109 942343026 0.99
clickbench_q23/duckdb:parquet 309671125 315940820 0.98
clickbench_q24/duckdb:parquet 67105600 68721576 0.98
clickbench_q25/duckdb:parquet 155840094 157373735 0.99
clickbench_q26/duckdb:parquet 48622740 50909086 0.96
clickbench_q27/duckdb:parquet 636510337 643497414 0.99
clickbench_q28/duckdb:parquet 4840098752 4841928119 1.00
clickbench_q29/duckdb:parquet 40732468 40367744 1.01
clickbench_q30/duckdb:parquet 300203849 304268136 0.99
clickbench_q31/duckdb:parquet 353356827 365807174 0.97
clickbench_q32/duckdb:parquet 1183654379 1200517226 0.99
clickbench_q33/duckdb:parquet 1258319753 1303698337 0.97
clickbench_q34/duckdb:parquet 1272056191 1325130825 0.96
clickbench_q35/duckdb:parquet 359755213 364117297 0.99
clickbench_q36/duckdb:parquet 46643061 48573172 0.96
clickbench_q37/duckdb:parquet 31479240 31973949 0.98
clickbench_q38/duckdb:parquet 31097978 33010305 0.94
clickbench_q39/duckdb:parquet 🚨 90918096 74483331 1.22
clickbench_q40/duckdb:parquet 🚀 16489217 19698806 0.84
clickbench_q41/duckdb:parquet 18052525 18151289 0.99
clickbench_q42/duckdb:parquet 21503144 21022669 1.02
duckdb / duckdb (0.980x ➖, 2↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18428627 17513657 1.05
clickbench_q01/duckdb:duckdb 32489153 32435535 1.00
clickbench_q02/duckdb:duckdb 44170499 45690158 0.97
clickbench_q03/duckdb:duckdb 46087287 47941055 0.96
clickbench_q04/duckdb:duckdb 188253854 188845578 1.00
clickbench_q05/duckdb:duckdb 258553209 269290875 0.96
clickbench_q06/duckdb:duckdb 🚀 29265669 35947575 0.81
clickbench_q07/duckdb:duckdb 34387483 35817798 0.96
clickbench_q08/duckdb:duckdb 247359348 250746449 0.99
clickbench_q09/duckdb:duckdb 370571592 370596894 1.00
clickbench_q10/duckdb:duckdb 97451282 98602048 0.99
clickbench_q11/duckdb:duckdb 107505257 107385706 1.00
clickbench_q12/duckdb:duckdb 235758696 238384532 0.99
clickbench_q13/duckdb:duckdb 477485495 469105154 1.02
clickbench_q14/duckdb:duckdb 276864766 276850344 1.00
clickbench_q15/duckdb:duckdb 216738100 220527129 0.98
clickbench_q16/duckdb:duckdb 635563328 658188910 0.97
clickbench_q17/duckdb:duckdb 554808985 548004680 1.01
clickbench_q18/duckdb:duckdb 1201555360 1235480827 0.97
clickbench_q19/duckdb:duckdb 34398307 34804087 0.99
clickbench_q20/duckdb:duckdb 892874675 851183023 1.05
clickbench_q21/duckdb:duckdb 1012248825 962073488 1.05
clickbench_q22/duckdb:duckdb 1040988722 1125855230 0.92
clickbench_q23/duckdb:duckdb 254194213 265643881 0.96
clickbench_q24/duckdb:duckdb 60079327 61839156 0.97
clickbench_q25/duckdb:duckdb 141419408 144126244 0.98
clickbench_q26/duckdb:duckdb 58502776 62391926 0.94
clickbench_q27/duckdb:duckdb 1025874731 962524492 1.07
clickbench_q28/duckdb:duckdb 4645270839 4665309755 1.00
clickbench_q29/duckdb:duckdb 47932655 49257220 0.97
clickbench_q30/duckdb:duckdb 266163100 265847788 1.00
clickbench_q31/duckdb:duckdb 425597999 438841485 0.97
clickbench_q32/duckdb:duckdb 1544422725 1412292213 1.09
clickbench_q33/duckdb:duckdb 1903504770 1959662270 0.97
clickbench_q34/duckdb:duckdb 2103776926 2173652674 0.97
clickbench_q35/duckdb:duckdb 278284067 281789885 0.99
clickbench_q36/duckdb:duckdb 41225892 42669458 0.97
clickbench_q37/duckdb:duckdb 31155096 31556696 0.99
clickbench_q38/duckdb:duckdb 30364273 31676421 0.96
clickbench_q39/duckdb:duckdb 🚀 63984194 71120594 0.90
clickbench_q40/duckdb:duckdb 30908701 32125771 0.96
clickbench_q41/duckdb:duckdb 29645351 30144727 0.98
clickbench_q42/duckdb:duckdb 29268384 31802068 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -5.0% +3.1% -7.9% +762.5% ➖ noise
0 duckdb:duckdb +5.2% +3.1% +2.0% +286.6% ➖ noise
0 duckdb:vortex-file-compressed -1.0% +3.1% -4.0% +475.2% ➖ noise
1 datafusion:vortex-file-compressed -2.7% -2.5% -0.2% +23.5% ➖ noise
1 duckdb:duckdb +0.2% -2.5% +2.8% +58.5% ➖ noise
1 duckdb:vortex-file-compressed -6.5% -2.5% -4.1% +22.6% ➖ noise
2 datafusion:vortex-file-compressed -3.5% -3.1% -0.5% +14.7% ➖ noise
2 duckdb:duckdb -3.3% -3.1% -0.3% +21.8% ➖ noise
2 duckdb:vortex-file-compressed -1.5% -3.1% +1.6% +11.1% ➖ noise
3 datafusion:vortex-file-compressed -8.0% +2.1% -9.9% +137.2% ➖ noise
3 duckdb:duckdb -3.9% +2.1% -5.8% +43.3% ➖ noise
3 duckdb:vortex-file-compressed -1.3% +2.1% -3.3% +41.2% ➖ noise
4 datafusion:vortex-file-compressed -2.8% -3.2% +0.4% +10.0% ➖ noise
4 duckdb:duckdb -0.3% -3.2% +3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% -3.2% +2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -6.1% +0.4% -6.5% +10.0% ➖ noise
5 duckdb:duckdb -4.0% +0.4% -4.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.9% +0.4% -2.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.2% -0.7% +4.9% +42.2% ➖ noise
6 duckdb:duckdb -18.6% -0.7% -18.0% +28.0% ➖ noise
6 duckdb:vortex-file-compressed -3.9% -0.7% -3.2% +22.1% ➖ noise
7 datafusion:vortex-file-compressed +2.8% +1.3% +1.4% +14.4% ➖ noise
7 duckdb:duckdb -4.0% +1.3% -5.2% +11.5% ➖ noise
7 duckdb:vortex-file-compressed -2.2% +1.3% -3.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.5% -1.2% -1.3% +10.0% ➖ noise
8 duckdb:duckdb -1.4% -1.2% -0.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.0% -1.2% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -5.5% -0.9% -4.6% +10.0% ➖ noise
9 duckdb:duckdb -0.0% -0.9% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.3% -0.9% +0.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.1% -0.5% +0.6% +10.0% ➖ noise
10 duckdb:duckdb -1.2% -0.5% -0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -5.1% -0.5% -4.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -6.0% +0.3% -6.2% +10.0% ➖ noise
11 duckdb:duckdb +0.1% +0.3% -0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.4% +0.3% -0.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.8% -0.6% +2.3% +10.0% ➖ noise
12 duckdb:duckdb -1.1% -0.6% -0.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -6.6% -0.6% -6.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.1% -2.3% +0.3% +10.0% ➖ noise
13 duckdb:duckdb +1.8% -2.3% +4.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.4% -2.3% -0.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.4% -0.2% -3.2% +10.0% ➖ noise
14 duckdb:duckdb +0.0% -0.2% +0.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -6.1% -0.2% -5.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.8% -0.0% -0.8% +10.0% ➖ noise
15 duckdb:duckdb -1.7% -0.0% -1.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.6% -0.0% -1.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.0% -1.8% +1.8% +10.0% ➖ noise
16 duckdb:duckdb -3.4% -1.8% -1.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.5% -1.8% +1.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.7% -1.4% -0.3% +10.0% ➖ noise
17 duckdb:duckdb +1.2% -1.4% +2.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.3% -1.4% +2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.0% -2.9% +0.9% +10.0% ➖ noise
18 duckdb:duckdb -2.7% -2.9% +0.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.9% -2.9% +1.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +20.3% -0.5% +21.0% +25.3% ➖ noise
19 duckdb:duckdb -1.2% -0.5% -0.6% +14.3% ➖ noise
19 duckdb:vortex-file-compressed -1.3% -0.5% -0.7% +14.6% ➖ noise
20 datafusion:vortex-file-compressed +0.3% -1.4% +1.7% +205.5% ➖ noise
20 duckdb:duckdb +4.9% -1.4% +6.4% +33.1% ➖ noise
20 duckdb:vortex-file-compressed -6.4% -1.4% -5.1% +43.5% ➖ noise
21 datafusion:vortex-file-compressed -1.4% -1.5% +0.1% +10.0% ➖ noise
21 duckdb:duckdb +5.2% -1.5% +6.8% +10.5% ➖ noise
21 duckdb:vortex-file-compressed +1.8% -1.5% +3.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.5% -1.2% -2.2% +14.7% ➖ noise
22 duckdb:duckdb -7.5% -1.2% -6.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -3.0% -1.2% -1.8% +17.8% ➖ noise
23 datafusion:vortex-file-compressed -1.7% -1.0% -0.7% +48.1% ➖ noise
23 duckdb:duckdb -4.3% -1.0% -3.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -62.9% -1.0% -62.5% +48.7% ✅ faster
24 datafusion:vortex-file-compressed -4.5% -4.3% -0.3% +11.3% ➖ noise
24 duckdb:duckdb -2.8% -4.3% +1.5% +10.8% ➖ noise
24 duckdb:vortex-file-compressed -5.9% -4.3% -1.6% +23.2% ➖ noise
25 datafusion:vortex-file-compressed -3.4% -0.9% -2.5% +10.0% ➖ noise
25 duckdb:duckdb -1.9% -0.9% -0.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.6% -0.9% +8.6% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -1.7% -3.3% +1.6% +10.2% ➖ noise
26 duckdb:duckdb -6.2% -3.3% -3.0% +14.0% ➖ noise
26 duckdb:vortex-file-compressed +15.1% -3.3% +19.0% +27.4% ➖ noise
27 datafusion:vortex-file-compressed +0.1% -1.8% +2.0% +10.0% ➖ noise
27 duckdb:duckdb +6.6% -1.8% +8.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.4% -1.8% -0.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.3% -0.6% +0.3% +10.0% ➖ noise
28 duckdb:duckdb -0.4% -0.6% +0.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.6% -0.6% -0.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.8% +0.4% +1.4% +10.3% ➖ noise
29 duckdb:duckdb -2.7% +0.4% -3.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -9.1% +0.4% -9.4% +14.7% ➖ noise
30 datafusion:vortex-file-compressed -2.5% -2.2% -0.3% +10.0% ➖ noise
30 duckdb:duckdb +0.1% -2.2% +2.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.4% -2.2% +1.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.6% -1.7% -2.9% +10.0% ➖ noise
31 duckdb:duckdb -3.0% -1.7% -1.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.1% -1.7% -0.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -4.5% -2.3% -2.3% +10.0% ➖ noise
32 duckdb:duckdb +9.4% -2.3% +11.9% +10.0% 🚨 regression
32 duckdb:vortex-file-compressed -7.7% -2.3% -5.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.5% -3.5% -1.1% +10.0% ➖ noise
33 duckdb:duckdb -2.9% -3.5% +0.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -4.2% -3.5% -0.7% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -1.6% -3.6% +2.0% +10.0% ➖ noise
34 duckdb:duckdb -3.2% -3.6% +0.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -6.9% -3.6% -3.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.2% -2.4% +0.3% +10.0% ➖ noise
35 duckdb:duckdb -1.2% -2.4% +1.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.7% -2.4% +1.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.0% -3.7% -0.3% +10.0% ➖ noise
36 duckdb:duckdb -3.4% -3.7% +0.4% +10.8% ➖ noise
36 duckdb:vortex-file-compressed +0.6% -3.7% +4.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -4.0% -0.7% -3.3% +10.0% ➖ noise
37 duckdb:duckdb -1.3% -0.7% -0.6% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +5.5% -0.7% +6.2% +11.9% ➖ noise
38 datafusion:vortex-file-compressed -3.9% -3.7% -0.2% +12.6% ➖ noise
38 duckdb:duckdb -4.1% -3.7% -0.4% +10.6% ➖ noise
38 duckdb:vortex-file-compressed -0.0% -3.7% +3.8% +10.3% ➖ noise
39 datafusion:vortex-file-compressed -2.9% +9.7% -11.5% +10.0% ✅ faster
39 duckdb:duckdb -10.0% +9.7% -18.0% +15.5% ✅ faster
39 duckdb:vortex-file-compressed +3.5% +9.7% -5.7% +14.2% ➖ noise
40 datafusion:vortex-file-compressed -2.9% -9.8% +7.7% +12.2% ➖ noise
40 duckdb:duckdb -3.8% -9.8% +6.7% +12.0% ➖ noise
40 duckdb:vortex-file-compressed -15.3% -9.8% -6.1% +11.8% ➖ noise
41 datafusion:vortex-file-compressed -6.3% -1.8% -4.6% +10.0% ➖ noise
41 duckdb:duckdb -1.7% -1.8% +0.1% +12.1% ➖ noise
41 duckdb:vortex-file-compressed -10.7% -1.8% -9.0% +11.3% ➖ noise
42 datafusion:vortex-file-compressed -4.8% -1.8% -3.0% +10.0% ➖ noise
42 duckdb:duckdb -8.0% -1.8% -6.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -7.4% -1.8% -5.7% +12.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -1.5%


datafusion / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 392380866 401912416 0.98
tpch_q02/datafusion:vortex-file-compressed 106636721 107620260 0.99
tpch_q03/datafusion:vortex-file-compressed 214047645 218861528 0.98
tpch_q04/datafusion:vortex-file-compressed 114928251 115481883 1.00
tpch_q05/datafusion:vortex-file-compressed 367069926 374429425 0.98
tpch_q06/datafusion:vortex-file-compressed 45348121 46091780 0.98
tpch_q07/datafusion:vortex-file-compressed 498630984 508896921 0.98
tpch_q08/datafusion:vortex-file-compressed 351679750 362704849 0.97
tpch_q09/datafusion:vortex-file-compressed 620181764 643783723 0.96
tpch_q10/datafusion:vortex-file-compressed 230144280 234671341 0.98
tpch_q11/datafusion:vortex-file-compressed 80824120 84036190 0.96
tpch_q12/datafusion:vortex-file-compressed 120989467 126055278 0.96
tpch_q13/datafusion:vortex-file-compressed 213938647 217222665 0.98
tpch_q14/datafusion:vortex-file-compressed 56885182 58580863 0.97
tpch_q15/datafusion:vortex-file-compressed 106948552 110412010 0.97
tpch_q16/datafusion:vortex-file-compressed 74450315 76884961 0.97
tpch_q17/datafusion:vortex-file-compressed 624288318 645406022 0.97
tpch_q18/datafusion:vortex-file-compressed 824266440 845490232 0.97
tpch_q19/datafusion:vortex-file-compressed 90122681 95095980 0.95
tpch_q20/datafusion:vortex-file-compressed 168015956 171553812 0.98
tpch_q21/datafusion:vortex-file-compressed 641398541 656441820 0.98
tpch_q22/datafusion:vortex-file-compressed 64050872 66875076 0.96
datafusion / vortex-compact (0.981x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 441970999 442454724 1.00
tpch_q02/datafusion:vortex-compact 109620274 110958927 0.99
tpch_q03/datafusion:vortex-compact 215354495 220686917 0.98
tpch_q04/datafusion:vortex-compact 121490155 125768175 0.97
tpch_q05/datafusion:vortex-compact 370064333 385590730 0.96
tpch_q06/datafusion:vortex-compact 66219312 66573405 0.99
tpch_q07/datafusion:vortex-compact 516937332 525125961 0.98
tpch_q08/datafusion:vortex-compact 352901460 364704117 0.97
tpch_q09/datafusion:vortex-compact 632416904 644447817 0.98
tpch_q10/datafusion:vortex-compact 246497347 252539980 0.98
tpch_q11/datafusion:vortex-compact 83378047 85172081 0.98
tpch_q12/datafusion:vortex-compact 165538332 169141215 0.98
tpch_q13/datafusion:vortex-compact 262473501 268414254 0.98
tpch_q14/datafusion:vortex-compact 74850157 75520565 0.99
tpch_q15/datafusion:vortex-compact 161482514 165847054 0.97
tpch_q16/datafusion:vortex-compact 79612738 80972940 0.98
tpch_q17/datafusion:vortex-compact 630131328 635424207 0.99
tpch_q18/datafusion:vortex-compact 833894891 854677513 0.98
tpch_q19/datafusion:vortex-compact 132966765 135679510 0.98
tpch_q20/datafusion:vortex-compact 191771416 191633518 1.00
tpch_q21/datafusion:vortex-compact 651181011 657212532 0.99
tpch_q22/datafusion:vortex-compact 71796581 74159197 0.97
datafusion / parquet (0.989x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 467590887 459386841 1.02
tpch_q02/datafusion:parquet 169935881 175412221 0.97
tpch_q03/datafusion:parquet 285577997 290839587 0.98
tpch_q04/datafusion:parquet 129157127 132141077 0.98
tpch_q05/datafusion:parquet 439714061 447377979 0.98
tpch_q06/datafusion:parquet 131867470 128657858 1.02
tpch_q07/datafusion:parquet 611552393 621266865 0.98
tpch_q08/datafusion:parquet 468670577 472617724 0.99
tpch_q09/datafusion:parquet 739393585 751759821 0.98
tpch_q10/datafusion:parquet 496735478 510348979 0.97
tpch_q11/datafusion:parquet 121707660 123072109 0.99
tpch_q12/datafusion:parquet 210861486 214804156 0.98
tpch_q13/datafusion:parquet 329006353 344755113 0.95
tpch_q14/datafusion:parquet 162470459 164423025 0.99
tpch_q15/datafusion:parquet 258833155 262606334 0.99
tpch_q16/datafusion:parquet 127343588 129606964 0.98
tpch_q17/datafusion:parquet 683338378 687048241 0.99
tpch_q18/datafusion:parquet 860537940 875769081 0.98
tpch_q19/datafusion:parquet 289692905 279529743 1.04
tpch_q20/datafusion:parquet 296325393 298312883 0.99
tpch_q21/datafusion:parquet 699114080 716190215 0.98
tpch_q22/datafusion:parquet 212235188 210898931 1.01
datafusion / arrow (0.980x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 589063122 602198986 0.98
tpch_q02/datafusion:arrow 158587750 158966596 1.00
tpch_q03/datafusion:arrow 459969029 472770531 0.97
tpch_q04/datafusion:arrow 332047196 353632326 0.94
tpch_q05/datafusion:arrow 919033871 930047907 0.99
tpch_q06/datafusion:arrow 278312360 291554803 0.95
tpch_q07/datafusion:arrow 1145133352 1162195061 0.99
tpch_q08/datafusion:arrow 1113654771 1142963768 0.97
tpch_q09/datafusion:arrow 1312219726 1333084247 0.98
tpch_q10/datafusion:arrow 575278625 603018844 0.95
tpch_q11/datafusion:arrow 135586515 138258695 0.98
tpch_q12/datafusion:arrow 757581708 743859090 1.02
tpch_q13/datafusion:arrow 500644207 492058486 1.02
tpch_q14/datafusion:arrow 314742847 323050520 0.97
tpch_q15/datafusion:arrow 690944838 709559364 0.97
tpch_q16/datafusion:arrow 101656136 103157530 0.99
tpch_q17/datafusion:arrow 1288820843 1325437296 0.97
tpch_q18/datafusion:arrow 1858273814 1895263834 0.98
tpch_q19/datafusion:arrow 474581087 487087016 0.97
tpch_q20/datafusion:arrow 476136653 490541007 0.97
tpch_q21/datafusion:arrow 2979119592 3011447132 0.99
tpch_q22/datafusion:arrow 125837317 125923189 1.00
duckdb / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170142737 171833448 0.99
tpch_q02/duckdb:vortex-file-compressed 52419647 52004941 1.01
tpch_q03/duckdb:vortex-file-compressed 129121698 131087114 0.99
tpch_q04/duckdb:vortex-file-compressed 152012629 155102813 0.98
tpch_q05/duckdb:vortex-file-compressed 126904563 129375522 0.98
tpch_q06/duckdb:vortex-file-compressed 46479452 48746827 0.95
tpch_q07/duckdb:vortex-file-compressed 142564119 149407130 0.95
tpch_q08/duckdb:vortex-file-compressed 169849608 173513979 0.98
tpch_q09/duckdb:vortex-file-compressed 320537378 327503331 0.98
tpch_q10/duckdb:vortex-file-compressed 144307227 146897490 0.98
tpch_q11/duckdb:vortex-file-compressed 32247369 32780162 0.98
tpch_q12/duckdb:vortex-file-compressed 94875062 95637066 0.99
tpch_q13/duckdb:vortex-file-compressed 224868432 230522945 0.98
tpch_q14/duckdb:vortex-file-compressed 66336757 68271817 0.97
tpch_q15/duckdb:vortex-file-compressed 85036053 88961779 0.96
tpch_q16/duckdb:vortex-file-compressed 77490114 79243380 0.98
tpch_q17/duckdb:vortex-file-compressed 97638726 99920555 0.98
tpch_q18/duckdb:vortex-file-compressed 290425296 288871023 1.01
tpch_q19/duckdb:vortex-file-compressed 83906988 85420828 0.98
tpch_q20/duckdb:vortex-file-compressed 155279744 160542484 0.97
tpch_q21/duckdb:vortex-file-compressed 564886245 581320620 0.97
tpch_q22/duckdb:vortex-file-compressed 70378949 72220090 0.97
duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230391956 228949647 1.01
tpch_q02/duckdb:vortex-compact 54656890 55642024 0.98
tpch_q03/duckdb:vortex-compact 137323225 140790172 0.98
tpch_q04/duckdb:vortex-compact 171056813 175477124 0.97
tpch_q05/duckdb:vortex-compact 144426168 146614457 0.99
tpch_q06/duckdb:vortex-compact 81701513 82343607 0.99
tpch_q07/duckdb:vortex-compact 194274834 198086174 0.98
tpch_q08/duckdb:vortex-compact 184137826 187830897 0.98
tpch_q09/duckdb:vortex-compact 353919396 351804520 1.01
tpch_q10/duckdb:vortex-compact 176295770 178049105 0.99
tpch_q11/duckdb:vortex-compact 40047077 40785005 0.98
tpch_q12/duckdb:vortex-compact 200426501 201286855 1.00
tpch_q13/duckdb:vortex-compact 274856236 277628945 0.99
tpch_q14/duckdb:vortex-compact 96307382 100966309 0.95
tpch_q15/duckdb:vortex-compact 111810378 114446384 0.98
tpch_q16/duckdb:vortex-compact 83413554 82960556 1.01
tpch_q17/duckdb:vortex-compact 112672219 113697613 0.99
tpch_q18/duckdb:vortex-compact 291434037 291023544 1.00
tpch_q19/duckdb:vortex-compact 107434493 107838408 1.00
tpch_q20/duckdb:vortex-compact 200482780 202744699 0.99
tpch_q21/duckdb:vortex-compact 605813639 614982686 0.99
tpch_q22/duckdb:vortex-compact 86485570 84993143 1.02
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256045602 255773175 1.00
tpch_q02/duckdb:parquet 97516496 95889281 1.02
tpch_q03/duckdb:parquet 207520495 208670118 0.99
tpch_q04/duckdb:parquet 133294412 131669350 1.01
tpch_q05/duckdb:parquet 212832605 218423860 0.97
tpch_q06/duckdb:parquet 64186545 67028529 0.96
tpch_q07/duckdb:parquet 179613799 180645951 0.99
tpch_q08/duckdb:parquet 248902978 252748729 0.98
tpch_q09/duckdb:parquet 471895036 465814312 1.01
tpch_q10/duckdb:parquet 608768313 610516843 1.00
tpch_q11/duckdb:parquet 56262069 60690292 0.93
tpch_q12/duckdb:parquet 123765346 123593542 1.00
tpch_q13/duckdb:parquet 449628495 447001988 1.01
tpch_q14/duckdb:parquet 175622558 172544636 1.02
tpch_q15/duckdb:parquet 97580232 95431167 1.02
tpch_q16/duckdb:parquet 158962413 160192316 0.99
tpch_q17/duckdb:parquet 176593061 177896361 0.99
tpch_q18/duckdb:parquet 352127425 354288123 0.99
tpch_q19/duckdb:parquet 286279877 288689190 0.99
tpch_q20/duckdb:parquet 232888119 229807945 1.01
tpch_q21/duckdb:parquet 559148795 560009157 1.00
tpch_q22/duckdb:parquet 289937254 291457061 0.99
duckdb / duckdb (0.984x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116492812 117061804 1.00
tpch_q02/duckdb:duckdb 45050861 49063297 0.92
tpch_q03/duckdb:duckdb 96934283 97736643 0.99
tpch_q04/duckdb:duckdb 130892964 134544065 0.97
tpch_q05/duckdb:duckdb 109470691 110431390 0.99
tpch_q06/duckdb:duckdb 37311981 37546104 0.99
tpch_q07/duckdb:duckdb 86749662 87856396 0.99
tpch_q08/duckdb:duckdb 110231845 112154671 0.98
tpch_q09/duckdb:duckdb 277406669 273470608 1.01
tpch_q10/duckdb:duckdb 205020715 205867080 1.00
tpch_q11/duckdb:duckdb 15215618 15883795 0.96
tpch_q12/duckdb:duckdb 84918447 85088943 1.00
tpch_q13/duckdb:duckdb 220563588 224517664 0.98
tpch_q14/duckdb:duckdb 71324854 70997141 1.00
tpch_q15/duckdb:duckdb 76373674 78289777 0.98
tpch_q16/duckdb:duckdb 73891448 74469071 0.99
tpch_q17/duckdb:duckdb 84416119 84775478 1.00
tpch_q18/duckdb:duckdb 212201786 215139127 0.99
tpch_q19/duckdb:duckdb 115572368 116532301 0.99
tpch_q20/duckdb:duckdb 110893065 112462193 0.99
tpch_q21/duckdb:duckdb 295459183 298277349 0.99
tpch_q22/duckdb:duckdb 66762583 69757172 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.2% +0.9% -3.1% +10.0% ➖ noise
1 datafusion:vortex-compact -0.1% +0.9% -1.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -2.4% +0.9% -3.3% +10.5% ➖ noise
1 duckdb:duckdb -0.5% +0.9% -1.4% +10.0% ➖ noise
1 duckdb:vortex-compact +0.6% +0.9% -0.3% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -1.0% +0.9% -1.9% +10.0% ➖ noise
2 datafusion:arrow -0.2% -0.7% +0.5% +10.0% ➖ noise
2 datafusion:vortex-compact -1.2% -0.7% -0.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.9% -0.7% -0.2% +10.0% ➖ noise
2 duckdb:duckdb -8.2% -0.7% -7.5% +10.0% ➖ noise
2 duckdb:vortex-compact -1.8% -0.7% -1.0% +15.0% ➖ noise
2 duckdb:vortex-file-compressed +0.8% -0.7% +1.6% +10.0% ➖ noise
3 datafusion:arrow -2.7% -1.2% -1.5% +10.0% ➖ noise
3 datafusion:vortex-compact -2.4% -1.2% -1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -2.2% -1.2% -1.0% +10.0% ➖ noise
3 duckdb:duckdb -0.8% -1.2% +0.4% +10.0% ➖ noise
3 duckdb:vortex-compact -2.5% -1.2% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.5% -1.2% -0.3% +10.0% ➖ noise
4 datafusion:arrow -6.1% -0.5% -5.6% +10.0% ➖ noise
4 datafusion:vortex-compact -3.4% -0.5% -2.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.5% -0.5% +0.0% +10.0% ➖ noise
4 duckdb:duckdb -2.7% -0.5% -2.2% +10.0% ➖ noise
4 duckdb:vortex-compact -2.5% -0.5% -2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.0% -0.5% -1.5% +10.0% ➖ noise
5 datafusion:arrow -1.2% -2.1% +1.0% +10.0% ➖ noise
5 datafusion:vortex-compact -4.0% -2.1% -1.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.0% -2.1% +0.2% +10.0% ➖ noise
5 duckdb:duckdb -0.9% -2.1% +1.3% +10.0% ➖ noise
5 duckdb:vortex-compact -1.5% -2.1% +0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.9% -2.1% +0.2% +10.0% ➖ noise
6 datafusion:arrow -4.5% -0.9% -3.6% +10.0% ➖ noise
6 datafusion:vortex-compact -0.5% -0.9% +0.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.6% -0.9% -0.7% +10.0% ➖ noise
6 duckdb:duckdb -0.6% -0.9% +0.3% +10.0% ➖ noise
6 duckdb:vortex-compact -0.8% -0.9% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.7% -0.9% -3.8% +10.0% ➖ noise
7 datafusion:arrow -1.5% -1.1% -0.4% +10.0% ➖ noise
7 datafusion:vortex-compact -1.6% -1.1% -0.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.0% -1.1% -1.0% +10.0% ➖ noise
7 duckdb:duckdb -1.3% -1.1% -0.2% +10.0% ➖ noise
7 duckdb:vortex-compact -1.9% -1.1% -0.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.6% -1.1% -3.5% +10.0% ➖ noise
8 datafusion:arrow -2.6% -1.2% -1.4% +10.0% ➖ noise
8 datafusion:vortex-compact -3.2% -1.2% -2.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -3.0% -1.2% -1.9% +10.0% ➖ noise
8 duckdb:duckdb -1.7% -1.2% -0.5% +10.0% ➖ noise
8 duckdb:vortex-compact -2.0% -1.2% -0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.1% -1.2% -0.9% +10.0% ➖ noise
9 datafusion:arrow -1.6% -0.2% -1.4% +10.0% ➖ noise
9 datafusion:vortex-compact -1.9% -0.2% -1.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.7% -0.2% -3.5% +10.0% ➖ noise
9 duckdb:duckdb +1.4% -0.2% +1.6% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% -0.2% +0.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.1% -0.2% -1.9% +10.0% ➖ noise
10 datafusion:arrow -4.6% -1.5% -3.2% +10.0% ➖ noise
10 datafusion:vortex-compact -2.4% -1.5% -0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.9% -1.5% -0.5% +10.0% ➖ noise
10 duckdb:duckdb -0.4% -1.5% +1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -1.0% -1.5% +0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.8% -1.5% -0.3% +10.0% ➖ noise
11 datafusion:arrow -1.9% -4.3% +2.4% +10.0% ➖ noise
11 datafusion:vortex-compact -2.1% -4.3% +2.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.8% -4.3% +0.4% +10.0% ➖ noise
11 duckdb:duckdb -4.2% -4.3% +0.0% +10.3% ➖ noise
11 duckdb:vortex-compact -1.8% -4.3% +2.6% +10.2% ➖ noise
11 duckdb:vortex-file-compressed -1.6% -4.3% +2.7% +10.0% ➖ noise
12 datafusion:arrow +1.8% -0.9% +2.7% +29.6% ➖ noise
12 datafusion:vortex-compact -2.1% -0.9% -1.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.0% -0.9% -3.2% +10.0% ➖ noise
12 duckdb:duckdb -0.2% -0.9% +0.7% +10.0% ➖ noise
12 duckdb:vortex-compact -0.4% -0.9% +0.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.8% -0.9% +0.1% +10.0% ➖ noise
13 datafusion:arrow +1.7% -2.0% +3.8% +10.0% ➖ noise
13 datafusion:vortex-compact -2.2% -2.0% -0.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.5% -2.0% +0.5% +10.0% ➖ noise
13 duckdb:duckdb -1.8% -2.0% +0.3% +10.0% ➖ noise
13 duckdb:vortex-compact -1.0% -2.0% +1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.5% -2.0% -0.4% +10.0% ➖ noise
14 datafusion:arrow -2.6% +0.3% -2.9% +10.0% ➖ noise
14 datafusion:vortex-compact -0.9% +0.3% -1.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.9% +0.3% -3.2% +10.0% ➖ noise
14 duckdb:duckdb +0.5% +0.3% +0.2% +10.0% ➖ noise
14 duckdb:vortex-compact -4.6% +0.3% -4.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.8% +0.3% -3.1% +10.0% ➖ noise
15 datafusion:arrow -2.6% +0.4% -3.0% +10.0% ➖ noise
15 datafusion:vortex-compact -2.6% +0.4% -3.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -3.1% +0.4% -3.5% +10.0% ➖ noise
15 duckdb:duckdb -2.4% +0.4% -2.8% +10.0% ➖ noise
15 duckdb:vortex-compact -2.3% +0.4% -2.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -4.4% +0.4% -4.8% +10.0% ➖ noise
16 datafusion:arrow -1.5% -1.3% -0.2% +10.0% ➖ noise
16 datafusion:vortex-compact -1.7% -1.3% -0.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.2% -1.3% -1.9% +10.0% ➖ noise
16 duckdb:duckdb -0.8% -1.3% +0.5% +10.0% ➖ noise
16 duckdb:vortex-compact +0.5% -1.3% +1.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.2% -1.3% -1.0% +10.0% ➖ noise
17 datafusion:arrow -2.8% -0.6% -2.1% +10.0% ➖ noise
17 datafusion:vortex-compact -0.8% -0.6% -0.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -3.3% -0.6% -2.7% +10.0% ➖ noise
17 duckdb:duckdb -0.4% -0.6% +0.2% +10.0% ➖ noise
17 duckdb:vortex-compact -0.9% -0.6% -0.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.3% -0.6% -1.7% +10.0% ➖ noise
18 datafusion:arrow -2.0% -1.2% -0.8% +10.0% ➖ noise
18 datafusion:vortex-compact -2.4% -1.2% -1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.5% -1.2% -1.3% +10.0% ➖ noise
18 duckdb:duckdb -1.4% -1.2% -0.2% +10.0% ➖ noise
18 duckdb:vortex-compact +0.1% -1.2% +1.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.5% -1.2% +1.7% +10.0% ➖ noise
19 datafusion:arrow -2.6% +1.4% -3.9% +10.0% ➖ noise
19 datafusion:vortex-compact -2.0% +1.4% -3.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.2% +1.4% -6.5% +10.0% ➖ noise
19 duckdb:duckdb -0.8% +1.4% -2.2% +10.0% ➖ noise
19 duckdb:vortex-compact -0.4% +1.4% -1.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.8% +1.4% -3.1% +10.0% ➖ noise
20 datafusion:arrow -2.9% +0.3% -3.3% +10.0% ➖ noise
20 datafusion:vortex-compact +0.1% +0.3% -0.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.1% +0.3% -2.4% +10.0% ➖ noise
20 duckdb:duckdb -1.4% +0.3% -1.7% +10.0% ➖ noise
20 duckdb:vortex-compact -1.1% +0.3% -1.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -3.3% +0.3% -3.6% +10.0% ➖ noise
21 datafusion:arrow -1.1% -1.3% +0.2% +10.0% ➖ noise
21 datafusion:vortex-compact -0.9% -1.3% +0.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.3% -1.3% -1.0% +10.0% ➖ noise
21 duckdb:duckdb -0.9% -1.3% +0.3% +10.0% ➖ noise
21 duckdb:vortex-compact -1.5% -1.3% -0.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -2.8% -1.3% -1.6% +10.0% ➖ noise
22 datafusion:arrow -0.1% +0.1% -0.1% +10.0% ➖ noise
22 datafusion:vortex-compact -3.2% +0.1% -3.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.2% +0.1% -4.3% +10.0% ➖ noise
22 duckdb:duckdb -4.3% +0.1% -4.3% +10.0% ➖ noise
22 duckdb:vortex-compact +1.8% +0.1% +1.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.5% +0.1% -2.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.4%
Vortex (geomean): 0.964x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.3%


duckdb / vortex-file-compressed (0.943x ➖, 1↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11611839 12039460 0.96
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20160891 28564715 0.71
statpopgen_q02/duckdb:vortex-file-compressed 1386527256 1411616026 0.98
statpopgen_q03/duckdb:vortex-file-compressed 3123036391 3173597482 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3076922116 3284054319 0.94
statpopgen_q05/duckdb:vortex-file-compressed 1493109917 1488986683 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2138016618 2177779384 0.98
statpopgen_q07/duckdb:vortex-file-compressed 213575069 236554522 0.90
statpopgen_q08/duckdb:vortex-file-compressed 264568962 264108395 1.00
statpopgen_q09/duckdb:vortex-file-compressed 2920787162 3040695163 0.96
statpopgen_q10/duckdb:vortex-file-compressed 4755197689 4803097405 0.99
duckdb / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11510324 11711794 0.98
statpopgen_q01/duckdb:vortex-compact 163328458 167946253 0.97
statpopgen_q02/duckdb:vortex-compact 1833387489 1858254701 0.99
statpopgen_q03/duckdb:vortex-compact 3558528618 3528473034 1.01
statpopgen_q04/duckdb:vortex-compact 3513944040 3587603669 0.98
statpopgen_q05/duckdb:vortex-compact 1868746730 1871183718 1.00
statpopgen_q06/duckdb:vortex-compact 2674445057 2712447483 0.99
statpopgen_q07/duckdb:vortex-compact 883125523 911249179 0.97
statpopgen_q08/duckdb:vortex-compact 918168982 950852709 0.97
statpopgen_q09/duckdb:vortex-compact 3345116020 3336569635 1.00
statpopgen_q10/duckdb:vortex-compact 5408309203 5451107624 0.99
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 328380997 334845238 0.98
statpopgen_q01/duckdb:parquet 414128565 418341463 0.99
statpopgen_q02/duckdb:parquet 992809042 1013809732 0.98
statpopgen_q03/duckdb:parquet 1503727128 1505096881 1.00
statpopgen_q04/duckdb:parquet 1514562842 1525577725 0.99
statpopgen_q05/duckdb:parquet 1006418959 1022917006 0.98
statpopgen_q06/duckdb:parquet 1509613221 1509688362 1.00
statpopgen_q07/duckdb:parquet 1314740731 1325244572 0.99
statpopgen_q08/duckdb:parquet 1322208605 1332197815 0.99
statpopgen_q09/duckdb:parquet 1364053139 1404469356 0.97
statpopgen_q10/duckdb:parquet 2678515748 2713280549 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.7% -1.9% +0.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -3.6% -1.9% -1.7% +13.9% ➖ noise
1 duckdb:vortex-compact -2.7% -1.0% -1.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -29.4% -1.0% -28.7% +191.7% ➖ noise
2 duckdb:vortex-compact -1.3% -2.1% +0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.8% -2.1% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact +0.9% -0.1% +0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.6% -0.1% -1.5% +10.0% ➖ noise
4 duckdb:vortex-compact -2.1% -0.7% -1.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.3% -0.7% -5.6% +10.0% ➖ noise
5 duckdb:vortex-compact -0.1% -1.6% +1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -1.6% +1.9% +10.0% ➖ noise
6 duckdb:vortex-compact -1.4% -0.0% -1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.8% -0.0% -1.8% +10.0% ➖ noise
7 duckdb:vortex-compact -3.1% -0.8% -2.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -9.7% -0.8% -9.0% +11.9% ➖ noise
8 duckdb:vortex-compact -3.4% -0.7% -2.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.2% -0.7% +0.9% +10.0% ➖ noise
9 duckdb:vortex-compact +0.3% -2.9% +3.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.9% -2.9% -1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -0.8% -1.3% +0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.0% -1.3% +0.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 0.959x ➖
Parquet (geomean): 0.937x ➖
Shifts: Parquet (control) -6.3% · Median polish -2.6%


datafusion / vortex-file-compressed (0.965x ➖, 1↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 273260118 273612597 1.00
tpch_q02/datafusion:vortex-file-compressed 516425860 459610921 1.12
tpch_q03/datafusion:vortex-file-compressed 465463894 433405425 1.07
tpch_q04/datafusion:vortex-file-compressed 269966426 270548354 1.00
tpch_q05/datafusion:vortex-file-compressed 451040794 616823644 0.73
tpch_q06/datafusion:vortex-file-compressed 354284796 433162557 0.82
tpch_q07/datafusion:vortex-file-compressed 446453491 445154019 1.00
tpch_q08/datafusion:vortex-file-compressed 763431339 704027531 1.08
tpch_q09/datafusion:vortex-file-compressed 566787788 485877430 1.17
tpch_q10/datafusion:vortex-file-compressed 743585938 703613241 1.06
tpch_q11/datafusion:vortex-file-compressed 352092746 303914665 1.16
tpch_q12/datafusion:vortex-file-compressed 469269481 582722499 0.81
tpch_q13/datafusion:vortex-file-compressed 186630660 179234031 1.04
tpch_q14/datafusion:vortex-file-compressed 296295083 292908753 1.01
tpch_q15/datafusion:vortex-file-compressed 491925112 553020516 0.89
tpch_q16/datafusion:vortex-file-compressed 204838044 179770267 1.14
tpch_q17/datafusion:vortex-file-compressed 333947139 407195331 0.82
tpch_q18/datafusion:vortex-file-compressed 🚀 338062910 507966692 0.67
tpch_q19/datafusion:vortex-file-compressed 447692260 468238886 0.96
tpch_q20/datafusion:vortex-file-compressed 454284951 483878420 0.94
tpch_q21/datafusion:vortex-file-compressed 587887076 586207303 1.00
tpch_q22/datafusion:vortex-file-compressed 118450216 123639625 0.96
datafusion / vortex-compact (0.857x ➖, 1↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 254748930 295652905 0.86
tpch_q02/datafusion:vortex-compact 🚀 433766997 1677556865 0.26
tpch_q03/datafusion:vortex-compact 403371301 479237243 0.84
tpch_q04/datafusion:vortex-compact 240816966 234596449 1.03
tpch_q05/datafusion:vortex-compact 367368671 415902972 0.88
tpch_q06/datafusion:vortex-compact 352292978 392435176 0.90
tpch_q07/datafusion:vortex-compact 393737442 398578161 0.99
tpch_q08/datafusion:vortex-compact 487378382 640834283 0.76
tpch_q09/datafusion:vortex-compact 399442808 442062351 0.90
tpch_q10/datafusion:vortex-compact 496622284 573096247 0.87
tpch_q11/datafusion:vortex-compact 275650735 310866477 0.89
tpch_q12/datafusion:vortex-compact 450701430 500771516 0.90
tpch_q13/datafusion:vortex-compact 120098291 138767277 0.87
tpch_q14/datafusion:vortex-compact 254180944 255031303 1.00
tpch_q15/datafusion:vortex-compact 458901203 505320499 0.91
tpch_q16/datafusion:vortex-compact 182591918 188557131 0.97
tpch_q17/datafusion:vortex-compact 368411425 378032167 0.97
tpch_q18/datafusion:vortex-compact 270612583 325312731 0.83
tpch_q19/datafusion:vortex-compact 481821656 545128770 0.88
tpch_q20/datafusion:vortex-compact 521399115 454079826 1.15
tpch_q21/datafusion:vortex-compact 534293572 577040688 0.93
tpch_q22/datafusion:vortex-compact 102223069 126243143 0.81
datafusion / parquet (0.920x ➖, 0↑ 1↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 199714457 206105517 0.97
tpch_q02/datafusion:parquet 413261673 533836620 0.77
tpch_q03/datafusion:parquet 305885158 409287553 0.75
tpch_q04/datafusion:parquet 152022696 185838840 0.82
tpch_q05/datafusion:parquet 510023816 504242080 1.01
tpch_q06/datafusion:parquet 143641664 205043117 0.70
tpch_q07/datafusion:parquet 517367422 565703992 0.91
tpch_q08/datafusion:parquet 608220367 753291758 0.81
tpch_q09/datafusion:parquet 462110354 562021700 0.82
tpch_q10/datafusion:parquet 624466373 705873199 0.88
tpch_q11/datafusion:parquet 367372619 355646216 1.03
tpch_q12/datafusion:parquet 272079871 279896652 0.97
tpch_q13/datafusion:parquet 433157439 445927818 0.97
tpch_q14/datafusion:parquet 204535247 184499698 1.11
tpch_q15/datafusion:parquet 394523010 341745987 1.15
tpch_q16/datafusion:parquet 197392810 183501500 1.08
tpch_q17/datafusion:parquet 383223278 470888091 0.81
tpch_q18/datafusion:parquet 480265114 500515219 0.96
tpch_q19/datafusion:parquet 334778316 410488630 0.82
tpch_q20/datafusion:parquet 329535145 369458492 0.89
tpch_q21/datafusion:parquet 553601743 615677784 0.90
tpch_q22/datafusion:parquet 🚨 178906207 133753641 1.34
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 302756629 264504246 1.14
tpch_q02/duckdb:vortex-file-compressed 970207975 994722196 0.98
tpch_q03/duckdb:vortex-file-compressed 636907375 690176191 0.92
tpch_q04/duckdb:vortex-file-compressed 394369970 444573270 0.89
tpch_q05/duckdb:vortex-file-compressed 959471317 1035594930 0.93
tpch_q06/duckdb:vortex-file-compressed 492477868 453998276 1.08
tpch_q07/duckdb:vortex-file-compressed 836670735 830962423 1.01
tpch_q08/duckdb:vortex-file-compressed 1019628948 986738764 1.03
tpch_q09/duckdb:vortex-file-compressed 907582980 889530302 1.02
tpch_q10/duckdb:vortex-file-compressed 777572738 765059136 1.02
tpch_q11/duckdb:vortex-file-compressed 486586540 474664471 1.03
tpch_q12/duckdb:vortex-file-compressed 520939362 510044716 1.02
tpch_q13/duckdb:vortex-file-compressed 506998116 445132314 1.14
tpch_q14/duckdb:vortex-file-compressed 483852046 486730319 0.99
tpch_q15/duckdb:vortex-file-compressed 286157764 309497840 0.92
tpch_q16/duckdb:vortex-file-compressed 392894704 409900298 0.96
tpch_q17/duckdb:vortex-file-compressed 825198357 697253830 1.18
tpch_q18/duckdb:vortex-file-compressed 593722250 549877780 1.08
tpch_q19/duckdb:vortex-file-compressed 462963351 479656638 0.97
tpch_q20/duckdb:vortex-file-compressed 807987648 855776019 0.94
tpch_q21/duckdb:vortex-file-compressed 1181022753 1030540424 1.15
tpch_q22/duckdb:vortex-file-compressed 360724696 371415951 0.97
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 302290608 305694425 0.99
tpch_q02/duckdb:vortex-compact 955014402 859727904 1.11
tpch_q03/duckdb:vortex-compact 629306684 623173630 1.01
tpch_q04/duckdb:vortex-compact 353721760 341379162 1.04
tpch_q05/duckdb:vortex-compact 902266883 884478477 1.02
tpch_q06/duckdb:vortex-compact 405528808 404058669 1.00
tpch_q07/duckdb:vortex-compact 840594823 950724715 0.88
tpch_q08/duckdb:vortex-compact 1079237090 1000326226 1.08
tpch_q09/duckdb:vortex-compact 961855761 901372711 1.07
tpch_q10/duckdb:vortex-compact 737738676 713666286 1.03
tpch_q11/duckdb:vortex-compact 523208469 497035577 1.05
tpch_q12/duckdb:vortex-compact 461913258 474254912 0.97
tpch_q13/duckdb:vortex-compact 435520255 487618528 0.89
tpch_q14/duckdb:vortex-compact 514318929 499299131 1.03
tpch_q15/duckdb:vortex-compact 307465462 328453026 0.94
tpch_q16/duckdb:vortex-compact 389215474 385372925 1.01
tpch_q17/duckdb:vortex-compact 649380873 664723655 0.98
tpch_q18/duckdb:vortex-compact 504664836 515609919 0.98
tpch_q19/duckdb:vortex-compact 443201487 456140295 0.97
tpch_q20/duckdb:vortex-compact 811882526 801074374 1.01
tpch_q21/duckdb:vortex-compact 1158380151 1083956942 1.07
tpch_q22/duckdb:vortex-compact 383319995 331972989 1.15
duckdb / parquet (0.955x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 444336432 452331111 0.98
tpch_q02/duckdb:parquet 1199147199 1278606115 0.94
tpch_q03/duckdb:parquet 1000231578 1064315028 0.94
tpch_q04/duckdb:parquet 620683245 640875372 0.97
tpch_q05/duckdb:parquet 1447948414 1595351332 0.91
tpch_q06/duckdb:parquet 448444056 492339471 0.91
tpch_q07/duckdb:parquet 1252734839 1457062643 0.86
tpch_q08/duckdb:parquet 1729850942 1784126743 0.97
tpch_q09/duckdb:parquet 1454253261 1455708977 1.00
tpch_q10/duckdb:parquet 1215658092 1319926975 0.92
tpch_q11/duckdb:parquet 864445376 881640888 0.98
tpch_q12/duckdb:parquet 656359751 688894097 0.95
tpch_q13/duckdb:parquet 887680196 906584113 0.98
tpch_q14/duckdb:parquet 638196408 652626980 0.98
tpch_q15/duckdb:parquet 497609622 526223606 0.95
tpch_q16/duckdb:parquet 609572550 605403986 1.01
tpch_q17/duckdb:parquet 770585099 753393063 1.02
tpch_q18/duckdb:parquet 865297644 900581752 0.96
tpch_q19/duckdb:parquet 736613286 775815397 0.95
tpch_q20/duckdb:parquet 1096537236 1141584323 0.96
tpch_q21/duckdb:parquet 1093110800 1174938096 0.93
tpch_q22/duckdb:parquet 530206120 552369760 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.8% -2.4% -11.7% +80.8% ➖ noise
1 datafusion:vortex-file-compressed -0.1% -2.4% +2.4% +65.1% ➖ noise
1 duckdb:vortex-compact -1.1% -2.4% +1.4% +57.1% ➖ noise
1 duckdb:vortex-file-compressed +14.5% -2.4% +17.3% +40.8% ➖ noise
2 datafusion:vortex-compact -74.1% -14.8% -69.7% +131.1% ✅ faster
2 datafusion:vortex-file-compressed +12.4% -14.8% +31.9% +33.6% ➖ noise
2 duckdb:vortex-compact +11.1% -14.8% +30.4% +30.0% 🚨 regression
2 duckdb:vortex-file-compressed -2.5% -14.8% +14.5% +30.0% ➖ noise
3 datafusion:vortex-compact -15.8% -16.2% +0.4% +125.4% ➖ noise
3 datafusion:vortex-file-compressed +7.4% -16.2% +28.1% +62.6% ➖ noise
3 duckdb:vortex-compact +1.0% -16.2% +20.5% +36.5% ➖ noise
3 duckdb:vortex-file-compressed -7.7% -16.2% +10.1% +44.5% ➖ noise
4 datafusion:vortex-compact +2.7% -11.0% +15.3% +35.9% ➖ noise
4 datafusion:vortex-file-compressed -0.2% -11.0% +12.1% +30.0% ➖ noise
4 duckdb:vortex-compact +3.6% -11.0% +16.4% +31.1% ➖ noise
4 duckdb:vortex-file-compressed -11.3% -11.0% -0.3% +30.0% ➖ noise
5 datafusion:vortex-compact -11.7% -4.2% -7.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -26.9% -4.2% -23.7% +30.0% ✅ faster
5 duckdb:vortex-compact +2.0% -4.2% +6.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -7.4% -4.2% -3.3% +30.0% ➖ noise
6 datafusion:vortex-compact -10.2% -20.1% +12.4% +54.9% ➖ noise
6 datafusion:vortex-file-compressed -18.2% -20.1% +2.4% +39.2% ➖ noise
6 duckdb:vortex-compact +0.4% -20.1% +25.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +8.5% -20.1% +35.8% +43.6% ➖ noise
7 datafusion:vortex-compact -1.2% -11.3% +11.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.3% -11.3% +13.1% +30.0% ➖ noise
7 duckdb:vortex-compact -11.6% -11.3% -0.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.7% -11.3% +13.5% +30.0% ➖ noise
8 datafusion:vortex-compact -23.9% -11.5% -14.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +8.4% -11.5% +22.6% +30.0% ➖ noise
8 duckdb:vortex-compact +7.9% -11.5% +21.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.3% -11.5% +16.8% +30.0% ➖ noise
9 datafusion:vortex-compact -9.6% -9.4% -0.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +16.7% -9.4% +28.7% +30.0% ➖ noise
9 duckdb:vortex-compact +6.7% -9.4% +17.7% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +2.0% -9.4% +12.6% +30.0% ➖ noise
10 datafusion:vortex-compact -13.3% -9.7% -4.0% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +5.7% -9.7% +17.1% +33.1% ➖ noise
10 duckdb:vortex-compact +3.4% -9.7% +14.5% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +1.6% -9.7% +12.6% +30.0% ➖ noise
11 datafusion:vortex-compact -11.3% +0.6% -11.9% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +15.9% +0.6% +15.1% +30.0% ➖ noise
11 duckdb:vortex-compact +5.3% +0.6% +4.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +2.5% +0.6% +1.9% +30.0% ➖ noise
12 datafusion:vortex-compact -10.0% -3.8% -6.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -19.5% -3.8% -16.3% +30.0% ➖ noise
12 duckdb:vortex-compact -2.6% -3.8% +1.2% +30.7% ➖ noise
12 duckdb:vortex-file-compressed +2.1% -3.8% +6.1% +41.2% ➖ noise
13 datafusion:vortex-compact -13.5% -2.5% -11.3% +49.9% ➖ noise
13 datafusion:vortex-file-compressed +4.1% -2.5% +6.8% +50.0% ➖ noise
13 duckdb:vortex-compact -10.7% -2.5% -8.4% +33.6% ➖ noise
13 duckdb:vortex-file-compressed +13.9% -2.5% +16.8% +30.0% ➖ noise
14 datafusion:vortex-compact -0.3% +4.1% -4.3% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +1.2% +4.1% -2.8% +30.0% ➖ noise
14 duckdb:vortex-compact +3.0% +4.1% -1.1% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -0.6% +4.1% -4.5% +30.0% ➖ noise
15 datafusion:vortex-compact -9.2% +4.5% -13.1% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -11.0% +4.5% -14.9% +30.0% ➖ noise
15 duckdb:vortex-compact -6.4% +4.5% -10.4% +52.7% ➖ noise
15 duckdb:vortex-file-compressed -7.5% +4.5% -11.5% +30.0% ➖ noise
16 datafusion:vortex-compact -3.2% +4.1% -7.0% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +13.9% +4.1% +9.5% +30.0% ➖ noise
16 duckdb:vortex-compact +1.0% +4.1% -3.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -4.1% +4.1% -7.9% +30.0% ➖ noise
17 datafusion:vortex-compact -2.5% -8.8% +6.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -18.0% -8.8% -10.1% +30.0% ➖ noise
17 duckdb:vortex-compact -2.3% -8.8% +7.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +18.3% -8.8% +29.7% +30.0% ➖ noise
18 datafusion:vortex-compact -16.8% -4.0% -13.4% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -33.4% -4.0% -30.7% +39.4% ✅ faster
18 duckdb:vortex-compact -2.1% -4.0% +1.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +8.0% -4.0% +12.5% +30.0% ➖ noise
19 datafusion:vortex-compact -11.6% -12.0% +0.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -4.4% -12.0% +8.7% +30.0% ➖ noise
19 duckdb:vortex-compact -2.8% -12.0% +10.4% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -3.5% -12.0% +9.7% +30.0% ➖ noise
20 datafusion:vortex-compact +14.8% -7.4% +24.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -6.1% -7.4% +1.4% +30.0% ➖ noise
20 duckdb:vortex-compact +1.3% -7.4% +9.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -5.6% -7.4% +2.0% +30.0% ➖ noise
21 datafusion:vortex-compact -7.4% -8.5% +1.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +0.3% -8.5% +9.6% +30.0% ➖ noise
21 duckdb:vortex-compact +6.9% -8.5% +16.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +14.6% -8.5% +25.3% +30.0% ➖ noise
22 datafusion:vortex-compact -19.0% +13.3% -28.5% +39.2% ✅ faster
22 datafusion:vortex-file-compressed -4.2% +13.3% -15.5% +30.0% ➖ noise
22 duckdb:vortex-compact +15.5% +13.3% +1.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -2.9% +13.3% -14.3% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.3%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish +1.7%


datafusion / vortex-file-compressed (0.937x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 683205675 705990161 0.97
tpch_q02/datafusion:vortex-file-compressed 728908611 814493670 0.89
tpch_q03/datafusion:vortex-file-compressed 788684277 825446157 0.96
tpch_q04/datafusion:vortex-file-compressed 607217968 608049476 1.00
tpch_q05/datafusion:vortex-file-compressed 958073538 1040611906 0.92
tpch_q06/datafusion:vortex-file-compressed 627778919 668147594 0.94
tpch_q07/datafusion:vortex-file-compressed 1016821439 1060847847 0.96
tpch_q08/datafusion:vortex-file-compressed 1132381411 1315728283 0.86
tpch_q09/datafusion:vortex-file-compressed 1395834353 1321813823 1.06
tpch_q10/datafusion:vortex-file-compressed 950818521 1089262431 0.87
tpch_q11/datafusion:vortex-file-compressed 494007188 515965350 0.96
tpch_q12/datafusion:vortex-file-compressed 863870397 977882925 0.88
tpch_q13/datafusion:vortex-file-compressed 453975565 476687496 0.95
tpch_q14/datafusion:vortex-file-compressed 640087168 652070965 0.98
tpch_q15/datafusion:vortex-file-compressed 1448892033 1159334032 1.25
tpch_q16/datafusion:vortex-file-compressed 340765953 478065022 0.71
tpch_q17/datafusion:vortex-file-compressed 1126181654 1237110221 0.91
tpch_q18/datafusion:vortex-file-compressed 1254199009 1352211483 0.93
tpch_q19/datafusion:vortex-file-compressed 786214156 975535152 0.81
tpch_q20/datafusion:vortex-file-compressed 927185135 1076687246 0.86
tpch_q21/datafusion:vortex-file-compressed 1545063116 1702264886 0.91
tpch_q22/datafusion:vortex-file-compressed 489945756 418669279 1.17
datafusion / vortex-compact (0.969x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 696457546 781546373 0.89
tpch_q02/datafusion:vortex-compact 762979594 737731293 1.03
tpch_q03/datafusion:vortex-compact 732195891 872454092 0.84
tpch_q04/datafusion:vortex-compact 574911725 614530964 0.94
tpch_q05/datafusion:vortex-compact 943300097 908855063 1.04
tpch_q06/datafusion:vortex-compact 606865566 606120134 1.00
tpch_q07/datafusion:vortex-compact 1029611687 942118364 1.09
tpch_q08/datafusion:vortex-compact 1236235715 1042894254 1.19
tpch_q09/datafusion:vortex-compact 1185738180 1202441253 0.99
tpch_q10/datafusion:vortex-compact 913093406 900511783 1.01
tpch_q11/datafusion:vortex-compact 432167184 390576802 1.11
tpch_q12/datafusion:vortex-compact 909052660 1008783582 0.90
tpch_q13/datafusion:vortex-compact 436586035 520573604 0.84
tpch_q14/datafusion:vortex-compact 643654970 826765263 0.78
tpch_q15/datafusion:vortex-compact 1152402429 1177120405 0.98
tpch_q16/datafusion:vortex-compact 368691265 344739869 1.07
tpch_q17/datafusion:vortex-compact 1195771068 1229331341 0.97
tpch_q18/datafusion:vortex-compact 1096141851 1073177419 1.02
tpch_q19/datafusion:vortex-compact 789739368 887140415 0.89
tpch_q20/datafusion:vortex-compact 896720355 940429933 0.95
tpch_q21/datafusion:vortex-compact 1323165191 1370048430 0.97
tpch_q22/datafusion:vortex-compact 386865199 419332451 0.92
datafusion / parquet (0.891x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 644776116 758930613 0.85
tpch_q02/datafusion:parquet 777571604 893030358 0.87
tpch_q03/datafusion:parquet 970511878 1044818132 0.93
tpch_q04/datafusion:parquet 485170816 662913809 0.73
tpch_q05/datafusion:parquet 1092618701 1480716611 0.74
tpch_q06/datafusion:parquet 484287358 531680754 0.91
tpch_q07/datafusion:parquet 1193218902 1414879153 0.84
tpch_q08/datafusion:parquet 1461320332 1741496238 0.84
tpch_q09/datafusion:parquet 1638330393 1950740706 0.84
tpch_q10/datafusion:parquet 1951494095 2009129933 0.97
tpch_q11/datafusion:parquet 537365707 752511751 0.71
tpch_q12/datafusion:parquet 727393617 776039438 0.94
tpch_q13/datafusion:parquet 695430930 777396334 0.89
tpch_q14/datafusion:parquet 804342624 762000029 1.06
tpch_q15/datafusion:parquet 1179536430 1239528182 0.95
tpch_q16/datafusion:parquet 412986569 425726537 0.97
tpch_q17/datafusion:parquet 1480977155 1341510809 1.10
tpch_q18/datafusion:parquet 1441805385 1604722517 0.90
tpch_q19/datafusion:parquet 1025399820 1077818189 0.95
tpch_q20/datafusion:parquet 1188244486 1248724735 0.95
tpch_q21/datafusion:parquet 1776025125 2066299218 0.86
tpch_q22/datafusion:parquet 685915652 763662827 0.90
duckdb / vortex-file-compressed (1.091x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 613107269 616688550 0.99
tpch_q02/duckdb:vortex-file-compressed 1358110105 1171377473 1.16
tpch_q03/duckdb:vortex-file-compressed 1037293825 882814096 1.17
tpch_q04/duckdb:vortex-file-compressed 650101703 605272696 1.07
tpch_q05/duckdb:vortex-file-compressed 1209035726 1072249875 1.13
tpch_q06/duckdb:vortex-file-compressed 862787309 796374638 1.08
tpch_q07/duckdb:vortex-file-compressed 1443856488 1332524940 1.08
tpch_q08/duckdb:vortex-file-compressed 1547612978 1396077334 1.11
tpch_q09/duckdb:vortex-file-compressed 1570966865 1446187500 1.09
tpch_q10/duckdb:vortex-file-compressed 1187402965 1136502158 1.04
tpch_q11/duckdb:vortex-file-compressed 720805569 610731921 1.18
tpch_q12/duckdb:vortex-file-compressed 826860377 721583110 1.15
tpch_q13/duckdb:vortex-file-compressed 981048177 907918049 1.08
tpch_q14/duckdb:vortex-file-compressed 895647885 837040645 1.07
tpch_q15/duckdb:vortex-file-compressed 580248550 511102535 1.14
tpch_q16/duckdb:vortex-file-compressed 554616797 521439466 1.06
tpch_q17/duckdb:vortex-file-compressed 1016677345 979656844 1.04
tpch_q18/duckdb:vortex-file-compressed 952516528 866208950 1.10
tpch_q19/duckdb:vortex-file-compressed 801484965 771360801 1.04
tpch_q20/duckdb:vortex-file-compressed 1328574712 1207992170 1.10
tpch_q21/duckdb:vortex-file-compressed 2039934688 1972438613 1.03
tpch_q22/duckdb:vortex-file-compressed 655812750 593284862 1.11
duckdb / vortex-compact (1.085x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 617827622 596439733 1.04
tpch_q02/duckdb:vortex-compact 1247275626 1031284472 1.21
tpch_q03/duckdb:vortex-compact 971396728 832067227 1.17
tpch_q04/duckdb:vortex-compact 539889466 479877410 1.13
tpch_q05/duckdb:vortex-compact 1080178896 1055106315 1.02
tpch_q06/duckdb:vortex-compact 803949687 749727637 1.07
tpch_q07/duckdb:vortex-compact 1094604622 1028932493 1.06
tpch_q08/duckdb:vortex-compact 1418370447 1466415297 0.97
tpch_q09/duckdb:vortex-compact 1520185444 1308081913 1.16
tpch_q10/duckdb:vortex-compact 1241806892 1163392333 1.07
tpch_q11/duckdb:vortex-compact 832595401 680000579 1.22
tpch_q12/duckdb:vortex-compact 753910353 673015377 1.12
tpch_q13/duckdb:vortex-compact 987984910 909656016 1.09
tpch_q14/duckdb:vortex-compact 857816683 816904459 1.05
tpch_q15/duckdb:vortex-compact 580654585 540948662 1.07
tpch_q16/duckdb:vortex-compact 506979433 437133217 1.16
tpch_q17/duckdb:vortex-compact 978919492 1028324373 0.95
tpch_q18/duckdb:vortex-compact 819294494 862646742 0.95
tpch_q19/duckdb:vortex-compact 787514782 722614510 1.09
tpch_q20/duckdb:vortex-compact 1239145151 1222470759 1.01
tpch_q21/duckdb:vortex-compact 1818691260 1702391851 1.07
tpch_q22/duckdb:vortex-compact 790152130 623734984 1.27
duckdb / parquet (1.050x ➖, 0↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 774572757 818182918 0.95
tpch_q02/duckdb:parquet 1550825614 1529854516 1.01
tpch_q03/duckdb:parquet 1673640268 1730618110 0.97
tpch_q04/duckdb:parquet 1043722000 1092112434 0.96
tpch_q05/duckdb:parquet 2142002975 2185587354 0.98
tpch_q06/duckdb:parquet 687255876 705980829 0.97
tpch_q07/duckdb:parquet 1910252851 1850027287 1.03
tpch_q08/duckdb:parquet 2659720877 2575618280 1.03
tpch_q09/duckdb:parquet 2595286399 2734560123 0.95
tpch_q10/duckdb:parquet 3426292013 3067853836 1.12
tpch_q11/duckdb:parquet 1041808002 1040785099 1.00
tpch_q12/duckdb:parquet 1196187323 1044243526 1.15
tpch_q13/duckdb:parquet 1265711976 1167748194 1.08
tpch_q14/duckdb:parquet 1311881009 1263984339 1.04
tpch_q15/duckdb:parquet 930125076 932028232 1.00
tpch_q16/duckdb:parquet 963465819 955416558 1.01
tpch_q17/duckdb:parquet 1458631108 1214143845 1.20
tpch_q18/duckdb:parquet 1765658362 1378170185 1.28
tpch_q19/duckdb:parquet 1840846857 1483448226 1.24
tpch_q20/duckdb:parquet 1998751805 1821676136 1.10
tpch_q21/duckdb:parquet 1786449301 1726810821 1.03
tpch_q22/duckdb:parquet 1131973354 1033975409 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -10.9% -10.3% -0.6% +46.0% ➖ noise
1 datafusion:vortex-file-compressed -3.2% -10.3% +7.9% +55.2% ➖ noise
1 duckdb:vortex-compact +3.6% -10.3% +15.5% +39.9% ➖ noise
1 duckdb:vortex-file-compressed -0.6% -10.3% +10.9% +37.2% ➖ noise
2 datafusion:vortex-compact +3.4% -6.1% +10.1% +44.4% ➖ noise
2 datafusion:vortex-file-compressed -10.5% -6.1% -4.7% +43.5% ➖ noise
2 duckdb:vortex-compact +20.9% -6.1% +28.7% +38.4% ➖ noise
2 duckdb:vortex-file-compressed +15.9% -6.1% +23.4% +43.3% ➖ noise
3 datafusion:vortex-compact -16.1% -5.2% -11.5% +46.4% ➖ noise
3 datafusion:vortex-file-compressed -4.5% -5.2% +0.8% +51.9% ➖ noise
3 duckdb:vortex-compact +16.7% -5.2% +23.2% +39.2% ➖ noise
3 duckdb:vortex-file-compressed +17.5% -5.2% +24.0% +49.4% ➖ noise
4 datafusion:vortex-compact -6.4% -16.4% +11.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% -16.4% +19.4% +30.0% ➖ noise
4 duckdb:vortex-compact +12.5% -16.4% +34.5% +30.0% 🚨 regression
4 duckdb:vortex-file-compressed +7.4% -16.4% +28.4% +30.0% ➖ noise
5 datafusion:vortex-compact +3.8% -15.0% +22.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -7.9% -15.0% +8.3% +30.0% ➖ noise
5 duckdb:vortex-compact +2.4% -15.0% +20.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +12.8% -15.0% +32.6% +30.0% 🚨 regression
6 datafusion:vortex-compact +0.1% -5.8% +6.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -6.0% -5.8% -0.2% +30.0% ➖ noise
6 duckdb:vortex-compact +7.2% -5.8% +13.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +8.3% -5.8% +15.1% +30.0% ➖ noise
7 datafusion:vortex-compact +9.3% -6.7% +17.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -4.2% -6.7% +2.7% +30.0% ➖ noise
7 duckdb:vortex-compact +6.4% -6.7% +14.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.4% -6.7% +16.1% +30.0% ➖ noise
8 datafusion:vortex-compact +18.5% -6.9% +27.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -13.9% -6.9% -7.5% +30.0% ➖ noise
8 duckdb:vortex-compact -3.3% -6.9% +3.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +10.9% -6.9% +19.1% +30.0% ➖ noise
9 datafusion:vortex-compact -1.4% -10.7% +10.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +5.6% -10.7% +18.3% +30.0% ➖ noise
9 duckdb:vortex-compact +16.2% -10.7% +30.2% +30.0% 🚨 regression
9 duckdb:vortex-file-compressed +8.6% -10.7% +21.7% +30.0% ➖ noise
10 datafusion:vortex-compact +1.4% +4.2% -2.6% +36.0% ➖ noise
10 datafusion:vortex-file-compressed -12.7% +4.2% -16.2% +30.0% ➖ noise
10 duckdb:vortex-compact +6.7% +4.2% +2.5% +31.3% ➖ noise
10 duckdb:vortex-file-compressed +4.5% +4.2% +0.3% +30.0% ➖ noise
11 datafusion:vortex-compact +10.6% -15.5% +30.9% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed -4.3% -15.5% +13.2% +30.0% ➖ noise
11 duckdb:vortex-compact +22.4% -15.5% +44.8% +30.0% 🚨 regression
11 duckdb:vortex-file-compressed +18.0% -15.5% +39.6% +30.0% 🚨 regression
12 datafusion:vortex-compact -9.9% +3.6% -13.0% +34.5% ➖ noise
12 datafusion:vortex-file-compressed -11.7% +3.6% -14.7% +30.0% ➖ noise
12 duckdb:vortex-compact +12.0% +3.6% +8.1% +32.5% ➖ noise
12 duckdb:vortex-file-compressed +14.6% +3.6% +10.6% +34.8% ➖ noise
13 datafusion:vortex-compact -16.1% -1.5% -14.8% +34.0% ➖ noise
13 datafusion:vortex-file-compressed -4.8% -1.5% -3.3% +72.5% ➖ noise
13 duckdb:vortex-compact +8.6% -1.5% +10.3% +48.4% ➖ noise
13 duckdb:vortex-file-compressed +8.1% -1.5% +9.7% +44.5% ➖ noise
14 datafusion:vortex-compact -22.1% +4.7% -25.6% +38.5% ➖ noise
14 datafusion:vortex-file-compressed -1.8% +4.7% -6.2% +31.6% ➖ noise
14 duckdb:vortex-compact +5.0% +4.7% +0.3% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +7.0% +4.7% +2.2% +30.0% ➖ noise
15 datafusion:vortex-compact -2.1% -2.5% +0.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +25.0% -2.5% +28.2% +30.0% ➖ noise
15 duckdb:vortex-compact +7.3% -2.5% +10.1% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +13.5% -2.5% +16.5% +30.0% ➖ noise
16 datafusion:vortex-compact +6.9% -1.1% +8.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -28.7% -1.1% -27.9% +40.0% ➖ noise
16 duckdb:vortex-compact +16.0% -1.1% +17.3% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +6.4% -1.1% +7.5% +30.0% ➖ noise
17 datafusion:vortex-compact -2.7% +15.2% -15.5% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -9.0% +15.2% -21.0% +30.0% ➖ noise
17 duckdb:vortex-compact -4.8% +15.2% -17.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.8% +15.2% -9.9% +30.0% ➖ noise
18 datafusion:vortex-compact +2.1% +7.3% -4.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -7.2% +7.3% -13.5% +30.0% ➖ noise
18 duckdb:vortex-compact -5.0% +7.3% -11.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +10.0% +7.3% +2.5% +30.0% ➖ noise
19 datafusion:vortex-compact -11.0% +8.7% -18.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -19.4% +8.7% -25.8% +31.8% ✅ faster
19 duckdb:vortex-compact +9.0% +8.7% +0.3% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +3.9% +8.7% -4.4% +30.0% ➖ noise
20 datafusion:vortex-compact -4.6% +2.2% -6.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -13.9% +2.2% -15.7% +30.0% ➖ noise
20 duckdb:vortex-compact +1.4% +2.2% -0.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +10.0% +2.2% +7.6% +30.0% ➖ noise
21 datafusion:vortex-compact -3.4% -5.7% +2.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -9.2% -5.7% -3.7% +30.0% ➖ noise
21 duckdb:vortex-compact +6.8% -5.7% +13.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +3.4% -5.7% +9.7% +30.0% ➖ noise
22 datafusion:vortex-compact -7.7% -0.8% -7.0% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +17.0% -0.8% +18.0% +30.5% ➖ noise
22 duckdb:vortex-compact +26.7% -0.8% +27.8% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +10.5% -0.8% +11.5% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: Random Access

Vortex (geomean): 0.933x ➖
Parquet (geomean): 0.973x ➖


unknown / unknown (0.959x ➖, 5↑ 0↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2072036 3099654 0.67
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1411767 1470728 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8468110129 8580311868 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8406325260 8451159014 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8626644 8406755 1.03
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7432058 7871494 0.94
random-access/feature-vectors/uniform/lance-tokio-local-disk 5927777 6048666 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6654661 6806281 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8523567130 8632603110 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8542903755 8595417162 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13342923 13894602 0.96
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13174599 13660941 0.96
random-access/lance-tokio-local-disk 755645 748958 1.01
random-access/lance-tokio-local-disk-footer 1305145 1303214 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 254785 257477 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 661620 680078 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 131927910 135433170 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131953297 133699449 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 618421 680036 0.91
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 628993 685205 0.92
random-access/nested-lists/uniform/lance-tokio-local-disk 1079853 1082776 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1511353 1516267 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 131452929 133836323 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 132168468 134869771 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk 2147007 2193493 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2149032 2195282 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 396192 399052 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 602491 616235 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk 27039804 28768648 0.94
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27199227 28693335 0.95
random-access/nested-structs/correlated/vortex-tokio-local-disk 775516 817054 0.95
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 770654 808396 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk 2675428 2683908 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2935093 2927458 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk 26463182 28643862 0.92
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27644324 28705039 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk 1720927 1778507 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1703923 1752732 0.97
random-access/parquet-tokio-local-disk 179653275 184409314 0.97
random-access/parquet-tokio-local-disk-footer 180294754 183790391 0.98
random-access/taxi/correlated/lance-tokio-local-disk 946374 945372 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1588493 1589111 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 268903847 274092058 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 267195991 274419974 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1586459 1992124 0.80
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1769901 2002834 0.88
random-access/taxi/uniform/lance-tokio-local-disk 9914018 9796031 1.01
random-access/taxi/uniform/lance-tokio-local-disk-footer 10565580 10502348 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 282752246 289685229 0.98
random-access/taxi/uniform/parquet-tokio-local-disk-footer 282581598 290785294 0.97
random-access/taxi/uniform/vortex-tokio-local-disk 4528879 4924501 0.92
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4541744 4892195 0.93
random-access/vortex-tokio-local-disk 🚀 1213602 1370844 0.89
random-access/vortex-tokio-local-disk-footer 🚀 1241705 1397437 0.89

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Benchmarks: Compression

Vortex (geomean): 1.006x ➖
Parquet (geomean): 0.995x ➖


unknown / unknown (0.994x ➖, 3↑ 3↓)
name PR 696cff3 (ns) base 140eec6 (ns) ratio (PR/base)
compress time/Arade 1169244786 1139273319 1.03
compress time/Bimbo 6875701826 7103801038 0.97
compress time/CMSprovider 2888155518 2964926982 0.97
compress time/Euro2016 435624046 457773734 0.95
compress time/Food 417314287 425921334 0.98
compress time/HashTags 837148006 823581462 1.02
compress time/TPC-H l_comment canonical 1355879868 1345955485 1.01
compress time/TPC-H l_comment chunked 1329518346 1368992572 0.97
compress time/taxi 736141854 722380122 1.02
compress time/wide table cols=100 chunks=1 rows=1000 11623298 11826670 0.98
compress time/wide table cols=100 chunks=50 rows=1000 11930628 12076266 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 124273003 127491031 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 125834227 124325524 1.01
compress time/wide table cols=10000 chunks=1 rows=1000 1405017673 1445656464 0.97
compress time/wide table cols=10000 chunks=50 rows=1000 1417178171 1397890641 1.01
decompress time/Arade 🚨 29916331 26916134 1.11
decompress time/Bimbo 102731894 101240956 1.01
decompress time/CMSprovider 🚀 86502696 97629106 0.89
decompress time/Euro2016 🚀 18619845 21300599 0.87
decompress time/Food 9681694 9386223 1.03
decompress time/HashTags 71993367 71568712 1.01
decompress time/TPC-H l_comment canonical 40734401 41485979 0.98
decompress time/TPC-H l_comment chunked 40736988 42560984 0.96
decompress time/taxi 16498313 17855209 0.92
decompress time/wide table cols=100 chunks=1 rows=1000 2672196 2601998 1.03
decompress time/wide table cols=100 chunks=50 rows=1000 2685939 2597562 1.03
decompress time/wide table cols=1000 chunks=1 rows=1000 23831863 25788739 0.92
decompress time/wide table cols=1000 chunks=50 rows=1000 24249708 24558365 0.99
decompress time/wide table cols=10000 chunks=1 rows=1000 269787260 273511464 0.99
decompress time/wide table cols=10000 chunks=50 rows=1000 261635832 261083404 1.00
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2965759640 2903072688 1.02
parquet_rs-zstd compress time/Bimbo 14907892357 15057545789 0.99
parquet_rs-zstd compress time/CMSprovider 7660730846 7813213820 0.98
parquet_rs-zstd compress time/Euro2016 1366824644 1409914921 0.97
parquet_rs-zstd compress time/Food 885245700 900015387 0.98
parquet_rs-zstd compress time/HashTags 2373527925 2475989775 0.96
parquet_rs-zstd compress time/TPC-H l_comment canonical 3121042987 3308929524 0.94
parquet_rs-zstd compress time/TPC-H l_comment chunked 3148196284 3152281745 1.00
parquet_rs-zstd compress time/taxi 1392590133 1399228920 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 7041112 7731328 0.91
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7051082 7800259 0.90
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 83936904 85406169 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 84534288 85048446 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 882082385 894353959 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 941023298 875522655 1.07
parquet_rs-zstd decompress time/Arade 643313517 639984720 1.01
parquet_rs-zstd decompress time/Bimbo 1709059308 1734354743 0.99
parquet_rs-zstd decompress time/CMSprovider 1960924110 2152528774 0.91
parquet_rs-zstd decompress time/Euro2016 387415765 393732989 0.98
parquet_rs-zstd decompress time/Food 219031703 227167749 0.96
parquet_rs-zstd decompress time/HashTags 657277620 671086060 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 569053380 581265294 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 570591278 572886041 1.00
parquet_rs-zstd decompress time/taxi 246577582 249617116 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2777483 2853141 0.97
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2766312 2984092 0.93
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33235348 33164625 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33585126 35614972 0.94
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 342922191 350042801 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 340602183 362931425 0.94
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163599060 163394012 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 1.00
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.06
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.07
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio compress time/taxi 0 0 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio decompress time/Euro2016 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/Food 0 0 1.07
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.96
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.92
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from a3e6376 to c54684f Compare April 27, 2026 09:38
@myrrc myrrc requested a review from joseph-isaacs April 27, 2026 09:39
Comment thread vortex-duckdb/cpp/table_function.cpp Outdated
Comment thread vortex-duckdb/src/duckdb/value.rs Outdated
Comment thread vortex-duckdb/src/datasource.rs Outdated
Comment thread vortex-duckdb/src/datasource.rs Outdated
@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from c54684f to 32f5e43 Compare April 27, 2026 10:35
@myrrc myrrc enabled auto-merge (squash) April 27, 2026 10:35
@myrrc myrrc disabled auto-merge April 27, 2026 10:35
@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch 2 times, most recently from 5cb2217 to b0f2e4a Compare April 27, 2026 10:46
@myrrc myrrc enabled auto-merge (squash) April 27, 2026 10:49
@myrrc myrrc disabled auto-merge April 27, 2026 10:50
@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 27, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 27, 2026
@myrrc myrrc marked this pull request as draft April 27, 2026 11:05
@myrrc myrrc changed the title file_index virtual column for duckdb row id columns for duckdb Apr 28, 2026
@myrrc myrrc requested a review from joseph-isaacs April 28, 2026 11:15
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 28, 2026
@github-actions github-actions Bot removed action/benchmark-sql Trigger SQL benchmarks to run on this PR action/benchmark Trigger full benchmarks to run on this PR labels Apr 28, 2026
@myrrc myrrc changed the title row id columns for duckdb Late materialization support for duckdb Apr 28, 2026
Signed-off-by: Mikhail Kot <to@myrrc.dev>
@myrrc myrrc force-pushed the myrrc/duckdb-row-id-columns branch from 8325606 to 696cff3 Compare April 28, 2026 16:38
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 28, 2026

Merging this PR will degrade performance by 10.6%

⚡ 5 improved benchmarks
❌ 1 regressed benchmark
✅ 1124 untouched benchmarks
⏩ 33 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation patched_take_10k_dispersed 315.5 µs 285.2 µs +10.62%
Simulation take_10k_dispersed 284.4 µs 239.6 µs +18.69%
Simulation patched_take_10k_first_chunk_only 301.9 µs 271.6 µs +11.17%
Simulation take_10k_first_chunk_only 270.4 µs 225.5 µs +19.9%
Simulation patched_take_10k_adversarial 258.4 µs 228.2 µs +13.23%
Simulation bitwise_not_vortex_buffer_mut[128] 246.1 ns 275.3 ns -10.6%

Comparing myrrc/duckdb-row-id-columns (696cff3) with develop (b13ba9c)

Open in CodSpeed

Footnotes

  1. 33 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 28, 2026
@github-actions github-actions Bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 28, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 28, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@myrrc
Copy link
Copy Markdown
Contributor Author

myrrc commented Apr 28, 2026

@joseph-isaacs The particularly hacky stuff here is adding partition indices, however, I can't imagine another way to filter files in a stable manner.

@myrrc myrrc marked this pull request as ready for review April 28, 2026 17:07
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 28, 2026
@joseph-isaacs
Copy link
Copy Markdown
Contributor

nice. let me review this tomorrow and get this over the line. what is the perf results?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants