Skip to content

Fix custom-labels for DuckDB#7619

Draft
AdamGS wants to merge 1 commit intodevelopfrom
adamg/re-wire-labels-duckdb
Draft

Fix custom-labels for DuckDB#7619
AdamGS wants to merge 1 commit intodevelopfrom
adamg/re-wire-labels-duckdb

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Apr 24, 2026

Summary

Not sure what changed, but the labels became really messy. This change introduces two additional points where the labels are synchronized with the global set.

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added ext/duckdb Relates to the DuckDB integration changelog/chore A trivial change action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 24, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 24, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 24, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 46a3b2a 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.933x ➖


datafusion / vortex-file-compressed (0.933x ➖, 4↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚀 113998027 127903294 0.89
polarsignals_q01/datafusion:vortex-file-compressed 263635837 283928176 0.93
polarsignals_q02/datafusion:vortex-file-compressed 🚀 22952312 25605005 0.90
polarsignals_q03/datafusion:vortex-file-compressed 278893465 282206685 0.99
polarsignals_q04/datafusion:vortex-file-compressed 11770444 12477847 0.94
polarsignals_q05/datafusion:vortex-file-compressed 16207837 15981158 1.01
polarsignals_q06/datafusion:vortex-file-compressed 18848021 19924465 0.95
polarsignals_q07/datafusion:vortex-file-compressed 🚀 13348421 15252919 0.88
polarsignals_q08/datafusion:vortex-file-compressed 362526421 377047261 0.96
polarsignals_q09/datafusion:vortex-file-compressed 🚀 11130145 12378825 0.90

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.976x ➖
Shifts: Parquet (control) -2.4% · Median polish -0.5%


datafusion / vortex-file-compressed (0.973x ➖, 2↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4897104 5844753 0.84
fineweb_q01/datafusion:vortex-file-compressed 🚨 21756033 18658712 1.17
fineweb_q02/datafusion:vortex-file-compressed 22328653 22610763 0.99
fineweb_q03/datafusion:vortex-file-compressed 79849239 87565661 0.91
fineweb_q04/datafusion:vortex-file-compressed 232625388 235129999 0.99
fineweb_q05/datafusion:vortex-file-compressed 215686552 218472698 0.99
fineweb_q06/datafusion:vortex-file-compressed 54479115 57402692 0.95
fineweb_q07/datafusion:vortex-file-compressed 🚀 56777067 64090531 0.89
fineweb_q08/datafusion:vortex-file-compressed 23354482 21606932 1.08
datafusion / vortex-compact (0.983x ➖, 1↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5563199 6869265 0.81
fineweb_q01/datafusion:vortex-compact 136288651 128130441 1.06
fineweb_q02/datafusion:vortex-compact 129400168 128479856 1.01
fineweb_q03/datafusion:vortex-compact 1030570026 1030053393 1.00
fineweb_q04/datafusion:vortex-compact 1092225719 1129657595 0.97
fineweb_q05/datafusion:vortex-compact 951558011 969003709 0.98
fineweb_q06/datafusion:vortex-compact 522508625 524445308 1.00
fineweb_q07/datafusion:vortex-compact 534718430 543685813 0.98
fineweb_q08/datafusion:vortex-compact 20071249 18862304 1.06
datafusion / parquet (0.989x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6804484 6524795 1.04
fineweb_q01/datafusion:parquet 278423300 287976651 0.97
fineweb_q02/datafusion:parquet 278422478 292730549 0.95
fineweb_q03/datafusion:parquet 288062847 278040308 1.04
fineweb_q04/datafusion:parquet 298807513 297646642 1.00
fineweb_q05/datafusion:parquet 290458204 309636072 0.94
fineweb_q06/datafusion:parquet 279638545 293609331 0.95
fineweb_q07/datafusion:parquet 286695082 281161698 1.02
fineweb_q08/datafusion:parquet 275505587 276669236 1.00
duckdb / vortex-file-compressed (1.026x ➖, 0↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3264371 3261513 1.00
fineweb_q01/duckdb:vortex-file-compressed 21894131 22768393 0.96
fineweb_q02/duckdb:vortex-file-compressed 22939089 24011738 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚨 158915354 113453115 1.40
fineweb_q04/duckdb:vortex-file-compressed 218986818 215134039 1.02
fineweb_q05/duckdb:vortex-file-compressed 215662044 212738823 1.01
fineweb_q06/duckdb:vortex-file-compressed 51572670 53177725 0.97
fineweb_q07/duckdb:vortex-file-compressed 53310972 53436781 1.00
fineweb_q08/duckdb:vortex-file-compressed 22097084 22617624 0.98
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4060791 3951165 1.03
fineweb_q01/duckdb:vortex-compact 102271201 103256203 0.99
fineweb_q02/duckdb:vortex-compact 110366001 119503067 0.92
fineweb_q03/duckdb:vortex-compact 852044830 868936532 0.98
fineweb_q04/duckdb:vortex-compact 898120804 902341250 1.00
fineweb_q05/duckdb:vortex-compact 807104666 809521549 1.00
fineweb_q06/duckdb:vortex-compact 457800212 467347506 0.98
fineweb_q07/duckdb:vortex-compact 477725884 476370362 1.00
fineweb_q08/duckdb:vortex-compact 23638007 23797630 0.99
duckdb / parquet (0.964x ➖, 2↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 26502031 29732768 0.89
fineweb_q01/duckdb:parquet 81288246 83032218 0.98
fineweb_q02/duckdb:parquet 83986611 83768846 1.00
fineweb_q03/duckdb:parquet 306414021 311818845 0.98
fineweb_q04/duckdb:parquet 434988345 441420382 0.99
fineweb_q05/duckdb:parquet 407052210 411975271 0.99
fineweb_q06/duckdb:parquet 196762298 198453181 0.99
fineweb_q07/duckdb:parquet 206518895 210245779 0.98
fineweb_q08/duckdb:parquet 🚀 28714342 32523398 0.88
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -19.0% -3.6% -16.0% +55.4% ➖ noise
0 datafusion:vortex-file-compressed -16.2% -3.6% -13.1% +55.5% ➖ noise
0 duckdb:vortex-compact +2.8% -3.6% +6.6% +46.6% ➖ noise
0 duckdb:vortex-file-compressed +0.1% -3.6% +3.8% +82.9% ➖ noise
1 datafusion:vortex-compact +6.4% -2.7% +9.3% +12.8% ➖ noise
1 datafusion:vortex-file-compressed +16.6% -2.7% +19.8% +31.5% ➖ noise
1 duckdb:vortex-compact -1.0% -2.7% +1.8% +22.7% ➖ noise
1 duckdb:vortex-file-compressed -3.8% -2.7% -1.2% +60.3% ➖ noise
2 datafusion:vortex-compact +0.7% -2.3% +3.1% +12.6% ➖ noise
2 datafusion:vortex-file-compressed -1.2% -2.3% +1.1% +17.1% ➖ noise
2 duckdb:vortex-compact -7.6% -2.3% -5.4% +13.3% ➖ noise
2 duckdb:vortex-file-compressed -4.5% -2.3% -2.2% +10.1% ➖ noise
3 datafusion:vortex-compact +0.1% +0.9% -0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -8.8% +0.9% -9.6% +37.7% ➖ noise
3 duckdb:vortex-compact -1.9% +0.9% -2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +40.1% +0.9% +38.8% +27.8% 🚨 regression
4 datafusion:vortex-compact -3.3% -0.5% -2.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.1% -0.5% -0.5% +10.0% ➖ noise
4 duckdb:vortex-compact -0.5% -0.5% +0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.8% -0.5% +2.3% +10.0% ➖ noise
5 datafusion:vortex-compact -1.8% -3.7% +2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.3% -3.7% +2.5% +10.0% ➖ noise
5 duckdb:vortex-compact -0.3% -3.7% +3.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.4% -3.7% +5.3% +10.0% ➖ noise
6 datafusion:vortex-compact -0.4% -2.8% +2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.1% -2.8% -2.3% +10.0% ➖ noise
6 duckdb:vortex-compact -2.0% -2.8% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.0% -2.8% -0.2% +10.3% ➖ noise
7 datafusion:vortex-compact -1.6% +0.1% -1.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -11.4% +0.1% -11.5% +28.4% ➖ noise
7 duckdb:vortex-compact +0.3% +0.1% +0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.2% +0.1% -0.3% +35.1% ➖ noise
8 datafusion:vortex-compact +6.4% -6.2% +13.5% +15.6% ➖ noise
8 datafusion:vortex-file-compressed +8.1% -6.2% +15.3% +17.1% ➖ noise
8 duckdb:vortex-compact -0.7% -6.2% +5.9% +36.0% ➖ noise
8 duckdb:vortex-file-compressed -2.3% -6.2% +4.2% +11.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.064x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +1.2%


datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50531190 48692103 1.04
tpch_q02/datafusion:vortex-file-compressed 28467184 28651261 0.99
tpch_q03/datafusion:vortex-file-compressed 28588745 28698294 1.00
tpch_q04/datafusion:vortex-file-compressed 20971533 21668962 0.97
tpch_q05/datafusion:vortex-file-compressed 49057824 48481261 1.01
tpch_q06/datafusion:vortex-file-compressed 12858617 13139341 0.98
tpch_q07/datafusion:vortex-file-compressed 60889974 60773312 1.00
tpch_q08/datafusion:vortex-file-compressed 40762884 41330773 0.99
tpch_q09/datafusion:vortex-file-compressed 55275382 54065201 1.02
tpch_q10/datafusion:vortex-file-compressed 44476516 45393470 0.98
tpch_q11/datafusion:vortex-file-compressed 16279312 16841140 0.97
tpch_q12/datafusion:vortex-file-compressed 25999245 26899536 0.97
tpch_q13/datafusion:vortex-file-compressed 24814408 25321029 0.98
tpch_q14/datafusion:vortex-file-compressed 16995480 17926748 0.95
tpch_q15/datafusion:vortex-file-compressed 27599636 27760576 0.99
tpch_q16/datafusion:vortex-file-compressed 20982519 20589514 1.02
tpch_q17/datafusion:vortex-file-compressed 68216350 68420506 1.00
tpch_q18/datafusion:vortex-file-compressed 79135031 81032447 0.98
tpch_q19/datafusion:vortex-file-compressed 24583325 24295970 1.01
tpch_q20/datafusion:vortex-file-compressed 30421498 30312203 1.00
tpch_q21/datafusion:vortex-file-compressed 75810364 76994489 0.98
tpch_q22/datafusion:vortex-file-compressed 14562347 14502712 1.00
datafusion / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59358143 60656704 0.98
tpch_q02/datafusion:vortex-compact 33023854 31019125 1.06
tpch_q03/datafusion:vortex-compact 31093030 30253510 1.03
tpch_q04/datafusion:vortex-compact 24569114 24499163 1.00
tpch_q05/datafusion:vortex-compact 53951897 52394403 1.03
tpch_q06/datafusion:vortex-compact 14471723 14754162 0.98
tpch_q07/datafusion:vortex-compact 66618199 66119638 1.01
tpch_q08/datafusion:vortex-compact 46025709 45704547 1.01
tpch_q09/datafusion:vortex-compact 58676678 59939941 0.98
tpch_q10/datafusion:vortex-compact 49371038 50554915 0.98
tpch_q11/datafusion:vortex-compact 17259518 17057048 1.01
tpch_q12/datafusion:vortex-compact 33489804 32941834 1.02
tpch_q13/datafusion:vortex-compact 32146384 31671316 1.01
tpch_q14/datafusion:vortex-compact 19876279 20403193 0.97
tpch_q15/datafusion:vortex-compact 33575818 33801926 0.99
tpch_q16/datafusion:vortex-compact 25728069 24501497 1.05
tpch_q17/datafusion:vortex-compact 71043840 69924059 1.02
tpch_q18/datafusion:vortex-compact 84635686 85997287 0.98
tpch_q19/datafusion:vortex-compact 31047849 32061023 0.97
tpch_q20/datafusion:vortex-compact 34886774 35696438 0.98
tpch_q21/datafusion:vortex-compact 82723512 82503078 1.00
tpch_q22/datafusion:vortex-compact 15395854 15415145 1.00
datafusion / parquet (1.034x ➖, 0↑ 4↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 100026919 94948443 1.05
tpch_q02/datafusion:parquet 🚨 70659414 62414870 1.13
tpch_q03/datafusion:parquet 76598986 73178706 1.05
tpch_q04/datafusion:parquet 48737738 45466335 1.07
tpch_q05/datafusion:parquet 🚨 103784960 93586437 1.11
tpch_q06/datafusion:parquet 45798449 41941526 1.09
tpch_q07/datafusion:parquet 🚨 117657843 103767954 1.13
tpch_q08/datafusion:parquet 97592546 98777247 0.99
tpch_q09/datafusion:parquet 133488370 128673633 1.04
tpch_q10/datafusion:parquet 111025865 114729223 0.97
tpch_q11/datafusion:parquet 42772847 42096056 1.02
tpch_q12/datafusion:parquet 🚨 88687373 74640354 1.19
tpch_q13/datafusion:parquet 189894845 190333239 1.00
tpch_q14/datafusion:parquet 47137230 45113403 1.04
tpch_q15/datafusion:parquet 59694448 62210783 0.96
tpch_q16/datafusion:parquet 44252715 43624466 1.01
tpch_q17/datafusion:parquet 131997266 134040896 0.98
tpch_q18/datafusion:parquet 159611249 162571842 0.98
tpch_q19/datafusion:parquet 81555538 82365494 0.99
tpch_q20/datafusion:parquet 70304127 70465965 1.00
tpch_q21/datafusion:parquet 134566451 133626720 1.01
tpch_q22/datafusion:parquet 30846688 32024568 0.96
datafusion / arrow (1.069x ➖, 0↑ 7↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 50224158 52777905 0.95
tpch_q02/datafusion:arrow 18164682 18112086 1.00
tpch_q03/datafusion:arrow 31007463 28608674 1.08
tpch_q04/datafusion:arrow 27138208 25131983 1.08
tpch_q05/datafusion:arrow 78839946 71761787 1.10
tpch_q06/datafusion:arrow 🚨 22373621 19035628 1.18
tpch_q07/datafusion:arrow 101798786 100872787 1.01
tpch_q08/datafusion:arrow 40532216 41288415 0.98
tpch_q09/datafusion:arrow 62058487 62329876 1.00
tpch_q10/datafusion:arrow 46257715 49073584 0.94
tpch_q11/datafusion:arrow 8876358 8950714 0.99
tpch_q12/datafusion:arrow 53576234 51682239 1.04
tpch_q13/datafusion:arrow 48188729 46669893 1.03
tpch_q14/datafusion:arrow 22022763 21202176 1.04
tpch_q15/datafusion:arrow 41439979 42738848 0.97
tpch_q16/datafusion:arrow 18951873 18536873 1.02
tpch_q17/datafusion:arrow 🚨 77680816 68952296 1.13
tpch_q18/datafusion:arrow 🚨 162375217 131924245 1.23
tpch_q19/datafusion:arrow 🚨 44301781 34701929 1.28
tpch_q20/datafusion:arrow 🚨 42854755 33763138 1.27
tpch_q21/datafusion:arrow 🚨 172734429 147976001 1.17
tpch_q22/datafusion:arrow 🚨 19260888 17220863 1.12
duckdb / vortex-file-compressed (1.190x ❌, 0↑ 21↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33700369 31322798 1.08
tpch_q02/duckdb:vortex-file-compressed 🚨 28744343 24788065 1.16
tpch_q03/duckdb:vortex-file-compressed 🚨 35414893 28872421 1.23
tpch_q04/duckdb:vortex-file-compressed 🚨 34774629 29873805 1.16
tpch_q05/duckdb:vortex-file-compressed 🚨 38526634 34017706 1.13
tpch_q06/duckdb:vortex-file-compressed 🚨 11798632 10501815 1.12
tpch_q07/duckdb:vortex-file-compressed 🚨 43280250 37211779 1.16
tpch_q08/duckdb:vortex-file-compressed 🚨 44034494 39015307 1.13
tpch_q09/duckdb:vortex-file-compressed 🚨 86541820 73341567 1.18
tpch_q10/duckdb:vortex-file-compressed 🚨 42418257 34520778 1.23
tpch_q11/duckdb:vortex-file-compressed 🚨 16858145 14875887 1.13
tpch_q12/duckdb:vortex-file-compressed 🚨 26070223 22347698 1.17
tpch_q13/duckdb:vortex-file-compressed 🚨 42487527 34799399 1.22
tpch_q14/duckdb:vortex-file-compressed 🚨 27881565 20552969 1.36
tpch_q15/duckdb:vortex-file-compressed 🚨 20134598 16313634 1.23
tpch_q16/duckdb:vortex-file-compressed 🚨 34777976 28464696 1.22
tpch_q17/duckdb:vortex-file-compressed 🚨 29793805 24818193 1.20
tpch_q18/duckdb:vortex-file-compressed 🚨 60019216 50539542 1.19
tpch_q19/duckdb:vortex-file-compressed 🚨 34937714 27782522 1.26
tpch_q20/duckdb:vortex-file-compressed 🚨 41327547 34225344 1.21
tpch_q21/duckdb:vortex-file-compressed 🚨 129459143 104820130 1.24
tpch_q22/duckdb:vortex-file-compressed 🚨 20523315 17106944 1.20
duckdb / vortex-compact (1.084x ➖, 0↑ 9↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41297679 38873984 1.06
tpch_q02/duckdb:vortex-compact 🚨 39968673 33853649 1.18
tpch_q03/duckdb:vortex-compact 🚨 37611923 31991116 1.18
tpch_q04/duckdb:vortex-compact 🚨 38711651 33243037 1.16
tpch_q05/duckdb:vortex-compact 🚨 42991274 37078839 1.16
tpch_q06/duckdb:vortex-compact 🚨 17475108 15663770 1.12
tpch_q07/duckdb:vortex-compact 🚨 48636514 42446914 1.15
tpch_q08/duckdb:vortex-compact 49191793 44813817 1.10
tpch_q09/duckdb:vortex-compact 🚨 96449938 85314172 1.13
tpch_q10/duckdb:vortex-compact 🚨 43352681 39126009 1.11
tpch_q11/duckdb:vortex-compact 🚨 22319589 19010221 1.17
tpch_q12/duckdb:vortex-compact 38173709 35138224 1.09
tpch_q13/duckdb:vortex-compact 45177812 43773009 1.03
tpch_q14/duckdb:vortex-compact 29733316 29176474 1.02
tpch_q15/duckdb:vortex-compact 19922685 19718963 1.01
tpch_q16/duckdb:vortex-compact 35636305 34830584 1.02
tpch_q17/duckdb:vortex-compact 31226932 30527461 1.02
tpch_q18/duckdb:vortex-compact 51402494 50111232 1.03
tpch_q19/duckdb:vortex-compact 35540227 34194076 1.04
tpch_q20/duckdb:vortex-compact 42826021 42477923 1.01
tpch_q21/duckdb:vortex-compact 114569049 110654406 1.04
tpch_q22/duckdb:vortex-compact 20695267 19423404 1.07
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76041988 77502771 0.98
tpch_q02/duckdb:parquet 39033976 38310484 1.02
tpch_q03/duckdb:parquet 68081683 72638369 0.94
tpch_q04/duckdb:parquet 46298020 46771918 0.99
tpch_q05/duckdb:parquet 68462833 65216629 1.05
tpch_q06/duckdb:parquet 19896876 20362232 0.98
tpch_q07/duckdb:parquet 72995626 68387276 1.07
tpch_q08/duckdb:parquet 80211020 79811013 1.01
tpch_q09/duckdb:parquet 134631190 132387203 1.02
tpch_q10/duckdb:parquet 118112264 114473032 1.03
tpch_q11/duckdb:parquet 22281066 22218054 1.00
tpch_q12/duckdb:parquet 44482349 44975287 0.99
tpch_q13/duckdb:parquet 247571103 245642467 1.01
tpch_q14/duckdb:parquet 49415229 49641195 1.00
tpch_q15/duckdb:parquet 24456426 24719273 0.99
tpch_q16/duckdb:parquet 56549443 55110413 1.03
tpch_q17/duckdb:parquet 53323444 53541696 1.00
tpch_q18/duckdb:parquet 118260962 108304823 1.09
tpch_q19/duckdb:parquet 67501581 65044885 1.04
tpch_q20/duckdb:parquet 65635854 62921827 1.04
tpch_q21/duckdb:parquet 181741207 165580234 1.10
tpch_q22/duckdb:parquet 54752740 51460646 1.06
duckdb / duckdb (1.012x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16033514 15838095 1.01
tpch_q02/duckdb:duckdb 11936057 12456876 0.96
tpch_q03/duckdb:duckdb 18762835 19012462 0.99
tpch_q04/duckdb:duckdb 19435482 20173717 0.96
tpch_q05/duckdb:duckdb 19932387 19586402 1.02
tpch_q06/duckdb:duckdb 5288199 5225849 1.01
tpch_q07/duckdb:duckdb 22617061 21325571 1.06
tpch_q08/duckdb:duckdb 21509377 21173953 1.02
tpch_q09/duckdb:duckdb 55348386 52799821 1.05
tpch_q10/duckdb:duckdb 43945178 43657359 1.01
tpch_q11/duckdb:duckdb 5986393 5889626 1.02
tpch_q12/duckdb:duckdb 13644961 13658314 1.00
tpch_q13/duckdb:duckdb 38034818 38033245 1.00
tpch_q14/duckdb:duckdb 17276890 16458666 1.05
tpch_q15/duckdb:duckdb 12262225 11764439 1.04
tpch_q16/duckdb:duckdb 23244261 23911927 0.97
tpch_q17/duckdb:duckdb 13858072 13336821 1.04
tpch_q18/duckdb:duckdb 38313246 38360770 1.00
tpch_q19/duckdb:duckdb 27301803 26429590 1.03
tpch_q20/duckdb:duckdb 23326039 22673472 1.03
tpch_q21/duckdb:duckdb 56333085 56310844 1.00
tpch_q22/duckdb:duckdb 24676802 24228607 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.8% +1.7% -6.4% +21.6% ➖ noise
1 datafusion:vortex-compact -2.1% +1.7% -3.7% +20.0% ➖ noise
1 datafusion:vortex-file-compressed +3.8% +1.7% +2.1% +20.8% ➖ noise
1 duckdb:duckdb +1.2% +1.7% -0.4% +19.6% ➖ noise
1 duckdb:vortex-compact +6.2% +1.7% +4.5% +19.5% ➖ noise
1 duckdb:vortex-file-compressed +7.6% +1.7% +5.8% +22.8% ➖ noise
2 datafusion:arrow +0.3% +7.4% -6.6% +10.0% ➖ noise
2 datafusion:vortex-compact +6.5% +7.4% -0.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.6% +7.4% -7.5% +10.0% ➖ noise
2 duckdb:duckdb -4.2% +7.4% -10.8% +11.4% ✅ faster
2 duckdb:vortex-compact +18.1% +7.4% +9.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +16.0% +7.4% +8.0% +10.0% ➖ noise
3 datafusion:arrow +8.4% -1.0% +9.4% +10.0% ➖ noise
3 datafusion:vortex-compact +2.8% -1.0% +3.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.4% -1.0% +0.6% +10.0% ➖ noise
3 duckdb:duckdb -1.3% -1.0% -0.4% +11.0% ➖ noise
3 duckdb:vortex-compact +17.6% -1.0% +18.7% +15.8% 🚨 regression
3 duckdb:vortex-file-compressed +22.7% -1.0% +23.8% +14.6% 🚨 regression
4 datafusion:arrow +8.0% +3.0% +4.8% +10.0% ➖ noise
4 datafusion:vortex-compact +0.3% +3.0% -2.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.2% +3.0% -6.0% +10.0% ➖ noise
4 duckdb:duckdb -3.7% +3.0% -6.5% +10.0% ➖ noise
4 duckdb:vortex-compact +16.5% +3.0% +13.0% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +16.4% +3.0% +13.0% +10.0% 🚨 regression
5 datafusion:arrow +9.9% +7.9% +1.8% +11.1% ➖ noise
5 datafusion:vortex-compact +3.0% +7.9% -4.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.2% +7.9% -6.2% +10.0% ➖ noise
5 duckdb:duckdb +1.8% +7.9% -5.7% +14.3% ➖ noise
5 duckdb:vortex-compact +15.9% +7.9% +7.5% +10.4% ➖ noise
5 duckdb:vortex-file-compressed +13.3% +7.9% +5.0% +11.4% ➖ noise
6 datafusion:arrow +17.5% +3.3% +13.8% +13.9% ➖ noise
6 datafusion:vortex-compact -1.9% +3.3% -5.0% +14.3% ➖ noise
6 datafusion:vortex-file-compressed -2.1% +3.3% -5.3% +14.6% ➖ noise
6 duckdb:duckdb +1.2% +3.3% -2.0% +15.5% ➖ noise
6 duckdb:vortex-compact +11.6% +3.3% +8.0% +15.0% ➖ noise
6 duckdb:vortex-file-compressed +12.3% +3.3% +8.8% +13.8% ➖ noise
7 datafusion:arrow +0.9% +10.0% -8.3% +13.9% ➖ noise
7 datafusion:vortex-compact +0.8% +10.0% -8.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.2% +10.0% -8.9% +10.0% ➖ noise
7 duckdb:duckdb +6.1% +10.0% -3.6% +10.0% ➖ noise
7 duckdb:vortex-compact +14.6% +10.0% +4.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +16.3% +10.0% +5.7% +10.0% ➖ noise
8 datafusion:arrow -1.8% -0.4% -1.5% +10.0% ➖ noise
8 datafusion:vortex-compact +0.7% -0.4% +1.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.4% -0.4% -1.0% +10.0% ➖ noise
8 duckdb:duckdb +1.6% -0.4% +1.9% +10.0% ➖ noise
8 duckdb:vortex-compact +9.8% -0.4% +10.2% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +12.9% -0.4% +13.3% +10.0% 🚨 regression
9 datafusion:arrow -0.4% +2.7% -3.1% +10.0% ➖ noise
9 datafusion:vortex-compact -2.1% +2.7% -4.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.2% +2.7% -0.5% +10.0% ➖ noise
9 duckdb:duckdb +4.8% +2.7% +2.1% +10.0% ➖ noise
9 duckdb:vortex-compact +13.1% +2.7% +10.1% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +18.0% +2.7% +14.9% +10.0% 🚨 regression
10 datafusion:arrow -5.7% -0.1% -5.7% +10.8% ➖ noise
10 datafusion:vortex-compact -2.3% -0.1% -2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.0% -0.1% -1.9% +10.0% ➖ noise
10 duckdb:duckdb +0.7% -0.1% +0.7% +11.7% ➖ noise
10 duckdb:vortex-compact +10.8% -0.1% +10.9% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +22.9% -0.1% +23.0% +10.0% 🚨 regression
11 datafusion:arrow -0.8% +0.9% -1.8% +10.0% ➖ noise
11 datafusion:vortex-compact +1.2% +0.9% +0.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.3% +0.9% -4.2% +10.3% ➖ noise
11 duckdb:duckdb +1.6% +0.9% +0.7% +10.0% ➖ noise
11 duckdb:vortex-compact +17.4% +0.9% +16.3% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +13.3% +0.9% +12.3% +10.0% 🚨 regression
12 datafusion:arrow +3.7% +8.4% -4.4% +17.0% ➖ noise
12 datafusion:vortex-compact +1.7% +8.4% -6.2% +10.3% ➖ noise
12 datafusion:vortex-file-compressed -3.3% +8.4% -10.8% +10.0% ✅ faster
12 duckdb:duckdb -0.1% +8.4% -7.8% +10.0% ➖ noise
12 duckdb:vortex-compact +8.6% +8.4% +0.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +16.7% +8.4% +7.6% +11.0% ➖ noise
13 datafusion:arrow +3.3% +0.3% +3.0% +10.0% ➖ noise
13 datafusion:vortex-compact +1.5% +0.3% +1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.0% +0.3% -2.3% +10.0% ➖ noise
13 duckdb:duckdb +0.0% +0.3% -0.3% +10.5% ➖ noise
13 duckdb:vortex-compact +3.2% +0.3% +2.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +22.1% +0.3% +21.8% +10.0% 🚨 regression
14 datafusion:arrow +3.9% +2.0% +1.8% +11.6% ➖ noise
14 datafusion:vortex-compact -2.6% +2.0% -4.5% +10.8% ➖ noise
14 datafusion:vortex-file-compressed -5.2% +2.0% -7.0% +11.1% ➖ noise
14 duckdb:duckdb +5.0% +2.0% +2.9% +17.2% ➖ noise
14 duckdb:vortex-compact +1.9% +2.0% -0.1% +12.0% ➖ noise
14 duckdb:vortex-file-compressed +35.7% +2.0% +33.0% +11.9% 🚨 regression
15 datafusion:arrow -3.0% -2.6% -0.5% +10.3% ➖ noise
15 datafusion:vortex-compact -0.7% -2.6% +1.9% +11.7% ➖ noise
15 datafusion:vortex-file-compressed -0.6% -2.6% +2.0% +10.9% ➖ noise
15 duckdb:duckdb +4.2% -2.6% +7.0% +13.9% ➖ noise
15 duckdb:vortex-compact +1.0% -2.6% +3.7% +12.4% ➖ noise
15 duckdb:vortex-file-compressed +23.4% -2.6% +26.7% +11.1% 🚨 regression
16 datafusion:arrow +2.2% +2.0% +0.2% +10.0% ➖ noise
16 datafusion:vortex-compact +5.0% +2.0% +2.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.9% +2.0% -0.1% +10.0% ➖ noise
16 duckdb:duckdb -2.8% +2.0% -4.7% +10.0% ➖ noise
16 duckdb:vortex-compact +2.3% +2.0% +0.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +22.2% +2.0% +19.8% +10.0% 🚨 regression
17 datafusion:arrow +12.7% -1.0% +13.8% +12.8% 🚨 regression
17 datafusion:vortex-compact +1.6% -1.0% +2.6% +10.2% ➖ noise
17 datafusion:vortex-file-compressed -0.3% -1.0% +0.7% +10.0% ➖ noise
17 duckdb:duckdb +3.9% -1.0% +4.9% +10.7% ➖ noise
17 duckdb:vortex-compact +2.3% -1.0% +3.3% +14.3% ➖ noise
17 duckdb:vortex-file-compressed +20.0% -1.0% +21.2% +12.1% 🚨 regression
18 datafusion:arrow +23.1% +3.5% +18.9% +10.0% 🚨 regression
18 datafusion:vortex-compact -1.6% +3.5% -4.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.3% +3.5% -5.7% +10.0% ➖ noise
18 duckdb:duckdb -0.1% +3.5% -3.5% +10.0% ➖ noise
18 duckdb:vortex-compact +2.6% +3.5% -0.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +18.8% +3.5% +14.7% +10.0% 🚨 regression
19 datafusion:arrow +27.7% +1.4% +25.9% +17.0% 🚨 regression
19 datafusion:vortex-compact -3.2% +1.4% -4.5% +13.3% ➖ noise
19 datafusion:vortex-file-compressed +1.2% +1.4% -0.2% +14.1% ➖ noise
19 duckdb:duckdb +3.3% +1.4% +1.9% +16.2% ➖ noise
19 duckdb:vortex-compact +3.9% +1.4% +2.5% +15.4% ➖ noise
19 duckdb:vortex-file-compressed +25.8% +1.4% +24.1% +12.9% 🚨 regression
20 datafusion:arrow +26.9% +2.0% +24.4% +10.0% 🚨 regression
20 datafusion:vortex-compact -2.3% +2.0% -4.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.4% +2.0% -1.6% +10.0% ➖ noise
20 duckdb:duckdb +2.9% +2.0% +0.8% +10.9% ➖ noise
20 duckdb:vortex-compact +0.8% +2.0% -1.2% +10.5% ➖ noise
20 duckdb:vortex-file-compressed +20.8% +2.0% +18.4% +11.6% 🚨 regression
21 datafusion:arrow +16.7% +5.1% +11.0% +10.0% 🚨 regression
21 datafusion:vortex-compact +0.3% +5.1% -4.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.5% +5.1% -6.3% +10.0% ➖ noise
21 duckdb:duckdb +0.0% +5.1% -4.8% +10.0% ➖ noise
21 duckdb:vortex-compact +3.5% +5.1% -1.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +23.5% +5.1% +17.5% +10.0% 🚨 regression
22 datafusion:arrow +11.8% +1.2% +10.5% +10.0% 🚨 regression
22 datafusion:vortex-compact -0.1% +1.2% -1.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.4% +1.2% -0.8% +10.0% ➖ noise
22 duckdb:duckdb +1.8% +1.2% +0.6% +10.0% ➖ noise
22 duckdb:vortex-compact +6.5% +1.2% +5.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +20.0% +1.2% +18.5% +10.2% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 0.973x ➖
Parquet (geomean): 0.969x ➖
Shifts: Parquet (control) -3.1% · Median polish -2.6%


datafusion / vortex-file-compressed (0.953x ➖, 4↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25595753 26734404 0.96
tpcds_q02/datafusion:vortex-file-compressed 47861010 50003573 0.96
tpcds_q03/datafusion:vortex-file-compressed 17420258 18444024 0.94
tpcds_q04/datafusion:vortex-file-compressed 267175265 279591576 0.96
tpcds_q05/datafusion:vortex-file-compressed 45783548 47187320 0.97
tpcds_q06/datafusion:vortex-file-compressed 44256656 44810479 0.99
tpcds_q07/datafusion:vortex-file-compressed 44061332 47085099 0.94
tpcds_q08/datafusion:vortex-file-compressed 30672741 31680874 0.97
tpcds_q09/datafusion:vortex-file-compressed 47611885 46120871 1.03
tpcds_q10/datafusion:vortex-file-compressed 39604228 41533384 0.95
tpcds_q11/datafusion:vortex-file-compressed 153313862 157687974 0.97
tpcds_q12/datafusion:vortex-file-compressed 21682883 22642988 0.96
tpcds_q13/datafusion:vortex-file-compressed 47848167 47960513 1.00
tpcds_q14/datafusion:vortex-file-compressed 175179871 181247349 0.97
tpcds_q15/datafusion:vortex-file-compressed 30727380 32404477 0.95
tpcds_q16/datafusion:vortex-file-compressed 28883992 31625421 0.91
tpcds_q17/datafusion:vortex-file-compressed 64632842 66949238 0.97
tpcds_q18/datafusion:vortex-file-compressed 69245124 71608781 0.97
tpcds_q19/datafusion:vortex-file-compressed 25854392 25490351 1.01
tpcds_q20/datafusion:vortex-file-compressed 22741640 23866093 0.95
tpcds_q21/datafusion:vortex-file-compressed 125558339 129695199 0.97
tpcds_q22/datafusion:vortex-file-compressed 55810279 54308989 1.03
tpcds_q23/datafusion:vortex-file-compressed 129152715 135400517 0.95
tpcds_q24/datafusion:vortex-file-compressed 99903196 105616044 0.95
tpcds_q25/datafusion:vortex-file-compressed 67268992 69760639 0.96
tpcds_q26/datafusion:vortex-file-compressed 35204591 37323542 0.94
tpcds_q27/datafusion:vortex-file-compressed 100095688 108857982 0.92
tpcds_q28/datafusion:vortex-file-compressed 45472593 42248964 1.08
tpcds_q29/datafusion:vortex-file-compressed 68653105 67926630 1.01
tpcds_q30/datafusion:vortex-file-compressed 23672722 25515598 0.93
tpcds_q31/datafusion:vortex-file-compressed 85717935 94338193 0.91
tpcds_q32/datafusion:vortex-file-compressed 🚀 21563920 24110548 0.89
tpcds_q33/datafusion:vortex-file-compressed 30420573 32349888 0.94
tpcds_q34/datafusion:vortex-file-compressed 28558961 29735867 0.96
tpcds_q35/datafusion:vortex-file-compressed 49279463 52029457 0.95
tpcds_q36/datafusion:vortex-file-compressed 63316674 68222882 0.93
tpcds_q37/datafusion:vortex-file-compressed 30333702 33212951 0.91
tpcds_q38/datafusion:vortex-file-compressed 49775815 54268126 0.92
tpcds_q39/datafusion:vortex-file-compressed 🚀 133844896 148884582 0.90
tpcds_q40/datafusion:vortex-file-compressed 48148253 50789516 0.95
tpcds_q41/datafusion:vortex-file-compressed 🚀 15881761 17869123 0.89
tpcds_q42/datafusion:vortex-file-compressed 16697654 18538636 0.90
tpcds_q43/datafusion:vortex-file-compressed 28970433 29832431 0.97
tpcds_q44/datafusion:vortex-file-compressed 35989097 39241997 0.92
tpcds_q45/datafusion:vortex-file-compressed 31992263 34713654 0.92
tpcds_q46/datafusion:vortex-file-compressed 43385249 44258535 0.98
tpcds_q47/datafusion:vortex-file-compressed 190936108 197679147 0.97
tpcds_q48/datafusion:vortex-file-compressed 41219792 42082661 0.98
tpcds_q49/datafusion:vortex-file-compressed 58358947 61717044 0.95
tpcds_q50/datafusion:vortex-file-compressed 42026994 44221293 0.95
tpcds_q51/datafusion:vortex-file-compressed 89085479 89812605 0.99
tpcds_q52/datafusion:vortex-file-compressed 16481123 17593271 0.94
tpcds_q53/datafusion:vortex-file-compressed 22045617 22822286 0.97
tpcds_q54/datafusion:vortex-file-compressed 37083476 39709933 0.93
tpcds_q55/datafusion:vortex-file-compressed 15677535 17037573 0.92
tpcds_q56/datafusion:vortex-file-compressed 31411332 33365620 0.94
tpcds_q57/datafusion:vortex-file-compressed 115996039 128467327 0.90
tpcds_q58/datafusion:vortex-file-compressed 64002911 66818205 0.96
tpcds_q59/datafusion:vortex-file-compressed 66076238 68723619 0.96
tpcds_q60/datafusion:vortex-file-compressed 32959796 33406794 0.99
tpcds_q61/datafusion:vortex-file-compressed 41730734 43178347 0.97
tpcds_q62/datafusion:vortex-file-compressed 28537976 29950876 0.95
tpcds_q63/datafusion:vortex-file-compressed 21562534 22900458 0.94
tpcds_q64/datafusion:vortex-file-compressed 430157471 448910178 0.96
tpcds_q65/datafusion:vortex-file-compressed 43209111 45708643 0.95
tpcds_q66/datafusion:vortex-file-compressed 82878224 88082606 0.94
tpcds_q67/datafusion:vortex-file-compressed 119150243 120384921 0.99
tpcds_q68/datafusion:vortex-file-compressed 41622151 41394124 1.01
tpcds_q69/datafusion:vortex-file-compressed 37135869 39591790 0.94
tpcds_q70/datafusion:vortex-file-compressed 99944522 105668038 0.95
tpcds_q71/datafusion:vortex-file-compressed 25883581 26453792 0.98
tpcds_q72/datafusion:vortex-file-compressed 2384053151 2519251880 0.95
tpcds_q73/datafusion:vortex-file-compressed 26919622 28271970 0.95
tpcds_q74/datafusion:vortex-file-compressed 100448691 106927646 0.94
tpcds_q75/datafusion:vortex-file-compressed 110638360 114250861 0.97
tpcds_q76/datafusion:vortex-file-compressed 27160876 29009810 0.94
tpcds_q77/datafusion:vortex-file-compressed 40608479 41778848 0.97
tpcds_q78/datafusion:vortex-file-compressed 123998580 132662254 0.93
tpcds_q79/datafusion:vortex-file-compressed 34591945 34100458 1.01
tpcds_q80/datafusion:vortex-file-compressed 96160354 103575483 0.93
tpcds_q81/datafusion:vortex-file-compressed 29763832 29167832 1.02
tpcds_q82/datafusion:vortex-file-compressed 34701624 34713064 1.00
tpcds_q83/datafusion:vortex-file-compressed 42657557 45491681 0.94
tpcds_q84/datafusion:vortex-file-compressed 13277021 14417070 0.92
tpcds_q85/datafusion:vortex-file-compressed 92102156 97431217 0.95
tpcds_q86/datafusion:vortex-file-compressed 18736692 20555775 0.91
tpcds_q87/datafusion:vortex-file-compressed 50056352 54128365 0.92
tpcds_q88/datafusion:vortex-file-compressed 57077448 61011162 0.94
tpcds_q89/datafusion:vortex-file-compressed 31905122 34290908 0.93
tpcds_q90/datafusion:vortex-file-compressed 14932096 15809107 0.94
tpcds_q91/datafusion:vortex-file-compressed 21445811 22809674 0.94
tpcds_q92/datafusion:vortex-file-compressed 🚀 19590968 21883057 0.90
tpcds_q93/datafusion:vortex-file-compressed 33755462 34693971 0.97
tpcds_q94/datafusion:vortex-file-compressed 25104546 25590967 0.98
tpcds_q95/datafusion:vortex-file-compressed 60030603 61682286 0.97
tpcds_q96/datafusion:vortex-file-compressed 13872646 14200744 0.98
tpcds_q97/datafusion:vortex-file-compressed 34673375 36525687 0.95
tpcds_q98/datafusion:vortex-file-compressed 28234958 29798969 0.95
tpcds_q99/datafusion:vortex-file-compressed 41012638 44191829 0.93
datafusion / vortex-compact (0.967x ➖, 3↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26983677 28273745 0.95
tpcds_q02/datafusion:vortex-compact 52079769 55420738 0.94
tpcds_q03/datafusion:vortex-compact 22390657 23194321 0.97
tpcds_q04/datafusion:vortex-compact 301450332 305697540 0.99
tpcds_q05/datafusion:vortex-compact 50276803 52765489 0.95
tpcds_q06/datafusion:vortex-compact 45596876 50240103 0.91
tpcds_q07/datafusion:vortex-compact 55929246 56523052 0.99
tpcds_q08/datafusion:vortex-compact 37452642 38096643 0.98
tpcds_q09/datafusion:vortex-compact 63702680 64753305 0.98
tpcds_q10/datafusion:vortex-compact 51194218 53130614 0.96
tpcds_q11/datafusion:vortex-compact 166391005 172274057 0.97
tpcds_q12/datafusion:vortex-compact 26387083 27081429 0.97
tpcds_q13/datafusion:vortex-compact 96144321 97583792 0.99
tpcds_q14/datafusion:vortex-compact 202837573 208985712 0.97
tpcds_q15/datafusion:vortex-compact 34232817 35697155 0.96
tpcds_q16/datafusion:vortex-compact 33508462 34991440 0.96
tpcds_q17/datafusion:vortex-compact 80251384 77863717 1.03
tpcds_q18/datafusion:vortex-compact 79886141 82985578 0.96
tpcds_q19/datafusion:vortex-compact 33695417 35656520 0.95
tpcds_q20/datafusion:vortex-compact 26856051 28125499 0.95
tpcds_q21/datafusion:vortex-compact 134472523 132845152 1.01
tpcds_q22/datafusion:vortex-compact 61460210 63150328 0.97
tpcds_q23/datafusion:vortex-compact 142507638 151788377 0.94
tpcds_q24/datafusion:vortex-compact 115214849 117886167 0.98
tpcds_q25/datafusion:vortex-compact 78516079 85336478 0.92
tpcds_q26/datafusion:vortex-compact 45729354 48150945 0.95
tpcds_q27/datafusion:vortex-compact 126198757 131588871 0.96
tpcds_q28/datafusion:vortex-compact 82347147 78765174 1.05
tpcds_q29/datafusion:vortex-compact 76930459 80183720 0.96
tpcds_q30/datafusion:vortex-compact 27952770 29312741 0.95
tpcds_q31/datafusion:vortex-compact 112582815 113096739 1.00
tpcds_q32/datafusion:vortex-compact 26833697 28699841 0.93
tpcds_q33/datafusion:vortex-compact 37484539 39843968 0.94
tpcds_q34/datafusion:vortex-compact 36226334 39187417 0.92
tpcds_q35/datafusion:vortex-compact 54997638 58129682 0.95
tpcds_q36/datafusion:vortex-compact 81105307 83112613 0.98
tpcds_q37/datafusion:vortex-compact 45091215 46440935 0.97
tpcds_q38/datafusion:vortex-compact 56692603 59730866 0.95
tpcds_q39/datafusion:vortex-compact 137569825 137952606 1.00
tpcds_q40/datafusion:vortex-compact 51316038 52811218 0.97
tpcds_q41/datafusion:vortex-compact 19342565 19404847 1.00
tpcds_q42/datafusion:vortex-compact 21554549 20971266 1.03
tpcds_q43/datafusion:vortex-compact 33926791 36399606 0.93
tpcds_q44/datafusion:vortex-compact 53500985 55574801 0.96
tpcds_q45/datafusion:vortex-compact 35146999 37000675 0.95
tpcds_q46/datafusion:vortex-compact 51661890 52383581 0.99
tpcds_q47/datafusion:vortex-compact 201683225 214957200 0.94
tpcds_q48/datafusion:vortex-compact 74607930 76680059 0.97
tpcds_q49/datafusion:vortex-compact 68702957 70461544 0.98
tpcds_q50/datafusion:vortex-compact 51111924 51156729 1.00
tpcds_q51/datafusion:vortex-compact 96761775 98171801 0.99
tpcds_q52/datafusion:vortex-compact 21167318 20733479 1.02
tpcds_q53/datafusion:vortex-compact 28963663 28958042 1.00
tpcds_q54/datafusion:vortex-compact 45674526 45841236 1.00
tpcds_q55/datafusion:vortex-compact 20794023 21864330 0.95
tpcds_q56/datafusion:vortex-compact 39226314 39890558 0.98
tpcds_q57/datafusion:vortex-compact 126842232 134740363 0.94
tpcds_q58/datafusion:vortex-compact 75940773 77960907 0.97
tpcds_q59/datafusion:vortex-compact 75083155 78200359 0.96
tpcds_q60/datafusion:vortex-compact 38155948 39196706 0.97
tpcds_q61/datafusion:vortex-compact 57198213 56268437 1.02
tpcds_q62/datafusion:vortex-compact 31747872 33234851 0.96
tpcds_q63/datafusion:vortex-compact 28925441 30643335 0.94
tpcds_q64/datafusion:vortex-compact 480139577 487841540 0.98
tpcds_q65/datafusion:vortex-compact 59147484 59495901 0.99
tpcds_q66/datafusion:vortex-compact 90002158 88101142 1.02
tpcds_q67/datafusion:vortex-compact 113761777 121248234 0.94
tpcds_q68/datafusion:vortex-compact 51513498 54340608 0.95
tpcds_q69/datafusion:vortex-compact 48529255 51390648 0.94
tpcds_q70/datafusion:vortex-compact 114532783 117824161 0.97
tpcds_q71/datafusion:vortex-compact 32478994 33328136 0.97
tpcds_q72/datafusion:vortex-compact 2406429846 2511771369 0.96
tpcds_q73/datafusion:vortex-compact 35279207 36282571 0.97
tpcds_q74/datafusion:vortex-compact 123598521 115524583 1.07
tpcds_q75/datafusion:vortex-compact 127729832 136554128 0.94
tpcds_q76/datafusion:vortex-compact 36004618 36643482 0.98
tpcds_q77/datafusion:vortex-compact 52112270 54757456 0.95
tpcds_q78/datafusion:vortex-compact 138758730 143630273 0.97
tpcds_q79/datafusion:vortex-compact 43075090 44547490 0.97
tpcds_q80/datafusion:vortex-compact 106342657 109144453 0.97
tpcds_q81/datafusion:vortex-compact 33830696 34321056 0.99
tpcds_q82/datafusion:vortex-compact 46483507 48197980 0.96
tpcds_q83/datafusion:vortex-compact 46073954 49733978 0.93
tpcds_q84/datafusion:vortex-compact 16334097 16054822 1.02
tpcds_q85/datafusion:vortex-compact 128279671 121720514 1.05
tpcds_q86/datafusion:vortex-compact 20535816 22749490 0.90
tpcds_q87/datafusion:vortex-compact 56853568 60145179 0.95
tpcds_q88/datafusion:vortex-compact 79818355 82279668 0.97
tpcds_q89/datafusion:vortex-compact 37822749 40346160 0.94
tpcds_q90/datafusion:vortex-compact 15290479 16464181 0.93
tpcds_q91/datafusion:vortex-compact 35481222 37387328 0.95
tpcds_q92/datafusion:vortex-compact 26807437 27234936 0.98
tpcds_q93/datafusion:vortex-compact 38602870 39711910 0.97
tpcds_q94/datafusion:vortex-compact 28810962 27702933 1.04
tpcds_q95/datafusion:vortex-compact 64651691 67446823 0.96
tpcds_q96/datafusion:vortex-compact 🚀 17440830 19591352 0.89
tpcds_q97/datafusion:vortex-compact 🚀 37426767 42060878 0.89
tpcds_q98/datafusion:vortex-compact 🚀 32361283 37645656 0.86
tpcds_q99/datafusion:vortex-compact 46477304 45171056 1.03
datafusion / parquet (0.966x ➖, 3↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 32549705 31010547 1.05
tpcds_q02/datafusion:parquet 42682144 42058561 1.01
tpcds_q03/datafusion:parquet 13066194 13903823 0.94
tpcds_q04/datafusion:parquet 258998570 274849984 0.94
tpcds_q05/datafusion:parquet 41456171 41867592 0.99
tpcds_q06/datafusion:parquet 60494095 58398916 1.04
tpcds_q07/datafusion:parquet 77653295 80725686 0.96
tpcds_q08/datafusion:parquet 26278291 26032346 1.01
tpcds_q09/datafusion:parquet 45613517 44345298 1.03
tpcds_q10/datafusion:parquet 75065510 74102338 1.01
tpcds_q11/datafusion:parquet 155289092 146777355 1.06
tpcds_q12/datafusion:parquet 17668560 18361459 0.96
tpcds_q13/datafusion:parquet 75415706 76523484 0.99
tpcds_q14/datafusion:parquet 165614138 166776501 0.99
tpcds_q15/datafusion:parquet 20677334 21769255 0.95
tpcds_q16/datafusion:parquet 23767993 25964746 0.92
tpcds_q17/datafusion:parquet 63066570 68370767 0.92
tpcds_q18/datafusion:parquet 114051470 115169000 0.99
tpcds_q19/datafusion:parquet 23164942 23452131 0.99
tpcds_q20/datafusion:parquet 16013272 16515669 0.97
tpcds_q21/datafusion:parquet 18505509 18863951 0.98
tpcds_q22/datafusion:parquet 142884669 132988592 1.07
tpcds_q23/datafusion:parquet 145951438 147927034 0.99
tpcds_q24/datafusion:parquet 90665489 91779168 0.99
tpcds_q25/datafusion:parquet 65016558 65367344 0.99
tpcds_q26/datafusion:parquet 65300700 70015845 0.93
tpcds_q27/datafusion:parquet 147719690 152913817 0.97
tpcds_q28/datafusion:parquet 44876310 45430679 0.99
tpcds_q29/datafusion:parquet 63291078 69720853 0.91
tpcds_q30/datafusion:parquet 34382077 36335000 0.95
tpcds_q31/datafusion:parquet 64978900 67553474 0.96
tpcds_q32/datafusion:parquet 18952897 19973770 0.95
tpcds_q33/datafusion:parquet 26923733 28375612 0.95
tpcds_q34/datafusion:parquet 22233579 22444047 0.99
tpcds_q35/datafusion:parquet 69214708 74755500 0.93
tpcds_q36/datafusion:parquet 57106834 59470925 0.96
tpcds_q37/datafusion:parquet 19089046 21006190 0.91
tpcds_q38/datafusion:parquet 🚀 38702202 43180698 0.90
tpcds_q39/datafusion:parquet 70317552 77693343 0.91
tpcds_q40/datafusion:parquet 24988309 24272677 1.03
tpcds_q41/datafusion:parquet 13208317 14344406 0.92
tpcds_q42/datafusion:parquet 11873785 12625297 0.94
tpcds_q43/datafusion:parquet 16546420 16865987 0.98
tpcds_q44/datafusion:parquet 33278967 35486736 0.94
tpcds_q45/datafusion:parquet 27871205 28949798 0.96
tpcds_q46/datafusion:parquet 31472350 32959374 0.95
tpcds_q47/datafusion:parquet 126877901 130731376 0.97
tpcds_q48/datafusion:parquet 68953204 71768993 0.96
tpcds_q49/datafusion:parquet 57699226 57271592 1.01
tpcds_q50/datafusion:parquet 42749979 44488274 0.96
tpcds_q51/datafusion:parquet 82389403 83781641 0.98
tpcds_q52/datafusion:parquet 🚀 12215867 14558238 0.84
tpcds_q53/datafusion:parquet 17633532 18653475 0.95
tpcds_q54/datafusion:parquet 35011182 35860836 0.98
tpcds_q55/datafusion:parquet 11978965 11421568 1.05
tpcds_q56/datafusion:parquet 28420642 28383365 1.00
tpcds_q57/datafusion:parquet 91647835 94031154 0.97
tpcds_q58/datafusion:parquet 49589708 50184454 0.99
tpcds_q59/datafusion:parquet 52999289 54324253 0.98
tpcds_q60/datafusion:parquet 27397909 28899777 0.95
tpcds_q61/datafusion:parquet 41812898 44064375 0.95
tpcds_q62/datafusion:parquet 🚨 24603735 20864883 1.18
tpcds_q63/datafusion:parquet 17806383 17846445 1.00
tpcds_q64/datafusion:parquet 515365263 540839782 0.95
tpcds_q65/datafusion:parquet 38429629 39629927 0.97
tpcds_q66/datafusion:parquet 68836572 69093020 1.00
tpcds_q67/datafusion:parquet 138965545 150240731 0.92
tpcds_q68/datafusion:parquet 31599060 33492269 0.94
tpcds_q69/datafusion:parquet 70383527 72717073 0.97
tpcds_q70/datafusion:parquet 83670900 90116978 0.93
tpcds_q71/datafusion:parquet 21831751 23196308 0.94
tpcds_q72/datafusion:parquet 601246425 642215938 0.94
tpcds_q73/datafusion:parquet 20992614 22323687 0.94
tpcds_q74/datafusion:parquet 83649316 89098397 0.94
tpcds_q75/datafusion:parquet 98533098 102286773 0.96
tpcds_q76/datafusion:parquet 30055955 31233014 0.96
tpcds_q77/datafusion:parquet 39383426 39824484 0.99
tpcds_q78/datafusion:parquet 110280748 118550266 0.93
tpcds_q79/datafusion:parquet 27583657 27381947 1.01
tpcds_q80/datafusion:parquet 79099906 82714891 0.96
tpcds_q81/datafusion:parquet 31715418 32954023 0.96
tpcds_q82/datafusion:parquet 19031902 21112616 0.90
tpcds_q83/datafusion:parquet 35794310 39221236 0.91
tpcds_q84/datafusion:parquet 39533397 40979064 0.96
tpcds_q85/datafusion:parquet 148896033 153740800 0.97
tpcds_q86/datafusion:parquet 15914033 16567513 0.96
tpcds_q87/datafusion:parquet 41452504 42457382 0.98
tpcds_q88/datafusion:parquet 61004993 60683236 1.01
tpcds_q89/datafusion:parquet 21589151 22274121 0.97
tpcds_q90/datafusion:parquet 14403661 15386674 0.94
tpcds_q91/datafusion:parquet 57726801 62147950 0.93
tpcds_q92/datafusion:parquet 18463681 18560435 0.99
tpcds_q93/datafusion:parquet 31882232 33074461 0.96
tpcds_q94/datafusion:parquet 20010661 20400092 0.98
tpcds_q95/datafusion:parquet 58094379 59082967 0.98
tpcds_q96/datafusion:parquet 11755373 12830137 0.92
tpcds_q97/datafusion:parquet 29836969 31542001 0.95
tpcds_q98/datafusion:parquet 21046301 22020582 0.96
tpcds_q99/datafusion:parquet 🚀 24507910 28892719 0.85
duckdb / vortex-file-compressed (0.981x ➖, 3↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21488211 22736167 0.95
tpcds_q02/duckdb:vortex-file-compressed 🚨 36968590 28623477 1.29
tpcds_q03/duckdb:vortex-file-compressed 32460415 32045367 1.01
tpcds_q04/duckdb:vortex-file-compressed 🚀 105779088 118174600 0.90
tpcds_q05/duckdb:vortex-file-compressed 36397433 38818232 0.94
tpcds_q06/duckdb:vortex-file-compressed 32432117 33629241 0.96
tpcds_q07/duckdb:vortex-file-compressed 19944303 20305973 0.98
tpcds_q08/duckdb:vortex-file-compressed 29346227 28692688 1.02
tpcds_q09/duckdb:vortex-file-compressed 38927812 40698341 0.96
tpcds_q10/duckdb:vortex-file-compressed 40323407 40985427 0.98
tpcds_q11/duckdb:vortex-file-compressed 59754233 62792368 0.95
tpcds_q12/duckdb:vortex-file-compressed 14555740 15258955 0.95
tpcds_q13/duckdb:vortex-file-compressed 33807231 33945034 1.00
tpcds_q14/duckdb:vortex-file-compressed 105185632 106339540 0.99
tpcds_q15/duckdb:vortex-file-compressed 26893158 27697612 0.97
tpcds_q16/duckdb:vortex-file-compressed 27528220 27571330 1.00
tpcds_q17/duckdb:vortex-file-compressed 43625175 43838596 1.00
tpcds_q18/duckdb:vortex-file-compressed 46641241 47301867 0.99
tpcds_q19/duckdb:vortex-file-compressed 33167088 33492791 0.99
tpcds_q20/duckdb:vortex-file-compressed 15763090 15875834 0.99
tpcds_q21/duckdb:vortex-file-compressed 16761816 18326283 0.91
tpcds_q22/duckdb:vortex-file-compressed 70026449 71666926 0.98
tpcds_q23/duckdb:vortex-file-compressed 108820426 114441394 0.95
tpcds_q24/duckdb:vortex-file-compressed 49712157 48978748 1.01
tpcds_q25/duckdb:vortex-file-compressed 50357452 50474980 1.00
tpcds_q26/duckdb:vortex-file-compressed 40182434 42757316 0.94
tpcds_q27/duckdb:vortex-file-compressed 50207039 51773138 0.97
tpcds_q28/duckdb:vortex-file-compressed 35394938 36563701 0.97
tpcds_q29/duckdb:vortex-file-compressed 42085503 43628776 0.96
tpcds_q30/duckdb:vortex-file-compressed 25785557 25274080 1.02
tpcds_q31/duckdb:vortex-file-compressed 36446866 36093327 1.01
tpcds_q32/duckdb:vortex-file-compressed 14351378 15006396 0.96
tpcds_q33/duckdb:vortex-file-compressed 25470611 24363314 1.05
tpcds_q34/duckdb:vortex-file-compressed 23858952 24594957 0.97
tpcds_q35/duckdb:vortex-file-compressed 69325769 66189223 1.05
tpcds_q36/duckdb:vortex-file-compressed 24966981 25422098 0.98
tpcds_q37/duckdb:vortex-file-compressed 15726433 16747977 0.94
tpcds_q38/duckdb:vortex-file-compressed 36843818 39051590 0.94
tpcds_q39/duckdb:vortex-file-compressed 34605785 33591829 1.03
tpcds_q40/duckdb:vortex-file-compressed 19751054 20116587 0.98
tpcds_q41/duckdb:vortex-file-compressed 12955752 13410114 0.97
tpcds_q42/duckdb:vortex-file-compressed 13567148 12772953 1.06
tpcds_q43/duckdb:vortex-file-compressed 23877902 24830941 0.96
tpcds_q44/duckdb:vortex-file-compressed 22087120 21682196 1.02
tpcds_q45/duckdb:vortex-file-compressed 29023067 29727715 0.98
tpcds_q46/duckdb:vortex-file-compressed 52370104 52806008 0.99
tpcds_q47/duckdb:vortex-file-compressed 47742461 50787675 0.94
tpcds_q48/duckdb:vortex-file-compressed 32881716 31718858 1.04
tpcds_q49/duckdb:vortex-file-compressed 33077751 36359068 0.91
tpcds_q50/duckdb:vortex-file-compressed 33889535 35727989 0.95
tpcds_q51/duckdb:vortex-file-compressed 102041583 98357590 1.04
tpcds_q52/duckdb:vortex-file-compressed 12831215 12824024 1.00
tpcds_q53/duckdb:vortex-file-compressed 23294769 24039410 0.97
tpcds_q54/duckdb:vortex-file-compressed 29676923 29860839 0.99
tpcds_q55/duckdb:vortex-file-compressed 13695439 14023869 0.98
tpcds_q56/duckdb:vortex-file-compressed 25025432 25433865 0.98
tpcds_q57/duckdb:vortex-file-compressed 🚀 39809764 47855664 0.83
tpcds_q58/duckdb:vortex-file-compressed 30160611 32756943 0.92
tpcds_q59/duckdb:vortex-file-compressed 68657352 68202700 1.01
tpcds_q60/duckdb:vortex-file-compressed 26826269 27808515 0.96
tpcds_q61/duckdb:vortex-file-compressed 35072647 36537749 0.96
tpcds_q62/duckdb:vortex-file-compressed 17379353 19176828 0.91
tpcds_q63/duckdb:vortex-file-compressed 22801349 22152827 1.03
tpcds_q64/duckdb:vortex-file-compressed 83357674 88970333 0.94
tpcds_q65/duckdb:vortex-file-compressed 22321164 24413694 0.91
tpcds_q66/duckdb:vortex-file-compressed 29898791 30095150 0.99
tpcds_q67/duckdb:vortex-file-compressed 138817900 136960874 1.01
tpcds_q68/duckdb:vortex-file-compressed 41187180 42095777 0.98
tpcds_q69/duckdb:vortex-file-compressed 42806635 43827528 0.98
tpcds_q70/duckdb:vortex-file-compressed 25869113 27010890 0.96
tpcds_q71/duckdb:vortex-file-compressed 22249558 21968468 1.01
tpcds_q72/duckdb:vortex-file-compressed 171097815 171623828 1.00
tpcds_q73/duckdb:vortex-file-compressed 23393986 23770188 0.98
tpcds_q74/duckdb:vortex-file-compressed 74883089 74058408 1.01
tpcds_q75/duckdb:vortex-file-compressed 57362692 58625054 0.98
tpcds_q76/duckdb:vortex-file-compressed 18899420 20029162 0.94
tpcds_q77/duckdb:vortex-file-compressed 25177101 26453450 0.95
tpcds_q78/duckdb:vortex-file-compressed 76423885 75658803 1.01
tpcds_q79/duckdb:vortex-file-compressed 33077162 34079960 0.97
tpcds_q80/duckdb:vortex-file-compressed 49828614 50920633 0.98
tpcds_q81/duckdb:vortex-file-compressed 29021271 29691932 0.98
tpcds_q82/duckdb:vortex-file-compressed 17617192 16805611 1.05
tpcds_q83/duckdb:vortex-file-compressed 24916528 25278559 0.99
tpcds_q84/duckdb:vortex-file-compressed 19568213 20863959 0.94
tpcds_q85/duckdb:vortex-file-compressed 44805828 45317112 0.99
tpcds_q86/duckdb:vortex-file-compressed 16942357 17636639 0.96
tpcds_q87/duckdb:vortex-file-compressed 40521655 39751678 1.02
tpcds_q88/duckdb:vortex-file-compressed 34026372 36492588 0.93
tpcds_q89/duckdb:vortex-file-compressed 22732506 23256807 0.98
tpcds_q90/duckdb:vortex-file-compressed 13399063 13498905 0.99
tpcds_q91/duckdb:vortex-file-compressed 33583735 32637413 1.03
tpcds_q92/duckdb:vortex-file-compressed 21762993 22408491 0.97
tpcds_q93/duckdb:vortex-file-compressed 28975058 28197474 1.03
tpcds_q94/duckdb:vortex-file-compressed 23584797 23707912 0.99
tpcds_q95/duckdb:vortex-file-compressed 154713710 153948836 1.00
tpcds_q96/duckdb:vortex-file-compressed 14354167 13462605 1.07
tpcds_q97/duckdb:vortex-file-compressed 39338847 39283007 1.00
tpcds_q98/duckdb:vortex-file-compressed 18290138 19222261 0.95
tpcds_q99/duckdb:vortex-file-compressed 🚀 26932361 30029448 0.90
duckdb / vortex-compact (0.991x ➖, 1↑ 4↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24355852 25293920 0.96
tpcds_q02/duckdb:vortex-compact 41926490 43026763 0.97
tpcds_q03/duckdb:vortex-compact 57412790 57355256 1.00
tpcds_q04/duckdb:vortex-compact 124152758 123376511 1.01
tpcds_q05/duckdb:vortex-compact 53494801 55085888 0.97
tpcds_q06/duckdb:vortex-compact 40779310 42057778 0.97
tpcds_q07/duckdb:vortex-compact 34954375 35742303 0.98
tpcds_q08/duckdb:vortex-compact 44129199 46943757 0.94
tpcds_q09/duckdb:vortex-compact 58413246 58585689 1.00
tpcds_q10/duckdb:vortex-compact 63752135 63812838 1.00
tpcds_q11/duckdb:vortex-compact 71051497 72444439 0.98
tpcds_q12/duckdb:vortex-compact 23476884 22456133 1.05
tpcds_q13/duckdb:vortex-compact 59458847 60945293 0.98
tpcds_q14/duckdb:vortex-compact 135344525 135235915 1.00
tpcds_q15/duckdb:vortex-compact 31383977 33938575 0.92
tpcds_q16/duckdb:vortex-compact 30346613 32303796 0.94
tpcds_q17/duckdb:vortex-compact 54418059 55714907 0.98
tpcds_q18/duckdb:vortex-compact 57743827 59570569 0.97
tpcds_q19/duckdb:vortex-compact 51173933 54364885 0.94
tpcds_q20/duckdb:vortex-compact 20595137 21281700 0.97
tpcds_q21/duckdb:vortex-compact 20585349 19450408 1.06
tpcds_q22/duckdb:vortex-compact 73494493 73144314 1.00
tpcds_q23/duckdb:vortex-compact 🚨 136742443 122856607 1.11
tpcds_q24/duckdb:vortex-compact 64456170 63365742 1.02
tpcds_q25/duckdb:vortex-compact 82411969 82434908 1.00
tpcds_q26/duckdb:vortex-compact 51667507 53971121 0.96
tpcds_q27/duckdb:vortex-compact 69467238 71200766 0.98
tpcds_q28/duckdb:vortex-compact 82859571 87738610 0.94
tpcds_q29/duckdb:vortex-compact 55536217 57246265 0.97
tpcds_q30/duckdb:vortex-compact 28996458 30297003 0.96
tpcds_q31/duckdb:vortex-compact 45870373 46141847 0.99
tpcds_q32/duckdb:vortex-compact 22926762 23342361 0.98
tpcds_q33/duckdb:vortex-compact 37857733 37080183 1.02
tpcds_q34/duckdb:vortex-compact 38975567 40550383 0.96
tpcds_q35/duckdb:vortex-compact 82864252 84865632 0.98
tpcds_q36/duckdb:vortex-compact 41093378 43244883 0.95
tpcds_q37/duckdb:vortex-compact 23778025 24898476 0.95
tpcds_q38/duckdb:vortex-compact 49540075 45632715 1.09
tpcds_q39/duckdb:vortex-compact 36924314 36721106 1.01
tpcds_q40/duckdb:vortex-compact 24838207 27225405 0.91
tpcds_q41/duckdb:vortex-compact 15581222 15677155 0.99
tpcds_q42/duckdb:vortex-compact 22033991 22711431 0.97
tpcds_q43/duckdb:vortex-compact 🚨 39063737 34776341 1.12
tpcds_q44/duckdb:vortex-compact 30878469 30541867 1.01
tpcds_q45/duckdb:vortex-compact 39521982 39454540 1.00
tpcds_q46/duckdb:vortex-compact 75395854 71066569 1.06
tpcds_q47/duckdb:vortex-compact 64307514 65285996 0.99
tpcds_q48/duckdb:vortex-compact 52583555 51913645 1.01
tpcds_q49/duckdb:vortex-compact 59280310 62299454 0.95
tpcds_q50/duckdb:vortex-compact 47928055 48952650 0.98
tpcds_q51/duckdb:vortex-compact 113777495 111160912 1.02
tpcds_q52/duckdb:vortex-compact 23071329 22559895 1.02
tpcds_q53/duckdb:vortex-compact 38994690 39052861 1.00
tpcds_q54/duckdb:vortex-compact 🚨 43727386 38895390 1.12
tpcds_q55/duckdb:vortex-compact 23268714 23318616 1.00
tpcds_q56/duckdb:vortex-compact 37136765 37861757 0.98
tpcds_q57/duckdb:vortex-compact 45399762 44867665 1.01
tpcds_q58/duckdb:vortex-compact 41883717 43790087 0.96
tpcds_q59/duckdb:vortex-compact 92630748 90066287 1.03
tpcds_q60/duckdb:vortex-compact 39844947 39787850 1.00
tpcds_q61/duckdb:vortex-compact 68945040 68675158 1.00
tpcds_q62/duckdb:vortex-compact 25055615 26917274 0.93
tpcds_q63/duckdb:vortex-compact 40763857 38896568 1.05
tpcds_q64/duckdb:vortex-compact 116468650 122800918 0.95
tpcds_q65/duckdb:vortex-compact 35707881 33565270 1.06
tpcds_q66/duckdb:vortex-compact 39865291 41018434 0.97
tpcds_q67/duckdb:vortex-compact 150672300 155936997 0.97
tpcds_q68/duckdb:vortex-compact 62839925 61353528 1.02
tpcds_q69/duckdb:vortex-compact 64915871 66532129 0.98
tpcds_q70/duckdb:vortex-compact 37547126 37479971 1.00
tpcds_q71/duckdb:vortex-compact 34066385 33624677 1.01
tpcds_q72/duckdb:vortex-compact 194204496 193109335 1.01
tpcds_q73/duckdb:vortex-compact 38919153 38739585 1.00
tpcds_q74/duckdb:vortex-compact 80454611 86403303 0.93
tpcds_q75/duckdb:vortex-compact 77989605 74293553 1.05
tpcds_q76/duckdb:vortex-compact 35563797 36629695 0.97
tpcds_q77/duckdb:vortex-compact 44271373 42415586 1.04
tpcds_q78/duckdb:vortex-compact 88282332 89714048 0.98
tpcds_q79/duckdb:vortex-compact 54344514 55021085 0.99
tpcds_q80/duckdb:vortex-compact 80455111 85414537 0.94
tpcds_q81/duckdb:vortex-compact 34379050 34574491 0.99
tpcds_q82/duckdb:vortex-compact 26065163 26115500 1.00
tpcds_q83/duckdb:vortex-compact 32349778 34105106 0.95
tpcds_q84/duckdb:vortex-compact 27387883 27568320 0.99
tpcds_q85/duckdb:vortex-compact 58187862 59770043 0.97
tpcds_q86/duckdb:vortex-compact 🚨 25366105 22724180 1.12
tpcds_q87/duckdb:vortex-compact 53803345 51626693 1.04
tpcds_q88/duckdb:vortex-compact 40475632 40920591 0.99
tpcds_q89/duckdb:vortex-compact 38872704 38326568 1.01
tpcds_q90/duckdb:vortex-compact 15225040 15892079 0.96
tpcds_q91/duckdb:vortex-compact 49775660 54950787 0.91
tpcds_q92/duckdb:vortex-compact 45298365 47788640 0.95
tpcds_q93/duckdb:vortex-compact 32433828 31618765 1.03
tpcds_q94/duckdb:vortex-compact 🚀 29933543 34824130 0.86
tpcds_q95/duckdb:vortex-compact 159882778 164343973 0.97
tpcds_q96/duckdb:vortex-compact 18419795 18502939 1.00
tpcds_q97/duckdb:vortex-compact 46030066 44209622 1.04
tpcds_q98/duckdb:vortex-compact 30143796 29414680 1.02
tpcds_q99/duckdb:vortex-compact 30757779 33367528 0.92
duckdb / parquet (0.972x ➖, 5↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 26942212 28457279 0.95
tpcds_q02/duckdb:parquet 23781584 23716920 1.00
tpcds_q03/duckdb:parquet 11928458 11593444 1.03
tpcds_q04/duckdb:parquet 165799613 167491730 0.99
tpcds_q05/duckdb:parquet 28189115 30559975 0.92
tpcds_q06/duckdb:parquet 27448857 27475880 1.00
tpcds_q07/duckdb:parquet 21114519 20852352 1.01
tpcds_q08/duckdb:parquet 26619477 27215945 0.98
tpcds_q09/duckdb:parquet 39329963 39969373 0.98
tpcds_q10/duckdb:parquet 32426218 32894050 0.99
tpcds_q11/duckdb:parquet 88799461 91636014 0.97
tpcds_q12/duckdb:parquet 15017740 14971401 1.00
tpcds_q13/duckdb:parquet 32490837 32413270 1.00
tpcds_q14/duckdb:parquet 98781556 101251258 0.98
tpcds_q15/duckdb:parquet 30042756 29523602 1.02
tpcds_q16/duckdb:parquet 21028104 20686197 1.02
tpcds_q17/duckdb:parquet 36109933 35883777 1.01
tpcds_q18/duckdb:parquet 45370634 45608630 0.99
tpcds_q19/duckdb:parquet 28149673 29315078 0.96
tpcds_q20/duckdb:parquet 15395376 15010335 1.03
tpcds_q21/duckdb:parquet 🚀 9805958 10986828 0.89
tpcds_q22/duckdb:parquet 67209982 71604218 0.94
tpcds_q23/duckdb:parquet 79197509 79777519 0.99
tpcds_q24/duckdb:parquet 43095177 45184197 0.95
tpcds_q25/duckdb:parquet 32887511 33137960 0.99
tpcds_q26/duckdb:parquet 36365829 35820310 1.02
tpcds_q27/duckdb:parquet 47918142 49730452 0.96
tpcds_q28/duckdb:parquet 38062702 37588485 1.01
tpcds_q29/duckdb:parquet 33420694 36158912 0.92
tpcds_q30/duckdb:parquet 33937234 34050940 1.00
tpcds_q31/duckdb:parquet 22237518 23965938 0.93
tpcds_q32/duckdb:parquet 10781914 10788653 1.00
tpcds_q33/duckdb:parquet 20294847 20837801 0.97
tpcds_q34/duckdb:parquet 20279001 21598058 0.94
tpcds_q35/duckdb:parquet 59055996 57569257 1.03
tpcds_q36/duckdb:parquet 19550103 21121921 0.93
tpcds_q37/duckdb:parquet 11923077 12287831 0.97
tpcds_q38/duckdb:parquet 33789964 32897459 1.03
tpcds_q39/duckdb:parquet 28276605 30666376 0.92
tpcds_q40/duckdb:parquet 🚀 17498607 19516412 0.90
tpcds_q41/duckdb:parquet 7498358 8037701 0.93
tpcds_q42/duckdb:parquet 9512872 9918615 0.96
tpcds_q43/duckdb:parquet 15143989 16394802 0.92
tpcds_q44/duckdb:parquet 21409490 23091133 0.93
tpcds_q45/duckdb:parquet 27085644 28265630 0.96
tpcds_q46/duckdb:parquet 43641657 45678403 0.96
tpcds_q47/duckdb:parquet 43474728 44031969 0.99
tpcds_q48/duckdb:parquet 28894779 29249391 0.99
tpcds_q49/duckdb:parquet 25043512 25248363 0.99
tpcds_q50/duckdb:parquet 23621641 24241899 0.97
tpcds_q51/duckdb:parquet 96313183 97173954 0.99
tpcds_q52/duckdb:parquet 10331920 11146668 0.93
tpcds_q53/duckdb:parquet 14953949 14957861 1.00
tpcds_q54/duckdb:parquet 25055490 25553841 0.98
tpcds_q55/duckdb:parquet 9525911 9870714 0.97
tpcds_q56/duckdb:parquet 20977352 20775092 1.01
tpcds_q57/duckdb:parquet 34487380 34861461 0.99
tpcds_q58/duckdb:parquet 21956867 22688635 0.97
tpcds_q59/duckdb:parquet 35774760 35420593 1.01
tpcds_q60/duckdb:parquet 21223820 22046633 0.96
tpcds_q61/duckdb:parquet 30566384 32515541 0.94
tpcds_q62/duckdb:parquet 11883645 12070516 0.98
tpcds_q63/duckdb:parquet 13404204 14064484 0.95
tpcds_q64/duckdb:parquet 72103518 74289942 0.97
tpcds_q65/duckdb:parquet 20006103 19811951 1.01
tpcds_q66/duckdb:parquet 29397894 28903749 1.02
tpcds_q67/duckdb:parquet 132031519 137530611 0.96
tpcds_q68/duckdb:parquet 36275197 36230834 1.00
tpcds_q69/duckdb:parquet 35833029 35917392 1.00
tpcds_q70/duckdb:parquet 19022150 19393003 0.98
tpcds_q71/duckdb:parquet 18557148 18821502 0.99
tpcds_q72/duckdb:parquet 163234307 165808919 0.98
tpcds_q73/duckdb:parquet 17383282 17664606 0.98
tpcds_q74/duckdb:parquet 127196027 130477451 0.97
tpcds_q75/duckdb:parquet 52740675 51958706 1.02
tpcds_q76/duckdb:parquet 18641482 19518251 0.96
tpcds_q77/duckdb:parquet 21003406 21817874 0.96
tpcds_q78/duckdb:parquet 75111098 76361111 0.98
tpcds_q79/duckdb:parquet 26428525 28713331 0.92
tpcds_q80/duckdb:parquet 🚀 40588186 45324454 0.90
tpcds_q81/duckdb:parquet 31695550 32263894 0.98
tpcds_q82/duckdb:parquet 13107031 13498649 0.97
tpcds_q83/duckdb:parquet 🚀 15327466 17225948 0.89
tpcds_q84/duckdb:parquet 18766690 18955383 0.99
tpcds_q85/duckdb:parquet 38150847 39820245 0.96
tpcds_q86/duckdb:parquet 12061435 12285886 0.98
tpcds_q87/duckdb:parquet 36328624 36848561 0.99
tpcds_q88/duckdb:parquet 48265624 49219522 0.98
tpcds_q89/duckdb:parquet 16204410 16608367 0.98
tpcds_q90/duckdb:parquet 7100304 7492371 0.95
tpcds_q91/duckdb:parquet 22146961 22326688 0.99
tpcds_q92/duckdb:parquet 11105150 11477084 0.97
tpcds_q93/duckdb:parquet 28869883 31013023 0.93
tpcds_q94/duckdb:parquet 15963807 16007208 1.00
tpcds_q95/duckdb:parquet 🚀 120849796 143179784 0.84
tpcds_q96/duckdb:parquet 8410897 8737588 0.96
tpcds_q97/duckdb:parquet 33487557 35113061 0.95
tpcds_q98/duckdb:parquet 17344847 16910406 1.03
tpcds_q99/duckdb:parquet 18881864 20214709 0.93
duckdb / duckdb (0.993x ➖, 3↑ 4↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20217029 19976866 1.01
tpcds_q02/duckdb:duckdb 19174724 18468212 1.04
tpcds_q03/duckdb:duckdb 8437916 8478825 1.00
tpcds_q04/duckdb:duckdb 173868020 177993417 0.98
tpcds_q05/duckdb:duckdb 19522509 19644685 0.99
tpcds_q06/duckdb:duckdb 22321844 22760153 0.98
tpcds_q07/duckdb:duckdb 37152626 40889594 0.91
tpcds_q08/duckdb:duckdb 121104194 120687122 1.00
tpcds_q09/duckdb:duckdb 19699764 20274150 0.97
tpcds_q10/duckdb:duckdb 23484531 25474507 0.92
tpcds_q11/duckdb:duckdb 89688631 88274344 1.02
tpcds_q12/duckdb:duckdb 10956988 11977204 0.91
tpcds_q13/duckdb:duckdb 23628077 24152664 0.98
tpcds_q14/duckdb:duckdb 91187299 92596878 0.98
tpcds_q15/duckdb:duckdb 24181463 25129588 0.96
tpcds_q16/duckdb:duckdb 17381832 18412517 0.94
tpcds_q17/duckdb:duckdb 20913211 22762686 0.92
tpcds_q18/duckdb:duckdb 43273242 43790729 0.99
tpcds_q19/duckdb:duckdb 17314592 16368610 1.06
tpcds_q20/duckdb:duckdb 11731362 11648191 1.01
tpcds_q21/duckdb:duckdb 🚀 6271103 7278847 0.86
tpcds_q22/duckdb:duckdb 62059252 67527701 0.92
tpcds_q23/duckdb:duckdb 81351406 78812331 1.03
tpcds_q24/duckdb:duckdb 27060514 24835025 1.09
tpcds_q25/duckdb:duckdb 17471290 17411729 1.00
tpcds_q26/duckdb:duckdb 26188746 26557548 0.99
tpcds_q27/duckdb:duckdb 38328927 38965890 0.98
tpcds_q28/duckdb:duckdb 21930447 22105711 0.99
tpcds_q29/duckdb:duckdb 21061735 20739020 1.02
tpcds_q30/duckdb:duckdb 31098411 30617551 1.02
tpcds_q31/duckdb:duckdb 49296955 46759378 1.05
tpcds_q32/duckdb:duckdb 7229198 7576147 0.95
tpcds_q33/duckdb:duckdb 12789385 12597442 1.02
tpcds_q34/duckdb:duckdb 🚨 17828729 15027798 1.19
tpcds_q35/duckdb:duckdb 31859637 31463162 1.01
tpcds_q36/duckdb:duckdb 70502743 70563178 1.00
tpcds_q37/duckdb:duckdb 🚀 7654406 8654606 0.88
tpcds_q38/duckdb:duckdb 33049355 31205895 1.06
tpcds_q39/duckdb:duckdb 26075831 25389223 1.03
tpcds_q40/duckdb:duckdb 14245019 14244774 1.00
tpcds_q41/duckdb:duckdb 8284353 8693977 0.95
tpcds_q42/duckdb:duckdb 6232546 6356437 0.98
tpcds_q43/duckdb:duckdb 10953631 11334458 0.97
tpcds_q44/duckdb:duckdb 13414674 13734707 0.98
tpcds_q45/duckdb:duckdb 17728129 17239296 1.03
tpcds_q46/duckdb:duckdb 38796679 36317095 1.07
tpcds_q47/duckdb:duckdb 41882342 39364228 1.06
tpcds_q48/duckdb:duckdb 23355202 23419036 1.00
tpcds_q49/duckdb:duckdb 17265920 16862961 1.02
tpcds_q50/duckdb:duckdb 13964718 14515209 0.96
tpcds_q51/duckdb:duckdb 92937323 90698827 1.02
tpcds_q52/duckdb:duckdb 7331980 7689005 0.95
tpcds_q53/duckdb:duckdb 13255688 13275336 1.00
tpcds_q54/duckdb:duckdb 16382279 17468581 0.94
tpcds_q55/duckdb:duckdb 7274596 7074196 1.03
tpcds_q56/duckdb:duckdb 14200333 14094967 1.01
tpcds_q57/duckdb:duckdb 31349580 33452812 0.94
tpcds_q58/duckdb:duckdb 13241872 12496101 1.06
tpcds_q59/duckdb:duckdb 35726719 35724204 1.00
tpcds_q60/duckdb:duckdb 14961043 14672801 1.02
tpcds_q61/duckdb:duckdb 14228625 14461633 0.98
tpcds_q62/duckdb:duckdb 9258009 9614497 0.96
tpcds_q63/duckdb:duckdb 12456962 12458622 1.00
tpcds_q64/duckdb:duckdb 54849358 56066107 0.98
tpcds_q65/duckdb:duckdb 34798267 34303315 1.01
tpcds_q66/duckdb:duckdb 26247452 24451131 1.07
tpcds_q67/duckdb:duckdb 127245591 131267853 0.97
tpcds_q68/duckdb:duckdb 🚨 27885702 24841613 1.12
tpcds_q69/duckdb:duckdb 25241345 25136633 1.00
tpcds_q70/duckdb:duckdb 13887039 14729327 0.94
tpcds_q71/duckdb:duckdb 12387212 13473571 0.92
tpcds_q72/duckdb:duckdb 40638009 43002017 0.95
tpcds_q73/duckdb:duckdb 11077584 10911535 1.02
tpcds_q74/duckdb:duckdb 146959655 143180452 1.03
tpcds_q75/duckdb:duckdb 42320297 44087023 0.96
tpcds_q76/duckdb:duckdb 12483055 11903533 1.05
tpcds_q77/duckdb:duckdb 11962035 13263251 0.90
tpcds_q78/duckdb:duckdb 63065954 63152906 1.00
tpcds_q79/duckdb:duckdb 🚨 21682296 18854173 1.15
tpcds_q80/duckdb:duckdb 28617323 27039495 1.06
tpcds_q81/duckdb:duckdb 41818878 39908762 1.05
tpcds_q82/duckdb:duckdb 8417471 8907672 0.94
tpcds_q83/duckdb:duckdb 9300529 9936620 0.94
tpcds_q84/duckdb:duckdb 🚨 16990236 14543063 1.17
tpcds_q85/duckdb:duckdb 24468661 24784889 0.99
tpcds_q86/duckdb:duckdb 10489975 11252204 0.93
tpcds_q87/duckdb:duckdb 36074528 34846462 1.04
tpcds_q88/duckdb:duckdb 25535123 26407305 0.97
tpcds_q89/duckdb:duckdb 14853734 15472100 0.96
tpcds_q90/duckdb:duckdb 5484985 6076108 0.90
tpcds_q91/duckdb:duckdb 13065437 13465475 0.97
tpcds_q92/duckdb:duckdb 8962768 8643271 1.04
tpcds_q93/duckdb:duckdb 21674535 20075513 1.08
tpcds_q94/duckdb:duckdb 13188875 13055036 1.01
tpcds_q95/duckdb:duckdb 🚀 108752256 132608376 0.82
tpcds_q96/duckdb:duckdb 4593538 4870296 0.94
tpcds_q97/duckdb:duckdb 31483496 30359585 1.04
tpcds_q98/duckdb:duckdb 13532347 13444065 1.01
tpcds_q99/duckdb:duckdb 16147776 16536986 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.6% -0.3% -4.3% +20.2% ➖ noise
1 datafusion:vortex-file-compressed -4.3% -0.3% -4.0% +19.2% ➖ noise
1 duckdb:duckdb +1.2% -0.3% +1.5% +21.6% ➖ noise
1 duckdb:vortex-compact -3.7% -0.3% -3.4% +22.0% ➖ noise
1 duckdb:vortex-file-compressed -5.5% -0.3% -5.2% +33.2% ➖ noise
2 datafusion:vortex-compact -6.0% +0.9% -6.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.3% +0.9% -5.1% +11.7% ➖ noise
2 duckdb:duckdb +3.8% +0.9% +2.9% +10.3% ➖ noise
2 duckdb:vortex-compact -2.6% +0.9% -3.4% +23.7% ➖ noise
2 duckdb:vortex-file-compressed +29.2% +0.9% +28.0% +27.6% 🚨 regression
3 datafusion:vortex-compact -3.5% -1.7% -1.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -5.6% -1.7% -3.9% +10.0% ➖ noise
3 duckdb:duckdb -0.5% -1.7% +1.2% +15.5% ➖ noise
3 duckdb:vortex-compact +0.1% -1.7% +1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% -1.7% +3.0% +10.0% ➖ noise
4 datafusion:vortex-compact -1.4% -3.4% +2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.4% -3.4% -1.1% +10.0% ➖ noise
4 duckdb:duckdb -2.3% -3.4% +1.1% +11.5% ➖ noise
4 duckdb:vortex-compact +0.6% -3.4% +4.2% +16.0% ➖ noise
4 duckdb:vortex-file-compressed -10.5% -3.4% -7.3% +13.3% ➖ noise
5 datafusion:vortex-compact -4.7% -4.4% -0.3% +14.9% ➖ noise
5 datafusion:vortex-file-compressed -3.0% -4.4% +1.5% +16.4% ➖ noise
5 duckdb:duckdb -0.6% -4.4% +4.0% +11.2% ➖ noise
5 duckdb:vortex-compact -2.9% -4.4% +1.6% +18.7% ➖ noise
5 duckdb:vortex-file-compressed -6.2% -4.4% -1.9% +12.5% ➖ noise
6 datafusion:vortex-compact -9.2% +1.7% -10.8% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -1.2% +1.7% -2.9% +14.2% ➖ noise
6 duckdb:duckdb -1.9% +1.7% -3.6% +10.6% ➖ noise
6 duckdb:vortex-compact -3.0% +1.7% -4.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.6% +1.7% -5.2% +10.0% ➖ noise
7 datafusion:vortex-compact -1.1% -1.3% +0.3% +14.1% ➖ noise
7 datafusion:vortex-file-compressed -6.4% -1.3% -5.2% +13.8% ➖ noise
7 duckdb:duckdb -9.1% -1.3% -7.9% +17.4% ➖ noise
7 duckdb:vortex-compact -2.2% -1.3% -0.9% +14.2% ➖ noise
7 duckdb:vortex-file-compressed -1.8% -1.3% -0.5% +35.8% ➖ noise
8 datafusion:vortex-compact -1.7% -0.6% -1.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -3.2% -0.6% -2.6% +10.0% ➖ noise
8 duckdb:duckdb +0.3% -0.6% +1.0% +10.0% ➖ noise
8 duckdb:vortex-compact -6.0% -0.6% -5.4% +11.2% ➖ noise
8 duckdb:vortex-file-compressed +2.3% -0.6% +2.9% +10.0% ➖ noise
9 datafusion:vortex-compact -1.6% +0.6% -2.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.2% +0.6% +2.6% +10.0% ➖ noise
9 duckdb:duckdb -2.8% +0.6% -3.4% +10.0% ➖ noise
9 duckdb:vortex-compact -0.3% +0.6% -0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.4% +0.6% -4.9% +10.0% ➖ noise
10 datafusion:vortex-compact -3.6% -0.1% -3.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.6% -0.1% -4.6% +10.0% ➖ noise
10 duckdb:duckdb -7.8% -0.1% -7.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.1% -0.1% -0.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.6% -0.1% -1.5% +10.0% ➖ noise
11 datafusion:vortex-compact -3.4% +1.3% -4.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.8% +1.3% -4.0% +10.0% ➖ noise
11 duckdb:duckdb +1.6% +1.3% +0.3% +10.0% ➖ noise
11 duckdb:vortex-compact -1.9% +1.3% -3.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -4.8% +1.3% -6.0% +14.2% ➖ noise
12 datafusion:vortex-compact -2.6% -1.8% -0.8% +13.2% ➖ noise
12 datafusion:vortex-file-compressed -4.2% -1.8% -2.5% +10.0% ➖ noise
12 duckdb:duckdb -8.5% -1.8% -6.9% +10.5% ➖ noise
12 duckdb:vortex-compact +4.5% -1.8% +6.4% +15.5% ➖ noise
12 duckdb:vortex-file-compressed -4.6% -1.8% -2.9% +23.5% ➖ noise
13 datafusion:vortex-compact -1.5% -0.6% -0.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
13 duckdb:duckdb -2.2% -0.6% -1.6% +10.0% ➖ noise
13 duckdb:vortex-compact -2.4% -0.6% -1.8% +10.8% ➖ noise
13 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +10.0% ➖ noise
14 datafusion:vortex-compact -2.9% -1.6% -1.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.3% -1.6% -1.8% +10.0% ➖ noise
14 duckdb:duckdb -1.5% -1.6% +0.1% +10.0% ➖ noise
14 duckdb:vortex-compact +0.1% -1.6% +1.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.1% -1.6% +0.5% +10.0% ➖ noise
15 datafusion:vortex-compact -4.1% -1.7% -2.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -5.2% -1.7% -3.5% +10.0% ➖ noise
15 duckdb:duckdb -3.8% -1.7% -2.1% +15.3% ➖ noise
15 duckdb:vortex-compact -7.5% -1.7% -5.9% +14.4% ➖ noise
15 duckdb:vortex-file-compressed -2.9% -1.7% -1.2% +10.0% ➖ noise
16 datafusion:vortex-compact -4.2% -3.5% -0.7% +12.2% ➖ noise
16 datafusion:vortex-file-compressed -8.7% -3.5% -5.3% +13.7% ➖ noise
16 duckdb:duckdb -5.6% -3.5% -2.1% +14.9% ➖ noise
16 duckdb:vortex-compact -6.1% -3.5% -2.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.2% -3.5% +3.5% +10.0% ➖ noise
17 datafusion:vortex-compact +3.1% -3.7% +7.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -3.5% -3.7% +0.2% +12.0% ➖ noise
17 duckdb:duckdb -8.1% -3.7% -4.6% +10.0% ➖ noise
17 duckdb:vortex-compact -2.3% -3.7% +1.4% +10.6% ➖ noise
17 duckdb:vortex-file-compressed -0.5% -3.7% +3.3% +14.4% ➖ noise
18 datafusion:vortex-compact -3.7% -0.7% -3.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.3% -0.7% -2.6% +13.4% ➖ noise
18 duckdb:duckdb -1.2% -0.7% -0.4% +10.0% ➖ noise
18 duckdb:vortex-compact -3.1% -0.7% -2.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.4% -0.7% -0.7% +10.0% ➖ noise
19 datafusion:vortex-compact -5.5% -2.6% -3.0% +11.3% ➖ noise
19 datafusion:vortex-file-compressed +1.4% -2.6% +4.1% +10.0% ➖ noise
19 duckdb:duckdb +5.8% -2.6% +8.6% +10.1% ➖ noise
19 duckdb:vortex-compact -5.9% -2.6% -3.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.0% -2.6% +1.7% +10.0% ➖ noise
20 datafusion:vortex-compact -4.5% -0.3% -4.2% +13.9% ➖ noise
20 datafusion:vortex-file-compressed -4.7% -0.3% -4.4% +10.0% ➖ noise
20 duckdb:duckdb +0.7% -0.3% +1.0% +14.5% ➖ noise
20 duckdb:vortex-compact -3.2% -0.3% -3.0% +14.4% ➖ noise
20 duckdb:vortex-file-compressed -0.7% -0.3% -0.4% +10.0% ➖ noise
21 datafusion:vortex-compact +1.2% -6.4% +8.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -3.2% -6.4% +3.5% +10.0% ➖ noise
21 duckdb:duckdb -13.8% -6.4% -7.9% +18.5% ➖ noise
21 duckdb:vortex-compact +5.8% -6.4% +13.1% +17.9% ➖ noise
21 duckdb:vortex-file-compressed -8.5% -6.4% -2.3% +19.0% ➖ noise
22 datafusion:vortex-compact -2.7% +0.4% -3.1% +13.0% ➖ noise
22 datafusion:vortex-file-compressed +2.8% +0.4% +2.3% +16.6% ➖ noise
22 duckdb:duckdb -8.1% +0.4% -8.5% +12.5% ➖ noise
22 duckdb:vortex-compact +0.5% +0.4% +0.1% +13.4% ➖ noise
22 duckdb:vortex-file-compressed -2.3% +0.4% -2.7% +11.1% ➖ noise
23 datafusion:vortex-compact -6.1% -1.0% -5.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -4.6% -1.0% -3.6% +10.0% ➖ noise
23 duckdb:duckdb +3.2% -1.0% +4.3% +13.6% ➖ noise
23 duckdb:vortex-compact +11.3% -1.0% +12.5% +11.7% 🚨 regression
23 duckdb:vortex-file-compressed -4.9% -1.0% -3.9% +14.1% ➖ noise
24 datafusion:vortex-compact -2.3% -2.9% +0.7% +11.5% ➖ noise
24 datafusion:vortex-file-compressed -5.4% -2.9% -2.6% +10.0% ➖ noise
24 duckdb:duckdb +9.0% -2.9% +12.3% +10.0% 🚨 regression
24 duckdb:vortex-compact +1.7% -2.9% +4.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.5% -2.9% +4.6% +10.0% ➖ noise
25 datafusion:vortex-compact -8.0% -0.6% -7.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -3.6% -0.6% -2.9% +15.4% ➖ noise
25 duckdb:duckdb +0.3% -0.6% +1.0% +10.0% ➖ noise
25 duckdb:vortex-compact -0.0% -0.6% +0.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.2% -0.6% +0.4% +10.0% ➖ noise
26 datafusion:vortex-compact -5.0% -2.7% -2.4% +12.7% ➖ noise
26 datafusion:vortex-file-compressed -5.7% -2.7% -3.1% +10.0% ➖ noise
26 duckdb:duckdb -1.4% -2.7% +1.3% +11.6% ➖ noise
26 duckdb:vortex-compact -4.3% -2.7% -1.6% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -6.0% -2.7% -3.4% +15.1% ➖ noise
27 datafusion:vortex-compact -4.1% -3.5% -0.6% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -8.0% -3.5% -4.7% +14.3% ➖ noise
27 duckdb:duckdb -1.6% -3.5% +2.0% +18.5% ➖ noise
27 duckdb:vortex-compact -2.4% -3.5% +1.1% +11.6% ➖ noise
27 duckdb:vortex-file-compressed -3.0% -3.5% +0.5% +14.7% ➖ noise
28 datafusion:vortex-compact +4.5% +0.0% +4.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +7.6% +0.0% +7.6% +10.1% ➖ noise
28 duckdb:duckdb -0.8% +0.0% -0.8% +10.0% ➖ noise
28 duckdb:vortex-compact -5.6% +0.0% -5.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -3.2% +0.0% -3.2% +10.0% ➖ noise
29 datafusion:vortex-compact -4.1% -8.4% +4.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +1.1% -8.4% +10.3% +10.0% 🚨 regression
29 duckdb:duckdb +1.6% -8.4% +10.9% +10.0% 🚨 regression
29 duckdb:vortex-compact -3.0% -8.4% +5.9% +14.3% ➖ noise
29 duckdb:vortex-file-compressed -3.5% -8.4% +5.3% +12.4% ➖ noise
30 datafusion:vortex-compact -4.6% -2.9% -1.8% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -7.2% -2.9% -4.5% +10.0% ➖ noise
30 duckdb:duckdb +1.6% -2.9% +4.6% +10.0% ➖ noise
30 duckdb:vortex-compact -4.3% -2.9% -1.4% +14.5% ➖ noise
30 duckdb:vortex-file-compressed +2.0% -2.9% +5.1% +12.6% ➖ noise
31 datafusion:vortex-compact -0.5% -5.5% +5.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -9.1% -5.5% -3.8% +10.0% ➖ noise
31 duckdb:duckdb +5.4% -5.5% +11.6% +10.0% 🚨 regression
31 duckdb:vortex-compact -0.6% -5.5% +5.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.0% -5.5% +6.9% +10.0% ➖ noise
32 datafusion:vortex-compact -6.5% -2.6% -4.0% +14.9% ➖ noise
32 datafusion:vortex-file-compressed -10.6% -2.6% -8.2% +10.0% ➖ noise
32 duckdb:duckdb -4.6% -2.6% -2.0% +10.9% ➖ noise
32 duckdb:vortex-compact -1.8% -2.6% +0.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -4.4% -2.6% -1.8% +10.0% ➖ noise
33 datafusion:vortex-compact -5.9% -3.9% -2.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -6.0% -3.9% -2.2% +10.0% ➖ noise
33 duckdb:duckdb +1.5% -3.9% +5.6% +10.4% ➖ noise
33 duckdb:vortex-compact +2.1% -3.9% +6.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +4.5% -3.9% +8.8% +10.0% ➖ noise
34 datafusion:vortex-compact -7.6% -3.6% -4.1% +10.1% ➖ noise
34 datafusion:vortex-file-compressed -4.0% -3.6% -0.4% +20.4% ➖ noise
34 duckdb:duckdb +18.6% -3.6% +23.0% +11.7% 🚨 regression
34 duckdb:vortex-compact -3.9% -3.6% -0.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.0% -3.6% +0.6% +10.0% ➖ noise
35 datafusion:vortex-compact -5.4% -2.5% -2.9% +10.2% ➖ noise
35 datafusion:vortex-file-compressed -5.3% -2.5% -2.8% +11.3% ➖ noise
35 duckdb:duckdb +1.3% -2.5% +3.9% +15.7% ➖ noise
35 duckdb:vortex-compact -2.4% -2.5% +0.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +4.7% -2.5% +7.5% +10.0% ➖ noise
36 datafusion:vortex-compact -2.4% -5.7% +3.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -7.2% -5.7% -1.6% +10.0% ➖ noise
36 duckdb:duckdb -0.1% -5.7% +6.0% +10.0% ➖ noise
36 duckdb:vortex-compact -5.0% -5.7% +0.8% +13.8% ➖ noise
36 duckdb:vortex-file-compressed -1.8% -5.7% +4.2% +17.4% ➖ noise
37 datafusion:vortex-compact -2.9% -6.1% +3.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -8.7% -6.1% -2.7% +12.4% ➖ noise
37 duckdb:duckdb -11.6% -6.1% -5.8% +13.9% ➖ noise
37 duckdb:vortex-compact -4.5% -6.1% +1.7% +10.8% ➖ noise
37 duckdb:vortex-file-compressed -6.1% -6.1% -0.0% +11.1% ➖ noise
38 datafusion:vortex-compact -5.1% -4.1% -1.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -8.3% -4.1% -4.4% +10.7% ➖ noise
38 duckdb:duckdb +5.9% -4.1% +10.4% +10.0% 🚨 regression
38 duckdb:vortex-compact +8.6% -4.1% +13.1% +12.8% 🚨 regression
38 duckdb:vortex-file-compressed -5.7% -4.1% -1.7% +16.0% ➖ noise
39 datafusion:vortex-compact -0.3% -8.6% +9.2% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -10.1% -8.6% -1.6% +12.5% ➖ noise
39 duckdb:duckdb +2.7% -8.6% +12.4% +17.2% ➖ noise
39 duckdb:vortex-compact +0.6% -8.6% +10.1% +10.0% 🚨 regression
39 duckdb:vortex-file-compressed +3.0% -8.6% +12.8% +15.0% ➖ noise
40 datafusion:vortex-compact -2.8% -3.9% +1.1% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -5.2% -3.9% -1.3% +10.0% ➖ noise
40 duckdb:duckdb +0.0% -3.9% +4.1% +14.3% ➖ noise
40 duckdb:vortex-compact -8.8% -3.9% -5.0% +14.7% ➖ noise
40 duckdb:vortex-file-compressed -1.8% -3.9% +2.2% +15.3% ➖ noise
41 datafusion:vortex-compact -0.3% -7.3% +7.5% +12.2% ➖ noise
41 datafusion:vortex-file-compressed -11.1% -7.3% -4.1% +26.1% ➖ noise
41 duckdb:duckdb -4.7% -7.3% +2.8% +10.0% ➖ noise
41 duckdb:vortex-compact -0.6% -7.3% +7.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -3.4% -7.3% +4.2% +10.0% ➖ noise
42 datafusion:vortex-compact +2.8% -5.0% +8.2% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -9.9% -5.0% -5.2% +16.5% ➖ noise
42 duckdb:duckdb -1.9% -5.0% +3.2% +14.9% ➖ noise
42 duckdb:vortex-compact -3.0% -5.0% +2.2% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +6.2% -5.0% +11.8% +10.0% 🚨 regression
43 datafusion:vortex-compact -6.8% -4.8% -2.1% +14.8% ➖ noise
43 datafusion:vortex-file-compressed -2.9% -4.8% +2.0% +10.0% ➖ noise
43 duckdb:duckdb -3.4% -4.8% +1.5% +10.5% ➖ noise
43 duckdb:vortex-compact +12.3% -4.8% +18.0% +10.0% 🚨 regression
43 duckdb:vortex-file-compressed -3.8% -4.8% +1.0% +10.8% ➖ noise
44 datafusion:vortex-compact -3.7% -6.8% +3.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -8.3% -6.8% -1.6% +10.0% ➖ noise
44 duckdb:duckdb -2.3% -6.8% +4.7% +15.8% ➖ noise
44 duckdb:vortex-compact +1.1% -6.8% +8.4% +14.5% ➖ noise
44 duckdb:vortex-file-compressed +1.9% -6.8% +9.2% +10.0% ➖ noise
45 datafusion:vortex-compact -5.0% -4.0% -1.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -7.8% -4.0% -4.0% +10.0% ➖ noise
45 duckdb:duckdb +2.8% -4.0% +7.1% +10.4% ➖ noise
45 duckdb:vortex-compact +0.2% -4.0% +4.3% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -2.4% -4.0% +1.6% +10.6% ➖ noise
46 datafusion:vortex-compact -1.4% -4.5% +3.3% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -2.0% -4.5% +2.6% +10.0% ➖ noise
46 duckdb:duckdb +6.8% -4.5% +11.8% +10.0% 🚨 regression
46 duckdb:vortex-compact +6.1% -4.5% +11.1% +10.0% 🚨 regression
46 duckdb:vortex-file-compressed -0.8% -4.5% +3.8% +10.0% ➖ noise
47 datafusion:vortex-compact -6.2% -2.1% -4.2% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -3.4% -2.1% -1.3% +10.0% ➖ noise
47 duckdb:duckdb +6.4% -2.1% +8.7% +10.0% ➖ noise
47 duckdb:vortex-compact -1.5% -2.1% +0.6% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -6.0% -2.1% -4.0% +10.0% ➖ noise
48 datafusion:vortex-compact -2.7% -2.6% -0.1% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -2.1% -2.6% +0.5% +17.5% ➖ noise
48 duckdb:duckdb -0.3% -2.6% +2.4% +10.0% ➖ noise
48 duckdb:vortex-compact +1.3% -2.6% +4.0% +13.2% ➖ noise
48 duckdb:vortex-file-compressed +3.7% -2.6% +6.4% +12.6% ➖ noise
49 datafusion:vortex-compact -2.5% -0.0% -2.5% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -5.4% -0.0% -5.4% +10.0% ➖ noise
49 duckdb:duckdb +2.4% -0.0% +2.4% +13.6% ➖ noise
49 duckdb:vortex-compact -4.8% -0.0% -4.8% +11.0% ➖ noise
49 duckdb:vortex-file-compressed -9.0% -0.0% -9.0% +13.0% ➖ noise
50 datafusion:vortex-compact -0.1% -3.2% +3.3% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -5.0% -3.2% -1.8% +10.0% ➖ noise
50 duckdb:duckdb -3.8% -3.2% -0.6% +10.0% ➖ noise
50 duckdb:vortex-compact -2.1% -3.2% +1.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -5.1% -3.2% -2.0% +11.5% ➖ noise
51 datafusion:vortex-compact -1.4% -1.3% -0.2% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -0.8% -1.3% +0.5% +10.4% ➖ noise
51 duckdb:duckdb +2.5% -1.3% +3.8% +10.0% ➖ noise
51 duckdb:vortex-compact +2.4% -1.3% +3.7% +20.4% ➖ noise
51 duckdb:vortex-file-compressed +3.7% -1.3% +5.1% +10.0% ➖ noise
52 datafusion:vortex-compact +2.1% -11.8% +15.8% +10.0% 🚨 regression
52 datafusion:vortex-file-compressed -6.3% -11.8% +6.2% +10.8% ➖ noise
52 duckdb:duckdb -4.6% -11.8% +8.1% +15.2% ➖ noise
52 duckdb:vortex-compact +2.3% -11.8% +16.0% +11.5% 🚨 regression
52 duckdb:vortex-file-compressed +0.1% -11.8% +13.5% +10.2% 🚨 regression
53 datafusion:vortex-compact +0.0% -2.8% +2.9% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -3.4% -2.8% -0.6% +10.0% ➖ noise
53 duckdb:duckdb -0.1% -2.8% +2.7% +10.0% ➖ noise
53 duckdb:vortex-compact -0.1% -2.8% +2.7% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -3.1% -2.8% -0.3% +15.4% ➖ noise
54 datafusion:vortex-compact -0.4% -2.2% +1.8% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -6.6% -2.2% -4.6% +10.0% ➖ noise
54 duckdb:duckdb -6.2% -2.2% -4.1% +10.0% ➖ noise
54 duckdb:vortex-compact +12.4% -2.2% +14.9% +15.9% ➖ noise
54 duckdb:vortex-file-compressed -0.6% -2.2% +1.6% +10.7% ➖ noise
55 datafusion:vortex-compact -4.9% +0.6% -5.5% +11.2% ➖ noise
55 datafusion:vortex-file-compressed -8.0% +0.6% -8.5% +10.0% ➖ noise
55 duckdb:duckdb +2.8% +0.6% +2.2% +16.9% ➖ noise
55 duckdb:vortex-compact -0.2% +0.6% -0.8% +13.6% ➖ noise
55 duckdb:vortex-file-compressed -2.3% +0.6% -2.9% +10.4% ➖ noise
56 datafusion:vortex-compact -1.7% +0.6% -2.2% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -5.9% +0.6% -6.4% +10.0% ➖ noise
56 duckdb:duckdb +0.7% +0.6% +0.2% +11.0% ➖ noise
56 duckdb:vortex-compact -1.9% +0.6% -2.5% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -1.6% +0.6% -2.1% +10.0% ➖ noise
57 datafusion:vortex-compact -5.9% -1.8% -4.1% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -9.7% -1.8% -8.0% +10.0% ➖ noise
57 duckdb:duckdb -6.3% -1.8% -4.6% +13.1% ➖ noise
57 duckdb:vortex-compact +1.2% -1.8% +3.0% +12.6% ➖ noise
57 duckdb:vortex-file-compressed -16.8% -1.8% -15.3% +16.6% ✅ faster
58 datafusion:vortex-compact -2.6% -2.2% -0.4% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -4.2% -2.2% -2.0% +10.0% ➖ noise
58 duckdb:duckdb +6.0% -2.2% +8.4% +16.6% ➖ noise
58 duckdb:vortex-compact -4.4% -2.2% -2.2% +14.4% ➖ noise
58 duckdb:vortex-file-compressed -7.9% -2.2% -5.8% +16.0% ➖ noise
59 datafusion:vortex-compact -4.0% -0.7% -3.3% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -3.9% -0.7% -3.1% +10.0% ➖ noise
59 duckdb:duckdb +0.0% -0.7% +0.7% +10.0% ➖ noise
59 duckdb:vortex-compact +2.8% -0.7% +3.6% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +0.7% -0.7% +1.4% +20.2% ➖ noise
60 datafusion:vortex-compact -2.7% -4.5% +1.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -1.3% -4.5% +3.3% +15.5% ➖ noise
60 duckdb:duckdb +2.0% -4.5% +6.7% +10.6% ➖ noise
60 duckdb:vortex-compact +0.1% -4.5% +4.8% +15.3% ➖ noise
60 duckdb:vortex-file-compressed -3.5% -4.5% +1.0% +11.6% ➖ noise
61 datafusion:vortex-compact +1.7% -5.6% +7.6% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -3.4% -5.6% +2.3% +10.0% ➖ noise
61 duckdb:duckdb -1.6% -5.6% +4.2% +10.0% ➖ noise
61 duckdb:vortex-compact +0.4% -5.6% +6.3% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -4.0% -5.6% +1.6% +15.8% ➖ noise
62 datafusion:vortex-compact -4.5% +7.7% -11.3% +11.6% ✅ faster
62 datafusion:vortex-file-compressed -4.7% +7.7% -11.6% +10.0% ✅ faster
62 duckdb:duckdb -3.7% +7.7% -10.6% +11.3% ✅ faster
62 duckdb:vortex-compact -6.9% +7.7% -13.6% +14.4% ✅ faster
62 duckdb:vortex-file-compressed -9.4% +7.7% -15.9% +16.0% ✅ faster
63 datafusion:vortex-compact -5.6% -2.5% -3.2% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -5.8% -2.5% -3.4% +10.0% ➖ noise
63 duckdb:duckdb -0.0% -2.5% +2.5% +10.0% ➖ noise
63 duckdb:vortex-compact +4.8% -2.5% +7.5% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +2.9% -2.5% +5.6% +12.3% ➖ noise
64 datafusion:vortex-compact -1.6% -3.8% +2.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -4.2% -3.8% -0.4% +10.0% ➖ noise
64 duckdb:duckdb -2.2% -3.8% +1.7% +10.0% ➖ noise
64 duckdb:vortex-compact -5.2% -3.8% -1.4% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -6.3% -3.8% -2.6% +11.5% ➖ noise
65 datafusion:vortex-compact -0.6% -1.0% +0.5% +11.9% ➖ noise
65 datafusion:vortex-file-compressed -5.5% -1.0% -4.5% +14.3% ➖ noise
65 duckdb:duckdb +1.4% -1.0% +2.5% +13.3% ➖ noise
65 duckdb:vortex-compact +6.4% -1.0% +7.5% +16.8% ➖ noise
65 duckdb:vortex-file-compressed -8.6% -1.0% -7.6% +10.0% ➖ noise
66 datafusion:vortex-compact +2.2% +0.7% +1.5% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -5.9% +0.7% -6.5% +10.0% ➖ noise
66 duckdb:duckdb +7.3% +0.7% +6.6% +14.1% ➖ noise
66 duckdb:vortex-compact -2.8% +0.7% -3.5% +11.4% ➖ noise
66 duckdb:vortex-file-compressed -0.7% +0.7% -1.3% +14.7% ➖ noise
67 datafusion:vortex-compact -6.2% -5.8% -0.4% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -1.0% -5.8% +5.0% +12.9% ➖ noise
67 duckdb:duckdb -3.1% -5.8% +2.9% +10.0% ➖ noise
67 duckdb:vortex-compact -3.4% -5.8% +2.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +1.4% -5.8% +7.6% +10.0% ➖ noise
68 datafusion:vortex-compact -5.2% -2.8% -2.5% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +0.6% -2.8% +3.5% +10.0% ➖ noise
68 duckdb:duckdb +12.3% -2.8% +15.5% +11.5% 🚨 regression
68 duckdb:vortex-compact +2.4% -2.8% +5.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -2.2% -2.8% +0.7% +10.0% ➖ noise
69 datafusion:vortex-compact -5.6% -1.7% -3.9% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -6.2% -1.7% -4.5% +11.6% ➖ noise
69 duckdb:duckdb +0.4% -1.7% +2.2% +13.7% ➖ noise
69 duckdb:vortex-compact -2.4% -1.7% -0.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -2.3% -1.7% -0.6% +10.0% ➖ noise
70 datafusion:vortex-compact -2.8% -4.6% +1.9% +10.8% ➖ noise
70 datafusion:vortex-file-compressed -5.4% -4.6% -0.9% +13.4% ➖ noise
70 duckdb:duckdb -5.7% -4.6% -1.2% +12.6% ➖ noise
70 duckdb:vortex-compact +0.2% -4.6% +5.0% +11.1% ➖ noise
70 duckdb:vortex-file-compressed -4.2% -4.6% +0.4% +14.1% ➖ noise
71 datafusion:vortex-compact -2.5% -3.7% +1.2% +13.5% ➖ noise
71 datafusion:vortex-file-compressed -2.2% -3.7% +1.6% +13.2% ➖ noise
71 duckdb:duckdb -8.1% -3.7% -4.6% +13.3% ➖ noise
71 duckdb:vortex-compact +1.3% -3.7% +5.2% +14.1% ➖ noise
71 duckdb:vortex-file-compressed +1.3% -3.7% +5.1% +10.0% ➖ noise
72 datafusion:vortex-compact -4.2% -4.0% -0.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -5.4% -4.0% -1.4% +10.0% ➖ noise
72 duckdb:duckdb -5.5% -4.0% -1.6% +10.9% ➖ noise
72 duckdb:vortex-compact +0.6% -4.0% +4.8% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.3% -4.0% +3.8% +10.0% ➖ noise
73 datafusion:vortex-compact -2.8% -3.8% +1.1% +19.5% ➖ noise
73 datafusion:vortex-file-compressed -4.8% -3.8% -1.0% +33.4% ➖ noise
73 duckdb:duckdb +1.5% -3.8% +5.5% +12.5% ➖ noise
73 duckdb:vortex-compact +0.5% -3.8% +4.4% +15.8% ➖ noise
73 duckdb:vortex-file-compressed -1.6% -3.8% +2.3% +12.9% ➖ noise
74 datafusion:vortex-compact +7.0% -4.3% +11.8% +11.5% 🚨 regression
74 datafusion:vortex-file-compressed -6.1% -4.3% -1.8% +12.1% ➖ noise
74 duckdb:duckdb +2.6% -4.3% +7.3% +10.0% ➖ noise
74 duckdb:vortex-compact -6.9% -4.3% -2.7% +26.2% ➖ noise
74 duckdb:vortex-file-compressed +1.1% -4.3% +5.7% +19.8% ➖ noise
75 datafusion:vortex-compact -6.5% -1.1% -5.4% +11.4% ➖ noise
75 datafusion:vortex-file-compressed -3.2% -1.1% -2.1% +10.9% ➖ noise
75 duckdb:duckdb -4.0% -1.1% -2.9% +10.0% ➖ noise
75 duckdb:vortex-compact +5.0% -1.1% +6.2% +10.4% ➖ noise
75 duckdb:vortex-file-compressed -2.2% -1.1% -1.0% +16.0% ➖ noise
76 datafusion:vortex-compact -1.7% -4.1% +2.5% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -6.4% -4.1% -2.3% +18.5% ➖ noise
76 duckdb:duckdb +4.9% -4.1% +9.4% +12.2% ➖ noise
76 duckdb:vortex-compact -2.9% -4.1% +1.3% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -5.6% -4.1% -1.6% +15.0% ➖ noise
77 datafusion:vortex-compact -4.8% -2.4% -2.5% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -2.8% -2.4% -0.4% +10.0% ➖ noise
77 duckdb:duckdb -9.8% -2.4% -7.6% +13.6% ➖ noise
77 duckdb:vortex-compact +4.4% -2.4% +7.0% +12.8% ➖ noise
77 duckdb:vortex-file-compressed -4.8% -2.4% -2.5% +10.0% ➖ noise
78 datafusion:vortex-compact -3.4% -4.3% +1.0% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -6.5% -4.3% -2.3% +10.0% ➖ noise
78 duckdb:duckdb -0.1% -4.3% +4.4% +12.2% ➖ noise
78 duckdb:vortex-compact -1.6% -4.3% +2.9% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +1.0% -4.3% +5.6% +10.0% ➖ noise
79 datafusion:vortex-compact -3.3% -3.7% +0.4% +12.2% ➖ noise
79 datafusion:vortex-file-compressed +1.4% -3.7% +5.3% +12.7% ➖ noise
79 duckdb:duckdb +15.0% -3.7% +19.4% +10.0% 🚨 regression
79 duckdb:vortex-compact -1.2% -3.7% +2.6% +12.1% ➖ noise
79 duckdb:vortex-file-compressed -2.9% -3.7% +0.8% +22.2% ➖ noise
80 datafusion:vortex-compact -2.6% -7.5% +5.3% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -7.2% -7.5% +0.3% +10.0% ➖ noise
80 duckdb:duckdb +5.8% -7.5% +14.4% +12.0% 🚨 regression
80 duckdb:vortex-compact -5.8% -7.5% +1.8% +10.4% ➖ noise
80 duckdb:vortex-file-compressed -2.1% -7.5% +5.7% +10.0% ➖ noise
81 datafusion:vortex-compact -1.4% -2.8% +1.4% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +2.0% -2.8% +4.9% +13.5% ➖ noise
81 duckdb:duckdb +4.8% -2.8% +7.8% +11.0% ➖ noise
81 duckdb:vortex-compact -0.6% -2.8% +2.3% +10.1% ➖ noise
81 duckdb:vortex-file-compressed -2.3% -2.8% +0.5% +13.3% ➖ noise
82 datafusion:vortex-compact -3.6% -6.4% +3.1% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.0% -6.4% +6.9% +13.2% ➖ noise
82 duckdb:duckdb -5.5% -6.4% +1.0% +13.9% ➖ noise
82 duckdb:vortex-compact -0.2% -6.4% +6.7% +13.4% ➖ noise
82 duckdb:vortex-file-compressed +4.8% -6.4% +12.0% +10.0% 🚨 regression
83 datafusion:vortex-compact -7.4% -9.9% +2.8% +10.3% ➖ noise
83 datafusion:vortex-file-compressed -6.2% -9.9% +4.1% +12.9% ➖ noise
83 duckdb:duckdb -6.4% -9.9% +3.9% +14.2% ➖ noise
83 duckdb:vortex-compact -5.1% -9.9% +5.3% +21.1% ➖ noise
83 duckdb:vortex-file-compressed -1.4% -9.9% +9.4% +20.0% ➖ noise
84 datafusion:vortex-compact +1.7% -2.3% +4.1% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -7.9% -2.3% -5.8% +10.0% ➖ noise
84 duckdb:duckdb +16.8% -2.3% +19.5% +10.0% 🚨 regression
84 duckdb:vortex-compact -0.7% -2.3% +1.7% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -6.2% -2.3% -4.0% +10.0% ➖ noise
85 datafusion:vortex-compact +5.4% -3.7% +9.4% +10.3% ➖ noise
85 datafusion:vortex-file-compressed -5.5% -3.7% -1.9% +10.0% ➖ noise
85 duckdb:duckdb -1.3% -3.7% +2.5% +10.0% ➖ noise
85 duckdb:vortex-compact -2.6% -3.7% +1.1% +12.1% ➖ noise
85 duckdb:vortex-file-compressed -1.1% -3.7% +2.6% +10.0% ➖ noise
86 datafusion:vortex-compact -9.7% -2.9% -7.0% +15.0% ➖ noise
86 datafusion:vortex-file-compressed -8.8% -2.9% -6.1% +13.2% ➖ noise
86 duckdb:duckdb -6.8% -2.9% -4.0% +21.2% ➖ noise
86 duckdb:vortex-compact +11.6% -2.9% +14.9% +14.0% 🚨 regression
86 duckdb:vortex-file-compressed -3.9% -2.9% -1.1% +17.3% ➖ noise
87 datafusion:vortex-compact -5.5% -1.9% -3.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -7.5% -1.9% -5.7% +10.0% ➖ noise
87 duckdb:duckdb +3.5% -1.9% +5.5% +17.7% ➖ noise
87 duckdb:vortex-compact +4.2% -1.9% +6.2% +13.2% ➖ noise
87 duckdb:vortex-file-compressed +1.9% -1.9% +3.9% +11.1% ➖ noise
88 datafusion:vortex-compact -3.0% -0.7% -2.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -6.4% -0.7% -5.8% +11.2% ➖ noise
88 duckdb:duckdb -3.3% -0.7% -2.6% +10.0% ➖ noise
88 duckdb:vortex-compact -1.1% -0.7% -0.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -6.8% -0.7% -6.1% +10.0% ➖ noise
89 datafusion:vortex-compact -6.3% -2.8% -3.6% +12.8% ➖ noise
89 datafusion:vortex-file-compressed -7.0% -2.8% -4.3% +11.0% ➖ noise
89 duckdb:duckdb -4.0% -2.8% -1.3% +13.2% ➖ noise
89 duckdb:vortex-compact +1.4% -2.8% +4.3% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -2.3% -2.8% +0.5% +10.0% ➖ noise
90 datafusion:vortex-compact -7.1% -5.8% -1.4% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -5.5% -5.8% +0.3% +10.0% ➖ noise
90 duckdb:duckdb -9.7% -5.8% -4.2% +10.0% ➖ noise
90 duckdb:vortex-compact -4.2% -5.8% +1.7% +13.3% ➖ noise
90 duckdb:vortex-file-compressed -0.7% -5.8% +5.4% +16.6% ➖ noise
91 datafusion:vortex-compact -5.1% -4.0% -1.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -6.0% -4.0% -2.1% +12.3% ➖ noise
91 duckdb:duckdb -3.0% -4.0% +1.1% +11.1% ➖ noise
91 duckdb:vortex-compact -9.4% -4.0% -5.6% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +2.9% -4.0% +7.2% +10.0% ➖ noise
92 datafusion:vortex-compact -1.6% -1.9% +0.3% +10.1% ➖ noise
92 datafusion:vortex-file-compressed -10.5% -1.9% -8.7% +10.7% ➖ noise
92 duckdb:duckdb +3.7% -1.9% +5.7% +14.0% ➖ noise
92 duckdb:vortex-compact -5.2% -1.9% -3.4% +21.1% ➖ noise
92 duckdb:vortex-file-compressed -2.9% -1.9% -1.0% +15.8% ➖ noise
93 datafusion:vortex-compact -2.8% -5.3% +2.6% +12.4% ➖ noise
93 datafusion:vortex-file-compressed -2.7% -5.3% +2.7% +10.0% ➖ noise
93 duckdb:duckdb +8.0% -5.3% +14.0% +16.1% ➖ noise
93 duckdb:vortex-compact +2.6% -5.3% +8.3% +14.1% ➖ noise
93 duckdb:vortex-file-compressed +2.8% -5.3% +8.5% +15.3% ➖ noise
94 datafusion:vortex-compact +4.0% -1.1% +5.1% +11.6% ➖ noise
94 datafusion:vortex-file-compressed -1.9% -1.1% -0.8% +11.0% ➖ noise
94 duckdb:duckdb +1.0% -1.1% +2.1% +10.3% ➖ noise
94 duckdb:vortex-compact -14.0% -1.1% -13.1% +14.2% ✅ faster
94 duckdb:vortex-file-compressed -0.5% -1.1% +0.6% +10.0% ➖ noise
95 datafusion:vortex-compact -4.1% -8.9% +5.2% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -2.7% -8.9% +6.8% +10.0% ➖ noise
95 duckdb:duckdb -18.0% -8.9% -10.0% +16.9% ➖ noise
95 duckdb:vortex-compact -2.7% -8.9% +6.8% +13.8% ➖ noise
95 duckdb:vortex-file-compressed +0.5% -8.9% +10.3% +14.2% ➖ noise
96 datafusion:vortex-compact -11.0% -6.1% -5.2% +11.9% ➖ noise
96 datafusion:vortex-file-compressed -2.3% -6.1% +4.0% +10.0% ➖ noise
96 duckdb:duckdb -5.7% -6.1% +0.4% +13.1% ➖ noise
96 duckdb:vortex-compact -0.4% -6.1% +6.0% +10.0% ➖ noise
96 duckdb:vortex-file-compressed +6.6% -6.1% +13.5% +11.2% 🚨 regression
97 datafusion:vortex-compact -11.0% -5.0% -6.3% +10.4% ➖ noise
97 datafusion:vortex-file-compressed -5.1% -5.0% -0.1% +11.0% ➖ noise
97 duckdb:duckdb +3.7% -5.0% +9.2% +10.3% ➖ noise
97 duckdb:vortex-compact +4.1% -5.0% +9.6% +11.8% ➖ noise
97 duckdb:vortex-file-compressed +0.1% -5.0% +5.4% +10.0% ➖ noise
98 datafusion:vortex-compact -14.0% -1.0% -13.2% +10.0% ✅ faster
98 datafusion:vortex-file-compressed -5.2% -1.0% -4.3% +10.0% ➖ noise
98 duckdb:duckdb +0.7% -1.0% +1.7% +12.9% ➖ noise
98 duckdb:vortex-compact +2.5% -1.0% +3.5% +12.1% ➖ noise
98 duckdb:vortex-file-compressed -4.8% -1.0% -3.9% +10.0% ➖ noise
99 datafusion:vortex-compact +2.9% -11.0% +15.6% +18.0% ➖ noise
99 datafusion:vortex-file-compressed -7.2% -11.0% +4.3% +16.5% ➖ noise
99 duckdb:duckdb -2.4% -11.0% +9.7% +35.7% ➖ noise
99 duckdb:vortex-compact -7.8% -11.0% +3.6% +22.9% ➖ noise
99 duckdb:vortex-file-compressed -10.3% -11.0% +0.8% +19.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.1%
Vortex (geomean): 0.930x ➖
Parquet (geomean): 1.023x ➖
Shifts: Parquet (control) +2.3% · Median polish -3.0%


datafusion / vortex-file-compressed (0.928x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 30325115 35704308 0.85
fineweb_q01/datafusion:vortex-file-compressed 523445625 674133709 0.78
fineweb_q02/datafusion:vortex-file-compressed 508514143 528265014 0.96
fineweb_q03/datafusion:vortex-file-compressed 1388108661 1516109724 0.92
fineweb_q04/datafusion:vortex-file-compressed 1387028083 1464053771 0.95
fineweb_q05/datafusion:vortex-file-compressed 1348500180 1379969857 0.98
fineweb_q06/datafusion:vortex-file-compressed 1534841596 1550924215 0.99
fineweb_q07/datafusion:vortex-file-compressed 1344500497 1346495670 1.00
fineweb_q08/datafusion:vortex-file-compressed 528982015 551704662 0.96
datafusion / vortex-compact (0.835x ➖, 1↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33895511 38607180 0.88
fineweb_q01/datafusion:vortex-compact 489460451 612816744 0.80
fineweb_q02/datafusion:vortex-compact 🚀 543306375 1065390790 0.51
fineweb_q03/datafusion:vortex-compact 1485012278 1784342053 0.83
fineweb_q04/datafusion:vortex-compact 1813282079 1830335058 0.99
fineweb_q05/datafusion:vortex-compact 1476373140 1550907648 0.95
fineweb_q06/datafusion:vortex-compact 1375038362 1522210834 0.90
fineweb_q07/datafusion:vortex-compact 1218061737 1269668716 0.96
fineweb_q08/datafusion:vortex-compact 398697311 489626302 0.81
datafusion / parquet (1.030x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1239143051 1048909770 1.18
fineweb_q01/datafusion:parquet 1939112420 1675311748 1.16
fineweb_q02/datafusion:parquet 1593405781 1663590855 0.96
fineweb_q03/datafusion:parquet 1865696480 1693417529 1.10
fineweb_q04/datafusion:parquet 1665540896 1933210588 0.86
fineweb_q05/datafusion:parquet 1978269917 1724515688 1.15
fineweb_q06/datafusion:parquet 2016741408 1808931796 1.11
fineweb_q07/datafusion:parquet 1678121181 1863246059 0.90
fineweb_q08/datafusion:parquet 1831461350 2016909846 0.91
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 85934653 83143584 1.03
fineweb_q01/duckdb:vortex-file-compressed 617669939 561523675 1.10
fineweb_q02/duckdb:vortex-file-compressed 450340797 479837267 0.94
fineweb_q03/duckdb:vortex-file-compressed 1460341442 1630746840 0.90
fineweb_q04/duckdb:vortex-file-compressed 1529985817 1536941892 1.00
fineweb_q05/duckdb:vortex-file-compressed 1469304100 1562130239 0.94
fineweb_q06/duckdb:vortex-file-compressed 1612697565 1672898235 0.96
fineweb_q07/duckdb:vortex-file-compressed 1728623926 1483774920 1.17
fineweb_q08/duckdb:vortex-file-compressed 623329974 697802820 0.89
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 94262268 84690027 1.11
fineweb_q01/duckdb:vortex-compact 524035767 547815663 0.96
fineweb_q02/duckdb:vortex-compact 557592291 576424018 0.97
fineweb_q03/duckdb:vortex-compact 1658622876 1746459480 0.95
fineweb_q04/duckdb:vortex-compact 1808957775 1839166356 0.98
fineweb_q05/duckdb:vortex-compact 1518021493 1575625410 0.96
fineweb_q06/duckdb:vortex-compact 1533332835 1457974081 1.05
fineweb_q07/duckdb:vortex-compact 1369574289 1508768212 0.91
fineweb_q08/duckdb:vortex-compact 456263928 500106346 0.91
duckdb / parquet (1.016x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1130985565 1055995475 1.07
fineweb_q01/duckdb:parquet 1337115179 1319061012 1.01
fineweb_q02/duckdb:parquet 1448785049 1322109233 1.10
fineweb_q03/duckdb:parquet 3542077837 3704376152 0.96
fineweb_q04/duckdb:parquet 1855912882 1856344693 1.00
fineweb_q05/duckdb:parquet 2075631456 2065166733 1.01
fineweb_q06/duckdb:parquet 4273541175 4450902622 0.96
fineweb_q07/duckdb:parquet 2684148452 2529120564 1.06
fineweb_q08/duckdb:parquet 1087211588 1100909060 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -12.2% +12.5% -21.9% +137.2% ➖ noise
0 datafusion:vortex-file-compressed -15.1% +12.5% -24.5% +218.0% ➖ noise
0 duckdb:vortex-compact +11.3% +12.5% -1.0% +41.9% ➖ noise
0 duckdb:vortex-file-compressed +3.4% +12.5% -8.1% +36.1% ➖ noise
1 datafusion:vortex-compact -20.1% +8.3% -26.3% +43.4% ➖ noise
1 datafusion:vortex-file-compressed -22.4% +8.3% -28.3% +46.2% ➖ noise
1 duckdb:vortex-compact -4.3% +8.3% -11.7% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +10.0% +8.3% +1.6% +30.0% ➖ noise
2 datafusion:vortex-compact -49.0% +2.4% -50.2% +30.0% ✅ faster
2 datafusion:vortex-file-compressed -3.7% +2.4% -6.0% +41.6% ➖ noise
2 duckdb:vortex-compact -3.3% +2.4% -5.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -6.1% +2.4% -8.4% +30.0% ➖ noise
3 datafusion:vortex-compact -16.8% +2.6% -18.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -8.4% +2.6% -10.8% +30.0% ➖ noise
3 duckdb:vortex-compact -5.0% +2.6% -7.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -10.4% +2.6% -12.8% +30.0% ➖ noise
4 datafusion:vortex-compact -0.9% -7.2% +6.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -5.3% -7.2% +2.1% +30.0% ➖ noise
4 duckdb:vortex-compact -1.6% -7.2% +6.0% +277.3% ➖ noise
4 duckdb:vortex-file-compressed -0.5% -7.2% +7.3% +30.0% ➖ noise
5 datafusion:vortex-compact -4.8% +7.4% -11.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.3% +7.4% -9.0% +30.0% ➖ noise
5 duckdb:vortex-compact -3.7% +7.4% -10.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -5.9% +7.4% -12.4% +30.0% ➖ noise
6 datafusion:vortex-compact -9.7% +3.5% -12.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -1.0% +3.5% -4.3% +30.0% ➖ noise
6 duckdb:vortex-compact +5.2% +3.5% +1.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -3.6% +3.5% -6.8% +30.0% ➖ noise
7 datafusion:vortex-compact -4.1% -2.2% -1.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.1% -2.2% +2.1% +30.0% ➖ noise
7 duckdb:vortex-compact -9.2% -2.2% -7.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +16.5% -2.2% +19.2% +30.0% ➖ noise
8 datafusion:vortex-compact -18.6% -5.3% -14.0% +35.2% ➖ noise
8 datafusion:vortex-file-compressed -4.1% -5.3% +1.3% +30.0% ➖ noise
8 duckdb:vortex-compact -8.8% -5.3% -3.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -10.7% -5.3% -5.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.1%


duckdb / vortex-file-compressed (1.011x ➖, 0↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11653085 11715828 0.99
statpopgen_q01/duckdb:vortex-file-compressed 🚨 26208541 20949495 1.25
statpopgen_q02/duckdb:vortex-file-compressed 1389786562 1400155081 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3111076797 3154305434 0.99
statpopgen_q04/duckdb:vortex-file-compressed 3094714800 3101764398 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1440551924 1482467262 0.97
statpopgen_q06/duckdb:vortex-file-compressed 2133099957 2157779056 0.99
statpopgen_q07/duckdb:vortex-file-compressed 219795611 226441205 0.97
statpopgen_q08/duckdb:vortex-file-compressed 264758472 262577885 1.01
statpopgen_q09/duckdb:vortex-file-compressed 2932948377 2938111898 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4730498740 4769601358 0.99
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12121363 11705324 1.04
statpopgen_q01/duckdb:vortex-compact 166869525 167346390 1.00
statpopgen_q02/duckdb:vortex-compact 1822098121 1819031505 1.00
statpopgen_q03/duckdb:vortex-compact 3563769646 3501946378 1.02
statpopgen_q04/duckdb:vortex-compact 3555745414 3588891019 0.99
statpopgen_q05/duckdb:vortex-compact 1792462205 1838640859 0.97
statpopgen_q06/duckdb:vortex-compact 2689407631 2690486075 1.00
statpopgen_q07/duckdb:vortex-compact 897670297 898402424 1.00
statpopgen_q08/duckdb:vortex-compact 936191550 931681147 1.00
statpopgen_q09/duckdb:vortex-compact 3270743735 3355492816 0.97
statpopgen_q10/duckdb:vortex-compact 5379444231 5392068167 1.00
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 326082976 330789185 0.99
statpopgen_q01/duckdb:parquet 415916830 409164889 1.02
statpopgen_q02/duckdb:parquet 1002907060 999430945 1.00
statpopgen_q03/duckdb:parquet 1530600650 1476488998 1.04
statpopgen_q04/duckdb:parquet 1504045785 1497161740 1.00
statpopgen_q05/duckdb:parquet 1016984294 1004287161 1.01
statpopgen_q06/duckdb:parquet 1473636461 1479957233 1.00
statpopgen_q07/duckdb:parquet 1331129274 1308384822 1.02
statpopgen_q08/duckdb:parquet 1328806384 1320395697 1.01
statpopgen_q09/duckdb:parquet 1358110040 1383892348 0.98
statpopgen_q10/duckdb:parquet 2679893685 2692062713 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.6% -1.4% +5.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.5% -1.4% +0.9% +16.3% ➖ noise
1 duckdb:vortex-compact -0.3% +1.7% -1.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +25.1% +1.7% +23.1% +193.8% ➖ noise
2 duckdb:vortex-compact +0.2% +0.3% -0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.7% +0.3% -1.1% +10.0% ➖ noise
3 duckdb:vortex-compact +1.8% +3.7% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.4% +3.7% -4.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% +0.5% -1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +0.5% -0.7% +10.0% ➖ noise
5 duckdb:vortex-compact -2.5% +1.3% -3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.8% +1.3% -4.0% +10.0% ➖ noise
6 duckdb:vortex-compact -0.0% -0.4% +0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.1% -0.4% -0.7% +10.0% ➖ noise
7 duckdb:vortex-compact -0.1% +1.7% -1.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.9% +1.7% -4.6% +10.0% ➖ noise
8 duckdb:vortex-compact +0.5% +0.6% -0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.8% +0.6% +0.2% +10.0% ➖ noise
9 duckdb:vortex-compact -2.5% -1.9% -0.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% -1.9% +1.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.2% -0.5% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.8% -0.5% -0.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 1.069x ➖
Parquet (geomean): 1.046x ➖
Shifts: Parquet (control) +4.6% · Median polish +2.5%


datafusion / vortex-file-compressed (1.111x ❌, 0↑ 9↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 401352994 378445206 1.06
tpch_q02/datafusion:vortex-file-compressed 111903825 109532045 1.02
tpch_q03/datafusion:vortex-file-compressed 219914279 213338913 1.03
tpch_q04/datafusion:vortex-file-compressed 115053013 111748257 1.03
tpch_q05/datafusion:vortex-file-compressed 🚨 422330413 368174461 1.15
tpch_q06/datafusion:vortex-file-compressed 🚨 56018871 43842072 1.28
tpch_q07/datafusion:vortex-file-compressed 🚨 712356109 545142651 1.31
tpch_q08/datafusion:vortex-file-compressed 🚨 461512398 350934618 1.32
tpch_q09/datafusion:vortex-file-compressed 650365985 638716314 1.02
tpch_q10/datafusion:vortex-file-compressed 248857694 247742091 1.00
tpch_q11/datafusion:vortex-file-compressed 82714424 82146253 1.01
tpch_q12/datafusion:vortex-file-compressed 124782817 120567188 1.03
tpch_q13/datafusion:vortex-file-compressed 216640167 212413624 1.02
tpch_q14/datafusion:vortex-file-compressed 58524977 57042874 1.03
tpch_q15/datafusion:vortex-file-compressed 110594403 109187506 1.01
tpch_q16/datafusion:vortex-file-compressed 76007453 74642340 1.02
tpch_q17/datafusion:vortex-file-compressed 676297033 619199872 1.09
tpch_q18/datafusion:vortex-file-compressed 🚨 913500370 821016176 1.11
tpch_q19/datafusion:vortex-file-compressed 🚨 110788116 92606767 1.20
tpch_q20/datafusion:vortex-file-compressed 🚨 218346440 165728372 1.32
tpch_q21/datafusion:vortex-file-compressed 🚨 886382619 667300349 1.33
tpch_q22/datafusion:vortex-file-compressed 🚨 78558343 65561862 1.20
datafusion / vortex-compact (1.087x ➖, 0↑ 7↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 445850062 447116006 1.00
tpch_q02/datafusion:vortex-compact 117856493 111784306 1.05
tpch_q03/datafusion:vortex-compact 222612015 216370696 1.03
tpch_q04/datafusion:vortex-compact 124274975 121982855 1.02
tpch_q05/datafusion:vortex-compact 385230143 373511765 1.03
tpch_q06/datafusion:vortex-compact 66430788 63485646 1.05
tpch_q07/datafusion:vortex-compact 579527419 560411502 1.03
tpch_q08/datafusion:vortex-compact 360834710 352035356 1.02
tpch_q09/datafusion:vortex-compact 661182026 639858663 1.03
tpch_q10/datafusion:vortex-compact 280857440 264920172 1.06
tpch_q11/datafusion:vortex-compact 🚨 103718675 83893733 1.24
tpch_q12/datafusion:vortex-compact 🚨 202847829 166210031 1.22
tpch_q13/datafusion:vortex-compact 🚨 312315834 260223945 1.20
tpch_q14/datafusion:vortex-compact 🚨 90209889 72654325 1.24
tpch_q15/datafusion:vortex-compact 🚨 200116582 160585358 1.25
tpch_q16/datafusion:vortex-compact 🚨 94943326 78464813 1.21
tpch_q17/datafusion:vortex-compact 🚨 742475939 628242617 1.18
tpch_q18/datafusion:vortex-compact 850319985 820717779 1.04
tpch_q19/datafusion:vortex-compact 133738553 129063433 1.04
tpch_q20/datafusion:vortex-compact 196224476 188063458 1.04
tpch_q21/datafusion:vortex-compact 694956362 674943857 1.03
tpch_q22/datafusion:vortex-compact 72242922 73773327 0.98
datafusion / parquet (1.057x ➖, 0↑ 3↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 496386489 463083191 1.07
tpch_q02/datafusion:parquet 174889963 171093556 1.02
tpch_q03/datafusion:parquet 295134263 290154897 1.02
tpch_q04/datafusion:parquet 132277656 129900495 1.02
tpch_q05/datafusion:parquet 449913248 438537781 1.03
tpch_q06/datafusion:parquet 131658230 133505266 0.99
tpch_q07/datafusion:parquet 🚨 770648082 606150928 1.27
tpch_q08/datafusion:parquet 🚨 595258460 468201511 1.27
tpch_q09/datafusion:parquet 🚨 915606459 737363435 1.24
tpch_q10/datafusion:parquet 534709703 497154489 1.08
tpch_q11/datafusion:parquet 127544628 121272126 1.05
tpch_q12/datafusion:parquet 208391930 212031735 0.98
tpch_q13/datafusion:parquet 339936880 330705549 1.03
tpch_q14/datafusion:parquet 162335874 158000926 1.03
tpch_q15/datafusion:parquet 262567040 256268827 1.02
tpch_q16/datafusion:parquet 134087714 126905224 1.06
tpch_q17/datafusion:parquet 692255409 667490768 1.04
tpch_q18/datafusion:parquet 887231457 868657565 1.02
tpch_q19/datafusion:parquet 299060630 292627286 1.02
tpch_q20/datafusion:parquet 302339605 294677440 1.03
tpch_q21/datafusion:parquet 712788553 698228969 1.02
tpch_q22/datafusion:parquet 217386753 211496223 1.03
datafusion / arrow (1.078x ➖, 0↑ 7↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 584716726 588312515 0.99
tpch_q02/datafusion:arrow 159703107 158606555 1.01
tpch_q03/datafusion:arrow 466476364 463645178 1.01
tpch_q04/datafusion:arrow 343194732 337256564 1.02
tpch_q05/datafusion:arrow 943177698 912893757 1.03
tpch_q06/datafusion:arrow 🚨 346048182 279115704 1.24
tpch_q07/datafusion:arrow 🚨 1476990566 1140147350 1.30
tpch_q08/datafusion:arrow 🚨 1293442770 1111793726 1.16
tpch_q09/datafusion:arrow 1344024661 1315119179 1.02
tpch_q10/datafusion:arrow 591116654 581551500 1.02
tpch_q11/datafusion:arrow 134951489 134452556 1.00
tpch_q12/datafusion:arrow 708106832 661898382 1.07
tpch_q13/datafusion:arrow 482614780 498331049 0.97
tpch_q14/datafusion:arrow 318304318 312894167 1.02
tpch_q15/datafusion:arrow 708595396 681828337 1.04
tpch_q16/datafusion:arrow 🚨 120568644 100655643 1.20
tpch_q17/datafusion:arrow 🚨 1453201707 1292942472 1.12
tpch_q18/datafusion:arrow 1880019209 1863357233 1.01
tpch_q19/datafusion:arrow 🚨 601894280 484088710 1.24
tpch_q20/datafusion:arrow 🚨 619772640 475027570 1.30
tpch_q21/datafusion:arrow 3036107571 2968569977 1.02
tpch_q22/datafusion:arrow 126016931 123292289 1.02
duckdb / vortex-file-compressed (1.025x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 173719598 170207746 1.02
tpch_q02/duckdb:vortex-file-compressed 52938730 51886006 1.02
tpch_q03/duckdb:vortex-file-compressed 130022113 126305953 1.03
tpch_q04/duckdb:vortex-file-compressed 158074095 151381352 1.04
tpch_q05/duckdb:vortex-file-compressed 131126726 129257736 1.01
tpch_q06/duckdb:vortex-file-compressed 50009384 46879261 1.07
tpch_q07/duckdb:vortex-file-compressed 148150791 144703845 1.02
tpch_q08/duckdb:vortex-file-compressed 174619435 171359378 1.02
tpch_q09/duckdb:vortex-file-compressed 325899375 322111508 1.01
tpch_q10/duckdb:vortex-file-compressed 150341807 143217604 1.05
tpch_q11/duckdb:vortex-file-compressed 33612156 33289231 1.01
tpch_q12/duckdb:vortex-file-compressed 96471657 94921985 1.02
tpch_q13/duckdb:vortex-file-compressed 233396372 227316246 1.03
tpch_q14/duckdb:vortex-file-compressed 69461069 66828255 1.04
tpch_q15/duckdb:vortex-file-compressed 88655281 87876252 1.01
tpch_q16/duckdb:vortex-file-compressed 80728638 78100833 1.03
tpch_q17/duckdb:vortex-file-compressed 100972525 98584161 1.02
tpch_q18/duckdb:vortex-file-compressed 285226117 287250059 0.99
tpch_q19/duckdb:vortex-file-compressed 86158478 84011528 1.03
tpch_q20/duckdb:vortex-file-compressed 161917076 158331857 1.02
tpch_q21/duckdb:vortex-file-compressed 584867130 565548839 1.03
tpch_q22/duckdb:vortex-file-compressed 72798390 70990896 1.03
duckdb / vortex-compact (1.054x ➖, 0↑ 4↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229421395 228230388 1.01
tpch_q02/duckdb:vortex-compact 58090231 55710929 1.04
tpch_q03/duckdb:vortex-compact 141844673 139197533 1.02
tpch_q04/duckdb:vortex-compact 174224308 170993076 1.02
tpch_q05/duckdb:vortex-compact 149760356 142603244 1.05
tpch_q06/duckdb:vortex-compact 83929473 84011424 1.00
tpch_q07/duckdb:vortex-compact 199380128 197264627 1.01
tpch_q08/duckdb:vortex-compact 188970750 186394187 1.01
tpch_q09/duckdb:vortex-compact 358531466 349589108 1.03
tpch_q10/duckdb:vortex-compact 179919699 172683892 1.04
tpch_q11/duckdb:vortex-compact 41488628 40426412 1.03
tpch_q12/duckdb:vortex-compact 205046384 201807245 1.02
tpch_q13/duckdb:vortex-compact 285788913 276425472 1.03
tpch_q14/duckdb:vortex-compact 100867611 99350102 1.02
tpch_q15/duckdb:vortex-compact 113978330 111690077 1.02
tpch_q16/duckdb:vortex-compact 86553347 82989908 1.04
tpch_q17/duckdb:vortex-compact 117728371 113620198 1.04
tpch_q18/duckdb:vortex-compact 🚨 335615699 288182287 1.16
tpch_q19/duckdb:vortex-compact 🚨 123157405 106986953 1.15
tpch_q20/duckdb:vortex-compact 🚨 249319651 200904427 1.24
tpch_q21/duckdb:vortex-compact 🚨 747782638 610106742 1.23
tpch_q22/duckdb:vortex-compact 87028111 83543598 1.04
duckdb / parquet (1.034x ➖, 0↑ 2↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260846728 257521294 1.01
tpch_q02/duckdb:parquet 98580485 95867787 1.03
tpch_q03/duckdb:parquet 207223394 202454570 1.02
tpch_q04/duckdb:parquet 132315895 130177043 1.02
tpch_q05/duckdb:parquet 215733863 214272016 1.01
tpch_q06/duckdb:parquet 66091401 66523230 0.99
tpch_q07/duckdb:parquet 182250942 179577462 1.01
tpch_q08/duckdb:parquet 254812246 252206417 1.01
tpch_q09/duckdb:parquet 🚨 560922980 490407404 1.14
tpch_q10/duckdb:parquet 661400554 608375250 1.09
tpch_q11/duckdb:parquet 59900431 59188583 1.01
tpch_q12/duckdb:parquet 123922447 123136643 1.01
tpch_q13/duckdb:parquet 444343733 444105276 1.00
tpch_q14/duckdb:parquet 174155883 172558025 1.01
tpch_q15/duckdb:parquet 98422433 98002736 1.00
tpch_q16/duckdb:parquet 163340146 161630004 1.01
tpch_q17/duckdb:parquet 185748531 175754428 1.06
tpch_q18/duckdb:parquet 🚨 396366627 353049979 1.12
tpch_q19/duckdb:parquet 310075486 283641243 1.09
tpch_q20/duckdb:parquet 245481962 230099386 1.07
tpch_q21/duckdb:parquet 567035575 553046026 1.03
tpch_q22/duckdb:parquet 292659100 288237220 1.02
duckdb / duckdb (1.068x ➖, 0↑ 9↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116320091 116311541 1.00
tpch_q02/duckdb:duckdb 45717821 44090644 1.04
tpch_q03/duckdb:duckdb 97700418 97515569 1.00
tpch_q04/duckdb:duckdb 134863936 130038179 1.04
tpch_q05/duckdb:duckdb 110352939 110936408 0.99
tpch_q06/duckdb:duckdb 38295838 37492381 1.02
tpch_q07/duckdb:duckdb 86650258 86712242 1.00
tpch_q08/duckdb:duckdb 110533519 110496113 1.00
tpch_q09/duckdb:duckdb 276865400 277394639 1.00
tpch_q10/duckdb:duckdb 206764736 201624141 1.03
tpch_q11/duckdb:duckdb 🚨 17715260 15345499 1.15
tpch_q12/duckdb:duckdb 🚨 95766746 84809718 1.13
tpch_q13/duckdb:duckdb 🚨 260396661 220728553 1.18
tpch_q14/duckdb:duckdb 🚨 80595513 69782151 1.15
tpch_q15/duckdb:duckdb 🚨 89031567 77376113 1.15
tpch_q16/duckdb:duckdb 🚨 84578459 73466373 1.15
tpch_q17/duckdb:duckdb 🚨 94070930 84808140 1.11
tpch_q18/duckdb:duckdb 🚨 245508985 211322636 1.16
tpch_q19/duckdb:duckdb 🚨 128842901 115824067 1.11
tpch_q20/duckdb:duckdb 112751599 111163864 1.01
tpch_q21/duckdb:duckdb 305536077 288533157 1.06
tpch_q22/duckdb:duckdb 73308680 69894174 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.6% +4.2% -4.6% +12.6% ➖ noise
1 datafusion:vortex-compact -0.3% +4.2% -4.3% +12.6% ➖ noise
1 datafusion:vortex-file-compressed +6.1% +4.2% +1.8% +12.6% ➖ noise
1 duckdb:duckdb +0.0% +4.2% -4.0% +12.6% ➖ noise
1 duckdb:vortex-compact +0.5% +4.2% -3.5% +12.6% ➖ noise
1 duckdb:vortex-file-compressed +2.1% +4.2% -2.1% +12.6% ➖ noise
2 datafusion:arrow +0.7% +2.5% -1.8% +12.6% ➖ noise
2 datafusion:vortex-compact +5.4% +2.5% +2.8% +12.6% ➖ noise
2 datafusion:vortex-file-compressed +2.2% +2.5% -0.3% +12.6% ➖ noise
2 duckdb:duckdb +3.7% +2.5% +1.1% +12.6% ➖ noise
2 duckdb:vortex-compact +4.3% +2.5% +1.7% +12.6% ➖ noise
2 duckdb:vortex-file-compressed +2.0% +2.5% -0.5% +12.6% ➖ noise
3 datafusion:arrow +0.6% +2.0% -1.4% +12.6% ➖ noise
3 datafusion:vortex-compact +2.9% +2.0% +0.8% +12.6% ➖ noise
3 datafusion:vortex-file-compressed +3.1% +2.0% +1.0% +12.6% ➖ noise
3 duckdb:duckdb +0.2% +2.0% -1.8% +12.6% ➖ noise
3 duckdb:vortex-compact +1.9% +2.0% -0.1% +12.6% ➖ noise
3 duckdb:vortex-file-compressed +2.9% +2.0% +0.9% +12.6% ➖ noise
4 datafusion:arrow +1.8% +1.7% +0.0% +12.6% ➖ noise
4 datafusion:vortex-compact +1.9% +1.7% +0.1% +12.6% ➖ noise
4 datafusion:vortex-file-compressed +3.0% +1.7% +1.2% +12.6% ➖ noise
4 duckdb:duckdb +3.7% +1.7% +1.9% +12.6% ➖ noise
4 duckdb:vortex-compact +1.9% +1.7% +0.2% +12.6% ➖ noise
4 duckdb:vortex-file-compressed +4.4% +1.7% +2.6% +12.6% ➖ noise
5 datafusion:arrow +3.3% +1.6% +1.7% +12.6% ➖ noise
5 datafusion:vortex-compact +3.1% +1.6% +1.5% +12.6% ➖ noise
5 datafusion:vortex-file-compressed +14.7% +1.6% +12.9% +12.6% 🚨 regression
5 duckdb:duckdb -0.5% +1.6% -2.1% +12.6% ➖ noise
5 duckdb:vortex-compact +5.0% +1.6% +3.3% +12.6% ➖ noise
5 duckdb:vortex-file-compressed +1.4% +1.6% -0.2% +12.6% ➖ noise
6 datafusion:arrow +24.0% -1.0% +25.3% +12.6% 🚨 regression
6 datafusion:vortex-compact +4.6% -1.0% +5.7% +12.6% ➖ noise
6 datafusion:vortex-file-compressed +27.8% -1.0% +29.1% +12.6% 🚨 regression
6 duckdb:duckdb +2.1% -1.0% +3.2% +12.6% ➖ noise
6 duckdb:vortex-compact -0.1% -1.0% +0.9% +12.6% ➖ noise
6 duckdb:vortex-file-compressed +6.7% -1.0% +7.8% +12.6% ➖ noise
7 datafusion:arrow +29.5% +13.6% +14.0% +12.6% 🚨 regression
7 datafusion:vortex-compact +3.4% +13.6% -9.0% +12.6% ➖ noise
7 datafusion:vortex-file-compressed +30.7% +13.6% +15.0% +12.6% 🚨 regression
7 duckdb:duckdb -0.1% +13.6% -12.0% +12.6% ✅ faster
7 duckdb:vortex-compact +1.1% +13.6% -11.0% +12.6% ➖ noise
7 duckdb:vortex-file-compressed +2.4% +13.6% -9.9% +12.6% ➖ noise
8 datafusion:arrow +16.3% +13.3% +2.6% +12.6% ➖ noise
8 datafusion:vortex-compact +2.5% +13.3% -9.6% +12.6% ➖ noise
8 datafusion:vortex-file-compressed +31.5% +13.3% +16.0% +12.6% 🚨 regression
8 duckdb:duckdb +0.0% +13.3% -11.7% +12.6% ✅ faster
8 duckdb:vortex-compact +1.4% +13.3% -10.5% +12.6% ➖ noise
8 duckdb:vortex-file-compressed +1.9% +13.3% -10.1% +12.6% ➖ noise
9 datafusion:arrow +2.2% +19.2% -14.2% +12.6% ✅ faster
9 datafusion:vortex-compact +3.3% +19.2% -13.3% +12.6% ✅ faster
9 datafusion:vortex-file-compressed +1.8% +19.2% -14.6% +12.6% ✅ faster
9 duckdb:duckdb -0.2% +19.2% -16.3% +12.6% ✅ faster
9 duckdb:vortex-compact +2.6% +19.2% -13.9% +12.6% ✅ faster
9 duckdb:vortex-file-compressed +1.2% +19.2% -15.1% +12.6% ✅ faster
10 datafusion:arrow +1.6% +8.1% -6.0% +12.6% ➖ noise
10 datafusion:vortex-compact +6.0% +8.1% -2.0% +12.6% ➖ noise
10 datafusion:vortex-file-compressed +0.5% +8.1% -7.1% +12.6% ➖ noise
10 duckdb:duckdb +2.5% +8.1% -5.2% +12.6% ➖ noise
10 duckdb:vortex-compact +4.2% +8.1% -3.6% +12.6% ➖ noise
10 duckdb:vortex-file-compressed +5.0% +8.1% -2.9% +12.6% ➖ noise
11 datafusion:arrow +0.4% +3.2% -2.7% +12.6% ➖ noise
11 datafusion:vortex-compact +23.6% +3.2% +19.8% +12.6% 🚨 regression
11 datafusion:vortex-file-compressed +0.7% +3.2% -2.4% +12.6% ➖ noise
11 duckdb:duckdb +15.4% +3.2% +11.9% +12.6% ➖ noise
11 duckdb:vortex-compact +2.6% +3.2% -0.5% +12.6% ➖ noise
11 duckdb:vortex-file-compressed +1.0% +3.2% -2.1% +12.6% ➖ noise
12 datafusion:arrow +7.0% -0.5% +7.6% +38.1% ➖ noise
12 datafusion:vortex-compact +22.0% -0.5% +22.7% +12.6% 🚨 regression
12 datafusion:vortex-file-compressed +3.5% -0.5% +4.1% +12.6% ➖ noise
12 duckdb:duckdb +12.9% -0.5% +13.5% +12.6% 🚨 regression
12 duckdb:vortex-compact +1.6% -0.5% +2.2% +12.6% ➖ noise
12 duckdb:vortex-file-compressed +1.6% -0.5% +2.2% +12.6% ➖ noise
13 datafusion:arrow -3.2% +1.4% -4.5% +12.6% ➖ noise
13 datafusion:vortex-compact +20.0% +1.4% +18.3% +12.6% 🚨 regression
13 datafusion:vortex-file-compressed +2.0% +1.4% +0.6% +12.6% ➖ noise
13 duckdb:duckdb +18.0% +1.4% +16.3% +12.6% 🚨 regression
13 duckdb:vortex-compact +3.4% +1.4% +1.9% +12.6% ➖ noise
13 duckdb:vortex-file-compressed +2.7% +1.4% +1.2% +12.6% ➖ noise
14 datafusion:arrow +1.7% +1.8% -0.1% +12.6% ➖ noise
14 datafusion:vortex-compact +24.2% +1.8% +21.9% +12.6% 🚨 regression
14 datafusion:vortex-file-compressed +2.6% +1.8% +0.8% +12.6% ➖ noise
14 duckdb:duckdb +15.5% +1.8% +13.4% +12.6% 🚨 regression
14 duckdb:vortex-compact +1.5% +1.8% -0.3% +12.6% ➖ noise
14 duckdb:vortex-file-compressed +3.9% +1.8% +2.1% +12.6% ➖ noise
15 datafusion:arrow +3.9% +1.4% +2.5% +12.6% ➖ noise
15 datafusion:vortex-compact +24.6% +1.4% +22.9% +12.6% 🚨 regression
15 datafusion:vortex-file-compressed +1.3% +1.4% -0.1% +12.6% ➖ noise
15 duckdb:duckdb +15.1% +1.4% +13.4% +12.6% 🚨 regression
15 duckdb:vortex-compact +2.0% +1.4% +0.6% +12.6% ➖ noise
15 duckdb:vortex-file-compressed +0.9% +1.4% -0.5% +12.6% ➖ noise
16 datafusion:arrow +19.8% +3.3% +15.9% +12.6% 🚨 regression
16 datafusion:vortex-compact +21.0% +3.3% +17.1% +12.6% 🚨 regression
16 datafusion:vortex-file-compressed +1.8% +3.3% -1.5% +12.6% ➖ noise
16 duckdb:duckdb +15.1% +3.3% +11.4% +12.6% ➖ noise
16 duckdb:vortex-compact +4.3% +3.3% +0.9% +12.6% ➖ noise
16 duckdb:vortex-file-compressed +3.4% +3.3% +0.0% +12.6% ➖ noise
17 datafusion:arrow +12.4% +4.7% +7.4% +12.6% ➖ noise
17 datafusion:vortex-compact +18.2% +4.7% +12.9% +12.6% 🚨 regression
17 datafusion:vortex-file-compressed +9.2% +4.7% +4.3% +12.6% ➖ noise
17 duckdb:duckdb +10.9% +4.7% +5.9% +12.6% ➖ noise
17 duckdb:vortex-compact +3.6% +4.7% -1.0% +12.6% ➖ noise
17 duckdb:vortex-file-compressed +2.4% +4.7% -2.2% +12.6% ➖ noise
18 datafusion:arrow +0.9% +7.1% -5.8% +12.6% ➖ noise
18 datafusion:vortex-compact +3.6% +7.1% -3.2% +12.6% ➖ noise
18 datafusion:vortex-file-compressed +11.3% +7.1% +3.9% +12.6% ➖ noise
18 duckdb:duckdb +16.2% +7.1% +8.5% +12.6% ➖ noise
18 duckdb:vortex-compact +16.5% +7.1% +8.8% +12.6% ➖ noise
18 duckdb:vortex-file-compressed -0.7% +7.1% -7.3% +12.6% ➖ noise
19 datafusion:arrow +24.3% +5.7% +17.6% +12.6% 🚨 regression
19 datafusion:vortex-compact +3.6% +5.7% -2.0% +12.6% ➖ noise
19 datafusion:vortex-file-compressed +19.6% +5.7% +13.2% +12.6% 🚨 regression
19 duckdb:duckdb +11.2% +5.7% +5.2% +12.6% ➖ noise
19 duckdb:vortex-compact +15.1% +5.7% +8.9% +12.6% ➖ noise
19 duckdb:vortex-file-compressed +2.6% +5.7% -3.0% +12.6% ➖ noise
20 datafusion:arrow +30.5% +4.6% +24.7% +12.6% 🚨 regression
20 datafusion:vortex-compact +4.3% +4.6% -0.3% +12.6% ➖ noise
20 datafusion:vortex-file-compressed +31.7% +4.6% +25.9% +12.6% 🚨 regression
20 duckdb:duckdb +1.4% +4.6% -3.1% +12.6% ➖ noise
20 duckdb:vortex-compact +24.1% +4.6% +18.6% +12.6% 🚨 regression
20 duckdb:vortex-file-compressed +2.3% +4.6% -2.3% +12.6% ➖ noise
21 datafusion:arrow +2.3% +2.3% -0.0% +12.6% ➖ noise
21 datafusion:vortex-compact +3.0% +2.3% +0.6% +12.6% ➖ noise
21 datafusion:vortex-file-compressed +32.8% +2.3% +29.8% +12.6% 🚨 regression
21 duckdb:duckdb +5.9% +2.3% +3.5% +12.6% ➖ noise
21 duckdb:vortex-compact +22.6% +2.3% +19.8% +12.6% 🚨 regression
21 duckdb:vortex-file-compressed +3.4% +2.3% +1.1% +12.6% ➖ noise
22 datafusion:arrow +2.2% +2.2% +0.1% +12.6% ➖ noise
22 datafusion:vortex-compact -2.1% +2.2% -4.1% +12.6% ➖ noise
22 datafusion:vortex-file-compressed +19.8% +2.2% +17.3% +12.6% 🚨 regression
22 duckdb:duckdb +4.9% +2.2% +2.7% +12.6% ➖ noise
22 duckdb:vortex-compact +4.2% +2.2% +2.0% +12.6% ➖ noise
22 duckdb:vortex-file-compressed +2.5% +2.2% +0.4% +12.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.0%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 1.021x ➖
Shifts: Parquet (control) +2.1% · Median polish -1.8%


datafusion / vortex-file-compressed (0.940x ➖, 1↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 261267743 261031165 1.00
tpch_q02/datafusion:vortex-file-compressed 445150719 520455767 0.86
tpch_q03/datafusion:vortex-file-compressed 452004295 442285319 1.02
tpch_q04/datafusion:vortex-file-compressed 257119482 272553237 0.94
tpch_q05/datafusion:vortex-file-compressed 415214327 446447547 0.93
tpch_q06/datafusion:vortex-file-compressed 346489662 404363977 0.86
tpch_q07/datafusion:vortex-file-compressed 443314912 496234350 0.89
tpch_q08/datafusion:vortex-file-compressed 541733389 556964788 0.97
tpch_q09/datafusion:vortex-file-compressed 397093621 422646255 0.94
tpch_q10/datafusion:vortex-file-compressed 533608268 511131185 1.04
tpch_q11/datafusion:vortex-file-compressed 288930093 292676862 0.99
tpch_q12/datafusion:vortex-file-compressed 437165253 493537442 0.89
tpch_q13/datafusion:vortex-file-compressed 🚀 135824448 210286846 0.65
tpch_q14/datafusion:vortex-file-compressed 247233915 264486621 0.93
tpch_q15/datafusion:vortex-file-compressed 488431514 532823388 0.92
tpch_q16/datafusion:vortex-file-compressed 184716811 196598242 0.94
tpch_q17/datafusion:vortex-file-compressed 332407259 424525054 0.78
tpch_q18/datafusion:vortex-file-compressed 342855433 407609161 0.84
tpch_q19/datafusion:vortex-file-compressed 491857751 480675017 1.02
tpch_q20/datafusion:vortex-file-compressed 452592684 438063208 1.03
tpch_q21/datafusion:vortex-file-compressed 606502645 540598021 1.12
tpch_q22/datafusion:vortex-file-compressed 🚨 182215642 139977767 1.30
datafusion / vortex-compact (0.919x ➖, 2↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 193984636 223526374 0.87
tpch_q02/datafusion:vortex-compact 458261586 603485682 0.76
tpch_q03/datafusion:vortex-compact 324944723 365023650 0.89
tpch_q04/datafusion:vortex-compact 196955799 192057192 1.03
tpch_q05/datafusion:vortex-compact 409494084 368482197 1.11
tpch_q06/datafusion:vortex-compact 298997020 279931063 1.07
tpch_q07/datafusion:vortex-compact 343489384 361284384 0.95
tpch_q08/datafusion:vortex-compact 480508400 478572937 1.00
tpch_q09/datafusion:vortex-compact 412425644 417883410 0.99
tpch_q10/datafusion:vortex-compact 427474046 419782991 1.02
tpch_q11/datafusion:vortex-compact 299051204 299329449 1.00
tpch_q12/datafusion:vortex-compact 445859879 367195288 1.21
tpch_q13/datafusion:vortex-compact 120258062 129000287 0.93
tpch_q14/datafusion:vortex-compact 202947373 188880614 1.07
tpch_q15/datafusion:vortex-compact 336573662 320296957 1.05
tpch_q16/datafusion:vortex-compact 184896131 195000569 0.95
tpch_q17/datafusion:vortex-compact 🚀 304576975 479263354 0.64
tpch_q18/datafusion:vortex-compact 233686465 282137222 0.83
tpch_q19/datafusion:vortex-compact 🚀 362991515 583396458 0.62
tpch_q20/datafusion:vortex-compact 367400797 416408598 0.88
tpch_q21/datafusion:vortex-compact 492434284 559418437 0.88
tpch_q22/datafusion:vortex-compact 138169077 186844292 0.74
datafusion / parquet (0.994x ➖, 0↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 221305850 212524157 1.04
tpch_q02/datafusion:parquet 427851646 437567521 0.98
tpch_q03/datafusion:parquet 291302953 315631370 0.92
tpch_q04/datafusion:parquet 131492017 140597221 0.94
tpch_q05/datafusion:parquet 424691839 465589571 0.91
tpch_q06/datafusion:parquet 133104391 137128625 0.97
tpch_q07/datafusion:parquet 451805543 471584831 0.96
tpch_q08/datafusion:parquet 571074925 579956034 0.98
tpch_q09/datafusion:parquet 456885997 485784741 0.94
tpch_q10/datafusion:parquet 🚨 634593781 487117064 1.30
tpch_q11/datafusion:parquet 381868818 339464787 1.12
tpch_q12/datafusion:parquet 289085800 225757668 1.28
tpch_q13/datafusion:parquet 458456940 433024722 1.06
tpch_q14/datafusion:parquet 191498552 169082975 1.13
tpch_q15/datafusion:parquet 328312748 281064552 1.17
tpch_q16/datafusion:parquet 191684576 170905864 1.12
tpch_q17/datafusion:parquet 366415009 422862681 0.87
tpch_q18/datafusion:parquet 432906100 468037585 0.92
tpch_q19/datafusion:parquet 331009579 382925192 0.86
tpch_q20/datafusion:parquet 314294908 375490019 0.84
tpch_q21/datafusion:parquet 504584592 541801345 0.93
tpch_q22/datafusion:parquet 109483614 136838549 0.80
duckdb / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 262631471 345584095 0.76
tpch_q02/duckdb:vortex-file-compressed 981449320 1068195743 0.92
tpch_q03/duckdb:vortex-file-compressed 678174287 592329313 1.14
tpch_q04/duckdb:vortex-file-compressed 419099422 344864736 1.22
tpch_q05/duckdb:vortex-file-compressed 1013057556 935875894 1.08
tpch_q06/duckdb:vortex-file-compressed 417161018 387507387 1.08
tpch_q07/duckdb:vortex-file-compressed 779155215 831451631 0.94
tpch_q08/duckdb:vortex-file-compressed 1058436358 1017792834 1.04
tpch_q09/duckdb:vortex-file-compressed 866307473 902931036 0.96
tpch_q10/duckdb:vortex-file-compressed 764600146 737403558 1.04
tpch_q11/duckdb:vortex-file-compressed 523065218 504631462 1.04
tpch_q12/duckdb:vortex-file-compressed 470679819 463089492 1.02
tpch_q13/duckdb:vortex-file-compressed 467768834 453333340 1.03
tpch_q14/duckdb:vortex-file-compressed 463664268 468326300 0.99
tpch_q15/duckdb:vortex-file-compressed 291185781 300988917 0.97
tpch_q16/duckdb:vortex-file-compressed 405719057 366939834 1.11
tpch_q17/duckdb:vortex-file-compressed 761498318 709826319 1.07
tpch_q18/duckdb:vortex-file-compressed 548695643 566120631 0.97
tpch_q19/duckdb:vortex-file-compressed 459709241 428139626 1.07
tpch_q20/duckdb:vortex-file-compressed 794018247 837989857 0.95
tpch_q21/duckdb:vortex-file-compressed 1187123493 1221531341 0.97
tpch_q22/duckdb:vortex-file-compressed 378843211 394114926 0.96
duckdb / vortex-compact (1.013x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 267364685 276129082 0.97
tpch_q02/duckdb:vortex-compact 925939535 893281408 1.04
tpch_q03/duckdb:vortex-compact 624931000 636654817 0.98
tpch_q04/duckdb:vortex-compact 401897361 439888254 0.91
tpch_q05/duckdb:vortex-compact 861138221 852722051 1.01
tpch_q06/duckdb:vortex-compact 386300018 451870781 0.85
tpch_q07/duckdb:vortex-compact 846680347 761104425 1.11
tpch_q08/duckdb:vortex-compact 920377006 992708206 0.93
tpch_q09/duckdb:vortex-compact 890887735 866440537 1.03
tpch_q10/duckdb:vortex-compact 703956848 707920939 0.99
tpch_q11/duckdb:vortex-compact 455475560 466101612 0.98
tpch_q12/duckdb:vortex-compact 461077713 448383474 1.03
tpch_q13/duckdb:vortex-compact 438296685 441996302 0.99
tpch_q14/duckdb:vortex-compact 516691376 463348061 1.12
tpch_q15/duckdb:vortex-compact 315078703 268204397 1.17
tpch_q16/duckdb:vortex-compact 358236272 347583992 1.03
tpch_q17/duckdb:vortex-compact 679122001 626842710 1.08
tpch_q18/duckdb:vortex-compact 471510953 462489069 1.02
tpch_q19/duckdb:vortex-compact 439427930 414096945 1.06
tpch_q20/duckdb:vortex-compact 735793255 772683814 0.95
tpch_q21/duckdb:vortex-compact 1130128909 1111145439 1.02
tpch_q22/duckdb:vortex-compact 342541666 324127980 1.06
duckdb / parquet (1.049x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 440534008 442693520 1.00
tpch_q02/duckdb:parquet 1169644380 1382419287 0.85
tpch_q03/duckdb:parquet 959444455 1004726843 0.95
tpch_q04/duckdb:parquet 663169322 637728207 1.04
tpch_q05/duckdb:parquet 1527411572 1470240068 1.04
tpch_q06/duckdb:parquet 440690351 396115938 1.11
tpch_q07/duckdb:parquet 1267184733 1190209913 1.06
tpch_q08/duckdb:parquet 1749877283 1623618805 1.08
tpch_q09/duckdb:parquet 1430121483 1409643679 1.01
tpch_q10/duckdb:parquet 1282771114 1245133537 1.03
tpch_q11/duckdb:parquet 864146964 841262455 1.03
tpch_q12/duckdb:parquet 701395690 634974583 1.10
tpch_q13/duckdb:parquet 933112162 851816573 1.10
tpch_q14/duckdb:parquet 689933495 668551358 1.03
tpch_q15/duckdb:parquet 534753998 489710025 1.09
tpch_q16/duckdb:parquet 650790352 614247256 1.06
tpch_q17/duckdb:parquet 765313794 762521843 1.00
tpch_q18/duckdb:parquet 829571711 804806121 1.03
tpch_q19/duckdb:parquet 883142265 777563405 1.14
tpch_q20/duckdb:parquet 1187781386 1050701637 1.13
tpch_q21/duckdb:parquet 1220416806 1081833831 1.13
tpch_q22/duckdb:parquet 573643607 519536929 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.2% +1.8% -14.7% +79.4% ➖ noise
1 datafusion:vortex-file-compressed +0.1% +1.8% -1.7% +62.7% ➖ noise
1 duckdb:vortex-compact -3.2% +1.8% -4.9% +42.0% ➖ noise
1 duckdb:vortex-file-compressed -24.0% +1.8% -25.3% +43.3% ➖ noise
2 datafusion:vortex-compact -24.1% -9.0% -16.5% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -14.5% -9.0% -6.0% +30.0% ➖ noise
2 duckdb:vortex-compact +3.7% -9.0% +14.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -8.1% -9.0% +1.0% +30.0% ➖ noise
3 datafusion:vortex-compact -11.0% -6.1% -5.2% +63.9% ➖ noise
3 datafusion:vortex-file-compressed +2.2% -6.1% +8.9% +47.3% ➖ noise
3 duckdb:vortex-compact -1.8% -6.1% +4.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +14.5% -6.1% +22.0% +30.0% ➖ noise
4 datafusion:vortex-compact +2.6% -1.4% +4.0% +30.2% ➖ noise
4 datafusion:vortex-file-compressed -5.7% -1.4% -4.3% +45.9% ➖ noise
4 duckdb:vortex-compact -8.6% -1.4% -7.4% +37.0% ➖ noise
4 duckdb:vortex-file-compressed +21.5% -1.4% +23.2% +30.0% ➖ noise
5 datafusion:vortex-compact +11.1% -2.7% +14.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -7.0% -2.7% -4.5% +30.0% ➖ noise
5 duckdb:vortex-compact +1.0% -2.7% +3.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +8.2% -2.7% +11.2% +30.0% ➖ noise
6 datafusion:vortex-compact +6.8% +3.9% +2.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -14.3% +3.9% -17.5% +30.0% ➖ noise
6 duckdb:vortex-compact -14.5% +3.9% -17.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.7% +3.9% +3.6% +30.0% ➖ noise
7 datafusion:vortex-compact -4.9% +1.0% -5.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -10.7% +1.0% -11.5% +30.0% ➖ noise
7 duckdb:vortex-compact +11.2% +1.0% +10.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -6.3% +1.0% -7.2% +30.0% ➖ noise
8 datafusion:vortex-compact +0.4% +3.0% -2.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -2.7% +3.0% -5.6% +30.0% ➖ noise
8 duckdb:vortex-compact -7.3% +3.0% -10.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.0% +3.0% +0.9% +30.0% ➖ noise
9 datafusion:vortex-compact -1.3% -2.3% +1.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -6.0% -2.3% -3.8% +30.0% ➖ noise
9 duckdb:vortex-compact +2.8% -2.3% +5.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -4.1% -2.3% -1.8% +30.0% ➖ noise
10 datafusion:vortex-compact +1.8% +15.9% -12.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +4.4% +15.9% -9.9% +30.0% ➖ noise
10 duckdb:vortex-compact -0.6% +15.9% -14.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +3.7% +15.9% -10.5% +30.0% ➖ noise
11 datafusion:vortex-compact -0.1% +7.5% -7.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -1.3% +7.5% -8.2% +30.0% ➖ noise
11 duckdb:vortex-compact -2.3% +7.5% -9.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +3.7% +7.5% -3.6% +30.0% ➖ noise
12 datafusion:vortex-compact +21.4% +18.9% +2.1% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -11.4% +18.9% -25.5% +30.0% ✅ faster
12 duckdb:vortex-compact +2.8% +18.9% -13.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +1.6% +18.9% -14.5% +30.0% ➖ noise
13 datafusion:vortex-compact -6.8% +7.7% -13.4% +43.7% ➖ noise
13 datafusion:vortex-file-compressed -35.4% +7.7% -40.0% +43.1% ✅ faster
13 duckdb:vortex-compact -0.8% +7.7% -7.9% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +3.2% +7.7% -4.2% +30.0% ➖ noise
14 datafusion:vortex-compact +7.4% +8.1% -0.6% +33.0% ➖ noise
14 datafusion:vortex-file-compressed -6.5% +8.1% -13.5% +33.6% ➖ noise
14 duckdb:vortex-compact +11.5% +8.1% +3.1% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.0% +8.1% -8.4% +30.0% ➖ noise
15 datafusion:vortex-compact +5.1% +12.9% -7.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.3% +12.9% -18.8% +30.0% ➖ noise
15 duckdb:vortex-compact +17.5% +12.9% +4.0% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -3.3% +12.9% -14.3% +30.0% ➖ noise
16 datafusion:vortex-compact -5.2% +9.0% -13.0% +30.3% ➖ noise
16 datafusion:vortex-file-compressed -6.0% +9.0% -13.8% +30.0% ➖ noise
16 duckdb:vortex-compact +3.1% +9.0% -5.5% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +10.6% +9.0% +1.4% +30.0% ➖ noise
17 datafusion:vortex-compact -36.4% -6.7% -31.9% +30.0% ✅ faster
17 datafusion:vortex-file-compressed -21.7% -6.7% -16.0% +30.0% ➖ noise
17 duckdb:vortex-compact +8.3% -6.7% +16.2% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +7.3% -6.7% +15.0% +30.0% ➖ noise
18 datafusion:vortex-compact -17.2% -2.4% -15.2% +30.4% ➖ noise
18 datafusion:vortex-file-compressed -15.9% -2.4% -13.9% +30.0% ➖ noise
18 duckdb:vortex-compact +2.0% -2.4% +4.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -3.1% -2.4% -0.7% +30.0% ➖ noise
19 datafusion:vortex-compact -37.8% -0.9% -37.2% +33.1% ✅ faster
19 datafusion:vortex-file-compressed +2.3% -0.9% +3.3% +30.0% ➖ noise
19 duckdb:vortex-compact +6.1% -0.9% +7.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +7.4% -0.9% +8.4% +30.0% ➖ noise
20 datafusion:vortex-compact -11.8% -2.7% -9.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +3.3% -2.7% +6.2% +30.0% ➖ noise
20 duckdb:vortex-compact -4.8% -2.7% -2.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -5.2% -2.7% -2.6% +30.0% ➖ noise
21 datafusion:vortex-compact -12.0% +2.5% -14.1% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +12.2% +2.5% +9.5% +30.0% ➖ noise
21 duckdb:vortex-compact +1.7% +2.5% -0.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.8% +2.5% -5.2% +30.0% ➖ noise
22 datafusion:vortex-compact -26.1% -6.0% -21.3% +40.1% ➖ noise
22 datafusion:vortex-file-compressed +30.2% -6.0% +38.5% +42.0% ➖ noise
22 duckdb:vortex-compact +5.7% -6.0% +12.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -3.9% -6.0% +2.3% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 0.962x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -1.0%


datafusion / vortex-file-compressed (0.995x ➖, 1↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1649113 1970473 0.84
clickbench_q01/datafusion:vortex-file-compressed 35436632 36415838 0.97
clickbench_q02/datafusion:vortex-file-compressed 50666655 53535070 0.95
clickbench_q03/datafusion:vortex-file-compressed 55001462 57174225 0.96
clickbench_q04/datafusion:vortex-file-compressed 298391128 291896170 1.02
clickbench_q05/datafusion:vortex-file-compressed 306946776 310597279 0.99
clickbench_q06/datafusion:vortex-file-compressed 1730874 1663095 1.04
clickbench_q07/datafusion:vortex-file-compressed 38121144 40114775 0.95
clickbench_q08/datafusion:vortex-file-compressed 361869807 359356961 1.01
clickbench_q09/datafusion:vortex-file-compressed 555426170 556844874 1.00
clickbench_q10/datafusion:vortex-file-compressed 85542913 85822908 1.00
clickbench_q11/datafusion:vortex-file-compressed 96725736 100033009 0.97
clickbench_q12/datafusion:vortex-file-compressed 274775874 276154171 1.00
clickbench_q13/datafusion:vortex-file-compressed 420187998 414615472 1.01
clickbench_q14/datafusion:vortex-file-compressed 264184704 267224022 0.99
clickbench_q15/datafusion:vortex-file-compressed 334566315 330901088 1.01
clickbench_q16/datafusion:vortex-file-compressed 653652210 641676267 1.02
clickbench_q17/datafusion:vortex-file-compressed 639551531 639233995 1.00
clickbench_q18/datafusion:vortex-file-compressed 1285988950 1264040516 1.02
clickbench_q19/datafusion:vortex-file-compressed 47449222 46202943 1.03
clickbench_q20/datafusion:vortex-file-compressed 344764770 345214310 1.00
clickbench_q21/datafusion:vortex-file-compressed 373813536 380850137 0.98
clickbench_q22/datafusion:vortex-file-compressed 458596316 459606557 1.00
clickbench_q23/datafusion:vortex-file-compressed 683985863 689366424 0.99
clickbench_q24/datafusion:vortex-file-compressed 55245328 57283813 0.96
clickbench_q25/datafusion:vortex-file-compressed 84717128 83978522 1.01
clickbench_q26/datafusion:vortex-file-compressed 51990179 52308789 0.99
clickbench_q27/datafusion:vortex-file-compressed 715189392 709640256 1.01
clickbench_q28/datafusion:vortex-file-compressed 6726403329 6845502211 0.98
clickbench_q29/datafusion:vortex-file-compressed 240152620 243601785 0.99
clickbench_q30/datafusion:vortex-file-compressed 232402968 228003806 1.02
clickbench_q31/datafusion:vortex-file-compressed 266520040 267662858 1.00
clickbench_q32/datafusion:vortex-file-compressed 1122222104 1126382387 1.00
clickbench_q33/datafusion:vortex-file-compressed 1280979246 1275863150 1.00
clickbench_q34/datafusion:vortex-file-compressed 1280705358 1280087725 1.00
clickbench_q35/datafusion:vortex-file-compressed 457488776 454322425 1.01
clickbench_q36/datafusion:vortex-file-compressed 72033036 71302961 1.01
clickbench_q37/datafusion:vortex-file-compressed 37723152 38152336 0.99
clickbench_q38/datafusion:vortex-file-compressed 22579893 21853568 1.03
clickbench_q39/datafusion:vortex-file-compressed 131691361 132790026 0.99
clickbench_q40/datafusion:vortex-file-compressed 20426155 19225195 1.06
clickbench_q41/datafusion:vortex-file-compressed 19612454 19344373 1.01
clickbench_q42/datafusion:vortex-file-compressed 21172755 20972229 1.01
datafusion / parquet (1.000x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1558417 1584100 0.98
clickbench_q01/datafusion:parquet 19171297 19042211 1.01
clickbench_q02/datafusion:parquet 46968124 48453327 0.97
clickbench_q03/datafusion:parquet 38104297 39026330 0.98
clickbench_q04/datafusion:parquet 292854619 294983680 0.99
clickbench_q05/datafusion:parquet 349857138 346489364 1.01
clickbench_q06/datafusion:parquet 1544038 1552490 0.99
clickbench_q07/datafusion:parquet 23768403 22823588 1.04
clickbench_q08/datafusion:parquet 364523394 357741113 1.02
clickbench_q09/datafusion:parquet 596525175 642509369 0.93
clickbench_q10/datafusion:parquet 112270881 109086001 1.03
clickbench_q11/datafusion:parquet 135192770 131473703 1.03
clickbench_q12/datafusion:parquet 344688995 346280569 1.00
clickbench_q13/datafusion:parquet 485831724 482924108 1.01
clickbench_q14/datafusion:parquet 340578828 337909658 1.01
clickbench_q15/datafusion:parquet 329054439 327694224 1.00
clickbench_q16/datafusion:parquet 649879209 665714015 0.98
clickbench_q17/datafusion:parquet 642801308 634275225 1.01
clickbench_q18/datafusion:parquet 1304906832 1290214653 1.01
clickbench_q19/datafusion:parquet 28353509 28591181 0.99
clickbench_q20/datafusion:parquet 600855132 606797339 0.99
clickbench_q21/datafusion:parquet 658066062 666751440 0.99
clickbench_q22/datafusion:parquet 981684100 960710403 1.02
clickbench_q23/datafusion:parquet 3751186372 3682571612 1.02
clickbench_q24/datafusion:parquet 84934226 85521463 0.99
clickbench_q25/datafusion:parquet 130310242 138947771 0.94
clickbench_q26/datafusion:parquet 83207590 81674282 1.02
clickbench_q27/datafusion:parquet 1040285350 1035220823 1.00
clickbench_q28/datafusion:parquet 6738527050 6727290516 1.00
clickbench_q29/datafusion:parquet 240476092 239120254 1.01
clickbench_q30/datafusion:parquet 324627789 328602809 0.99
clickbench_q31/datafusion:parquet 364498069 362362780 1.01
clickbench_q32/datafusion:parquet 1195240809 1185788562 1.01
clickbench_q33/datafusion:parquet 1465452519 1471865379 1.00
clickbench_q34/datafusion:parquet 1461958478 1460817753 1.00
clickbench_q35/datafusion:parquet 455161808 456225938 1.00
clickbench_q36/datafusion:parquet 139631161 138106411 1.01
clickbench_q37/datafusion:parquet 55922999 56263849 0.99
clickbench_q38/datafusion:parquet 82694947 85398529 0.97
clickbench_q39/datafusion:parquet 254694699 250995695 1.01
clickbench_q40/datafusion:parquet 29791443 29267160 1.02
clickbench_q41/datafusion:parquet 26511567 26702340 0.99
clickbench_q42/datafusion:parquet 30186579 28625852 1.05
duckdb / vortex-file-compressed (0.929x ➖, 8↑ 3↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 9074117 6378651 1.42
clickbench_q01/duckdb:vortex-file-compressed 13590860 14191980 0.96
clickbench_q02/duckdb:vortex-file-compressed 27183818 27298465 1.00
clickbench_q03/duckdb:vortex-file-compressed 30803583 32303076 0.95
clickbench_q04/duckdb:vortex-file-compressed 183320751 186456198 0.98
clickbench_q05/duckdb:vortex-file-compressed 176625420 170730043 1.03
clickbench_q06/duckdb:vortex-file-compressed 19175245 19273100 0.99
clickbench_q07/duckdb:vortex-file-compressed 🚨 17565106 15076532 1.17
clickbench_q08/duckdb:vortex-file-compressed 253068940 260641884 0.97
clickbench_q09/duckdb:vortex-file-compressed 331058595 340079329 0.97
clickbench_q10/duckdb:vortex-file-compressed 65798233 70748373 0.93
clickbench_q11/duckdb:vortex-file-compressed 76297435 77394738 0.99
clickbench_q12/duckdb:vortex-file-compressed 198025870 196249013 1.01
clickbench_q13/duckdb:vortex-file-compressed 399010905 409772703 0.97
clickbench_q14/duckdb:vortex-file-compressed 234182130 250251616 0.94
clickbench_q15/duckdb:vortex-file-compressed 243838089 256601109 0.95
clickbench_q16/duckdb:vortex-file-compressed 579990949 620687272 0.93
clickbench_q17/duckdb:vortex-file-compressed 485493903 505780271 0.96
clickbench_q18/duckdb:vortex-file-compressed 1014159940 1047243439 0.97
clickbench_q19/duckdb:vortex-file-compressed 🚀 21631165 25455188 0.85
clickbench_q20/duckdb:vortex-file-compressed 328369015 358052673 0.92
clickbench_q21/duckdb:vortex-file-compressed 363901277 382095958 0.95
clickbench_q22/duckdb:vortex-file-compressed 538108295 513373612 1.05
clickbench_q23/duckdb:vortex-file-compressed 🚀 646864106 1931151996 0.33
clickbench_q24/duckdb:vortex-file-compressed 🚨 45313963 38654689 1.17
clickbench_q25/duckdb:vortex-file-compressed 74465590 82097336 0.91
clickbench_q26/duckdb:vortex-file-compressed 48947022 48969585 1.00
clickbench_q27/duckdb:vortex-file-compressed 476674550 481357302 0.99
clickbench_q28/duckdb:vortex-file-compressed 2951315727 3133446695 0.94
clickbench_q29/duckdb:vortex-file-compressed 29601155 31255863 0.95
clickbench_q30/duckdb:vortex-file-compressed 187536616 202017497 0.93
clickbench_q31/duckdb:vortex-file-compressed 284116446 301468684 0.94
clickbench_q32/duckdb:vortex-file-compressed 1260708013 1193870695 1.06
clickbench_q33/duckdb:vortex-file-compressed 1224946414 1215595528 1.01
clickbench_q34/duckdb:vortex-file-compressed 1262128939 1218697610 1.04
clickbench_q35/duckdb:vortex-file-compressed 375359526 376640964 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 25603025 30652956 0.84
clickbench_q37/duckdb:vortex-file-compressed 🚀 17529784 22603611 0.78
clickbench_q38/duckdb:vortex-file-compressed 🚀 19551541 24356450 0.80
clickbench_q39/duckdb:vortex-file-compressed 38922533 42613623 0.91
clickbench_q40/duckdb:vortex-file-compressed 🚀 17613212 23360743 0.75
clickbench_q41/duckdb:vortex-file-compressed 🚀 16842344 22981414 0.73
clickbench_q42/duckdb:vortex-file-compressed 🚀 17459005 25337003 0.69
duckdb / parquet (0.959x ➖, 3↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26134785 24800937 1.05
clickbench_q01/duckdb:parquet 28438848 27441302 1.04
clickbench_q02/duckdb:parquet 47786795 48434957 0.99
clickbench_q03/duckdb:parquet 38303484 38851049 0.99
clickbench_q04/duckdb:parquet 200694124 203029250 0.99
clickbench_q05/duckdb:parquet 262946655 269831292 0.97
clickbench_q06/duckdb:parquet 46521247 47891557 0.97
clickbench_q07/duckdb:parquet 28742057 29849639 0.96
clickbench_q08/duckdb:parquet 266982722 267080441 1.00
clickbench_q09/duckdb:parquet 397388018 428963229 0.93
clickbench_q10/duckdb:parquet 80518585 85762431 0.94
clickbench_q11/duckdb:parquet 97375874 103467562 0.94
clickbench_q12/duckdb:parquet 283786789 309739498 0.92
clickbench_q13/duckdb:parquet 🚀 469988716 525766755 0.89
clickbench_q14/duckdb:parquet 324335926 350294165 0.93
clickbench_q15/duckdb:parquet 258727302 279879624 0.92
clickbench_q16/duckdb:parquet 642843333 700088484 0.92
clickbench_q17/duckdb:parquet 529801302 564785919 0.94
clickbench_q18/duckdb:parquet 1072958810 1071746544 1.00
clickbench_q19/duckdb:parquet 25619453 25472447 1.01
clickbench_q20/duckdb:parquet 422861830 427749653 0.99
clickbench_q21/duckdb:parquet 544293011 547624209 0.99
clickbench_q22/duckdb:parquet 925971424 994137559 0.93
clickbench_q23/duckdb:parquet 306095834 321350156 0.95
clickbench_q24/duckdb:parquet 70782034 72059458 0.98
clickbench_q25/duckdb:parquet 157301459 162983955 0.97
clickbench_q26/duckdb:parquet 48988616 51451220 0.95
clickbench_q27/duckdb:parquet 639366877 694962242 0.92
clickbench_q28/duckdb:parquet 4815346340 5073824440 0.95
clickbench_q29/duckdb:parquet 40089303 41956477 0.96
clickbench_q30/duckdb:parquet 296641729 319886662 0.93
clickbench_q31/duckdb:parquet 359894064 391914450 0.92
clickbench_q32/duckdb:parquet 1160412345 1190886489 0.97
clickbench_q33/duckdb:parquet 1249552244 1294577253 0.97
clickbench_q34/duckdb:parquet 1276882308 1331497282 0.96
clickbench_q35/duckdb:parquet 364786041 366549064 1.00
clickbench_q36/duckdb:parquet 🚀 43283011 49184714 0.88
clickbench_q37/duckdb:parquet 33706200 34207315 0.99
clickbench_q38/duckdb:parquet 33438256 35075737 0.95
clickbench_q39/duckdb:parquet 80099982 78876086 1.02
clickbench_q40/duckdb:parquet 🚀 17353594 19760555 0.88
clickbench_q41/duckdb:parquet 18679893 18108037 1.03
clickbench_q42/duckdb:parquet 20871158 22468165 0.93
duckdb / duckdb (0.983x ➖, 2↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17205439 19202436 0.90
clickbench_q01/duckdb:duckdb 33964356 35370462 0.96
clickbench_q02/duckdb:duckdb 45299597 46779567 0.97
clickbench_q03/duckdb:duckdb 46951306 49108492 0.96
clickbench_q04/duckdb:duckdb 189412899 193029134 0.98
clickbench_q05/duckdb:duckdb 265349229 265294388 1.00
clickbench_q06/duckdb:duckdb 35947938 37569407 0.96
clickbench_q07/duckdb:duckdb 35780981 37321994 0.96
clickbench_q08/duckdb:duckdb 251708756 247884300 1.02
clickbench_q09/duckdb:duckdb 368842579 366330006 1.01
clickbench_q10/duckdb:duckdb 98863345 98242723 1.01
clickbench_q11/duckdb:duckdb 108307973 108392418 1.00
clickbench_q12/duckdb:duckdb 240171808 242223417 0.99
clickbench_q13/duckdb:duckdb 471637790 469159122 1.01
clickbench_q14/duckdb:duckdb 274387764 274007734 1.00
clickbench_q15/duckdb:duckdb 221498973 221369391 1.00
clickbench_q16/duckdb:duckdb 650789778 639630969 1.02
clickbench_q17/duckdb:duckdb 552039401 571873877 0.97
clickbench_q18/duckdb:duckdb 1275218991 1332896895 0.96
clickbench_q19/duckdb:duckdb 34752893 37724410 0.92
clickbench_q20/duckdb:duckdb 1040535722 1002825484 1.04
clickbench_q21/duckdb:duckdb 1101390523 1013688068 1.09
clickbench_q22/duckdb:duckdb 1127637215 1125925420 1.00
clickbench_q23/duckdb:duckdb 255566004 279201372 0.92
clickbench_q24/duckdb:duckdb 62039550 66048467 0.94
clickbench_q25/duckdb:duckdb 145125445 151385725 0.96
clickbench_q26/duckdb:duckdb 60327451 65561016 0.92
clickbench_q27/duckdb:duckdb 1080241495 1048800514 1.03
clickbench_q28/duckdb:duckdb 4661897905 5021587368 0.93
clickbench_q29/duckdb:duckdb 48533343 51354861 0.95
clickbench_q30/duckdb:duckdb 258974655 260934094 0.99
clickbench_q31/duckdb:duckdb 418124203 426289503 0.98
clickbench_q32/duckdb:duckdb 1632174534 1484854133 1.10
clickbench_q33/duckdb:duckdb 2180810589 2062929942 1.06
clickbench_q34/duckdb:duckdb 🚨 2422056624 2103381126 1.15
clickbench_q35/duckdb:duckdb 280399665 280384696 1.00
clickbench_q36/duckdb:duckdb 41941643 39629932 1.06
clickbench_q37/duckdb:duckdb 🚀 29916280 33927488 0.88
clickbench_q38/duckdb:duckdb 32453367 32945495 0.99
clickbench_q39/duckdb:duckdb 67186520 64724214 1.04
clickbench_q40/duckdb:duckdb 31568551 34277513 0.92
clickbench_q41/duckdb:duckdb 30947848 33121524 0.93
clickbench_q42/duckdb:duckdb 31145698 34095440 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -16.3% +1.8% -17.8% +737.5% ➖ noise
0 duckdb:duckdb -10.4% +1.8% -12.0% +288.2% ➖ noise
0 duckdb:vortex-file-compressed +42.3% +1.8% +39.7% +437.6% ➖ noise
1 datafusion:vortex-file-compressed -2.7% +2.1% -4.7% +22.5% ➖ noise
1 duckdb:duckdb -4.0% +2.1% -6.0% +62.3% ➖ noise
1 duckdb:vortex-file-compressed -4.2% +2.1% -6.2% +23.0% ➖ noise
2 datafusion:vortex-file-compressed -5.4% -2.2% -3.2% +10.1% ➖ noise
2 duckdb:duckdb -3.2% -2.2% -1.0% +20.7% ➖ noise
2 duckdb:vortex-file-compressed -0.4% -2.2% +1.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -3.8% -1.9% -1.9% +103.2% ➖ noise
3 duckdb:duckdb -4.4% -1.9% -2.6% +42.4% ➖ noise
3 duckdb:vortex-file-compressed -4.6% -1.9% -2.8% +46.7% ➖ noise
4 datafusion:vortex-file-compressed +2.2% -0.9% +3.2% +10.0% ➖ noise
4 duckdb:duckdb -1.9% -0.9% -0.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.7% -0.9% -0.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.2% -0.8% -0.4% +10.0% ➖ noise
5 duckdb:duckdb +0.0% -0.8% +0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.5% -0.8% +4.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.1% -1.7% +5.9% +40.9% ➖ noise
6 duckdb:duckdb -4.3% -1.7% -2.7% +29.2% ➖ noise
6 duckdb:vortex-file-compressed -0.5% -1.7% +1.2% +17.4% ➖ noise
7 datafusion:vortex-file-compressed -5.0% +0.1% -5.1% +13.6% ➖ noise
7 duckdb:duckdb -4.1% +0.1% -4.3% +11.3% ➖ noise
7 duckdb:vortex-file-compressed +16.5% +0.1% +16.3% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +0.7% +0.9% -0.2% +10.0% ➖ noise
8 duckdb:duckdb +1.5% +0.9% +0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.9% +0.9% -3.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.3% -7.3% +7.6% +10.0% ➖ noise
9 duckdb:duckdb +0.7% -7.3% +8.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.7% -7.3% +5.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.3% -1.7% +1.4% +10.0% ➖ noise
10 duckdb:duckdb +0.6% -1.7% +2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -7.0% -1.7% -5.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.3% -1.6% -1.7% +12.1% ➖ noise
11 duckdb:duckdb -0.1% -1.6% +1.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.4% -1.6% +0.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.5% -4.5% +4.2% +10.0% ➖ noise
12 duckdb:duckdb -0.8% -4.5% +3.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.9% -4.5% +5.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.3% -5.2% +6.9% +10.0% ➖ noise
13 duckdb:duckdb +0.5% -5.2% +6.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.6% -5.2% +2.7% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.1% -3.4% +2.3% +10.0% ➖ noise
14 duckdb:duckdb +0.1% -3.4% +3.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -6.4% -3.4% -3.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.1% -3.7% +4.9% +10.0% ➖ noise
15 duckdb:duckdb +0.1% -3.7% +3.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -5.0% -3.7% -1.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.9% -5.3% +7.6% +10.0% ➖ noise
16 duckdb:duckdb +1.7% -5.3% +7.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -6.6% -5.3% -1.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.0% -2.5% +2.6% +10.0% ➖ noise
17 duckdb:duckdb -3.5% -2.5% -1.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.0% -2.5% -1.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.7% +0.6% +1.1% +10.0% ➖ noise
18 duckdb:duckdb -4.3% +0.6% -4.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.2% +0.6% -3.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +2.7% -0.1% +2.8% +18.0% ➖ noise
19 duckdb:duckdb -7.9% -0.1% -7.8% +12.7% ➖ noise
19 duckdb:vortex-file-compressed -15.0% -0.1% -14.9% +13.7% ✅ faster
20 datafusion:vortex-file-compressed -0.1% -1.1% +0.9% +204.9% ➖ noise
20 duckdb:duckdb +3.8% -1.1% +4.9% +21.7% ➖ noise
20 duckdb:vortex-file-compressed -8.3% -1.1% -7.3% +45.1% ➖ noise
21 datafusion:vortex-file-compressed -1.8% -1.0% -0.9% +10.0% ➖ noise
21 duckdb:duckdb +8.7% -1.0% +9.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -4.8% -1.0% -3.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.2% -2.4% +2.3% +13.9% ➖ noise
22 duckdb:duckdb +0.2% -2.4% +2.7% +14.4% ➖ noise
22 duckdb:vortex-file-compressed +4.8% -2.4% +7.4% +16.4% ➖ noise
23 datafusion:vortex-file-compressed -0.8% -1.5% +0.7% +45.2% ➖ noise
23 duckdb:duckdb -8.5% -1.5% -7.1% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -66.5% -1.5% -66.0% +30.8% ✅ faster
24 datafusion:vortex-file-compressed -3.6% -1.2% -2.4% +11.7% ➖ noise
24 duckdb:duckdb -6.1% -1.2% -4.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +17.2% -1.2% +18.7% +18.3% 🚨 regression
25 datafusion:vortex-file-compressed +0.9% -4.9% +6.0% +10.0% ➖ noise
25 duckdb:duckdb -4.1% -4.9% +0.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -9.3% -4.9% -4.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -0.6% -1.5% +0.9% +10.7% ➖ noise
26 duckdb:duckdb -8.0% -1.5% -6.6% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -0.0% -1.5% +1.5% +20.4% ➖ noise
27 datafusion:vortex-file-compressed +0.8% -3.8% +4.8% +10.0% ➖ noise
27 duckdb:duckdb +3.0% -3.8% +7.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.0% -3.8% +3.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.7% -2.5% +0.8% +10.0% ➖ noise
28 duckdb:duckdb -7.2% -2.5% -4.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -5.8% -2.5% -3.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.4% -2.0% +0.6% +10.0% ➖ noise
29 duckdb:duckdb -5.5% -2.0% -3.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -5.3% -2.0% -3.4% +13.4% ➖ noise
30 datafusion:vortex-file-compressed +1.9% -4.3% +6.5% +10.0% ➖ noise
30 duckdb:duckdb -0.8% -4.3% +3.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -7.2% -4.3% -3.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.4% -3.9% +3.6% +10.0% ➖ noise
31 duckdb:duckdb -1.9% -3.9% +2.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -5.8% -3.9% -1.9% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -0.4% -0.9% +0.5% +10.8% ➖ noise
32 duckdb:duckdb +9.9% -0.9% +10.9% +10.0% 🚨 regression
32 duckdb:vortex-file-compressed +5.6% -0.9% +6.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.4% -2.0% +2.4% +10.0% ➖ noise
33 duckdb:duckdb +5.7% -2.0% +7.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +0.8% -2.0% +2.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.0% -2.0% +2.1% +10.0% ➖ noise
34 duckdb:duckdb +15.2% -2.0% +17.5% +10.0% 🚨 regression
34 duckdb:vortex-file-compressed +3.6% -2.0% +5.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.7% -0.4% +1.1% +10.0% ➖ noise
35 duckdb:duckdb +0.0% -0.4% +0.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.3% -0.4% +0.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.0% -5.7% +7.1% +10.0% ➖ noise
36 duckdb:duckdb +5.8% -5.7% +12.2% +14.6% ➖ noise
36 duckdb:vortex-file-compressed -16.5% -5.7% -11.4% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -1.1% -1.0% -0.1% +10.0% ➖ noise
37 duckdb:duckdb -11.8% -1.0% -10.9% +10.0% ✅ faster
37 duckdb:vortex-file-compressed -22.4% -1.0% -21.6% +10.0% ✅ faster
38 datafusion:vortex-file-compressed +3.3% -3.9% +7.5% +11.0% ➖ noise
38 duckdb:duckdb -1.5% -3.9% +2.5% +11.2% ➖ noise
38 duckdb:vortex-file-compressed -19.7% -3.9% -16.5% +10.7% ✅ faster
39 datafusion:vortex-file-compressed -0.8% +1.5% -2.3% +10.0% ➖ noise
39 duckdb:duckdb +3.8% +1.5% +2.3% +10.0% ➖ noise
39 duckdb:vortex-file-compressed -8.7% +1.5% -10.0% +10.0% ✅ faster
40 datafusion:vortex-file-compressed +6.2% -5.5% +12.4% +12.5% ➖ noise
40 duckdb:duckdb -7.9% -5.5% -2.6% +11.7% ➖ noise
40 duckdb:vortex-file-compressed -24.6% -5.5% -20.3% +16.4% ✅ faster
41 datafusion:vortex-file-compressed +1.4% +1.2% +0.2% +13.6% ➖ noise
41 duckdb:duckdb -6.6% +1.2% -7.7% +13.5% ➖ noise
41 duckdb:vortex-file-compressed -26.7% +1.2% -27.6% +12.3% ✅ faster
42 datafusion:vortex-file-compressed +1.0% -1.0% +2.0% +10.5% ➖ noise
42 duckdb:duckdb -8.7% -1.0% -7.7% +10.9% ➖ noise
42 duckdb:vortex-file-compressed -31.1% -1.0% -30.4% +12.2% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.939x ➖
Shifts: Parquet (control) -6.1% · Median polish -2.3%


datafusion / vortex-file-compressed (0.914x ➖, 3↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 672358537 1072406877 0.63
tpch_q02/datafusion:vortex-file-compressed 🚀 708079246 1298567484 0.55
tpch_q03/datafusion:vortex-file-compressed 712051847 761191194 0.94
tpch_q04/datafusion:vortex-file-compressed 526495737 723138392 0.73
tpch_q05/datafusion:vortex-file-compressed 🚀 1035166760 1663175807 0.62
tpch_q06/datafusion:vortex-file-compressed 706486017 692767483 1.02
tpch_q07/datafusion:vortex-file-compressed 1089045698 1086291292 1.00
tpch_q08/datafusion:vortex-file-compressed 1128286430 1152332099 0.98
tpch_q09/datafusion:vortex-file-compressed 1343162322 1225287141 1.10
tpch_q10/datafusion:vortex-file-compressed 967504045 1026732144 0.94
tpch_q11/datafusion:vortex-file-compressed 443898505 436989620 1.02
tpch_q12/datafusion:vortex-file-compressed 966745603 892049435 1.08
tpch_q13/datafusion:vortex-file-compressed 491006038 406274668 1.21
tpch_q14/datafusion:vortex-file-compressed 599844041 639719842 0.94
tpch_q15/datafusion:vortex-file-compressed 1120385815 1217459144 0.92
tpch_q16/datafusion:vortex-file-compressed 382148551 417685681 0.91
tpch_q17/datafusion:vortex-file-compressed 1144698840 1166745736 0.98
tpch_q18/datafusion:vortex-file-compressed 1202340237 1238384703 0.97
tpch_q19/datafusion:vortex-file-compressed 810450465 757251835 1.07
tpch_q20/datafusion:vortex-file-compressed 1008884745 1162151979 0.87
tpch_q21/datafusion:vortex-file-compressed 1584467016 1657168055 0.96
tpch_q22/datafusion:vortex-file-compressed 412589152 393106627 1.05
datafusion / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 678697506 730236067 0.93
tpch_q02/datafusion:vortex-compact 579125635 728380923 0.80
tpch_q03/datafusion:vortex-compact 947804509 756999038 1.25
tpch_q04/datafusion:vortex-compact 556660696 541673926 1.03
tpch_q05/datafusion:vortex-compact 968319638 888558504 1.09
tpch_q06/datafusion:vortex-compact 647592747 696985281 0.93
tpch_q07/datafusion:vortex-compact 991475897 1022211925 0.97
tpch_q08/datafusion:vortex-compact 1198480004 988812628 1.21
tpch_q09/datafusion:vortex-compact 1223650937 1128278450 1.08
tpch_q10/datafusion:vortex-compact 776549260 824681757 0.94
tpch_q11/datafusion:vortex-compact 391341171 377025249 1.04
tpch_q12/datafusion:vortex-compact 801536422 777043121 1.03
tpch_q13/datafusion:vortex-compact 388035869 380242202 1.02
tpch_q14/datafusion:vortex-compact 549120039 566638032 0.97
tpch_q15/datafusion:vortex-compact 1066479229 1143614720 0.93
tpch_q16/datafusion:vortex-compact 280441734 368987765 0.76
tpch_q17/datafusion:vortex-compact 1140442697 1181121061 0.97
tpch_q18/datafusion:vortex-compact 1089119345 1190148210 0.92
tpch_q19/datafusion:vortex-compact 934880894 760638152 1.23
tpch_q20/datafusion:vortex-compact 820414690 886660138 0.93
tpch_q21/datafusion:vortex-compact 1356723796 1461943085 0.93
tpch_q22/datafusion:vortex-compact 387251673 375329619 1.03
datafusion / parquet (0.865x ➖, 2↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 650531613 675647194 0.96
tpch_q02/datafusion:parquet 575422820 690611222 0.83
tpch_q03/datafusion:parquet 888010558 981725575 0.90
tpch_q04/datafusion:parquet 480042690 559173075 0.86
tpch_q05/datafusion:parquet 1149657918 1249424093 0.92
tpch_q06/datafusion:parquet 501871825 552267392 0.91
tpch_q07/datafusion:parquet 1427162309 1496479672 0.95
tpch_q08/datafusion:parquet 1673254545 2027135982 0.83
tpch_q09/datafusion:parquet 1893437260 1966011654 0.96
tpch_q10/datafusion:parquet 1967866774 2481869812 0.79
tpch_q11/datafusion:parquet 🚀 466637716 722428589 0.65
tpch_q12/datafusion:parquet 720822367 843697365 0.85
tpch_q13/datafusion:parquet 710489980 991008843 0.72
tpch_q14/datafusion:parquet 🚀 769673277 1112230359 0.69
tpch_q15/datafusion:parquet 1183725153 1270690317 0.93
tpch_q16/datafusion:parquet 346783319 335473532 1.03
tpch_q17/datafusion:parquet 1362633475 1347591202 1.01
tpch_q18/datafusion:parquet 1556096882 1579097134 0.99
tpch_q19/datafusion:parquet 985255889 1013701662 0.97
tpch_q20/datafusion:parquet 1099559345 1185631979 0.93
tpch_q21/datafusion:parquet 1643100586 2344687028 0.70
tpch_q22/datafusion:parquet 682390198 855733214 0.80
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 594572303 597278694 1.00
tpch_q02/duckdb:vortex-file-compressed 1187019146 1297515237 0.91
tpch_q03/duckdb:vortex-file-compressed 1024807167 1003218250 1.02
tpch_q04/duckdb:vortex-file-compressed 658752887 656851917 1.00
tpch_q05/duckdb:vortex-file-compressed 1076818197 1133511339 0.95
tpch_q06/duckdb:vortex-file-compressed 789549880 794141277 0.99
tpch_q07/duckdb:vortex-file-compressed 1227728426 1204148671 1.02
tpch_q08/duckdb:vortex-file-compressed 1446477735 1471148922 0.98
tpch_q09/duckdb:vortex-file-compressed 1460242858 1578885030 0.92
tpch_q10/duckdb:vortex-file-compressed 1124488826 1099210142 1.02
tpch_q11/duckdb:vortex-file-compressed 702667415 651794590 1.08
tpch_q12/duckdb:vortex-file-compressed 759752390 685423574 1.11
tpch_q13/duckdb:vortex-file-compressed 888671715 869072528 1.02
tpch_q14/duckdb:vortex-file-compressed 807071835 860573223 0.94
tpch_q15/duckdb:vortex-file-compressed 559897979 520670674 1.08
tpch_q16/duckdb:vortex-file-compressed 551374996 503809700 1.09
tpch_q17/duckdb:vortex-file-compressed 979415765 959628107 1.02
tpch_q18/duckdb:vortex-file-compressed 926900786 909999645 1.02
tpch_q19/duckdb:vortex-file-compressed 778256769 787733966 0.99
tpch_q20/duckdb:vortex-file-compressed 1204758178 1157434579 1.04
tpch_q21/duckdb:vortex-file-compressed 1908311803 1915933205 1.00
tpch_q22/duckdb:vortex-file-compressed 607603724 637507648 0.95
duckdb / vortex-compact (0.977x ➖, 0↑ 1↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 615472707 598085272 1.03
tpch_q02/duckdb:vortex-compact 996451613 1085866717 0.92
tpch_q03/duckdb:vortex-compact 828129909 803271485 1.03
tpch_q04/duckdb:vortex-compact 🚨 697286955 517377649 1.35
tpch_q05/duckdb:vortex-compact 1096545898 1014786264 1.08
tpch_q06/duckdb:vortex-compact 738777124 759867030 0.97
tpch_q07/duckdb:vortex-compact 1027438663 1065693488 0.96
tpch_q08/duckdb:vortex-compact 1386073726 1354685701 1.02
tpch_q09/duckdb:vortex-compact 1400868409 1497066874 0.94
tpch_q10/duckdb:vortex-compact 1053075891 1214061256 0.87
tpch_q11/duckdb:vortex-compact 663664381 775690861 0.86
tpch_q12/duckdb:vortex-compact 676978706 610544188 1.11
tpch_q13/duckdb:vortex-compact 863054444 907350567 0.95
tpch_q14/duckdb:vortex-compact 823868567 840585211 0.98
tpch_q15/duckdb:vortex-compact 514825209 550970711 0.93
tpch_q16/duckdb:vortex-compact 480541896 509240530 0.94
tpch_q17/duckdb:vortex-compact 873697599 909986229 0.96
tpch_q18/duckdb:vortex-compact 781325319 745394909 1.05
tpch_q19/duckdb:vortex-compact 730467423 746268187 0.98
tpch_q20/duckdb:vortex-compact 1156283945 1258909678 0.92
tpch_q21/duckdb:vortex-compact 1628167679 1707831283 0.95
tpch_q22/duckdb:vortex-compact 653644062 806381129 0.81
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR 46a3b2a (ns) base 91a6b57 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 791928430 767657816 1.03
tpch_q02/duckdb:parquet 1436319600 1523461780 0.94
tpch_q03/duckdb:parquet 1777119723 2058462643 0.86
tpch_q04/duckdb:parquet 1078532770 942311857 1.14
tpch_q05/duckdb:parquet 2080658117 2106988244 0.99
tpch_q06/duckdb:parquet 763776909 734010490 1.04
tpch_q07/duckdb:parquet 1881219005 1892105114 0.99
tpch_q08/duckdb:parquet 2558602927 2495022950 1.03
tpch_q09/duckdb:parquet 2570596606 2704865656 0.95
tpch_q10/duckdb:parquet 3028271390 3089414015 0.98
tpch_q11/duckdb:parquet 1057911036 1139215119 0.93
tpch_q12/duckdb:parquet 1370546539 1099266054 1.25
tpch_q13/duckdb:parquet 1321888249 1227880528 1.08
tpch_q14/duckdb:parquet 1282588535 1232994658 1.04
tpch_q15/duckdb:parquet 968947836 878457839 1.10
tpch_q16/duckdb:parquet 861005478 811800230 1.06
tpch_q17/duckdb:parquet 1271014686 1236789339 1.03
tpch_q18/duckdb:parquet 1387111250 1354466716 1.02
tpch_q19/duckdb:parquet 1481386730 1519528900 0.97
tpch_q20/duckdb:parquet 1942600351 1697535837 1.14
tpch_q21/duckdb:parquet 1620480499 1830741398 0.89
tpch_q22/duckdb:parquet 1052981448 1042633684 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.1% -0.3% -6.7% +38.1% ➖ noise
1 datafusion:vortex-file-compressed -37.3% -0.3% -37.1% +49.4% ✅ faster
1 duckdb:vortex-compact +2.9% -0.3% +3.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -0.5% -0.3% -0.1% +33.2% ➖ noise
2 datafusion:vortex-compact -20.5% -11.4% -10.3% +44.4% ➖ noise
2 datafusion:vortex-file-compressed -45.5% -11.4% -38.5% +40.9% ✅ faster
2 duckdb:vortex-compact -8.2% -11.4% +3.5% +30.8% ➖ noise
2 duckdb:vortex-file-compressed -8.5% -11.4% +3.2% +31.3% ➖ noise
3 datafusion:vortex-compact +25.2% -11.6% +41.7% +42.1% ➖ noise
3 datafusion:vortex-file-compressed -6.5% -11.6% +5.9% +52.8% ➖ noise
3 duckdb:vortex-compact +3.1% -11.6% +16.7% +32.0% ➖ noise
3 duckdb:vortex-file-compressed +2.2% -11.6% +15.6% +37.6% ➖ noise
4 datafusion:vortex-compact +2.8% -0.9% +3.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -27.2% -0.9% -26.6% +40.6% ➖ noise
4 duckdb:vortex-compact +34.8% -0.9% +36.0% +31.8% 🚨 regression
4 duckdb:vortex-file-compressed +0.3% -0.9% +1.2% +30.0% ➖ noise
5 datafusion:vortex-compact +9.0% -4.7% +14.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -37.8% -4.7% -34.7% +121.9% ➖ noise
5 duckdb:vortex-compact +8.1% -4.7% +13.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -5.0% -4.7% -0.3% +30.0% ➖ noise
6 datafusion:vortex-compact -7.1% -2.8% -4.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +2.0% -2.8% +4.9% +30.0% ➖ noise
6 duckdb:vortex-compact -2.8% -2.8% -0.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.6% -2.8% +2.2% +30.0% ➖ noise
7 datafusion:vortex-compact -3.0% -2.6% -0.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.3% -2.6% +3.0% +30.0% ➖ noise
7 duckdb:vortex-compact -3.6% -2.6% -1.0% +30.3% ➖ noise
7 duckdb:vortex-file-compressed +2.0% -2.6% +4.7% +30.0% ➖ noise
8 datafusion:vortex-compact +21.2% -8.0% +31.7% +30.0% 🚨 regression
8 datafusion:vortex-file-compressed -2.1% -8.0% +6.4% +30.0% ➖ noise
8 duckdb:vortex-compact +2.3% -8.0% +11.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -1.7% -8.0% +6.9% +30.0% ➖ noise
9 datafusion:vortex-compact +8.5% -4.3% +13.4% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +9.6% -4.3% +14.6% +30.0% ➖ noise
9 duckdb:vortex-compact -6.4% -4.3% -2.2% +33.9% ➖ noise
9 duckdb:vortex-file-compressed -7.5% -4.3% -3.3% +30.0% ➖ noise
10 datafusion:vortex-compact -5.8% -11.8% +6.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -5.8% -11.8% +6.9% +30.0% ➖ noise
10 duckdb:vortex-compact -13.3% -11.8% -1.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +2.3% -11.8% +16.0% +30.0% ➖ noise
11 datafusion:vortex-compact +3.8% -22.6% +34.0% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed +1.6% -22.6% +31.2% +30.0% 🚨 regression
11 duckdb:vortex-compact -14.4% -22.6% +10.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +7.8% -22.6% +39.2% +30.0% 🚨 regression
12 datafusion:vortex-compact +3.2% +3.2% -0.1% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +8.4% +3.2% +5.0% +30.0% ➖ noise
12 duckdb:vortex-compact +10.9% +3.2% +7.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +10.8% +3.2% +7.4% +30.0% ➖ noise
13 datafusion:vortex-compact +2.0% -12.1% +16.2% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +20.9% -12.1% +37.6% +31.2% 🚨 regression
13 duckdb:vortex-compact -4.9% -12.1% +8.3% +38.8% ➖ noise
13 duckdb:vortex-file-compressed +2.3% -12.1% +16.4% +42.4% ➖ noise
14 datafusion:vortex-compact -3.1% -15.2% +14.2% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -6.2% -15.2% +10.5% +30.0% ➖ noise
14 duckdb:vortex-compact -2.0% -15.2% +15.5% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -6.2% -15.2% +10.5% +30.0% ➖ noise
15 datafusion:vortex-compact -6.7% +1.4% -8.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.0% +1.4% -9.2% +30.0% ➖ noise
15 duckdb:vortex-compact -6.6% +1.4% -7.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +7.5% +1.4% +6.1% +30.0% ➖ noise
16 datafusion:vortex-compact -24.0% +4.7% -27.4% +30.0% ✅ faster
16 datafusion:vortex-file-compressed -8.5% +4.7% -12.6% +32.4% ➖ noise
16 duckdb:vortex-compact -5.6% +4.7% -9.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +9.4% +4.7% +4.5% +30.0% ➖ noise
17 datafusion:vortex-compact -3.4% +1.9% -5.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -1.9% +1.9% -3.8% +30.0% ➖ noise
17 duckdb:vortex-compact -4.0% +1.9% -5.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +2.1% +1.9% +0.1% +30.0% ➖ noise
18 datafusion:vortex-compact -8.5% +0.5% -8.9% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -2.9% +0.5% -3.4% +30.0% ➖ noise
18 duckdb:vortex-compact +4.8% +0.5% +4.3% +31.6% ➖ noise
18 duckdb:vortex-file-compressed +1.9% +0.5% +1.4% +30.0% ➖ noise
19 datafusion:vortex-compact +22.9% -2.7% +26.3% +31.9% ➖ noise
19 datafusion:vortex-file-compressed +7.0% -2.7% +9.9% +30.0% ➖ noise
19 duckdb:vortex-compact -2.1% -2.7% +0.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -1.2% -2.7% +1.5% +30.0% ➖ noise
20 datafusion:vortex-compact -7.5% +3.0% -10.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -13.2% +3.0% -15.7% +30.0% ➖ noise
20 duckdb:vortex-compact -8.2% +3.0% -10.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +4.1% +3.0% +1.0% +30.0% ➖ noise
21 datafusion:vortex-compact -7.2% -21.2% +17.8% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -4.4% -21.2% +21.4% +30.0% ➖ noise
21 duckdb:vortex-compact -4.7% -21.2% +21.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -0.4% -21.2% +26.5% +30.0% ➖ noise
22 datafusion:vortex-compact +3.2% -10.3% +15.0% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +5.0% -10.3% +17.0% +45.1% ➖ noise
22 duckdb:vortex-compact -18.9% -10.3% -9.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.7% -10.3% +6.2% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant