Skip to content

Potentially better FSST estimation#7611

Closed
connortsui20 wants to merge 4 commits intodevelopfrom
ct/fsst-estimate
Closed

Potentially better FSST estimation#7611
connortsui20 wants to merge 4 commits intodevelopfrom
ct/fsst-estimate

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

Summary

Tracking issue: #7216

API Changes

TODO maybe?

Testing

Benchmarks run.

@connortsui20 connortsui20 added changelog/performance A performance improvement action/benchmark Trigger full benchmarks to run on this PR labels Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 94bcb3d 1 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done 0a0058d 1 Explore Profiling Data
🟢 Done b06abf9 1 Explore Profiling Data
🟢 Done 9823b45 1 Explore Profiling Data
🟢 Done d9a6ec5 1 Explore Profiling Data
🟢 Done c1994ab 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.015x ➖


datafusion / vortex-file-compressed (1.015x ➖, 0↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 113904457 124701180 0.91
polarsignals_q01/datafusion:vortex-file-compressed 261534982 289827135 0.90
polarsignals_q02/datafusion:vortex-file-compressed 23997498 23015691 1.04
polarsignals_q03/datafusion:vortex-file-compressed 🚨 312083305 268743986 1.16
polarsignals_q04/datafusion:vortex-file-compressed 11816304 11467813 1.03
polarsignals_q05/datafusion:vortex-file-compressed 16243338 15574804 1.04
polarsignals_q06/datafusion:vortex-file-compressed 18921750 18788102 1.01
polarsignals_q07/datafusion:vortex-file-compressed 14649892 13827182 1.06
polarsignals_q08/datafusion:vortex-file-compressed 356935355 353540228 1.01
polarsignals_q09/datafusion:vortex-file-compressed 10835741 10781449 1.01

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.41 MB 689.71 MB +297.41 KB +0.0%

Totals:

  • vortex-file-compressed: 689.41 MB → 689.71 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -3.4%


datafusion / vortex-file-compressed (0.968x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50401096 51221256 0.98
tpch_q02/datafusion:vortex-file-compressed 27004710 27142097 0.99
tpch_q03/datafusion:vortex-file-compressed 28535680 28440275 1.00
tpch_q04/datafusion:vortex-file-compressed 21649873 21407257 1.01
tpch_q05/datafusion:vortex-file-compressed 48513120 49305538 0.98
tpch_q06/datafusion:vortex-file-compressed 13447478 13821500 0.97
tpch_q07/datafusion:vortex-file-compressed 61059307 64019651 0.95
tpch_q08/datafusion:vortex-file-compressed 40507337 43482763 0.93
tpch_q09/datafusion:vortex-file-compressed 53794717 55339630 0.97
tpch_q10/datafusion:vortex-file-compressed 43299486 44556716 0.97
tpch_q11/datafusion:vortex-file-compressed 15379050 16674121 0.92
tpch_q12/datafusion:vortex-file-compressed 26015832 26671201 0.98
tpch_q13/datafusion:vortex-file-compressed 24855310 26043010 0.95
tpch_q14/datafusion:vortex-file-compressed 16432850 17612111 0.93
tpch_q15/datafusion:vortex-file-compressed 26888815 27852842 0.97
tpch_q16/datafusion:vortex-file-compressed 20529123 21790659 0.94
tpch_q17/datafusion:vortex-file-compressed 67483284 72149973 0.94
tpch_q18/datafusion:vortex-file-compressed 79228351 84569547 0.94
tpch_q19/datafusion:vortex-file-compressed 24608429 25369614 0.97
tpch_q20/datafusion:vortex-file-compressed 30077891 29474788 1.02
tpch_q21/datafusion:vortex-file-compressed 75562487 76864778 0.98
tpch_q22/datafusion:vortex-file-compressed 13815463 14095815 0.98
datafusion / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58196048 57681686 1.01
tpch_q02/datafusion:vortex-compact 30828454 30909820 1.00
tpch_q03/datafusion:vortex-compact 30476537 30032607 1.01
tpch_q04/datafusion:vortex-compact 23833345 24422373 0.98
tpch_q05/datafusion:vortex-compact 52036958 51962624 1.00
tpch_q06/datafusion:vortex-compact 15438980 14624891 1.06
tpch_q07/datafusion:vortex-compact 65024772 65928532 0.99
tpch_q08/datafusion:vortex-compact 44927350 45018050 1.00
tpch_q09/datafusion:vortex-compact 58847849 58727700 1.00
tpch_q10/datafusion:vortex-compact 49051811 49023672 1.00
tpch_q11/datafusion:vortex-compact 16416940 16395018 1.00
tpch_q12/datafusion:vortex-compact 33274324 33449009 0.99
tpch_q13/datafusion:vortex-compact 30416177 31791673 0.96
tpch_q14/datafusion:vortex-compact 20046175 20052446 1.00
tpch_q15/datafusion:vortex-compact 33076614 33630016 0.98
tpch_q16/datafusion:vortex-compact 24538447 24442420 1.00
tpch_q17/datafusion:vortex-compact 68550339 70277487 0.98
tpch_q18/datafusion:vortex-compact 84217424 84239071 1.00
tpch_q19/datafusion:vortex-compact 32091220 31808175 1.01
tpch_q20/datafusion:vortex-compact 33989034 35241121 0.96
tpch_q21/datafusion:vortex-compact 82172373 83245407 0.99
tpch_q22/datafusion:vortex-compact 14973329 15181197 0.99
datafusion / parquet (0.968x ➖, 2↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 125628724 114284939 1.10
tpch_q02/datafusion:parquet 61650887 65568963 0.94
tpch_q03/datafusion:parquet 73624606 70828907 1.04
tpch_q04/datafusion:parquet 43860867 46554088 0.94
tpch_q05/datafusion:parquet 92906213 95260557 0.98
tpch_q06/datafusion:parquet 42802906 42621946 1.00
tpch_q07/datafusion:parquet 107954309 105565786 1.02
tpch_q08/datafusion:parquet 93399365 97933453 0.95
tpch_q09/datafusion:parquet 129157765 126216013 1.02
tpch_q10/datafusion:parquet 108232965 112790410 0.96
tpch_q11/datafusion:parquet 41423648 43659802 0.95
tpch_q12/datafusion:parquet 89668195 89675036 1.00
tpch_q13/datafusion:parquet 187958549 197231367 0.95
tpch_q14/datafusion:parquet 46283524 49784818 0.93
tpch_q15/datafusion:parquet 58247745 60159882 0.97
tpch_q16/datafusion:parquet 44723663 44662530 1.00
tpch_q17/datafusion:parquet 🚀 126423614 142205461 0.89
tpch_q18/datafusion:parquet 160439741 173008842 0.93
tpch_q19/datafusion:parquet 🚀 76177048 93089103 0.82
tpch_q20/datafusion:parquet 68544650 72384747 0.95
tpch_q21/datafusion:parquet 135502356 139660676 0.97
tpch_q22/datafusion:parquet 32349748 31524578 1.03
datafusion / arrow (0.922x ➖, 6↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 49876199 59157584 0.84
tpch_q02/datafusion:arrow 18180344 19436125 0.94
tpch_q03/datafusion:arrow 🚀 28609264 32299253 0.89
tpch_q04/datafusion:arrow 24477999 25742407 0.95
tpch_q05/datafusion:arrow 73440723 77594573 0.95
tpch_q06/datafusion:arrow 21436174 21127815 1.01
tpch_q07/datafusion:arrow 102129903 106622814 0.96
tpch_q08/datafusion:arrow 43235735 46804291 0.92
tpch_q09/datafusion:arrow 61089491 65679883 0.93
tpch_q10/datafusion:arrow 🚀 44601568 51742394 0.86
tpch_q11/datafusion:arrow 8718498 9230743 0.94
tpch_q12/datafusion:arrow 51826791 55461424 0.93
tpch_q13/datafusion:arrow 46922443 48454007 0.97
tpch_q14/datafusion:arrow 🚀 21432455 25988366 0.82
tpch_q15/datafusion:arrow 🚀 41899964 46707440 0.90
tpch_q16/datafusion:arrow 18372492 19539791 0.94
tpch_q17/datafusion:arrow 67272332 74248102 0.91
tpch_q18/datafusion:arrow 134186979 142738883 0.94
tpch_q19/datafusion:arrow 36089697 39510531 0.91
tpch_q20/datafusion:arrow 🚀 33964816 38519369 0.88
tpch_q21/datafusion:arrow 148540952 155242291 0.96
tpch_q22/datafusion:arrow 17249713 18248085 0.95
duckdb / vortex-file-compressed (0.967x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31252168 32079654 0.97
tpch_q02/duckdb:vortex-file-compressed 24223733 25179876 0.96
tpch_q03/duckdb:vortex-file-compressed 29137845 30448755 0.96
tpch_q04/duckdb:vortex-file-compressed 28866283 30514868 0.95
tpch_q05/duckdb:vortex-file-compressed 32923046 33125271 0.99
tpch_q06/duckdb:vortex-file-compressed 11086289 10730323 1.03
tpch_q07/duckdb:vortex-file-compressed 35700404 37754398 0.95
tpch_q08/duckdb:vortex-file-compressed 37260718 38900782 0.96
tpch_q09/duckdb:vortex-file-compressed 73167653 72937300 1.00
tpch_q10/duckdb:vortex-file-compressed 34418881 34849855 0.99
tpch_q11/duckdb:vortex-file-compressed 13746826 14756280 0.93
tpch_q12/duckdb:vortex-file-compressed 21809832 22538919 0.97
tpch_q13/duckdb:vortex-file-compressed 34195080 35528491 0.96
tpch_q14/duckdb:vortex-file-compressed 20668606 21990871 0.94
tpch_q15/duckdb:vortex-file-compressed 16511260 16425383 1.01
tpch_q16/duckdb:vortex-file-compressed 27739523 28410070 0.98
tpch_q17/duckdb:vortex-file-compressed 24845125 25149681 0.99
tpch_q18/duckdb:vortex-file-compressed 49192174 50555138 0.97
tpch_q19/duckdb:vortex-file-compressed 🚀 28068003 31387808 0.89
tpch_q20/duckdb:vortex-file-compressed 34018693 35811136 0.95
tpch_q21/duckdb:vortex-file-compressed 104322820 111078991 0.94
tpch_q22/duckdb:vortex-file-compressed 17534119 17648904 0.99
duckdb / vortex-compact (0.952x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38263452 39416242 0.97
tpch_q02/duckdb:vortex-compact 35868656 35378340 1.01
tpch_q03/duckdb:vortex-compact 31625861 34411238 0.92
tpch_q04/duckdb:vortex-compact 34248239 35118401 0.98
tpch_q05/duckdb:vortex-compact 37086112 39424263 0.94
tpch_q06/duckdb:vortex-compact 13934420 15185330 0.92
tpch_q07/duckdb:vortex-compact 41770976 45374281 0.92
tpch_q08/duckdb:vortex-compact 43731016 45842313 0.95
tpch_q09/duckdb:vortex-compact 83117038 87664608 0.95
tpch_q10/duckdb:vortex-compact 38535279 39171602 0.98
tpch_q11/duckdb:vortex-compact 19115182 19731142 0.97
tpch_q12/duckdb:vortex-compact 34882927 36321796 0.96
tpch_q13/duckdb:vortex-compact 43804364 46111445 0.95
tpch_q14/duckdb:vortex-compact 28897497 30996580 0.93
tpch_q15/duckdb:vortex-compact 19281596 19816200 0.97
tpch_q16/duckdb:vortex-compact 34157810 35963082 0.95
tpch_q17/duckdb:vortex-compact 30078790 30987147 0.97
tpch_q18/duckdb:vortex-compact 49792410 51809024 0.96
tpch_q19/duckdb:vortex-compact 🚀 33380683 37870787 0.88
tpch_q20/duckdb:vortex-compact 41899068 43712141 0.96
tpch_q21/duckdb:vortex-compact 108590987 114965536 0.94
tpch_q22/duckdb:vortex-compact 19632929 20278297 0.97
duckdb / parquet (0.976x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75407778 80498445 0.94
tpch_q02/duckdb:parquet 38742961 39955250 0.97
tpch_q03/duckdb:parquet 70133615 71100566 0.99
tpch_q04/duckdb:parquet 46638826 48107930 0.97
tpch_q05/duckdb:parquet 65654135 66296837 0.99
tpch_q06/duckdb:parquet 20058552 20079081 1.00
tpch_q07/duckdb:parquet 66980153 72286324 0.93
tpch_q08/duckdb:parquet 79752705 82784973 0.96
tpch_q09/duckdb:parquet 🚀 141257104 157164400 0.90
tpch_q10/duckdb:parquet 115298459 116906661 0.99
tpch_q11/duckdb:parquet 21997986 22587227 0.97
tpch_q12/duckdb:parquet 44589202 46157020 0.97
tpch_q13/duckdb:parquet 247203777 255065149 0.97
tpch_q14/duckdb:parquet 48186547 47766346 1.01
tpch_q15/duckdb:parquet 24070806 24115071 1.00
tpch_q16/duckdb:parquet 54987181 56204684 0.98
tpch_q17/duckdb:parquet 55772056 50901428 1.10
tpch_q18/duckdb:parquet 112349935 111707035 1.01
tpch_q19/duckdb:parquet 65381080 67790858 0.96
tpch_q20/duckdb:parquet 63007370 63784947 0.99
tpch_q21/duckdb:parquet 163152526 173958366 0.94
tpch_q22/duckdb:parquet 51500459 52612491 0.98
duckdb / duckdb (0.953x ➖, 3↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15992436 16421310 0.97
tpch_q02/duckdb:duckdb 13034213 13573103 0.96
tpch_q03/duckdb:duckdb 18671688 20524872 0.91
tpch_q04/duckdb:duckdb 19209806 19863773 0.97
tpch_q05/duckdb:duckdb 20113184 20667857 0.97
tpch_q06/duckdb:duckdb 5343863 5663862 0.94
tpch_q07/duckdb:duckdb 22083770 23314838 0.95
tpch_q08/duckdb:duckdb 20405233 22595319 0.90
tpch_q09/duckdb:duckdb 🚀 52299517 58427516 0.90
tpch_q10/duckdb:duckdb 44637548 46944411 0.95
tpch_q11/duckdb:duckdb 🚀 5619290 6359063 0.88
tpch_q12/duckdb:duckdb 13705964 14336803 0.96
tpch_q13/duckdb:duckdb 38197172 38896481 0.98
tpch_q14/duckdb:duckdb 🚀 16810695 18946100 0.89
tpch_q15/duckdb:duckdb 11686812 12415418 0.94
tpch_q16/duckdb:duckdb 24121566 23703653 1.02
tpch_q17/duckdb:duckdb 13761414 14453868 0.95
tpch_q18/duckdb:duckdb 37479918 38231714 0.98
tpch_q19/duckdb:duckdb 27663160 26745003 1.03
tpch_q20/duckdb:duckdb 22394355 22914995 0.98
tpch_q21/duckdb:duckdb 55388125 56453814 0.98
tpch_q22/duckdb:duckdb 24460993 25039616 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -15.7% +1.5% -16.9% +18.1% ✅ faster
1 datafusion:vortex-compact +0.9% +1.5% -0.6% +16.5% ➖ noise
1 datafusion:vortex-file-compressed -1.6% +1.5% -3.0% +16.0% ➖ noise
1 duckdb:duckdb -2.6% +1.5% -4.0% +15.5% ➖ noise
1 duckdb:vortex-compact -2.9% +1.5% -4.3% +17.5% ➖ noise
1 duckdb:vortex-file-compressed -2.6% +1.5% -4.0% +18.3% ➖ noise
2 datafusion:arrow -6.5% -4.5% -2.0% +10.0% ➖ noise
2 datafusion:vortex-compact -0.3% -4.5% +4.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.5% -4.5% +4.2% +10.0% ➖ noise
2 duckdb:duckdb -4.0% -4.5% +0.6% +10.2% ➖ noise
2 duckdb:vortex-compact +1.4% -4.5% +6.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.8% -4.5% +0.8% +10.0% ➖ noise
3 datafusion:arrow -11.4% +1.3% -12.5% +10.0% ✅ faster
3 datafusion:vortex-compact +1.5% +1.3% +0.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.3% +1.3% -0.9% +10.0% ➖ noise
3 duckdb:duckdb -9.0% +1.3% -10.2% +11.6% ➖ noise
3 duckdb:vortex-compact -8.1% +1.3% -9.2% +10.1% ✅ faster
3 duckdb:vortex-file-compressed -4.3% +1.3% -5.5% +15.0% ➖ noise
4 datafusion:arrow -4.9% -4.4% -0.5% +10.0% ➖ noise
4 datafusion:vortex-compact -2.4% -4.4% +2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.1% -4.4% +5.8% +10.0% ➖ noise
4 duckdb:duckdb -3.3% -4.4% +1.2% +10.0% ➖ noise
4 duckdb:vortex-compact -2.5% -4.4% +2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.4% -4.4% -1.0% +10.0% ➖ noise
5 datafusion:arrow -5.4% -1.7% -3.7% +10.0% ➖ noise
5 datafusion:vortex-compact +0.1% -1.7% +1.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.6% -1.7% +0.1% +10.0% ➖ noise
5 duckdb:duckdb -2.7% -1.7% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact -5.9% -1.7% -4.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% -1.7% +1.1% +13.5% ➖ noise
6 datafusion:arrow +1.5% +0.2% +1.3% +12.7% ➖ noise
6 datafusion:vortex-compact +5.6% +0.2% +5.4% +15.5% ➖ noise
6 datafusion:vortex-file-compressed -2.7% +0.2% -2.9% +17.9% ➖ noise
6 duckdb:duckdb -5.6% +0.2% -5.8% +15.3% ➖ noise
6 duckdb:vortex-compact -8.2% +0.2% -8.4% +15.8% ➖ noise
6 duckdb:vortex-file-compressed +3.3% +0.2% +3.2% +14.4% ➖ noise
7 datafusion:arrow -4.2% -2.7% -1.6% +10.0% ➖ noise
7 datafusion:vortex-compact -1.4% -2.7% +1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.6% -2.7% -2.0% +10.0% ➖ noise
7 duckdb:duckdb -5.3% -2.7% -2.7% +10.0% ➖ noise
7 duckdb:vortex-compact -7.9% -2.7% -5.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.4% -2.7% -2.9% +10.0% ➖ noise
8 datafusion:arrow -7.6% -4.1% -3.6% +10.0% ➖ noise
8 datafusion:vortex-compact -0.2% -4.1% +4.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.8% -4.1% -2.8% +10.6% ➖ noise
8 duckdb:duckdb -9.7% -4.1% -5.8% +10.0% ➖ noise
8 duckdb:vortex-compact -4.6% -4.1% -0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.2% -4.1% -0.1% +11.2% ➖ noise
9 datafusion:arrow -7.0% -4.1% -3.0% +10.0% ➖ noise
9 datafusion:vortex-compact +0.2% -4.1% +4.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.8% -4.1% +1.4% +10.0% ➖ noise
9 duckdb:duckdb -10.5% -4.1% -6.7% +10.0% ➖ noise
9 duckdb:vortex-compact -5.2% -4.1% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.3% -4.1% +4.6% +10.0% ➖ noise
10 datafusion:arrow -13.8% -2.7% -11.4% +10.0% ✅ faster
10 datafusion:vortex-compact +0.1% -2.7% +2.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.8% -2.7% -0.1% +10.0% ➖ noise
10 duckdb:duckdb -4.9% -2.7% -2.3% +11.8% ➖ noise
10 duckdb:vortex-compact -1.6% -2.7% +1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.2% -2.7% +1.5% +10.0% ➖ noise
11 datafusion:arrow -5.5% -3.9% -1.7% +10.0% ➖ noise
11 datafusion:vortex-compact +0.1% -3.9% +4.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -7.8% -3.9% -4.1% +10.0% ➖ noise
11 duckdb:duckdb -11.6% -3.9% -8.1% +10.0% ➖ noise
11 duckdb:vortex-compact -3.1% -3.9% +0.8% +12.4% ➖ noise
11 duckdb:vortex-file-compressed -6.8% -3.9% -3.1% +10.0% ➖ noise
12 datafusion:arrow -6.6% -1.7% -4.9% +16.8% ➖ noise
12 datafusion:vortex-compact -0.5% -1.7% +1.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.5% -1.7% -0.8% +10.0% ➖ noise
12 duckdb:duckdb -4.4% -1.7% -2.7% +10.0% ➖ noise
12 duckdb:vortex-compact -4.0% -1.7% -2.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.2% -1.7% -1.5% +10.0% ➖ noise
13 datafusion:arrow -3.2% -3.9% +0.8% +10.0% ➖ noise
13 datafusion:vortex-compact -4.3% -3.9% -0.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -4.6% -3.9% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -1.8% -3.9% +2.2% +10.0% ➖ noise
13 duckdb:vortex-compact -5.0% -3.9% -1.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -3.8% -3.9% +0.1% +10.0% ➖ noise
14 datafusion:arrow -17.5% -3.2% -14.8% +12.7% ✅ faster
14 datafusion:vortex-compact -0.0% -3.2% +3.2% +10.4% ➖ noise
14 datafusion:vortex-file-compressed -6.7% -3.2% -3.7% +10.9% ➖ noise
14 duckdb:duckdb -11.3% -3.2% -8.4% +18.6% ➖ noise
14 duckdb:vortex-compact -6.8% -3.2% -3.7% +12.0% ➖ noise
14 duckdb:vortex-file-compressed -6.0% -3.2% -2.9% +12.0% ➖ noise
15 datafusion:arrow -10.3% -1.7% -8.7% +10.0% ➖ noise
15 datafusion:vortex-compact -1.6% -1.7% +0.0% +10.9% ➖ noise
15 datafusion:vortex-file-compressed -3.5% -1.7% -1.8% +11.7% ➖ noise
15 duckdb:duckdb -5.9% -1.7% -4.2% +12.0% ➖ noise
15 duckdb:vortex-compact -2.7% -1.7% -1.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.5% -1.7% +2.3% +11.3% ➖ noise
16 datafusion:arrow -6.0% -1.0% -5.0% +10.0% ➖ noise
16 datafusion:vortex-compact +0.4% -1.0% +1.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -5.8% -1.0% -4.8% +10.0% ➖ noise
16 duckdb:duckdb +1.8% -1.0% +2.8% +11.9% ➖ noise
16 duckdb:vortex-compact -5.0% -1.0% -4.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -2.4% -1.0% -1.4% +10.0% ➖ noise
17 datafusion:arrow -9.4% -1.3% -8.2% +10.5% ➖ noise
17 datafusion:vortex-compact -2.5% -1.3% -1.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -6.5% -1.3% -5.2% +10.0% ➖ noise
17 duckdb:duckdb -4.8% -1.3% -3.5% +11.4% ➖ noise
17 duckdb:vortex-compact -2.9% -1.3% -1.6% +10.1% ➖ noise
17 duckdb:vortex-file-compressed -1.2% -1.3% +0.1% +12.1% ➖ noise
18 datafusion:arrow -6.0% -3.4% -2.7% +10.0% ➖ noise
18 datafusion:vortex-compact -0.0% -3.4% +3.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -6.3% -3.4% -3.0% +10.0% ➖ noise
18 duckdb:duckdb -2.0% -3.4% +1.5% +10.0% ➖ noise
18 duckdb:vortex-compact -3.9% -3.4% -0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.7% -3.4% +0.8% +10.0% ➖ noise
19 datafusion:arrow -8.7% -11.2% +2.8% +17.6% ➖ noise
19 datafusion:vortex-compact +0.9% -11.2% +13.6% +14.4% ➖ noise
19 datafusion:vortex-file-compressed -3.0% -11.2% +9.2% +14.7% ➖ noise
19 duckdb:duckdb +3.4% -11.2% +16.4% +16.3% 🚨 regression
19 duckdb:vortex-compact -11.9% -11.2% -0.8% +13.5% ➖ noise
19 duckdb:vortex-file-compressed -10.6% -11.2% +0.7% +14.8% ➖ noise
20 datafusion:arrow -11.8% -3.3% -8.8% +10.0% ➖ noise
20 datafusion:vortex-compact -3.6% -3.3% -0.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +2.0% -3.3% +5.5% +10.0% ➖ noise
20 duckdb:duckdb -2.3% -3.3% +1.0% +10.0% ➖ noise
20 duckdb:vortex-compact -4.1% -3.3% -0.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -5.0% -3.3% -1.8% +10.0% ➖ noise
21 datafusion:arrow -4.3% -4.6% +0.3% +10.0% ➖ noise
21 datafusion:vortex-compact -1.3% -4.6% +3.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.7% -4.6% +3.1% +10.0% ➖ noise
21 duckdb:duckdb -1.9% -4.6% +2.9% +10.0% ➖ noise
21 duckdb:vortex-compact -5.5% -4.6% -1.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -6.1% -4.6% -1.5% +10.0% ➖ noise
22 datafusion:arrow -5.5% +0.2% -5.7% +10.0% ➖ noise
22 datafusion:vortex-compact -1.4% +0.2% -1.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -2.0% +0.2% -2.2% +10.0% ➖ noise
22 duckdb:duckdb -2.3% +0.2% -2.5% +10.0% ➖ noise
22 duckdb:vortex-compact -3.2% +0.2% -3.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +11.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (8 files changed, -0.0% overall, 0↑ 8↓)
File Scale Format Base HEAD Change %
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.42 MB 56 B -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.90 MB 56 B -0.0%
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.43 MB 56 B -0.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 63.03 MB 252 B -0.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 63.00 MB 260 B -0.0%
customer_0.vortex 1.0 vortex-file-compressed 10.50 MB 10.50 MB 248 B -0.0%
supplier_0.vortex 1.0 vortex-file-compressed 706.31 KB 705.69 KB 640 B -0.1%
region_0.vortex 1.0 vortex-file-compressed 6.13 KB 6.01 KB 120 B -1.9%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (-0.0%)
  • vortex-file-compressed: 266.60 MB → 266.60 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 1.068x ➖
Parquet (geomean): 1.077x ➖
Shifts: Parquet (control) +7.7% · Median polish +6.1%


datafusion / vortex-file-compressed (1.064x ➖, 0↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5661487 4999598 1.13
fineweb_q01/datafusion:vortex-file-compressed 22949917 21377026 1.07
fineweb_q02/datafusion:vortex-file-compressed 🚨 24685664 21366323 1.16
fineweb_q03/datafusion:vortex-file-compressed 81341534 85159045 0.96
fineweb_q04/datafusion:vortex-file-compressed 247626075 232551406 1.06
fineweb_q05/datafusion:vortex-file-compressed 219618162 215184493 1.02
fineweb_q06/datafusion:vortex-file-compressed 56700372 53961348 1.05
fineweb_q07/datafusion:vortex-file-compressed 61318178 58964094 1.04
fineweb_q08/datafusion:vortex-file-compressed 23302219 21300341 1.09
datafusion / vortex-compact (1.052x ➖, 0↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6204145 6483186 0.96
fineweb_q01/datafusion:vortex-compact 132773666 125600401 1.06
fineweb_q02/datafusion:vortex-compact 132117838 130936265 1.01
fineweb_q03/datafusion:vortex-compact 1076386370 1038245473 1.04
fineweb_q04/datafusion:vortex-compact 1172762608 1095069306 1.07
fineweb_q05/datafusion:vortex-compact 1008503135 958000820 1.05
fineweb_q06/datafusion:vortex-compact 566297708 532692650 1.06
fineweb_q07/datafusion:vortex-compact 560600733 544280888 1.03
fineweb_q08/datafusion:vortex-compact 🚨 22373836 18460819 1.21
datafusion / parquet (1.084x ➖, 0↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7048758 6682084 1.05
fineweb_q01/datafusion:parquet 306957076 287453099 1.07
fineweb_q02/datafusion:parquet 🚨 323266031 288314494 1.12
fineweb_q03/datafusion:parquet 🚨 323587337 281900486 1.15
fineweb_q04/datafusion:parquet 313821994 293042911 1.07
fineweb_q05/datafusion:parquet 311663653 294262841 1.06
fineweb_q06/datafusion:parquet 307856489 291769736 1.06
fineweb_q07/datafusion:parquet 306878705 283442429 1.08
fineweb_q08/datafusion:parquet 298044303 271627094 1.10
duckdb / vortex-file-compressed (1.061x ➖, 0↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3989717 3204950 1.24
fineweb_q01/duckdb:vortex-file-compressed 23026201 21216891 1.09
fineweb_q02/duckdb:vortex-file-compressed 24587437 23208309 1.06
fineweb_q03/duckdb:vortex-file-compressed 157758451 158925543 0.99
fineweb_q04/duckdb:vortex-file-compressed 232950241 226269661 1.03
fineweb_q05/duckdb:vortex-file-compressed 210597907 209109103 1.01
fineweb_q06/duckdb:vortex-file-compressed 54520064 52544085 1.04
fineweb_q07/duckdb:vortex-file-compressed 56187163 54514185 1.03
fineweb_q08/duckdb:vortex-file-compressed 24533069 22711714 1.08
duckdb / vortex-compact (1.094x ➖, 0↑ 3↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4226126 3859770 1.09
fineweb_q01/duckdb:vortex-compact 🚨 107224516 95591270 1.12
fineweb_q02/duckdb:vortex-compact 🚨 121388893 108435567 1.12
fineweb_q03/duckdb:vortex-compact 929199960 864881102 1.07
fineweb_q04/duckdb:vortex-compact 994154179 905572468 1.10
fineweb_q05/duckdb:vortex-compact 896548417 820826187 1.09
fineweb_q06/duckdb:vortex-compact 484833888 461476368 1.05
fineweb_q07/duckdb:vortex-compact 502686180 479880720 1.05
fineweb_q08/duckdb:vortex-compact 🚨 24964166 21689187 1.15
duckdb / parquet (1.069x ➖, 0↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 34009562 28217087 1.21
fineweb_q01/duckdb:parquet 88042595 81848436 1.08
fineweb_q02/duckdb:parquet 89926028 83673252 1.07
fineweb_q03/duckdb:parquet 329117267 309934360 1.06
fineweb_q04/duckdb:parquet 451513260 437711046 1.03
fineweb_q05/duckdb:parquet 415961846 411897808 1.01
fineweb_q06/duckdb:parquet 202170212 199494764 1.01
fineweb_q07/duckdb:parquet 214469866 208491539 1.03
fineweb_q08/duckdb:parquet 🚨 36337196 31913616 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.3% +12.8% -15.1% +54.4% ➖ noise
0 datafusion:vortex-file-compressed +13.2% +12.8% +0.4% +50.4% ➖ noise
0 duckdb:vortex-compact +9.5% +12.8% -2.9% +89.2% ➖ noise
0 duckdb:vortex-file-compressed +24.5% +12.8% +10.4% +77.6% ➖ noise
1 datafusion:vortex-compact +5.7% +7.2% -1.4% +14.3% ➖ noise
1 datafusion:vortex-file-compressed +7.4% +7.2% +0.2% +27.0% ➖ noise
1 duckdb:vortex-compact +12.2% +7.2% +4.7% +23.4% ➖ noise
1 duckdb:vortex-file-compressed +8.5% +7.2% +1.3% +64.0% ➖ noise
2 datafusion:vortex-compact +0.9% +9.8% -8.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +15.5% +9.8% +5.2% +10.5% ➖ noise
2 duckdb:vortex-compact +11.9% +9.8% +2.0% +10.2% ➖ noise
2 duckdb:vortex-file-compressed +5.9% +9.8% -3.5% +10.0% ➖ noise
3 datafusion:vortex-compact +3.7% +10.4% -6.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -4.5% +10.4% -13.5% +40.6% ➖ noise
3 duckdb:vortex-compact +7.4% +10.4% -2.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.7% +10.4% -10.1% +28.5% ➖ noise
4 datafusion:vortex-compact +7.1% +5.1% +1.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +6.5% +5.1% +1.3% +10.0% ➖ noise
4 duckdb:vortex-compact +9.8% +5.1% +4.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.0% +5.1% -2.0% +10.0% ➖ noise
5 datafusion:vortex-compact +5.3% +3.4% +1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.1% +3.4% -1.3% +10.0% ➖ noise
5 duckdb:vortex-compact +9.2% +3.4% +5.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.7% +3.4% -2.6% +10.0% ➖ noise
6 datafusion:vortex-compact +6.3% +3.4% +2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.1% +3.4% +1.6% +16.6% ➖ noise
6 duckdb:vortex-compact +5.1% +3.4% +1.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.8% +3.4% +0.3% +10.0% ➖ noise
7 datafusion:vortex-compact +3.0% +5.5% -2.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.0% +5.5% -1.5% +32.0% ➖ noise
7 duckdb:vortex-compact +4.8% +5.5% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.1% +5.5% -2.3% +11.8% ➖ noise
8 datafusion:vortex-compact +21.2% +11.8% +8.4% +14.0% ➖ noise
8 datafusion:vortex-file-compressed +9.4% +11.8% -2.1% +10.0% ➖ noise
8 duckdb:vortex-compact +15.1% +11.8% +3.0% +29.2% ➖ noise
8 duckdb:vortex-file-compressed +8.0% +11.8% -3.4% +34.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: FineWeb NVMe

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB +32.08 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%


datafusion / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25625941 25542027 1.00
tpcds_q02/datafusion:vortex-file-compressed 46907703 47389103 0.99
tpcds_q03/datafusion:vortex-file-compressed 16978315 17139204 0.99
tpcds_q04/datafusion:vortex-file-compressed 263596578 265234005 0.99
tpcds_q05/datafusion:vortex-file-compressed 43376374 44966053 0.96
tpcds_q06/datafusion:vortex-file-compressed 41337380 41896971 0.99
tpcds_q07/datafusion:vortex-file-compressed 43865231 44140874 0.99
tpcds_q08/datafusion:vortex-file-compressed 30577332 29202252 1.05
tpcds_q09/datafusion:vortex-file-compressed 44430426 45038784 0.99
tpcds_q10/datafusion:vortex-file-compressed 37813476 39517766 0.96
tpcds_q11/datafusion:vortex-file-compressed 152172195 151399576 1.01
tpcds_q12/datafusion:vortex-file-compressed 21212514 20971619 1.01
tpcds_q13/datafusion:vortex-file-compressed 45529237 45912804 0.99
tpcds_q14/datafusion:vortex-file-compressed 169441015 172602522 0.98
tpcds_q15/datafusion:vortex-file-compressed 30177703 30420682 0.99
tpcds_q16/datafusion:vortex-file-compressed 29335911 29197922 1.00
tpcds_q17/datafusion:vortex-file-compressed 64235804 64123092 1.00
tpcds_q18/datafusion:vortex-file-compressed 69597425 69638943 1.00
tpcds_q19/datafusion:vortex-file-compressed 24897634 25343792 0.98
tpcds_q20/datafusion:vortex-file-compressed 22969576 22840309 1.01
tpcds_q21/datafusion:vortex-file-compressed 122693390 127426229 0.96
tpcds_q22/datafusion:vortex-file-compressed 52850899 56164049 0.94
tpcds_q23/datafusion:vortex-file-compressed 128470371 126938647 1.01
tpcds_q24/datafusion:vortex-file-compressed 98253883 100112692 0.98
tpcds_q25/datafusion:vortex-file-compressed 66662454 66096460 1.01
tpcds_q26/datafusion:vortex-file-compressed 34694210 34160235 1.02
tpcds_q27/datafusion:vortex-file-compressed 104749258 105371102 0.99
tpcds_q28/datafusion:vortex-file-compressed 40080556 42161234 0.95
tpcds_q29/datafusion:vortex-file-compressed 62255041 62941609 0.99
tpcds_q30/datafusion:vortex-file-compressed 22750730 23321608 0.98
tpcds_q31/datafusion:vortex-file-compressed 84549351 85187914 0.99
tpcds_q32/datafusion:vortex-file-compressed 20841823 21158031 0.99
tpcds_q33/datafusion:vortex-file-compressed 29713395 29303183 1.01
tpcds_q34/datafusion:vortex-file-compressed 27804097 27113160 1.03
tpcds_q35/datafusion:vortex-file-compressed 47308823 47348655 1.00
tpcds_q36/datafusion:vortex-file-compressed 62169954 63911151 0.97
tpcds_q37/datafusion:vortex-file-compressed 30343794 30625117 0.99
tpcds_q38/datafusion:vortex-file-compressed 47942362 48665048 0.99
tpcds_q39/datafusion:vortex-file-compressed 136530990 132057901 1.03
tpcds_q40/datafusion:vortex-file-compressed 46268679 46230688 1.00
tpcds_q41/datafusion:vortex-file-compressed 15624110 16358410 0.96
tpcds_q42/datafusion:vortex-file-compressed 15834479 15902425 1.00
tpcds_q43/datafusion:vortex-file-compressed 28090360 29504280 0.95
tpcds_q44/datafusion:vortex-file-compressed 35816726 35242102 1.02
tpcds_q45/datafusion:vortex-file-compressed 31008638 31189417 0.99
tpcds_q46/datafusion:vortex-file-compressed 41621665 41424473 1.00
tpcds_q47/datafusion:vortex-file-compressed 184499727 187160593 0.99
tpcds_q48/datafusion:vortex-file-compressed 38935218 38956807 1.00
tpcds_q49/datafusion:vortex-file-compressed 58470323 57789198 1.01
tpcds_q50/datafusion:vortex-file-compressed 42256897 43101308 0.98
tpcds_q51/datafusion:vortex-file-compressed 89677732 88146248 1.02
tpcds_q52/datafusion:vortex-file-compressed 16895673 15951053 1.06
tpcds_q53/datafusion:vortex-file-compressed 21360811 21129040 1.01
tpcds_q54/datafusion:vortex-file-compressed 36091454 37644060 0.96
tpcds_q55/datafusion:vortex-file-compressed 16166078 16518856 0.98
tpcds_q56/datafusion:vortex-file-compressed 30847442 30913295 1.00
tpcds_q57/datafusion:vortex-file-compressed 117373906 116605493 1.01
tpcds_q58/datafusion:vortex-file-compressed 63843529 64959131 0.98
tpcds_q59/datafusion:vortex-file-compressed 65148412 63733021 1.02
tpcds_q60/datafusion:vortex-file-compressed 31599983 31964711 0.99
tpcds_q61/datafusion:vortex-file-compressed 41532211 44975372 0.92
tpcds_q62/datafusion:vortex-file-compressed 28341692 28488981 0.99
tpcds_q63/datafusion:vortex-file-compressed 22031564 21341044 1.03
tpcds_q64/datafusion:vortex-file-compressed 423700255 424969688 1.00
tpcds_q65/datafusion:vortex-file-compressed 41657847 41876559 0.99
tpcds_q66/datafusion:vortex-file-compressed 82231259 84503807 0.97
tpcds_q67/datafusion:vortex-file-compressed 112890037 114867486 0.98
tpcds_q68/datafusion:vortex-file-compressed 38241314 39342211 0.97
tpcds_q69/datafusion:vortex-file-compressed 36178852 37191005 0.97
tpcds_q70/datafusion:vortex-file-compressed 105484088 107107125 0.98
tpcds_q71/datafusion:vortex-file-compressed 25791635 25480694 1.01
tpcds_q72/datafusion:vortex-file-compressed 2408151710 2380413316 1.01
tpcds_q73/datafusion:vortex-file-compressed 25771155 25890019 1.00
tpcds_q74/datafusion:vortex-file-compressed 108503432 99606505 1.09
tpcds_q75/datafusion:vortex-file-compressed 109736649 109163434 1.01
tpcds_q76/datafusion:vortex-file-compressed 28028055 26406976 1.06
tpcds_q77/datafusion:vortex-file-compressed 40803277 40847641 1.00
tpcds_q78/datafusion:vortex-file-compressed 121452359 122663109 0.99
tpcds_q79/datafusion:vortex-file-compressed 32989670 32861938 1.00
tpcds_q80/datafusion:vortex-file-compressed 98067078 97866509 1.00
tpcds_q81/datafusion:vortex-file-compressed 26676804 26846072 0.99
tpcds_q82/datafusion:vortex-file-compressed 30772007 30238965 1.02
tpcds_q83/datafusion:vortex-file-compressed 41041155 40579749 1.01
tpcds_q84/datafusion:vortex-file-compressed 12328730 12682758 0.97
tpcds_q85/datafusion:vortex-file-compressed 90166256 93301621 0.97
tpcds_q86/datafusion:vortex-file-compressed 17673980 18026873 0.98
tpcds_q87/datafusion:vortex-file-compressed 48233272 47998141 1.00
tpcds_q88/datafusion:vortex-file-compressed 56852871 57669467 0.99
tpcds_q89/datafusion:vortex-file-compressed 31250048 31979032 0.98
tpcds_q90/datafusion:vortex-file-compressed 14902087 14593384 1.02
tpcds_q91/datafusion:vortex-file-compressed 19878743 20423382 0.97
tpcds_q92/datafusion:vortex-file-compressed 17798456 18376794 0.97
tpcds_q93/datafusion:vortex-file-compressed 33478159 33736362 0.99
tpcds_q94/datafusion:vortex-file-compressed 23403532 23197309 1.01
tpcds_q95/datafusion:vortex-file-compressed 60927683 60088940 1.01
tpcds_q96/datafusion:vortex-file-compressed 13333258 13690837 0.97
tpcds_q97/datafusion:vortex-file-compressed 30974399 31938058 0.97
tpcds_q98/datafusion:vortex-file-compressed 27847808 27732757 1.00
tpcds_q99/datafusion:vortex-file-compressed 42158154 41900437 1.01
datafusion / vortex-compact (0.996x ➖, 1↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26189423 25273543 1.04
tpcds_q02/datafusion:vortex-compact 51801022 52598161 0.98
tpcds_q03/datafusion:vortex-compact 22505601 22187343 1.01
tpcds_q04/datafusion:vortex-compact 302294463 295880559 1.02
tpcds_q05/datafusion:vortex-compact 50411528 50434728 1.00
tpcds_q06/datafusion:vortex-compact 46622895 44769353 1.04
tpcds_q07/datafusion:vortex-compact 53639962 55290083 0.97
tpcds_q08/datafusion:vortex-compact 37151857 36284803 1.02
tpcds_q09/datafusion:vortex-compact 63022205 64299450 0.98
tpcds_q10/datafusion:vortex-compact 50257244 49384522 1.02
tpcds_q11/datafusion:vortex-compact 165994657 164912234 1.01
tpcds_q12/datafusion:vortex-compact 25266999 25741226 0.98
tpcds_q13/datafusion:vortex-compact 93061299 94910199 0.98
tpcds_q14/datafusion:vortex-compact 198842896 200444258 0.99
tpcds_q15/datafusion:vortex-compact 🚀 32852206 36655861 0.90
tpcds_q16/datafusion:vortex-compact 33484751 33309562 1.01
tpcds_q17/datafusion:vortex-compact 74749658 76717557 0.97
tpcds_q18/datafusion:vortex-compact 79148916 80267591 0.99
tpcds_q19/datafusion:vortex-compact 33223282 32685114 1.02
tpcds_q20/datafusion:vortex-compact 26278859 26036955 1.01
tpcds_q21/datafusion:vortex-compact 129337340 129994370 0.99
tpcds_q22/datafusion:vortex-compact 62855569 60136236 1.05
tpcds_q23/datafusion:vortex-compact 142301957 144550906 0.98
tpcds_q24/datafusion:vortex-compact 110736264 111492446 0.99
tpcds_q25/datafusion:vortex-compact 80053642 78357159 1.02
tpcds_q26/datafusion:vortex-compact 46976460 46456174 1.01
tpcds_q27/datafusion:vortex-compact 121044411 121852199 0.99
tpcds_q28/datafusion:vortex-compact 80991518 80937064 1.00
tpcds_q29/datafusion:vortex-compact 74478384 75170919 0.99
tpcds_q30/datafusion:vortex-compact 27777993 28569229 0.97
tpcds_q31/datafusion:vortex-compact 107244104 109527155 0.98
tpcds_q32/datafusion:vortex-compact 25662349 25220295 1.02
tpcds_q33/datafusion:vortex-compact 36029889 39117864 0.92
tpcds_q34/datafusion:vortex-compact 35276535 36328116 0.97
tpcds_q35/datafusion:vortex-compact 54136910 54403648 1.00
tpcds_q36/datafusion:vortex-compact 79305059 81461502 0.97
tpcds_q37/datafusion:vortex-compact 43591010 43827451 0.99
tpcds_q38/datafusion:vortex-compact 56591097 57736618 0.98
tpcds_q39/datafusion:vortex-compact 146909034 134269530 1.09
tpcds_q40/datafusion:vortex-compact 50569257 50950570 0.99
tpcds_q41/datafusion:vortex-compact 18801577 18232585 1.03
tpcds_q42/datafusion:vortex-compact 20296779 20213426 1.00
tpcds_q43/datafusion:vortex-compact 33957678 34216732 0.99
tpcds_q44/datafusion:vortex-compact 53154524 53907893 0.99
tpcds_q45/datafusion:vortex-compact 35545948 36564385 0.97
tpcds_q46/datafusion:vortex-compact 51261577 51553907 0.99
tpcds_q47/datafusion:vortex-compact 198377065 204109611 0.97
tpcds_q48/datafusion:vortex-compact 72843254 72215693 1.01
tpcds_q49/datafusion:vortex-compact 67704591 69223634 0.98
tpcds_q50/datafusion:vortex-compact 49969536 48758115 1.02
tpcds_q51/datafusion:vortex-compact 93336314 94217951 0.99
tpcds_q52/datafusion:vortex-compact 20627497 20717601 1.00
tpcds_q53/datafusion:vortex-compact 27843253 28321392 0.98
tpcds_q54/datafusion:vortex-compact 44666902 43927053 1.02
tpcds_q55/datafusion:vortex-compact 19683921 20059950 0.98
tpcds_q56/datafusion:vortex-compact 37160564 37730224 0.98
tpcds_q57/datafusion:vortex-compact 126399429 129102037 0.98
tpcds_q58/datafusion:vortex-compact 69842760 71702290 0.97
tpcds_q59/datafusion:vortex-compact 73733558 77781426 0.95
tpcds_q60/datafusion:vortex-compact 39133139 38881465 1.01
tpcds_q61/datafusion:vortex-compact 54964707 55960438 0.98
tpcds_q62/datafusion:vortex-compact 30023028 30053233 1.00
tpcds_q63/datafusion:vortex-compact 28113856 27854201 1.01
tpcds_q64/datafusion:vortex-compact 461538208 464216677 0.99
tpcds_q65/datafusion:vortex-compact 56888904 56402159 1.01
tpcds_q66/datafusion:vortex-compact 85205604 84324743 1.01
tpcds_q67/datafusion:vortex-compact 121144025 115667599 1.05
tpcds_q68/datafusion:vortex-compact 50179546 52158259 0.96
tpcds_q69/datafusion:vortex-compact 47104709 47558804 0.99
tpcds_q70/datafusion:vortex-compact 113017803 111852137 1.01
tpcds_q71/datafusion:vortex-compact 33045475 32043268 1.03
tpcds_q72/datafusion:vortex-compact 2395180659 2374783999 1.01
tpcds_q73/datafusion:vortex-compact 34265559 34101588 1.00
tpcds_q74/datafusion:vortex-compact 110447494 113014913 0.98
tpcds_q75/datafusion:vortex-compact 129159929 129336705 1.00
tpcds_q76/datafusion:vortex-compact 35835864 36624340 0.98
tpcds_q77/datafusion:vortex-compact 50861957 51837497 0.98
tpcds_q78/datafusion:vortex-compact 141772537 138313753 1.03
tpcds_q79/datafusion:vortex-compact 42368028 42370947 1.00
tpcds_q80/datafusion:vortex-compact 105312240 106611598 0.99
tpcds_q81/datafusion:vortex-compact 33342265 34435587 0.97
tpcds_q82/datafusion:vortex-compact 44374785 44324110 1.00
tpcds_q83/datafusion:vortex-compact 44044623 44138245 1.00
tpcds_q84/datafusion:vortex-compact 14676711 15500939 0.95
tpcds_q85/datafusion:vortex-compact 126063477 129156183 0.98
tpcds_q86/datafusion:vortex-compact 🚨 22130529 19800843 1.12
tpcds_q87/datafusion:vortex-compact 56818905 55895630 1.02
tpcds_q88/datafusion:vortex-compact 78498991 78959652 0.99
tpcds_q89/datafusion:vortex-compact 37214663 36466690 1.02
tpcds_q90/datafusion:vortex-compact 15929579 15586398 1.02
tpcds_q91/datafusion:vortex-compact 34208631 34965188 0.98
tpcds_q92/datafusion:vortex-compact 23463762 24743283 0.95
tpcds_q93/datafusion:vortex-compact 38477815 37703180 1.02
tpcds_q94/datafusion:vortex-compact 29298207 29477439 0.99
tpcds_q95/datafusion:vortex-compact 64841425 62760545 1.03
tpcds_q96/datafusion:vortex-compact 17223851 17593422 0.98
tpcds_q97/datafusion:vortex-compact 36794884 38219475 0.96
tpcds_q98/datafusion:vortex-compact 31986170 32270967 0.99
tpcds_q99/datafusion:vortex-compact 44722588 46794921 0.96
datafusion / parquet (0.991x ➖, 2↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29608288 30554985 0.97
tpcds_q02/datafusion:parquet 40487291 42569311 0.95
tpcds_q03/datafusion:parquet 13492368 14266966 0.95
tpcds_q04/datafusion:parquet 264881651 269108059 0.98
tpcds_q05/datafusion:parquet 41766628 42936369 0.97
tpcds_q06/datafusion:parquet 58385202 58794638 0.99
tpcds_q07/datafusion:parquet 79013345 78573200 1.01
tpcds_q08/datafusion:parquet 26295366 26020326 1.01
tpcds_q09/datafusion:parquet 44897658 43080989 1.04
tpcds_q10/datafusion:parquet 75499287 72661573 1.04
tpcds_q11/datafusion:parquet 154308239 145318671 1.06
tpcds_q12/datafusion:parquet 17701670 16745112 1.06
tpcds_q13/datafusion:parquet 75585397 76351176 0.99
tpcds_q14/datafusion:parquet 159400321 160585955 0.99
tpcds_q15/datafusion:parquet 20703678 20710774 1.00
tpcds_q16/datafusion:parquet 24982729 23876158 1.05
tpcds_q17/datafusion:parquet 62280149 64232589 0.97
tpcds_q18/datafusion:parquet 113553648 114708527 0.99
tpcds_q19/datafusion:parquet 23012866 23236694 0.99
tpcds_q20/datafusion:parquet 16208194 16221361 1.00
tpcds_q21/datafusion:parquet 18456244 19270808 0.96
tpcds_q22/datafusion:parquet 144365346 145827672 0.99
tpcds_q23/datafusion:parquet 141510223 141692817 1.00
tpcds_q24/datafusion:parquet 89567058 91461684 0.98
tpcds_q25/datafusion:parquet 62495551 62492755 1.00
tpcds_q26/datafusion:parquet 67303988 67225667 1.00
tpcds_q27/datafusion:parquet 146791586 145561180 1.01
tpcds_q28/datafusion:parquet 45160793 43865888 1.03
tpcds_q29/datafusion:parquet 66180233 67180979 0.99
tpcds_q30/datafusion:parquet 34584241 35420090 0.98
tpcds_q31/datafusion:parquet 66450437 64150578 1.04
tpcds_q32/datafusion:parquet 18135549 18636005 0.97
tpcds_q33/datafusion:parquet 27622684 27360756 1.01
tpcds_q34/datafusion:parquet 22383167 22259215 1.01
tpcds_q35/datafusion:parquet 71097642 70378003 1.01
tpcds_q36/datafusion:parquet 56334425 56033645 1.01
tpcds_q37/datafusion:parquet 18875441 19090397 0.99
tpcds_q38/datafusion:parquet 40959071 40360347 1.01
tpcds_q39/datafusion:parquet 70782894 72956970 0.97
tpcds_q40/datafusion:parquet 23999692 23506877 1.02
tpcds_q41/datafusion:parquet 13407405 13683559 0.98
tpcds_q42/datafusion:parquet 11643302 12166833 0.96
tpcds_q43/datafusion:parquet 16198806 17089799 0.95
tpcds_q44/datafusion:parquet 🚀 32477085 36492472 0.89
tpcds_q45/datafusion:parquet 27817583 28422972 0.98
tpcds_q46/datafusion:parquet 31781294 31645533 1.00
tpcds_q47/datafusion:parquet 124386249 122887323 1.01
tpcds_q48/datafusion:parquet 71416383 70777810 1.01
tpcds_q49/datafusion:parquet 54603974 54515288 1.00
tpcds_q50/datafusion:parquet 42642932 42381434 1.01
tpcds_q51/datafusion:parquet 85541234 86903474 0.98
tpcds_q52/datafusion:parquet 11787334 12158856 0.97
tpcds_q53/datafusion:parquet 17276947 17135050 1.01
tpcds_q54/datafusion:parquet 33735191 34014671 0.99
tpcds_q55/datafusion:parquet 11694019 12149875 0.96
tpcds_q56/datafusion:parquet 27663089 27620983 1.00
tpcds_q57/datafusion:parquet 95471460 97358461 0.98
tpcds_q58/datafusion:parquet 49794727 47678394 1.04
tpcds_q59/datafusion:parquet 51140706 52888279 0.97
tpcds_q60/datafusion:parquet 27017897 28394956 0.95
tpcds_q61/datafusion:parquet 42587256 42024578 1.01
tpcds_q62/datafusion:parquet 19479385 19032221 1.02
tpcds_q63/datafusion:parquet 17829456 17939474 0.99
tpcds_q64/datafusion:parquet 508030683 511262059 0.99
tpcds_q65/datafusion:parquet 38277049 37552683 1.02
tpcds_q66/datafusion:parquet 64599836 69220411 0.93
tpcds_q67/datafusion:parquet 144504086 142457239 1.01
tpcds_q68/datafusion:parquet 31717274 32966203 0.96
tpcds_q69/datafusion:parquet 66897486 69227407 0.97
tpcds_q70/datafusion:parquet 89760005 91037978 0.99
tpcds_q71/datafusion:parquet 22711869 22402921 1.01
tpcds_q72/datafusion:parquet 593745066 593338384 1.00
tpcds_q73/datafusion:parquet 21500803 22755919 0.94
tpcds_q74/datafusion:parquet 83581578 83530660 1.00
tpcds_q75/datafusion:parquet 100644335 99831240 1.01
tpcds_q76/datafusion:parquet 29351552 29103795 1.01
tpcds_q77/datafusion:parquet 38184270 39266095 0.97
tpcds_q78/datafusion:parquet 112007977 110981178 1.01
tpcds_q79/datafusion:parquet 26799620 28266310 0.95
tpcds_q80/datafusion:parquet 77821974 78657492 0.99
tpcds_q81/datafusion:parquet 31358361 31459850 1.00
tpcds_q82/datafusion:parquet 19056026 19010089 1.00
tpcds_q83/datafusion:parquet 37237035 35727350 1.04
tpcds_q84/datafusion:parquet 38258964 39352233 0.97
tpcds_q85/datafusion:parquet 149552718 151386291 0.99
tpcds_q86/datafusion:parquet 🚨 15531792 13548369 1.15
tpcds_q87/datafusion:parquet 38551664 41681390 0.92
tpcds_q88/datafusion:parquet 59360863 59491139 1.00
tpcds_q89/datafusion:parquet 20937552 21105444 0.99
tpcds_q90/datafusion:parquet 14072595 14773989 0.95
tpcds_q91/datafusion:parquet 58522412 60118538 0.97
tpcds_q92/datafusion:parquet 18861358 18488892 1.02
tpcds_q93/datafusion:parquet 30812808 30867284 1.00
tpcds_q94/datafusion:parquet 20716376 20179865 1.03
tpcds_q95/datafusion:parquet 57167190 58992360 0.97
tpcds_q96/datafusion:parquet 11634880 12484254 0.93
tpcds_q97/datafusion:parquet 31069931 30754325 1.01
tpcds_q98/datafusion:parquet 21524792 20821411 1.03
tpcds_q99/datafusion:parquet 🚀 24684209 31392853 0.79
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21139477 21496665 0.98
tpcds_q02/duckdb:vortex-file-compressed 34963024 35727578 0.98
tpcds_q03/duckdb:vortex-file-compressed 33573840 31646994 1.06
tpcds_q04/duckdb:vortex-file-compressed 101456614 99483804 1.02
tpcds_q05/duckdb:vortex-file-compressed 36345796 36771210 0.99
tpcds_q06/duckdb:vortex-file-compressed 31444312 31436685 1.00
tpcds_q07/duckdb:vortex-file-compressed 19150975 20026817 0.96
tpcds_q08/duckdb:vortex-file-compressed 29476233 28875347 1.02
tpcds_q09/duckdb:vortex-file-compressed 40113430 39737072 1.01
tpcds_q10/duckdb:vortex-file-compressed 38956529 40301350 0.97
tpcds_q11/duckdb:vortex-file-compressed 60247388 59264789 1.02
tpcds_q12/duckdb:vortex-file-compressed 13717154 13812814 0.99
tpcds_q13/duckdb:vortex-file-compressed 32015398 31817454 1.01
tpcds_q14/duckdb:vortex-file-compressed 104755995 102361265 1.02
tpcds_q15/duckdb:vortex-file-compressed 26366057 26281415 1.00
tpcds_q16/duckdb:vortex-file-compressed 27186361 26249050 1.04
tpcds_q17/duckdb:vortex-file-compressed 42874549 41532456 1.03
tpcds_q18/duckdb:vortex-file-compressed 46200194 46757179 0.99
tpcds_q19/duckdb:vortex-file-compressed 32879357 33261766 0.99
tpcds_q20/duckdb:vortex-file-compressed 15423147 15195082 1.02
tpcds_q21/duckdb:vortex-file-compressed 16624085 16284085 1.02
tpcds_q22/duckdb:vortex-file-compressed 70956384 70830539 1.00
tpcds_q23/duckdb:vortex-file-compressed 103988407 105009900 0.99
tpcds_q24/duckdb:vortex-file-compressed 49449965 49701582 0.99
tpcds_q25/duckdb:vortex-file-compressed 48160604 47503498 1.01
tpcds_q26/duckdb:vortex-file-compressed 39197571 38841440 1.01
tpcds_q27/duckdb:vortex-file-compressed 46725188 44865209 1.04
tpcds_q28/duckdb:vortex-file-compressed 35566231 36357357 0.98
tpcds_q29/duckdb:vortex-file-compressed 39945060 40931989 0.98
tpcds_q30/duckdb:vortex-file-compressed 23144976 24114563 0.96
tpcds_q31/duckdb:vortex-file-compressed 34604899 33845561 1.02
tpcds_q32/duckdb:vortex-file-compressed 13672631 13768521 0.99
tpcds_q33/duckdb:vortex-file-compressed 24406980 23816485 1.02
tpcds_q34/duckdb:vortex-file-compressed 22903070 23031493 0.99
tpcds_q35/duckdb:vortex-file-compressed 65364183 61683290 1.06
tpcds_q36/duckdb:vortex-file-compressed 24522799 25847731 0.95
tpcds_q37/duckdb:vortex-file-compressed 15117488 15062444 1.00
tpcds_q38/duckdb:vortex-file-compressed 37661684 36980598 1.02
tpcds_q39/duckdb:vortex-file-compressed 🚨 38680081 32761830 1.18
tpcds_q40/duckdb:vortex-file-compressed 18738572 19091324 0.98
tpcds_q41/duckdb:vortex-file-compressed 13034937 12960338 1.01
tpcds_q42/duckdb:vortex-file-compressed 12784439 12380328 1.03
tpcds_q43/duckdb:vortex-file-compressed 22281510 22985163 0.97
tpcds_q44/duckdb:vortex-file-compressed 20812279 20521727 1.01
tpcds_q45/duckdb:vortex-file-compressed 28413695 28557509 0.99
tpcds_q46/duckdb:vortex-file-compressed 51847322 50738967 1.02
tpcds_q47/duckdb:vortex-file-compressed 46283018 47319642 0.98
tpcds_q48/duckdb:vortex-file-compressed 29562995 30601045 0.97
tpcds_q49/duckdb:vortex-file-compressed 34038324 34088551 1.00
tpcds_q50/duckdb:vortex-file-compressed 34159987 34699627 0.98
tpcds_q51/duckdb:vortex-file-compressed 96458950 95279306 1.01
tpcds_q52/duckdb:vortex-file-compressed 12843996 12260524 1.05
tpcds_q53/duckdb:vortex-file-compressed 22586918 23373131 0.97
tpcds_q54/duckdb:vortex-file-compressed 28449327 27829607 1.02
tpcds_q55/duckdb:vortex-file-compressed 12717249 12672428 1.00
tpcds_q56/duckdb:vortex-file-compressed 24322199 23151828 1.05
tpcds_q57/duckdb:vortex-file-compressed 38967231 39241131 0.99
tpcds_q58/duckdb:vortex-file-compressed 31167176 30852824 1.01
tpcds_q59/duckdb:vortex-file-compressed 66452442 65844955 1.01
tpcds_q60/duckdb:vortex-file-compressed 26172142 24863490 1.05
tpcds_q61/duckdb:vortex-file-compressed 35646160 32422779 1.10
tpcds_q62/duckdb:vortex-file-compressed 16489853 16624128 0.99
tpcds_q63/duckdb:vortex-file-compressed 21034639 20669256 1.02
tpcds_q64/duckdb:vortex-file-compressed 81856157 84120258 0.97
tpcds_q65/duckdb:vortex-file-compressed 22077859 21557101 1.02
tpcds_q66/duckdb:vortex-file-compressed 28619174 28737890 1.00
tpcds_q67/duckdb:vortex-file-compressed 135131234 139929549 0.97
tpcds_q68/duckdb:vortex-file-compressed 42030295 39595116 1.06
tpcds_q69/duckdb:vortex-file-compressed 41285484 42207105 0.98
tpcds_q70/duckdb:vortex-file-compressed 25286808 26039903 0.97
tpcds_q71/duckdb:vortex-file-compressed 21183834 21081778 1.00
tpcds_q72/duckdb:vortex-file-compressed 169371926 169003276 1.00
tpcds_q73/duckdb:vortex-file-compressed 23217509 22666254 1.02
tpcds_q74/duckdb:vortex-file-compressed 🚨 79438032 71405457 1.11
tpcds_q75/duckdb:vortex-file-compressed 56570169 53794884 1.05
tpcds_q76/duckdb:vortex-file-compressed 18450472 18280995 1.01
tpcds_q77/duckdb:vortex-file-compressed 25818009 26635062 0.97
tpcds_q78/duckdb:vortex-file-compressed 74627370 73713608 1.01
tpcds_q79/duckdb:vortex-file-compressed 32368165 32182434 1.01
tpcds_q80/duckdb:vortex-file-compressed 51457215 48374871 1.06
tpcds_q81/duckdb:vortex-file-compressed 28470546 28155478 1.01
tpcds_q82/duckdb:vortex-file-compressed 17167179 16027496 1.07
tpcds_q83/duckdb:vortex-file-compressed 23939895 22820143 1.05
tpcds_q84/duckdb:vortex-file-compressed 18509752 18206536 1.02
tpcds_q85/duckdb:vortex-file-compressed 44296265 45610610 0.97
tpcds_q86/duckdb:vortex-file-compressed 17034701 16851126 1.01
tpcds_q87/duckdb:vortex-file-compressed 40107336 38817117 1.03
tpcds_q88/duckdb:vortex-file-compressed 32693318 32706205 1.00
tpcds_q89/duckdb:vortex-file-compressed 22422787 23590631 0.95
tpcds_q90/duckdb:vortex-file-compressed 12170247 12555160 0.97
tpcds_q91/duckdb:vortex-file-compressed 29962243 30066350 1.00
tpcds_q92/duckdb:vortex-file-compressed 22118826 20606825 1.07
tpcds_q93/duckdb:vortex-file-compressed 28202195 27924408 1.01
tpcds_q94/duckdb:vortex-file-compressed 22420773 23241922 0.96
tpcds_q95/duckdb:vortex-file-compressed 136345129 137327598 0.99
tpcds_q96/duckdb:vortex-file-compressed 13941318 13534515 1.03
tpcds_q97/duckdb:vortex-file-compressed 36323129 36458296 1.00
tpcds_q98/duckdb:vortex-file-compressed 17256729 17713263 0.97
tpcds_q99/duckdb:vortex-file-compressed 26971135 27134178 0.99
duckdb / vortex-compact (1.004x ➖, 1↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24145758 23387781 1.03
tpcds_q02/duckdb:vortex-compact 38921200 42164399 0.92
tpcds_q03/duckdb:vortex-compact 57494628 56360033 1.02
tpcds_q04/duckdb:vortex-compact 124455041 124846783 1.00
tpcds_q05/duckdb:vortex-compact 52467691 51736804 1.01
tpcds_q06/duckdb:vortex-compact 41564997 40111940 1.04
tpcds_q07/duckdb:vortex-compact 33943340 35138558 0.97
tpcds_q08/duckdb:vortex-compact 43587622 45063639 0.97
tpcds_q09/duckdb:vortex-compact 58417609 56752022 1.03
tpcds_q10/duckdb:vortex-compact 62367630 63228818 0.99
tpcds_q11/duckdb:vortex-compact 74866575 71313448 1.05
tpcds_q12/duckdb:vortex-compact 22222764 23522413 0.94
tpcds_q13/duckdb:vortex-compact 60271180 61422542 0.98
tpcds_q14/duckdb:vortex-compact 134090559 127395826 1.05
tpcds_q15/duckdb:vortex-compact 29527017 30264108 0.98
tpcds_q16/duckdb:vortex-compact 29524531 30418418 0.97
tpcds_q17/duckdb:vortex-compact 55366673 53357587 1.04
tpcds_q18/duckdb:vortex-compact 58066164 57632621 1.01
tpcds_q19/duckdb:vortex-compact 52772438 49329396 1.07
tpcds_q20/duckdb:vortex-compact 20820307 20618751 1.01
tpcds_q21/duckdb:vortex-compact 19203253 20489992 0.94
tpcds_q22/duckdb:vortex-compact 73147484 74093700 0.99
tpcds_q23/duckdb:vortex-compact 🚨 139293001 117703258 1.18
tpcds_q24/duckdb:vortex-compact 62495418 61938164 1.01
tpcds_q25/duckdb:vortex-compact 81713792 82655489 0.99
tpcds_q26/duckdb:vortex-compact 50227872 51905860 0.97
tpcds_q27/duckdb:vortex-compact 70794308 68534599 1.03
tpcds_q28/duckdb:vortex-compact 87321381 85274868 1.02
tpcds_q29/duckdb:vortex-compact 55029584 55870753 0.98
tpcds_q30/duckdb:vortex-compact 28437827 28000449 1.02
tpcds_q31/duckdb:vortex-compact 45456077 44679825 1.02
tpcds_q32/duckdb:vortex-compact 22456247 22344060 1.01
tpcds_q33/duckdb:vortex-compact 36030204 36927323 0.98
tpcds_q34/duckdb:vortex-compact 38094434 37838042 1.01
tpcds_q35/duckdb:vortex-compact 80767855 79924685 1.01
tpcds_q36/duckdb:vortex-compact 41720536 41999223 0.99
tpcds_q37/duckdb:vortex-compact 23390707 23980269 0.98
tpcds_q38/duckdb:vortex-compact 45967914 47563589 0.97
tpcds_q39/duckdb:vortex-compact 35897170 35380251 1.01
tpcds_q40/duckdb:vortex-compact 24539306 26913875 0.91
tpcds_q41/duckdb:vortex-compact 15230505 16210725 0.94
tpcds_q42/duckdb:vortex-compact 22435028 21376298 1.05
tpcds_q43/duckdb:vortex-compact 36315373 34562945 1.05
tpcds_q44/duckdb:vortex-compact 29554120 28614791 1.03
tpcds_q45/duckdb:vortex-compact 39338671 37973658 1.04
tpcds_q46/duckdb:vortex-compact 72494603 69456946 1.04
tpcds_q47/duckdb:vortex-compact 62136391 63963692 0.97
tpcds_q48/duckdb:vortex-compact 52059486 53044845 0.98
tpcds_q49/duckdb:vortex-compact 60285589 59317982 1.02
tpcds_q50/duckdb:vortex-compact 47408475 47957426 0.99
tpcds_q51/duckdb:vortex-compact 107625705 105767674 1.02
tpcds_q52/duckdb:vortex-compact 22245007 22475892 0.99
tpcds_q53/duckdb:vortex-compact 39111923 39419559 0.99
tpcds_q54/duckdb:vortex-compact 40942644 40243355 1.02
tpcds_q55/duckdb:vortex-compact 23482209 22799939 1.03
tpcds_q56/duckdb:vortex-compact 36210592 35488266 1.02
tpcds_q57/duckdb:vortex-compact 42918772 43414290 0.99
tpcds_q58/duckdb:vortex-compact 44041415 44170264 1.00
tpcds_q59/duckdb:vortex-compact 🚀 76688351 88300976 0.87
tpcds_q60/duckdb:vortex-compact 37485517 37706524 0.99
tpcds_q61/duckdb:vortex-compact 65738384 65661572 1.00
tpcds_q62/duckdb:vortex-compact 26411720 25258064 1.05
tpcds_q63/duckdb:vortex-compact 36810066 37198652 0.99
tpcds_q64/duckdb:vortex-compact 115075390 115621262 1.00
tpcds_q65/duckdb:vortex-compact 33117585 32561800 1.02
tpcds_q66/duckdb:vortex-compact 41710149 38909358 1.07
tpcds_q67/duckdb:vortex-compact 151783842 150563401 1.01
tpcds_q68/duckdb:vortex-compact 62030431 61892616 1.00
tpcds_q69/duckdb:vortex-compact 62014463 61962848 1.00
tpcds_q70/duckdb:vortex-compact 37796406 37372560 1.01
tpcds_q71/duckdb:vortex-compact 33070057 34874462 0.95
tpcds_q72/duckdb:vortex-compact 190551084 189951790 1.00
tpcds_q73/duckdb:vortex-compact 38819259 37022308 1.05
tpcds_q74/duckdb:vortex-compact 84283020 83982304 1.00
tpcds_q75/duckdb:vortex-compact 71288334 73363148 0.97
tpcds_q76/duckdb:vortex-compact 36663142 36732381 1.00
tpcds_q77/duckdb:vortex-compact 41647135 44089219 0.94
tpcds_q78/duckdb:vortex-compact 89084019 86070050 1.04
tpcds_q79/duckdb:vortex-compact 56081942 54790278 1.02
tpcds_q80/duckdb:vortex-compact 80104969 83113479 0.96
tpcds_q81/duckdb:vortex-compact 33474103 33777587 0.99
tpcds_q82/duckdb:vortex-compact 24743686 25348520 0.98
tpcds_q83/duckdb:vortex-compact 30658428 31745442 0.97
tpcds_q84/duckdb:vortex-compact 27001782 26237922 1.03
tpcds_q85/duckdb:vortex-compact 58728608 57425846 1.02
tpcds_q86/duckdb:vortex-compact 22743785 23931695 0.95
tpcds_q87/duckdb:vortex-compact 49683837 50671023 0.98
tpcds_q88/duckdb:vortex-compact 40035749 39130586 1.02
tpcds_q89/duckdb:vortex-compact 37489480 38252672 0.98
tpcds_q90/duckdb:vortex-compact 14987405 14855291 1.01
tpcds_q91/duckdb:vortex-compact 51028949 50150648 1.02
tpcds_q92/duckdb:vortex-compact 49945004 48660432 1.03
tpcds_q93/duckdb:vortex-compact 31607333 31251911 1.01
tpcds_q94/duckdb:vortex-compact 31470102 31479026 1.00
tpcds_q95/duckdb:vortex-compact 161854468 156622416 1.03
tpcds_q96/duckdb:vortex-compact 🚨 19128609 17124757 1.12
tpcds_q97/duckdb:vortex-compact 47551338 43907752 1.08
tpcds_q98/duckdb:vortex-compact 29245383 28638544 1.02
tpcds_q99/duckdb:vortex-compact 33458058 30708477 1.09
duckdb / parquet (1.002x ➖, 0↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28494562 26693982 1.07
tpcds_q02/duckdb:parquet 24145120 23853423 1.01
tpcds_q03/duckdb:parquet 10893916 11394016 0.96
tpcds_q04/duckdb:parquet 166181045 165271163 1.01
tpcds_q05/duckdb:parquet 🚨 30410304 26876048 1.13
tpcds_q06/duckdb:parquet 27136739 28042248 0.97
tpcds_q07/duckdb:parquet 20492507 21556322 0.95
tpcds_q08/duckdb:parquet 26339324 26620162 0.99
tpcds_q09/duckdb:parquet 39316011 39393470 1.00
tpcds_q10/duckdb:parquet 32855526 33636359 0.98
tpcds_q11/duckdb:parquet 83638490 85386501 0.98
tpcds_q12/duckdb:parquet 14214007 14802309 0.96
tpcds_q13/duckdb:parquet 33749872 33436325 1.01
tpcds_q14/duckdb:parquet 99857184 100350855 1.00
tpcds_q15/duckdb:parquet 29684790 29451824 1.01
tpcds_q16/duckdb:parquet 20149446 20255183 0.99
tpcds_q17/duckdb:parquet 35844584 37069230 0.97
tpcds_q18/duckdb:parquet 44049048 45310375 0.97
tpcds_q19/duckdb:parquet 27707972 29436884 0.94
tpcds_q20/duckdb:parquet 14913194 15002953 0.99
tpcds_q21/duckdb:parquet 10632733 11221841 0.95
tpcds_q22/duckdb:parquet 69370873 68408624 1.01
tpcds_q23/duckdb:parquet 79321494 81213484 0.98
tpcds_q24/duckdb:parquet 43469346 43874750 0.99
tpcds_q25/duckdb:parquet 33068698 32732223 1.01
tpcds_q26/duckdb:parquet 36273620 34223988 1.06
tpcds_q27/duckdb:parquet 46015243 45619581 1.01
tpcds_q28/duckdb:parquet 37689814 37349953 1.01
tpcds_q29/duckdb:parquet 33564026 35222938 0.95
tpcds_q30/duckdb:parquet 33837929 34450087 0.98
tpcds_q31/duckdb:parquet 22732598 23952668 0.95
tpcds_q32/duckdb:parquet 11058897 10957808 1.01
tpcds_q33/duckdb:parquet 20722376 21501659 0.96
tpcds_q34/duckdb:parquet 19603498 19990270 0.98
tpcds_q35/duckdb:parquet 58203825 57352296 1.01
tpcds_q36/duckdb:parquet 19319544 19525301 0.99
tpcds_q37/duckdb:parquet 13262632 12639247 1.05
tpcds_q38/duckdb:parquet 35130365 32747668 1.07
tpcds_q39/duckdb:parquet 29850890 28267983 1.06
tpcds_q40/duckdb:parquet 17412537 16853737 1.03
tpcds_q41/duckdb:parquet 7538979 7695202 0.98
tpcds_q42/duckdb:parquet 9610414 9679883 0.99
tpcds_q43/duckdb:parquet 15140909 15208628 1.00
tpcds_q44/duckdb:parquet 22091868 22205417 0.99
tpcds_q45/duckdb:parquet 26415339 26773757 0.99
tpcds_q46/duckdb:parquet 43882702 43236722 1.01
tpcds_q47/duckdb:parquet 44002450 44133816 1.00
tpcds_q48/duckdb:parquet 29115355 28990738 1.00
tpcds_q49/duckdb:parquet 24612169 24369258 1.01
tpcds_q50/duckdb:parquet 24852992 24316332 1.02
tpcds_q51/duckdb:parquet 93217142 101757500 0.92
tpcds_q52/duckdb:parquet 10100074 9925239 1.02
tpcds_q53/duckdb:parquet 14653908 14550004 1.01
tpcds_q54/duckdb:parquet 24831432 24262994 1.02
tpcds_q55/duckdb:parquet 9690985 9668196 1.00
tpcds_q56/duckdb:parquet 20637053 20163452 1.02
tpcds_q57/duckdb:parquet 33763737 33988503 0.99
tpcds_q58/duckdb:parquet 21581692 22010419 0.98
tpcds_q59/duckdb:parquet 35370029 35057604 1.01
tpcds_q60/duckdb:parquet 21070628 20954389 1.01
tpcds_q61/duckdb:parquet 30552128 30635852 1.00
tpcds_q62/duckdb:parquet 11519112 11800069 0.98
tpcds_q63/duckdb:parquet 13657698 13706774 1.00
tpcds_q64/duckdb:parquet 73109404 72391535 1.01
tpcds_q65/duckdb:parquet 20616239 20049762 1.03
tpcds_q66/duckdb:parquet 27352857 28231112 0.97
tpcds_q67/duckdb:parquet 133726264 133941726 1.00
tpcds_q68/duckdb:parquet 36284458 36592564 0.99
tpcds_q69/duckdb:parquet 36270345 35096077 1.03
tpcds_q70/duckdb:parquet 19279078 19045503 1.01
tpcds_q71/duckdb:parquet 19255694 18282343 1.05
tpcds_q72/duckdb:parquet 164042668 164096621 1.00
tpcds_q73/duckdb:parquet 18404169 17363409 1.06
tpcds_q74/duckdb:parquet 124566097 127319258 0.98
tpcds_q75/duckdb:parquet 51869864 52322097 0.99
tpcds_q76/duckdb:parquet 18534214 19600707 0.95
tpcds_q77/duckdb:parquet 21413849 21636353 0.99
tpcds_q78/duckdb:parquet 74640257 74139928 1.01
tpcds_q79/duckdb:parquet 26301581 26368606 1.00
tpcds_q80/duckdb:parquet 41304673 39287929 1.05
tpcds_q81/duckdb:parquet 30052143 30881434 0.97
tpcds_q82/duckdb:parquet 13732040 12993589 1.06
tpcds_q83/duckdb:parquet 15861592 16274843 0.97
tpcds_q84/duckdb:parquet 18962933 18743780 1.01
tpcds_q85/duckdb:parquet 38285920 37147565 1.03
tpcds_q86/duckdb:parquet 12885146 12486344 1.03
tpcds_q87/duckdb:parquet 35513066 36382355 0.98
tpcds_q88/duckdb:parquet 48250153 48654914 0.99
tpcds_q89/duckdb:parquet 15886696 16120261 0.99
tpcds_q90/duckdb:parquet 7387839 7183771 1.03
tpcds_q91/duckdb:parquet 22709747 22872210 0.99
tpcds_q92/duckdb:parquet 11679986 10866539 1.07
tpcds_q93/duckdb:parquet 29008371 29229771 0.99
tpcds_q94/duckdb:parquet 16779092 15495695 1.08
tpcds_q95/duckdb:parquet 140377595 145022268 0.97
tpcds_q96/duckdb:parquet 9156783 8885714 1.03
tpcds_q97/duckdb:parquet 34691328 36046432 0.96
tpcds_q98/duckdb:parquet 17993359 17266112 1.04
tpcds_q99/duckdb:parquet 19380290 19566343 0.99
duckdb / duckdb (0.996x ➖, 0↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19935716 20171891 0.99
tpcds_q02/duckdb:duckdb 18747591 18573798 1.01
tpcds_q03/duckdb:duckdb 8537499 8264805 1.03
tpcds_q04/duckdb:duckdb 181039480 169402642 1.07
tpcds_q05/duckdb:duckdb 18838064 20400018 0.92
tpcds_q06/duckdb:duckdb 22482434 22900073 0.98
tpcds_q07/duckdb:duckdb 37078529 38156560 0.97
tpcds_q08/duckdb:duckdb 119771730 119889157 1.00
tpcds_q09/duckdb:duckdb 19718142 19934464 0.99
tpcds_q10/duckdb:duckdb 23043382 23179051 0.99
tpcds_q11/duckdb:duckdb 92100835 89456806 1.03
tpcds_q12/duckdb:duckdb 11404232 11596029 0.98
tpcds_q13/duckdb:duckdb 23959392 23756366 1.01
tpcds_q14/duckdb:duckdb 91737467 90927853 1.01
tpcds_q15/duckdb:duckdb 24809453 24650015 1.01
tpcds_q16/duckdb:duckdb 17229831 17052816 1.01
tpcds_q17/duckdb:duckdb 22047302 21683614 1.02
tpcds_q18/duckdb:duckdb 43703147 44648411 0.98
tpcds_q19/duckdb:duckdb 16431721 16408199 1.00
tpcds_q20/duckdb:duckdb 11472263 12107689 0.95
tpcds_q21/duckdb:duckdb 7092192 6453824 1.10
tpcds_q22/duckdb:duckdb 59895930 59307443 1.01
tpcds_q23/duckdb:duckdb 76367069 77046350 0.99
tpcds_q24/duckdb:duckdb 24457316 24621199 0.99
tpcds_q25/duckdb:duckdb 16745104 17135488 0.98
tpcds_q26/duckdb:duckdb 23278936 25662651 0.91
tpcds_q27/duckdb:duckdb 38744683 38768818 1.00
tpcds_q28/duckdb:duckdb 21814827 21548871 1.01
tpcds_q29/duckdb:duckdb 20515369 20672404 0.99
tpcds_q30/duckdb:duckdb 29888045 30317373 0.99
tpcds_q31/duckdb:duckdb 47174384 47087260 1.00
tpcds_q32/duckdb:duckdb 🚨 7739384 6997240 1.11
tpcds_q33/duckdb:duckdb 12916022 12570009 1.03
tpcds_q34/duckdb:duckdb 14771465 14811221 1.00
tpcds_q35/duckdb:duckdb 33312105 30918538 1.08
tpcds_q36/duckdb:duckdb 70221250 68387946 1.03
tpcds_q37/duckdb:duckdb 7467917 7391033 1.01
tpcds_q38/duckdb:duckdb 28701696 30105765 0.95
tpcds_q39/duckdb:duckdb 24930152 25052786 1.00
tpcds_q40/duckdb:duckdb 14207265 14388818 0.99
tpcds_q41/duckdb:duckdb 8023595 8303923 0.97
tpcds_q42/duckdb:duckdb 6344895 6696994 0.95
tpcds_q43/duckdb:duckdb 11115544 11149203 1.00
tpcds_q44/duckdb:duckdb 13164756 13529483 0.97
tpcds_q45/duckdb:duckdb 16568465 17664377 0.94
tpcds_q46/duckdb:duckdb 36868952 36426563 1.01
tpcds_q47/duckdb:duckdb 38460080 41146955 0.93
tpcds_q48/duckdb:duckdb 23083216 23471602 0.98
tpcds_q49/duckdb:duckdb 17401728 15845009 1.10
tpcds_q50/duckdb:duckdb 14221501 14274601 1.00
tpcds_q51/duckdb:duckdb 91068095 89416276 1.02
tpcds_q52/duckdb:duckdb 7370041 7264685 1.01
tpcds_q53/duckdb:duckdb 13076557 13195902 0.99
tpcds_q54/duckdb:duckdb 16164230 17170222 0.94
tpcds_q55/duckdb:duckdb 6832443 6892814 0.99
tpcds_q56/duckdb:duckdb 13284339 13734937 0.97
tpcds_q57/duckdb:duckdb 32614659 32429096 1.01
tpcds_q58/duckdb:duckdb 12033023 12511467 0.96
tpcds_q59/duckdb:duckdb 35467639 35010266 1.01
tpcds_q60/duckdb:duckdb 14618691 15503586 0.94
tpcds_q61/duckdb:duckdb 14449006 14060199 1.03
tpcds_q62/duckdb:duckdb 9315989 9302457 1.00
tpcds_q63/duckdb:duckdb 12488342 12176946 1.03
tpcds_q64/duckdb:duckdb 55080325 53837155 1.02
tpcds_q65/duckdb:duckdb 34083591 34341125 0.99
tpcds_q66/duckdb:duckdb 24831098 25922294 0.96
tpcds_q67/duckdb:duckdb 129474980 128955253 1.00
tpcds_q68/duckdb:duckdb 25111045 25426808 0.99
tpcds_q69/duckdb:duckdb 25105049 25308098 0.99
tpcds_q70/duckdb:duckdb 14011936 14920424 0.94
tpcds_q71/duckdb:duckdb 13311978 12434156 1.07
tpcds_q72/duckdb:duckdb 43140862 43109311 1.00
tpcds_q73/duckdb:duckdb 11582087 10998944 1.05
tpcds_q74/duckdb:duckdb 142200438 142829720 1.00
tpcds_q75/duckdb:duckdb 42750855 41886524 1.02
tpcds_q76/duckdb:duckdb 12022081 11669821 1.03
tpcds_q77/duckdb:duckdb 11814433 11954862 0.99
tpcds_q78/duckdb:duckdb 62819265 62822276 1.00
tpcds_q79/duckdb:duckdb 18888243 18884590 1.00
tpcds_q80/duckdb:duckdb 26095769 27205471 0.96
tpcds_q81/duckdb:duckdb 37326003 37285716 1.00
tpcds_q82/duckdb:duckdb 8509116 8744213 0.97
tpcds_q83/duckdb:duckdb 8869467 9362148 0.95
tpcds_q84/duckdb:duckdb 13495601 13495458 1.00
tpcds_q85/duckdb:duckdb 25009628 23675699 1.06
tpcds_q86/duckdb:duckdb 10307681 10765878 0.96
tpcds_q87/duckdb:duckdb 33965940 32662134 1.04
tpcds_q88/duckdb:duckdb 25793012 25865667 1.00
tpcds_q89/duckdb:duckdb 14639124 14566037 1.01
tpcds_q90/duckdb:duckdb 5538592 5549403 1.00
tpcds_q91/duckdb:duckdb 12943562 12861338 1.01
tpcds_q92/duckdb:duckdb 8915927 9064269 0.98
tpcds_q93/duckdb:duckdb 22384542 22471828 1.00
tpcds_q94/duckdb:duckdb 13609786 13525437 1.01
tpcds_q95/duckdb:duckdb 120709769 131043663 0.92
tpcds_q96/duckdb:duckdb 4359206 4488402 0.97
tpcds_q97/duckdb:duckdb 27913320 30799620 0.91
tpcds_q98/duckdb:duckdb 13464817 13868968 0.97
tpcds_q99/duckdb:duckdb 16650751 16233409 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +3.6% +1.7% +1.9% +24.5% ➖ noise
1 datafusion:vortex-file-compressed +0.3% +1.7% -1.4% +22.4% ➖ noise
1 duckdb:duckdb -1.2% +1.7% -2.8% +23.5% ➖ noise
1 duckdb:vortex-compact +3.2% +1.7% +1.5% +30.1% ➖ noise
1 duckdb:vortex-file-compressed -1.7% +1.7% -3.3% +35.1% ➖ noise
2 datafusion:vortex-compact -1.5% -1.9% +0.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.0% -1.9% +0.9% +10.0% ➖ noise
2 duckdb:duckdb +0.9% -1.9% +2.9% +10.0% ➖ noise
2 duckdb:vortex-compact -7.7% -1.9% -5.9% +22.5% ➖ noise
2 duckdb:vortex-file-compressed -2.1% -1.9% -0.3% +10.0% ➖ noise
3 datafusion:vortex-compact +1.4% -4.9% +6.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.9% -4.9% +4.2% +10.0% ➖ noise
3 duckdb:duckdb +3.3% -4.9% +8.6% +15.1% ➖ noise
3 duckdb:vortex-compact +2.0% -4.9% +7.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +6.1% -4.9% +11.6% +10.3% 🚨 regression
4 datafusion:vortex-compact +2.2% -0.5% +2.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.6% -0.5% -0.1% +10.0% ➖ noise
4 duckdb:duckdb +6.9% -0.5% +7.4% +10.0% ➖ noise
4 duckdb:vortex-compact -0.3% -0.5% +0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.0% -0.5% +2.5% +10.0% ➖ noise
5 datafusion:vortex-compact -0.0% +4.9% -4.7% +17.2% ➖ noise
5 datafusion:vortex-file-compressed -3.5% +4.9% -8.1% +10.4% ➖ noise
5 duckdb:duckdb -7.7% +4.9% -12.0% +16.5% ➖ noise
5 duckdb:vortex-compact +1.4% +4.9% -3.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.2% +4.9% -5.8% +10.6% ➖ noise
6 datafusion:vortex-compact +4.1% -2.0% +6.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.3% -2.0% +0.6% +10.5% ➖ noise
6 duckdb:duckdb -1.8% -2.0% +0.2% +13.1% ➖ noise
6 duckdb:vortex-compact +3.6% -2.0% +5.7% +13.2% ➖ noise
6 duckdb:vortex-file-compressed +0.0% -2.0% +2.0% +10.0% ➖ noise
7 datafusion:vortex-compact -3.0% -2.2% -0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% -2.2% +1.6% +10.0% ➖ noise
7 duckdb:duckdb -2.8% -2.2% -0.6% +17.4% ➖ noise
7 duckdb:vortex-compact -3.4% -2.2% -1.2% +10.2% ➖ noise
7 duckdb:vortex-file-compressed -4.4% -2.2% -2.2% +28.5% ➖ noise
8 datafusion:vortex-compact +2.4% -0.0% +2.4% +10.3% ➖ noise
8 datafusion:vortex-file-compressed +4.7% -0.0% +4.7% +10.0% ➖ noise
8 duckdb:duckdb -0.1% -0.0% -0.1% +10.0% ➖ noise
8 duckdb:vortex-compact -3.3% -0.0% -3.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.1% -0.0% +2.1% +10.0% ➖ noise
9 datafusion:vortex-compact -2.0% +2.0% -3.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.4% +2.0% -3.3% +10.0% ➖ noise
9 duckdb:duckdb -1.1% +2.0% -3.0% +10.0% ➖ noise
9 duckdb:vortex-compact +2.9% +2.0% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.9% +2.0% -1.0% +10.0% ➖ noise
10 datafusion:vortex-compact +1.8% +0.7% +1.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.3% +0.7% -5.0% +10.0% ➖ noise
10 duckdb:duckdb -0.6% +0.7% -1.3% +12.7% ➖ noise
10 duckdb:vortex-compact -1.4% +0.7% -2.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.3% +0.7% -4.1% +10.0% ➖ noise
11 datafusion:vortex-compact +0.7% +2.0% -1.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.5% +2.0% -1.4% +10.0% ➖ noise
11 duckdb:duckdb +3.0% +2.0% +1.0% +10.0% ➖ noise
11 duckdb:vortex-compact +5.0% +2.0% +2.9% +13.6% ➖ noise
11 duckdb:vortex-file-compressed +1.7% +2.0% -0.3% +10.1% ➖ noise
12 datafusion:vortex-compact -1.8% +0.8% -2.6% +11.8% ➖ noise
12 datafusion:vortex-file-compressed +1.1% +0.8% +0.4% +10.0% ➖ noise
12 duckdb:duckdb -1.7% +0.8% -2.4% +13.9% ➖ noise
12 duckdb:vortex-compact -5.5% +0.8% -6.2% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -0.7% +0.8% -1.4% +13.9% ➖ noise
13 datafusion:vortex-compact -1.9% -0.0% -1.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.8% -0.0% -0.8% +10.0% ➖ noise
13 duckdb:duckdb +0.9% -0.0% +0.9% +10.0% ➖ noise
13 duckdb:vortex-compact -1.9% -0.0% -1.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.6% -0.0% +0.7% +10.0% ➖ noise
14 datafusion:vortex-compact -0.8% -0.6% -0.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.8% -0.6% -1.2% +10.0% ➖ noise
14 duckdb:duckdb +0.9% -0.6% +1.5% +10.0% ➖ noise
14 duckdb:vortex-compact +5.3% -0.6% +5.9% +10.2% ➖ noise
14 duckdb:vortex-file-compressed +2.3% -0.6% +3.0% +13.0% ➖ noise
15 datafusion:vortex-compact -10.4% +0.4% -10.7% +10.0% ✅ faster
15 datafusion:vortex-file-compressed -0.8% +0.4% -1.2% +11.2% ➖ noise
15 duckdb:duckdb +0.6% +0.4% +0.3% +10.0% ➖ noise
15 duckdb:vortex-compact -2.4% +0.4% -2.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.3% +0.4% -0.1% +10.0% ➖ noise
16 datafusion:vortex-compact +0.5% +2.0% -1.5% +16.2% ➖ noise
16 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +11.2% ➖ noise
16 duckdb:duckdb +1.0% +2.0% -1.0% +13.2% ➖ noise
16 duckdb:vortex-compact -2.9% +2.0% -4.9% +12.4% ➖ noise
16 duckdb:vortex-file-compressed +3.6% +2.0% +1.5% +11.3% ➖ noise
17 datafusion:vortex-compact -2.6% -3.2% +0.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.2% -3.2% +3.5% +10.0% ➖ noise
17 duckdb:duckdb +1.7% -3.2% +5.0% +10.0% ➖ noise
17 duckdb:vortex-compact +3.8% -3.2% +7.2% +14.3% ➖ noise
17 duckdb:vortex-file-compressed +3.2% -3.2% +6.6% +10.0% ➖ noise
18 datafusion:vortex-compact -1.4% -1.9% +0.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.1% -1.9% +1.9% +10.0% ➖ noise
18 duckdb:duckdb -2.1% -1.9% -0.2% +10.4% ➖ noise
18 duckdb:vortex-compact +0.8% -1.9% +2.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -1.9% +0.7% +12.7% ➖ noise
19 datafusion:vortex-compact +1.6% -3.4% +5.3% +14.5% ➖ noise
19 datafusion:vortex-file-compressed -1.8% -3.4% +1.7% +14.3% ➖ noise
19 duckdb:duckdb +0.1% -3.4% +3.7% +11.2% ➖ noise
19 duckdb:vortex-compact +7.0% -3.4% +10.8% +11.6% ➖ noise
19 duckdb:vortex-file-compressed -1.1% -3.4% +2.4% +11.9% ➖ noise
20 datafusion:vortex-compact +0.9% -0.3% +1.3% +11.2% ➖ noise
20 datafusion:vortex-file-compressed +0.6% -0.3% +0.9% +10.0% ➖ noise
20 duckdb:duckdb -5.2% -0.3% -4.9% +10.4% ➖ noise
20 duckdb:vortex-compact +1.0% -0.3% +1.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.5% -0.3% +1.8% +10.0% ➖ noise
21 datafusion:vortex-compact -0.5% -4.7% +4.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -3.7% -4.7% +1.1% +10.8% ➖ noise
21 duckdb:duckdb +9.9% -4.7% +15.4% +50.8% ➖ noise
21 duckdb:vortex-compact -6.3% -4.7% -1.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +2.1% -4.7% +7.2% +12.3% ➖ noise
22 datafusion:vortex-compact +4.5% +0.2% +4.3% +16.4% ➖ noise
22 datafusion:vortex-file-compressed -5.9% +0.2% -6.1% +14.1% ➖ noise
22 duckdb:duckdb +1.0% +0.2% +0.8% +13.3% ➖ noise
22 duckdb:vortex-compact -1.3% +0.2% -1.5% +14.8% ➖ noise
22 duckdb:vortex-file-compressed +0.2% +0.2% -0.0% +13.7% ➖ noise
23 datafusion:vortex-compact -1.6% -1.2% -0.3% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +1.2% -1.2% +2.5% +10.0% ➖ noise
23 duckdb:duckdb -0.9% -1.2% +0.4% +14.2% ➖ noise
23 duckdb:vortex-compact +18.3% -1.2% +19.8% +18.4% 🚨 regression
23 duckdb:vortex-file-compressed -1.0% -1.2% +0.3% +13.6% ➖ noise
24 datafusion:vortex-compact -0.7% -1.5% +0.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -1.9% -1.5% -0.4% +10.0% ➖ noise
24 duckdb:duckdb -0.7% -1.5% +0.8% +10.2% ➖ noise
24 duckdb:vortex-compact +0.9% -1.5% +2.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.5% -1.5% +1.0% +13.4% ➖ noise
25 datafusion:vortex-compact +2.2% +0.5% +1.6% +15.1% ➖ noise
25 datafusion:vortex-file-compressed +0.9% +0.5% +0.3% +10.0% ➖ noise
25 duckdb:duckdb -2.3% +0.5% -2.8% +10.0% ➖ noise
25 duckdb:vortex-compact -1.1% +0.5% -1.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.4% +0.5% +0.9% +10.0% ➖ noise
26 datafusion:vortex-compact +1.1% +3.0% -1.8% +11.7% ➖ noise
26 datafusion:vortex-file-compressed +1.6% +3.0% -1.4% +10.0% ➖ noise
26 duckdb:duckdb -9.3% +3.0% -11.9% +12.8% ✅ faster
26 duckdb:vortex-compact -3.2% +3.0% -6.1% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +0.9% +3.0% -2.0% +14.5% ➖ noise
27 datafusion:vortex-compact -0.7% +0.9% -1.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -0.6% +0.9% -1.4% +11.6% ➖ noise
27 duckdb:duckdb -0.1% +0.9% -0.9% +20.8% ➖ noise
27 duckdb:vortex-compact +3.3% +0.9% +2.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +4.1% +0.9% +3.3% +16.7% ➖ noise
28 datafusion:vortex-compact +0.1% +1.9% -1.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -4.9% +1.9% -6.7% +10.0% ➖ noise
28 duckdb:duckdb +1.2% +1.9% -0.7% +10.0% ➖ noise
28 duckdb:vortex-compact +2.4% +1.9% +0.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -2.2% +1.9% -4.0% +10.0% ➖ noise
29 datafusion:vortex-compact -0.9% -3.1% +2.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.1% -3.1% +2.1% +10.0% ➖ noise
29 duckdb:duckdb -0.8% -3.1% +2.4% +10.0% ➖ noise
29 duckdb:vortex-compact -1.5% -3.1% +1.7% +17.3% ➖ noise
29 duckdb:vortex-file-compressed -2.4% -3.1% +0.7% +10.0% ➖ noise
30 datafusion:vortex-compact -2.8% -2.1% -0.7% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -2.4% -2.1% -0.4% +10.0% ➖ noise
30 duckdb:duckdb -1.4% -2.1% +0.7% +10.0% ➖ noise
30 duckdb:vortex-compact +1.6% -2.1% +3.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -4.0% -2.1% -2.0% +10.0% ➖ noise
31 datafusion:vortex-compact -2.1% -0.8% -1.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.7% -0.8% +0.1% +10.0% ➖ noise
31 duckdb:duckdb +0.2% -0.8% +1.0% +10.0% ➖ noise
31 duckdb:vortex-compact +1.7% -0.8% +2.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.2% -0.8% +3.1% +18.3% ➖ noise
32 datafusion:vortex-compact +1.8% -0.9% +2.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.5% -0.9% -0.6% +18.9% ➖ noise
32 duckdb:duckdb +10.6% -0.9% +11.6% +14.3% ➖ noise
32 duckdb:vortex-compact +0.5% -0.9% +1.4% +12.7% ➖ noise
32 duckdb:vortex-file-compressed -0.7% -0.9% +0.2% +10.0% ➖ noise
33 datafusion:vortex-compact -7.9% -1.4% -6.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.4% -1.4% +2.8% +13.3% ➖ noise
33 duckdb:duckdb +2.8% -1.4% +4.2% +10.0% ➖ noise
33 duckdb:vortex-compact -2.4% -1.4% -1.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +2.5% -1.4% +3.9% +10.0% ➖ noise
34 datafusion:vortex-compact -2.9% -0.7% -2.2% +10.6% ➖ noise
34 datafusion:vortex-file-compressed +2.5% -0.7% +3.3% +10.0% ➖ noise
34 duckdb:duckdb -0.3% -0.7% +0.4% +10.0% ➖ noise
34 duckdb:vortex-compact +0.7% -0.7% +1.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.6% -0.7% +0.1% +10.0% ➖ noise
35 datafusion:vortex-compact -0.5% +1.3% -1.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.1% +1.3% -1.3% +10.0% ➖ noise
35 duckdb:duckdb +7.7% +1.3% +6.4% +13.8% ➖ noise
35 duckdb:vortex-compact +1.1% +1.3% -0.2% +11.0% ➖ noise
35 duckdb:vortex-file-compressed +6.0% +1.3% +4.7% +11.2% ➖ noise
36 datafusion:vortex-compact -2.6% -0.3% -2.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.7% -0.3% -2.5% +10.0% ➖ noise
36 duckdb:duckdb +2.7% -0.3% +3.0% +10.0% ➖ noise
36 duckdb:vortex-compact -0.7% -0.3% -0.4% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -5.1% -0.3% -4.9% +11.5% ➖ noise
37 datafusion:vortex-compact -0.5% +1.9% -2.4% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.9% +1.9% -2.7% +14.0% ➖ noise
37 duckdb:duckdb +1.0% +1.9% -0.8% +12.1% ➖ noise
37 duckdb:vortex-compact -2.5% +1.9% -4.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +0.4% +1.9% -1.5% +11.5% ➖ noise
38 datafusion:vortex-compact -2.0% +4.3% -6.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -1.5% +4.3% -5.6% +10.0% ➖ noise
38 duckdb:duckdb -4.7% +4.3% -8.6% +10.5% ➖ noise
38 duckdb:vortex-compact -3.4% +4.3% -7.4% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +1.8% +4.3% -2.4% +13.7% ➖ noise
39 datafusion:vortex-compact +9.4% +1.2% +8.1% +13.1% ➖ noise
39 datafusion:vortex-file-compressed +3.4% +1.2% +2.1% +16.7% ➖ noise
39 duckdb:duckdb -0.5% +1.2% -1.7% +18.0% ➖ noise
39 duckdb:vortex-compact +1.5% +1.2% +0.2% +10.1% ➖ noise
39 duckdb:vortex-file-compressed +18.1% +1.2% +16.6% +14.0% 🚨 regression
40 datafusion:vortex-compact -0.7% +2.7% -3.4% +12.9% ➖ noise
40 datafusion:vortex-file-compressed +0.1% +2.7% -2.6% +10.0% ➖ noise
40 duckdb:duckdb -1.3% +2.7% -3.9% +13.0% ➖ noise
40 duckdb:vortex-compact -8.8% +2.7% -11.2% +10.0% ✅ faster
40 duckdb:vortex-file-compressed -1.8% +2.7% -4.4% +11.7% ➖ noise
41 datafusion:vortex-compact +3.1% -2.0% +5.3% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -4.5% -2.0% -2.5% +10.0% ➖ noise
41 duckdb:duckdb -3.4% -2.0% -1.4% +10.0% ➖ noise
41 duckdb:vortex-compact -6.0% -2.0% -4.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.6% -2.0% +2.7% +10.0% ➖ noise
42 datafusion:vortex-compact +0.4% -2.5% +3.0% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -0.4% -2.5% +2.2% +11.2% ➖ noise
42 duckdb:duckdb -5.3% -2.5% -2.8% +15.3% ➖ noise
42 duckdb:vortex-compact +5.0% -2.5% +7.7% +10.1% ➖ noise
42 duckdb:vortex-file-compressed +3.3% -2.5% +5.9% +15.5% ➖ noise
43 datafusion:vortex-compact -0.8% -2.9% +2.2% +12.8% ➖ noise
43 datafusion:vortex-file-compressed -4.8% -2.9% -2.0% +10.0% ➖ noise
43 duckdb:duckdb -0.3% -2.9% +2.6% +10.0% ➖ noise
43 duckdb:vortex-compact +5.1% -2.9% +8.2% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -3.1% -2.9% -0.2% +10.8% ➖ noise
44 datafusion:vortex-compact -1.4% -5.9% +4.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.6% -5.9% +8.0% +11.7% ➖ noise
44 duckdb:duckdb -2.7% -5.9% +3.4% +15.3% ➖ noise
44 duckdb:vortex-compact +3.3% -5.9% +9.8% +13.2% ➖ noise
44 duckdb:vortex-file-compressed +1.4% -5.9% +7.8% +10.0% ➖ noise
45 datafusion:vortex-compact -2.8% -1.7% -1.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.6% -1.7% +1.2% +10.0% ➖ noise
45 duckdb:duckdb -6.2% -1.7% -4.5% +10.8% ➖ noise
45 duckdb:vortex-compact +3.6% -1.7% +5.4% +10.4% ➖ noise
45 duckdb:vortex-file-compressed -0.5% -1.7% +1.3% +13.2% ➖ noise
46 datafusion:vortex-compact -0.6% +1.0% -1.5% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +14.3% ➖ noise
46 duckdb:duckdb +1.2% +1.0% +0.3% +10.0% ➖ noise
46 duckdb:vortex-compact +4.4% +1.0% +3.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +2.2% +1.0% +1.2% +10.0% ➖ noise
47 datafusion:vortex-compact -2.8% +0.5% -3.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -1.4% +0.5% -1.9% +10.0% ➖ noise
47 duckdb:duckdb -6.5% +0.5% -7.0% +11.1% ➖ noise
47 duckdb:vortex-compact -2.9% +0.5% -3.3% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -2.2% +0.5% -2.6% +10.0% ➖ noise
48 datafusion:vortex-compact +0.9% +0.7% +0.2% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -0.1% +0.7% -0.7% +10.0% ➖ noise
48 duckdb:duckdb -1.7% +0.7% -2.3% +10.0% ➖ noise
48 duckdb:vortex-compact -1.9% +0.7% -2.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -3.4% +0.7% -4.0% +10.0% ➖ noise
49 datafusion:vortex-compact -2.2% +0.6% -2.8% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +1.2% +0.6% +0.6% +10.0% ➖ noise
49 duckdb:duckdb +9.8% +0.6% +9.2% +15.0% ➖ noise
49 duckdb:vortex-compact +1.6% +0.6% +1.0% +12.2% ➖ noise
49 duckdb:vortex-file-compressed -0.1% +0.6% -0.7% +21.7% ➖ noise
50 datafusion:vortex-compact +2.5% +1.4% +1.1% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -2.0% +1.4% -3.3% +10.0% ➖ noise
50 duckdb:duckdb -0.4% +1.4% -1.8% +10.0% ➖ noise
50 duckdb:vortex-compact -1.1% +1.4% -2.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -1.6% +1.4% -2.9% +10.0% ➖ noise
51 datafusion:vortex-compact -0.9% -5.0% +4.3% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +1.7% -5.0% +7.1% +11.5% ➖ noise
51 duckdb:duckdb +1.8% -5.0% +7.3% +17.1% ➖ noise
51 duckdb:vortex-compact +1.8% -5.0% +7.2% +10.9% ➖ noise
51 duckdb:vortex-file-compressed +1.2% -5.0% +6.6% +24.9% ➖ noise
52 datafusion:vortex-compact -0.4% -0.7% +0.2% +19.8% ➖ noise
52 datafusion:vortex-file-compressed +5.9% -0.7% +6.6% +11.1% ➖ noise
52 duckdb:duckdb +1.5% -0.7% +2.1% +18.5% ➖ noise
52 duckdb:vortex-compact -1.0% -0.7% -0.4% +12.6% ➖ noise
52 duckdb:vortex-file-compressed +4.8% -0.7% +5.5% +24.1% ➖ noise
53 datafusion:vortex-compact -1.7% +0.8% -2.4% +14.6% ➖ noise
53 datafusion:vortex-file-compressed +1.1% +0.8% +0.3% +10.0% ➖ noise
53 duckdb:duckdb -0.9% +0.8% -1.7% +10.0% ➖ noise
53 duckdb:vortex-compact -0.8% +0.8% -1.5% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -3.4% +0.8% -4.1% +10.0% ➖ noise
54 datafusion:vortex-compact +1.7% +0.7% +0.9% +11.7% ➖ noise
54 datafusion:vortex-file-compressed -4.1% +0.7% -4.8% +10.0% ➖ noise
54 duckdb:duckdb -5.9% +0.7% -6.6% +10.0% ➖ noise
54 duckdb:vortex-compact +1.7% +0.7% +1.0% +12.7% ➖ noise
54 duckdb:vortex-file-compressed +2.2% +0.7% +1.5% +10.0% ➖ noise
55 datafusion:vortex-compact -1.9% -1.8% -0.1% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -2.1% -1.8% -0.4% +11.4% ➖ noise
55 duckdb:duckdb -0.9% -1.8% +0.9% +16.0% ➖ noise
55 duckdb:vortex-compact +3.0% -1.8% +4.9% +13.6% ➖ noise
55 duckdb:vortex-file-compressed +0.4% -1.8% +2.2% +11.1% ➖ noise
56 datafusion:vortex-compact -1.5% +1.2% -2.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.2% +1.2% -1.4% +10.0% ➖ noise
56 duckdb:duckdb -3.3% +1.2% -4.5% +10.0% ➖ noise
56 duckdb:vortex-compact +2.0% +1.2% +0.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +5.1% +1.2% +3.8% +15.6% ➖ noise
57 datafusion:vortex-compact -2.1% -1.3% -0.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +0.7% -1.3% +2.0% +10.0% ➖ noise
57 duckdb:duckdb +0.6% -1.3% +1.9% +15.4% ➖ noise
57 duckdb:vortex-compact -1.1% -1.3% +0.2% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -0.7% -1.3% +0.6% +15.3% ➖ noise
58 datafusion:vortex-compact -2.6% +1.2% -3.7% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -1.7% +1.2% -2.9% +10.0% ➖ noise
58 duckdb:duckdb -3.8% +1.2% -5.0% +14.5% ➖ noise
58 duckdb:vortex-compact -0.3% +1.2% -1.5% +17.7% ➖ noise
58 duckdb:vortex-file-compressed +1.0% +1.2% -0.2% +10.0% ➖ noise
59 datafusion:vortex-compact -5.2% -1.2% -4.0% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +2.2% -1.2% +3.5% +10.6% ➖ noise
59 duckdb:duckdb +1.3% -1.2% +2.6% +10.0% ➖ noise
59 duckdb:vortex-compact -13.2% -1.2% -12.1% +15.1% ➖ noise
59 duckdb:vortex-file-compressed +0.9% -1.2% +2.2% +10.0% ➖ noise
60 datafusion:vortex-compact +0.6% -2.2% +2.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -1.1% -2.2% +1.1% +10.0% ➖ noise
60 duckdb:duckdb -5.7% -2.2% -3.6% +12.4% ➖ noise
60 duckdb:vortex-compact -0.6% -2.2% +1.6% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +5.3% -2.2% +7.6% +10.0% ➖ noise
61 datafusion:vortex-compact -1.8% +0.5% -2.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -7.7% +0.5% -8.1% +10.1% ➖ noise
61 duckdb:duckdb +2.8% +0.5% +2.2% +10.0% ➖ noise
61 duckdb:vortex-compact +0.1% +0.5% -0.4% +12.8% ➖ noise
61 duckdb:vortex-file-compressed +9.9% +0.5% +9.4% +20.2% ➖ noise
62 datafusion:vortex-compact -0.1% -0.0% -0.1% +14.3% ➖ noise
62 datafusion:vortex-file-compressed -0.5% -0.0% -0.5% +15.0% ➖ noise
62 duckdb:duckdb +0.1% -0.0% +0.2% +15.3% ➖ noise
62 duckdb:vortex-compact +4.6% -0.0% +4.6% +16.2% ➖ noise
62 duckdb:vortex-file-compressed -0.8% -0.0% -0.8% +14.5% ➖ noise
63 datafusion:vortex-compact +0.9% -0.5% +1.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +3.2% -0.5% +3.7% +10.0% ➖ noise
63 duckdb:duckdb +2.6% -0.5% +3.1% +10.0% ➖ noise
63 duckdb:vortex-compact -1.0% -0.5% -0.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +1.8% -0.5% +2.3% +10.0% ➖ noise
64 datafusion:vortex-compact -0.6% +0.2% -0.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.3% +0.2% -0.5% +10.0% ➖ noise
64 duckdb:duckdb +2.3% +0.2% +2.1% +10.0% ➖ noise
64 duckdb:vortex-compact -0.5% +0.2% -0.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -2.7% +0.2% -2.9% +10.0% ➖ noise
65 datafusion:vortex-compact +0.9% +2.4% -1.5% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -0.5% +2.4% -2.8% +10.0% ➖ noise
65 duckdb:duckdb -0.7% +2.4% -3.1% +19.7% ➖ noise
65 duckdb:vortex-compact +1.7% +2.4% -0.7% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.4% +2.4% +0.0% +10.0% ➖ noise
66 datafusion:vortex-compact +1.0% -4.9% +6.3% +10.5% ➖ noise
66 datafusion:vortex-file-compressed -2.7% -4.9% +2.3% +16.0% ➖ noise
66 duckdb:duckdb -4.2% -4.9% +0.7% +13.7% ➖ noise
66 duckdb:vortex-compact +7.2% -4.9% +12.7% +10.4% 🚨 regression
66 duckdb:vortex-file-compressed -0.4% -4.9% +4.7% +11.8% ➖ noise
67 datafusion:vortex-compact +4.7% +0.6% +4.1% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -1.7% +0.6% -2.3% +11.6% ➖ noise
67 duckdb:duckdb +0.4% +0.6% -0.2% +10.0% ➖ noise
67 duckdb:vortex-compact +0.8% +0.6% +0.2% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -3.4% +0.6% -4.0% +10.0% ➖ noise
68 datafusion:vortex-compact -3.8% -2.3% -1.5% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -2.8% -2.3% -0.5% +10.0% ➖ noise
68 duckdb:duckdb -1.2% -2.3% +1.1% +10.0% ➖ noise
68 duckdb:vortex-compact +0.2% -2.3% +2.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +6.2% -2.3% +8.7% +10.0% ➖ noise
69 datafusion:vortex-compact -1.0% -0.1% -0.9% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -2.7% -0.1% -2.7% +11.0% ➖ noise
69 duckdb:duckdb -0.8% -0.1% -0.7% +10.0% ➖ noise
69 duckdb:vortex-compact +0.1% -0.1% +0.1% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -2.2% -0.1% -2.1% +14.3% ➖ noise
70 datafusion:vortex-compact +1.0% -0.1% +1.1% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -1.5% -0.1% -1.4% +10.0% ➖ noise
70 duckdb:duckdb -6.1% -0.1% -6.0% +12.2% ➖ noise
70 duckdb:vortex-compact +1.1% -0.1% +1.2% +11.4% ➖ noise
70 duckdb:vortex-file-compressed -2.9% -0.1% -2.8% +10.0% ➖ noise
71 datafusion:vortex-compact +3.1% +3.3% -0.2% +13.1% ➖ noise
71 datafusion:vortex-file-compressed +1.2% +3.3% -2.0% +10.1% ➖ noise
71 duckdb:duckdb +7.1% +3.3% +3.6% +16.9% ➖ noise
71 duckdb:vortex-compact -5.2% +3.3% -8.2% +11.3% ➖ noise
71 duckdb:vortex-file-compressed +0.5% +3.3% -2.8% +10.7% ➖ noise
72 datafusion:vortex-compact +0.9% +0.0% +0.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.2% +0.0% +1.1% +10.0% ➖ noise
72 duckdb:duckdb +0.1% +0.0% +0.1% +10.4% ➖ noise
72 duckdb:vortex-compact +0.3% +0.0% +0.3% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.2% +0.0% +0.2% +10.0% ➖ noise
73 datafusion:vortex-compact +0.5% +0.1% +0.4% +21.7% ➖ noise
73 datafusion:vortex-file-compressed -0.5% +0.1% -0.5% +10.0% ➖ noise
73 duckdb:duckdb +5.3% +0.1% +5.2% +12.9% ➖ noise
73 duckdb:vortex-compact +4.9% +0.1% +4.8% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.4% +0.1% +2.4% +10.0% ➖ noise
74 datafusion:vortex-compact -2.3% -1.1% -1.2% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +8.9% -1.1% +10.1% +13.2% ➖ noise
74 duckdb:duckdb -0.4% -1.1% +0.6% +10.0% ➖ noise
74 duckdb:vortex-compact +0.4% -1.1% +1.4% +27.7% ➖ noise
74 duckdb:vortex-file-compressed +11.2% -1.1% +12.4% +17.4% ➖ noise
75 datafusion:vortex-compact -0.1% -0.0% -0.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +0.5% -0.0% +0.6% +10.0% ➖ noise
75 duckdb:duckdb +2.1% -0.0% +2.1% +15.2% ➖ noise
75 duckdb:vortex-compact -2.8% -0.0% -2.8% +10.2% ➖ noise
75 duckdb:vortex-file-compressed +5.2% -0.0% +5.2% +10.0% ➖ noise
76 datafusion:vortex-compact -2.2% -2.3% +0.2% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +6.1% -2.3% +8.7% +10.0% ➖ noise
76 duckdb:duckdb +3.0% -2.3% +5.5% +19.9% ➖ noise
76 duckdb:vortex-compact -0.2% -2.3% +2.2% +11.9% ➖ noise
76 duckdb:vortex-file-compressed +0.9% -2.3% +3.4% +22.2% ➖ noise
77 datafusion:vortex-compact -1.9% -1.9% +0.0% +15.0% ➖ noise
77 datafusion:vortex-file-compressed -0.1% -1.9% +1.8% +16.5% ➖ noise
77 duckdb:duckdb -1.2% -1.9% +0.7% +14.8% ➖ noise
77 duckdb:vortex-compact -5.5% -1.9% -3.7% +18.5% ➖ noise
77 duckdb:vortex-file-compressed -3.1% -1.9% -1.2% +16.9% ➖ noise
78 datafusion:vortex-compact +2.5% +0.8% +1.7% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.0% +0.8% -1.8% +10.0% ➖ noise
78 duckdb:duckdb -0.0% +0.8% -0.8% +10.0% ➖ noise
78 duckdb:vortex-compact +3.5% +0.8% +2.7% +11.8% ➖ noise
78 duckdb:vortex-file-compressed +1.2% +0.8% +0.4% +10.0% ➖ noise
79 datafusion:vortex-compact -0.0% -2.8% +2.8% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +0.4% -2.8% +3.2% +14.4% ➖ noise
79 duckdb:duckdb +0.0% -2.8% +2.9% +10.0% ➖ noise
79 duckdb:vortex-compact +2.4% -2.8% +5.3% +11.3% ➖ noise
79 duckdb:vortex-file-compressed +0.6% -2.8% +3.4% +10.0% ➖ noise
80 datafusion:vortex-compact -1.2% +2.0% -3.1% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.2% +2.0% -1.7% +11.1% ➖ noise
80 duckdb:duckdb -4.1% +2.0% -5.9% +16.1% ➖ noise
80 duckdb:vortex-compact -3.6% +2.0% -5.5% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +6.4% +2.0% +4.3% +11.9% ➖ noise
81 datafusion:vortex-compact -3.2% -1.5% -1.7% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -0.6% -1.5% +0.9% +10.6% ➖ noise
81 duckdb:duckdb +0.1% -1.5% +1.6% +10.0% ➖ noise
81 duckdb:vortex-compact -0.9% -1.5% +0.6% +11.0% ➖ noise
81 duckdb:vortex-file-compressed +1.1% -1.5% +2.7% +10.8% ➖ noise
82 datafusion:vortex-compact +0.1% +2.9% -2.7% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +1.8% +2.9% -1.1% +11.9% ➖ noise
82 duckdb:duckdb -2.7% +2.9% -5.5% +12.1% ➖ noise
82 duckdb:vortex-compact -2.4% +2.9% -5.2% +11.1% ➖ noise
82 duckdb:vortex-file-compressed +7.1% +2.9% +4.1% +10.3% ➖ noise
83 datafusion:vortex-compact -0.2% +0.8% -1.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +1.1% +0.8% +0.3% +10.0% ➖ noise
83 duckdb:duckdb -5.3% +0.8% -6.0% +11.1% ➖ noise
83 duckdb:vortex-compact -3.4% +0.8% -4.2% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +4.9% +0.8% +4.1% +10.2% ➖ noise
84 datafusion:vortex-compact -5.3% -0.8% -4.5% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -2.8% -0.8% -2.0% +10.0% ➖ noise
84 duckdb:duckdb +0.0% -0.8% +0.8% +11.1% ➖ noise
84 duckdb:vortex-compact +2.9% -0.8% +3.8% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +1.7% -0.8% +2.5% +10.6% ➖ noise
85 datafusion:vortex-compact -2.4% +0.9% -3.3% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -3.4% +0.9% -4.2% +10.0% ➖ noise
85 duckdb:duckdb +5.6% +0.9% +4.7% +12.9% ➖ noise
85 duckdb:vortex-compact +2.3% +0.9% +1.4% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -2.9% +0.9% -3.8% +10.0% ➖ noise
86 datafusion:vortex-compact +11.8% +8.8% +2.8% +17.7% ➖ noise
86 datafusion:vortex-file-compressed -2.0% +8.8% -9.9% +14.6% ➖ noise
86 duckdb:duckdb -4.3% +8.8% -12.0% +19.0% ➖ noise
86 duckdb:vortex-compact -5.0% +8.8% -12.6% +16.2% ➖ noise
86 duckdb:vortex-file-compressed +1.1% +8.8% -7.1% +12.5% ➖ noise
87 datafusion:vortex-compact +1.7% -5.0% +7.0% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.5% -5.0% +5.8% +10.0% ➖ noise
87 duckdb:duckdb +4.0% -5.0% +9.4% +14.4% ➖ noise
87 duckdb:vortex-compact -1.9% -5.0% +3.2% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +3.3% -5.0% +8.7% +10.0% ➖ noise
88 datafusion:vortex-compact -0.6% -0.5% -0.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -1.4% -0.5% -0.9% +10.0% ➖ noise
88 duckdb:duckdb -0.3% -0.5% +0.2% +10.0% ➖ noise
88 duckdb:vortex-compact +2.3% -0.5% +2.9% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -0.0% -0.5% +0.5% +10.0% ➖ noise
89 datafusion:vortex-compact +2.1% -1.1% +3.2% +12.2% ➖ noise
89 datafusion:vortex-file-compressed -2.3% -1.1% -1.2% +14.0% ➖ noise
89 duckdb:duckdb +0.5% -1.1% +1.6% +10.0% ➖ noise
89 duckdb:vortex-compact -2.0% -1.1% -0.9% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -5.0% -1.1% -3.9% +10.8% ➖ noise
90 datafusion:vortex-compact +2.2% -1.0% +3.3% +11.1% ➖ noise
90 datafusion:vortex-file-compressed +2.1% -1.0% +3.2% +16.0% ➖ noise
90 duckdb:duckdb -0.2% -1.0% +0.8% +10.0% ➖ noise
90 duckdb:vortex-compact +0.9% -1.0% +1.9% +10.5% ➖ noise
90 duckdb:vortex-file-compressed -3.1% -1.0% -2.1% +10.0% ➖ noise
91 datafusion:vortex-compact -2.2% -1.7% -0.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -2.7% -1.7% -1.0% +10.0% ➖ noise
91 duckdb:duckdb +0.6% -1.7% +2.4% +11.2% ➖ noise
91 duckdb:vortex-compact +1.8% -1.7% +3.5% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -0.3% -1.7% +1.4% +10.0% ➖ noise
92 datafusion:vortex-compact -5.2% +4.7% -9.4% +14.4% ➖ noise
92 datafusion:vortex-file-compressed -3.1% +4.7% -7.5% +13.3% ➖ noise
92 duckdb:duckdb -1.6% +4.7% -6.1% +13.5% ➖ noise
92 duckdb:vortex-compact +2.6% +4.7% -2.0% +25.6% ➖ noise
92 duckdb:vortex-file-compressed +7.3% +4.7% +2.5% +15.4% ➖ noise
93 datafusion:vortex-compact +2.1% -0.5% +2.5% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -0.8% -0.5% -0.3% +10.0% ➖ noise
93 duckdb:duckdb -0.4% -0.5% +0.1% +11.6% ➖ noise
93 duckdb:vortex-compact +1.1% -0.5% +1.6% +12.9% ➖ noise
93 duckdb:vortex-file-compressed +1.0% -0.5% +1.5% +10.0% ➖ noise
94 datafusion:vortex-compact -0.6% +5.4% -5.7% +14.4% ➖ noise
94 datafusion:vortex-file-compressed +0.9% +5.4% -4.3% +10.0% ➖ noise
94 duckdb:duckdb +0.6% +5.4% -4.6% +11.5% ➖ noise
94 duckdb:vortex-compact -0.0% +5.4% -5.2% +10.0% ➖ noise
94 duckdb:vortex-file-compressed -3.5% +5.4% -8.5% +10.0% ➖ noise
95 datafusion:vortex-compact +3.3% -3.1% +6.7% +11.2% ➖ noise
95 datafusion:vortex-file-compressed +1.4% -3.1% +4.7% +10.7% ➖ noise
95 duckdb:duckdb -7.9% -3.1% -4.9% +20.8% ➖ noise
95 duckdb:vortex-compact +3.3% -3.1% +6.7% +17.2% ➖ noise
95 duckdb:vortex-file-compressed -0.7% -3.1% +2.5% +20.1% ➖ noise
96 datafusion:vortex-compact -2.1% -2.0% -0.1% +17.3% ➖ noise
96 datafusion:vortex-file-compressed -2.6% -2.0% -0.6% +10.0% ➖ noise
96 duckdb:duckdb -2.9% -2.0% -0.9% +16.6% ➖ noise
96 duckdb:vortex-compact +11.7% -2.0% +14.0% +14.3% ➖ noise
96 duckdb:vortex-file-compressed +3.0% -2.0% +5.1% +18.2% ➖ noise
97 datafusion:vortex-compact -3.7% -1.4% -2.4% +10.6% ➖ noise
97 datafusion:vortex-file-compressed -3.0% -1.4% -1.6% +10.0% ➖ noise
97 duckdb:duckdb -9.4% -1.4% -8.1% +13.3% ➖ noise
97 duckdb:vortex-compact +8.3% -1.4% +9.8% +10.4% ➖ noise
97 duckdb:vortex-file-compressed -0.4% -1.4% +1.0% +10.6% ➖ noise
98 datafusion:vortex-compact -0.9% +3.8% -4.5% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +0.4% +3.8% -3.3% +10.0% ➖ noise
98 duckdb:duckdb -2.9% +3.8% -6.5% +14.1% ➖ noise
98 duckdb:vortex-compact +2.1% +3.8% -1.6% +13.4% ➖ noise
98 duckdb:vortex-file-compressed -2.6% +3.8% -6.1% +10.0% ➖ noise
99 datafusion:vortex-compact -4.4% -11.7% +8.3% +17.7% ➖ noise
99 datafusion:vortex-file-compressed +0.6% -11.7% +14.0% +17.9% ➖ noise
99 duckdb:duckdb +2.6% -11.7% +16.2% +35.2% ➖ noise
99 duckdb:vortex-compact +9.0% -11.7% +23.5% +16.5% 🚨 regression
99 duckdb:vortex-file-compressed -0.6% -11.7% +12.6% +15.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (24 files changed, +0.0% overall, 2↑ 22↓)
File Scale Format Base HEAD Change %
item.vortex 1.0 vortex-compact 994.18 KB 1005.38 KB +11.20 KB +1.1%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.77 MB +19.52 KB +1.1%
customer.vortex 1.0 vortex-compact 3.29 MB 3.29 MB 32 B -0.0%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.52 MB 160 B -0.0%
date_dim.vortex 1.0 vortex-file-compressed 1.03 MB 1.03 MB 64 B -0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.49 MB 1.49 MB 112 B -0.0%
catalog_page.vortex 1.0 vortex-compact 362.64 KB 362.61 KB 32 B -0.0%
time_dim.vortex 1.0 vortex-file-compressed 687.27 KB 687.11 KB 160 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 611.54 KB 611.34 KB 200 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 1012.93 KB 1012.53 KB 408 B -0.0%
web_page.vortex 1.0 vortex-compact 27.80 KB 27.79 KB 16 B -0.1%
promotion.vortex 1.0 vortex-compact 51.48 KB 51.45 KB 32 B -0.1%
time_dim.vortex 1.0 vortex-compact 97.32 KB 97.26 KB 64 B -0.1%
customer_address.vortex 1.0 vortex-compact 558.59 KB 558.10 KB 504 B -0.1%
store.vortex 1.0 vortex-compact 45.73 KB 45.67 KB 56 B -0.1%
household_demographics.vortex 1.0 vortex-file-compressed 17.02 KB 16.96 KB 56 B -0.3%
warehouse.vortex 1.0 vortex-compact 22.20 KB 22.12 KB 80 B -0.4%
warehouse.vortex 1.0 vortex-file-compressed 23.80 KB 23.70 KB 104 B -0.4%
store.vortex 1.0 vortex-file-compressed 49.46 KB 49.08 KB 392 B -0.8%
web_site.vortex 1.0 vortex-compact 45.28 KB 44.93 KB 360 B -0.8%
call_center.vortex 1.0 vortex-file-compressed 54.91 KB 54.46 KB 456 B -0.8%
ship_mode.vortex 1.0 vortex-file-compressed 13.09 KB 12.98 KB 112 B -0.8%
reason.vortex 1.0 vortex-file-compressed 7.20 KB 7.12 KB 72 B -1.0%
web_site.vortex 1.0 vortex-file-compressed 54.05 KB 53.31 KB 760 B -1.4%

Totals:

  • vortex-compact: 207.50 MB → 207.51 MB (+0.0%)
  • vortex-file-compressed: 272.70 MB → 272.72 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 0.964x ➖
Parquet (geomean): 0.932x ➖
Shifts: Parquet (control) -6.8% · Median polish -2.3%


datafusion / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36015495 37390593 0.96
fineweb_q01/datafusion:vortex-file-compressed 609818698 487748936 1.25
fineweb_q02/datafusion:vortex-file-compressed 447175347 452335793 0.99
fineweb_q03/datafusion:vortex-file-compressed 1347258350 1396900016 0.96
fineweb_q04/datafusion:vortex-file-compressed 1346596842 1419982165 0.95
fineweb_q05/datafusion:vortex-file-compressed 1339837532 1392095557 0.96
fineweb_q06/datafusion:vortex-file-compressed 1458093284 1552195925 0.94
fineweb_q07/datafusion:vortex-file-compressed 1348997754 1367462019 0.99
fineweb_q08/datafusion:vortex-file-compressed 508946912 602913694 0.84
datafusion / vortex-compact (0.901x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36644030 49889107 0.73
fineweb_q01/datafusion:vortex-compact 505570352 588192936 0.86
fineweb_q02/datafusion:vortex-compact 🚀 590906669 910802443 0.65
fineweb_q03/datafusion:vortex-compact 1462353813 1457023929 1.00
fineweb_q04/datafusion:vortex-compact 1852331711 1817135979 1.02
fineweb_q05/datafusion:vortex-compact 1463461122 1459109424 1.00
fineweb_q06/datafusion:vortex-compact 1328110790 1364302161 0.97
fineweb_q07/datafusion:vortex-compact 1177117277 1171401227 1.00
fineweb_q08/datafusion:vortex-compact 390287590 410252300 0.95
datafusion / parquet (0.863x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1060489542 1240186623 0.86
fineweb_q01/datafusion:parquet 1670544189 2279078282 0.73
fineweb_q02/datafusion:parquet 1676064468 2309912318 0.73
fineweb_q03/datafusion:parquet 1771953925 2060161654 0.86
fineweb_q04/datafusion:parquet 2174501946 2216633057 0.98
fineweb_q05/datafusion:parquet 1810156199 1858911689 0.97
fineweb_q06/datafusion:parquet 1739147950 2396736249 0.73
fineweb_q07/datafusion:parquet 1935397812 1966668253 0.98
fineweb_q08/datafusion:parquet 1868164138 1882677176 0.99
duckdb / vortex-file-compressed (1.053x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 88929106 80740917 1.10
fineweb_q01/duckdb:vortex-file-compressed 653933885 579476175 1.13
fineweb_q02/duckdb:vortex-file-compressed 448496130 427425667 1.05
fineweb_q03/duckdb:vortex-file-compressed 1471272064 1457295425 1.01
fineweb_q04/duckdb:vortex-file-compressed 1525464034 1584328195 0.96
fineweb_q05/duckdb:vortex-file-compressed 1470615387 1463839318 1.00
fineweb_q06/duckdb:vortex-file-compressed 1689791437 1642502191 1.03
fineweb_q07/duckdb:vortex-file-compressed 1434338739 1476653307 0.97
fineweb_q08/duckdb:vortex-file-compressed 735763911 589328660 1.25
duckdb / vortex-compact (0.933x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 78583492 83485380 0.94
fineweb_q01/duckdb:vortex-compact 584958672 604046718 0.97
fineweb_q02/duckdb:vortex-compact 538951555 769710722 0.70
fineweb_q03/duckdb:vortex-compact 1616956969 1597346709 1.01
fineweb_q04/duckdb:vortex-compact 1740690649 1688521319 1.03
fineweb_q05/duckdb:vortex-compact 1520239392 1513819739 1.00
fineweb_q06/duckdb:vortex-compact 1411291638 1543198715 0.91
fineweb_q07/duckdb:vortex-compact 1297629136 1342808883 0.97
fineweb_q08/duckdb:vortex-compact 502611467 556632674 0.90
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1060619886 1157767017 0.92
fineweb_q01/duckdb:parquet 1368372686 1318423682 1.04
fineweb_q02/duckdb:parquet 1306115539 1359314732 0.96
fineweb_q03/duckdb:parquet 3751012601 3704123004 1.01
fineweb_q04/duckdb:parquet 1807793339 1836995206 0.98
fineweb_q05/duckdb:parquet 2221846428 2068289434 1.07
fineweb_q06/duckdb:parquet 4278055392 4197715777 1.02
fineweb_q07/duckdb:parquet 2648716358 2677870138 0.99
fineweb_q08/duckdb:parquet 1133724981 1046140149 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -26.5% -11.5% -17.0% +190.1% ➖ noise
0 datafusion:vortex-file-compressed -3.7% -11.5% +8.8% +184.2% ➖ noise
0 duckdb:vortex-compact -5.9% -11.5% +6.4% +71.8% ➖ noise
0 duckdb:vortex-file-compressed +10.1% -11.5% +24.4% +42.8% ➖ noise
1 datafusion:vortex-compact -14.0% -12.8% -1.5% +83.8% ➖ noise
1 datafusion:vortex-file-compressed +25.0% -12.8% +43.3% +89.0% ➖ noise
1 duckdb:vortex-compact -3.2% -12.8% +11.0% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +12.8% -12.8% +29.4% +34.0% ➖ noise
2 datafusion:vortex-compact -35.1% -16.5% -22.3% +48.3% ➖ noise
2 datafusion:vortex-file-compressed -1.1% -16.5% +18.4% +30.0% ➖ noise
2 duckdb:vortex-compact -30.0% -16.5% -16.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +4.9% -16.5% +25.7% +30.0% ➖ noise
3 datafusion:vortex-compact +0.4% -6.7% +7.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -3.6% -6.7% +3.3% +30.4% ➖ noise
3 duckdb:vortex-compact +1.2% -6.7% +8.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.0% -6.7% +8.2% +30.0% ➖ noise
4 datafusion:vortex-compact +1.9% -1.7% +3.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -5.2% -1.7% -3.5% +30.0% ➖ noise
4 duckdb:vortex-compact +3.1% -1.7% +4.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -3.7% -1.7% -2.0% +30.0% ➖ noise
5 datafusion:vortex-compact +0.3% +2.3% -1.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.8% +2.3% -5.9% +30.0% ➖ noise
5 duckdb:vortex-compact +0.4% +2.3% -1.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +0.5% +2.3% -1.8% +30.0% ➖ noise
6 datafusion:vortex-compact -2.7% -14.0% +13.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% -14.0% +9.2% +30.0% ➖ noise
6 duckdb:vortex-compact -8.5% -14.0% +6.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.9% -14.0% +19.6% +30.0% ➖ noise
7 datafusion:vortex-compact +0.5% -1.3% +1.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.4% -1.3% -0.0% +30.0% ➖ noise
7 duckdb:vortex-compact -3.4% -1.3% -2.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -2.9% -1.3% -1.5% +30.0% ➖ noise
8 datafusion:vortex-compact -4.9% +3.7% -8.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -15.6% +3.7% -18.6% +30.0% ➖ noise
8 duckdb:vortex-compact -9.7% +3.7% -12.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +24.8% +3.7% +20.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.966x ➖
Shifts: Parquet (control) -3.4% · Median polish -2.9%


datafusion / vortex-file-compressed (0.943x ➖, 2↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 408892576 434898529 0.94
tpch_q02/datafusion:vortex-file-compressed 116459891 122018853 0.95
tpch_q03/datafusion:vortex-file-compressed 227848814 243296741 0.94
tpch_q04/datafusion:vortex-file-compressed 117996808 127921215 0.92
tpch_q05/datafusion:vortex-file-compressed 🚀 386367609 435716600 0.89
tpch_q06/datafusion:vortex-file-compressed 46622879 50371592 0.93
tpch_q07/datafusion:vortex-file-compressed 579846787 622895492 0.93
tpch_q08/datafusion:vortex-file-compressed 379468513 405198181 0.94
tpch_q09/datafusion:vortex-file-compressed 670161858 715340962 0.94
tpch_q10/datafusion:vortex-file-compressed 263835055 278003872 0.95
tpch_q11/datafusion:vortex-file-compressed 85631756 90747544 0.94
tpch_q12/datafusion:vortex-file-compressed 126476419 135451137 0.93
tpch_q13/datafusion:vortex-file-compressed 222342386 231274634 0.96
tpch_q14/datafusion:vortex-file-compressed 60679477 63583238 0.95
tpch_q15/datafusion:vortex-file-compressed 119827777 119563974 1.00
tpch_q16/datafusion:vortex-file-compressed 82547883 80880732 1.02
tpch_q17/datafusion:vortex-file-compressed 697652784 704360437 0.99
tpch_q18/datafusion:vortex-file-compressed 914109621 938477213 0.97
tpch_q19/datafusion:vortex-file-compressed 94427946 98984175 0.95
tpch_q20/datafusion:vortex-file-compressed 172884252 187248661 0.92
tpch_q21/datafusion:vortex-file-compressed 🚀 677544133 766859699 0.88
tpch_q22/datafusion:vortex-file-compressed 66598376 73782524 0.90
datafusion / vortex-compact (0.972x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 467044117 479205221 0.97
tpch_q02/datafusion:vortex-compact 127934424 120934191 1.06
tpch_q03/datafusion:vortex-compact 240224152 241089104 1.00
tpch_q04/datafusion:vortex-compact 126439014 133546485 0.95
tpch_q05/datafusion:vortex-compact 385226213 422648628 0.91
tpch_q06/datafusion:vortex-compact 65551768 72091873 0.91
tpch_q07/datafusion:vortex-compact 615653083 638981008 0.96
tpch_q08/datafusion:vortex-compact 395201403 405860248 0.97
tpch_q09/datafusion:vortex-compact 749468618 736405631 1.02
tpch_q10/datafusion:vortex-compact 295110604 293185052 1.01
tpch_q11/datafusion:vortex-compact 95334137 94758500 1.01
tpch_q12/datafusion:vortex-compact 176299871 182188930 0.97
tpch_q13/datafusion:vortex-compact 274587692 280019343 0.98
tpch_q14/datafusion:vortex-compact 77701436 80136281 0.97
tpch_q15/datafusion:vortex-compact 169193438 175936872 0.96
tpch_q16/datafusion:vortex-compact 83008418 85060562 0.98
tpch_q17/datafusion:vortex-compact 680056477 703706674 0.97
tpch_q18/datafusion:vortex-compact 914261815 929817607 0.98
tpch_q19/datafusion:vortex-compact 135052653 142177565 0.95
tpch_q20/datafusion:vortex-compact 204599948 209993961 0.97
tpch_q21/datafusion:vortex-compact 716131829 750549661 0.95
tpch_q22/datafusion:vortex-compact 74954542 78939169 0.95
datafusion / parquet (0.951x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 478751016 498368917 0.96
tpch_q02/datafusion:parquet 179695564 184968197 0.97
tpch_q03/datafusion:parquet 302278699 330157955 0.92
tpch_q04/datafusion:parquet 134678634 141111669 0.95
tpch_q05/datafusion:parquet 463026360 487942762 0.95
tpch_q06/datafusion:parquet 133492442 138765342 0.96
tpch_q07/datafusion:parquet 651412311 679591418 0.96
tpch_q08/datafusion:parquet 496713145 520239845 0.95
tpch_q09/datafusion:parquet 784134844 839226756 0.93
tpch_q10/datafusion:parquet 522288668 543861596 0.96
tpch_q11/datafusion:parquet 127483585 130430963 0.98
tpch_q12/datafusion:parquet 210485805 233721063 0.90
tpch_q13/datafusion:parquet 338767685 353429640 0.96
tpch_q14/datafusion:parquet 171690959 178907158 0.96
tpch_q15/datafusion:parquet 270983725 285982118 0.95
tpch_q16/datafusion:parquet 132107877 136945400 0.96
tpch_q17/datafusion:parquet 714977218 752865246 0.95
tpch_q18/datafusion:parquet 911276064 972281976 0.94
tpch_q19/datafusion:parquet 286606320 310049690 0.92
tpch_q20/datafusion:parquet 308598360 321721910 0.96
tpch_q21/datafusion:parquet 742764256 789798341 0.94
tpch_q22/datafusion:parquet 216959057 220863675 0.98
datafusion / arrow (0.967x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 632133233 652223089 0.97
tpch_q02/datafusion:arrow 165441091 173116444 0.96
tpch_q03/datafusion:arrow 507984162 530470386 0.96
tpch_q04/datafusion:arrow 379247566 392112727 0.97
tpch_q05/datafusion:arrow 997981504 1036915267 0.96
tpch_q06/datafusion:arrow 308384015 316081055 0.98
tpch_q07/datafusion:arrow 1244951531 1279611533 0.97
tpch_q08/datafusion:arrow 1235241080 1242150431 0.99
tpch_q09/datafusion:arrow 1422763910 1468264545 0.97
tpch_q10/datafusion:arrow 639184170 656782741 0.97
tpch_q11/datafusion:arrow 140521758 145835040 0.96
tpch_q12/datafusion:arrow 944908650 1043761753 0.91
tpch_q13/datafusion:arrow 533202229 530634846 1.00
tpch_q14/datafusion:arrow 351856273 356685515 0.99
tpch_q15/datafusion:arrow 788725826 789704713 1.00
tpch_q16/datafusion:arrow 109350163 115721259 0.94
tpch_q17/datafusion:arrow 1419931740 1473594954 0.96
tpch_q18/datafusion:arrow 1993807908 2072964090 0.96
tpch_q19/datafusion:arrow 529718076 539328595 0.98
tpch_q20/datafusion:arrow 528827971 550416822 0.96
tpch_q21/datafusion:arrow 3141255460 3208998563 0.98
tpch_q22/datafusion:arrow 136305777 145000189 0.94
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 174807215 175512786 1.00
tpch_q02/duckdb:vortex-file-compressed 55934012 55178935 1.01
tpch_q03/duckdb:vortex-file-compressed 146189236 139820148 1.05
tpch_q04/duckdb:vortex-file-compressed 175764113 167472285 1.05
tpch_q05/duckdb:vortex-file-compressed 140628350 141425171 0.99
tpch_q06/duckdb:vortex-file-compressed 51092342 51057532 1.00
tpch_q07/duckdb:vortex-file-compressed 163730429 160174152 1.02
tpch_q08/duckdb:vortex-file-compressed 198091621 190988310 1.04
tpch_q09/duckdb:vortex-file-compressed 353535693 351022429 1.01
tpch_q10/duckdb:vortex-file-compressed 162908327 159708695 1.02
tpch_q11/duckdb:vortex-file-compressed 35437371 34639689 1.02
tpch_q12/duckdb:vortex-file-compressed 101704583 107346189 0.95
tpch_q13/duckdb:vortex-file-compressed 243811228 245755823 0.99
tpch_q14/duckdb:vortex-file-compressed 72738933 71765288 1.01
tpch_q15/duckdb:vortex-file-compressed 95025723 92922844 1.02
tpch_q16/duckdb:vortex-file-compressed 83964253 83720943 1.00
tpch_q17/duckdb:vortex-file-compressed 105946501 104098226 1.02
tpch_q18/duckdb:vortex-file-compressed 298726611 311578364 0.96
tpch_q19/duckdb:vortex-file-compressed 86515092 87342530 0.99
tpch_q20/duckdb:vortex-file-compressed 168159652 176381951 0.95
tpch_q21/duckdb:vortex-file-compressed 612127126 637492685 0.96
tpch_q22/duckdb:vortex-file-compressed 74096976 74085067 1.00
duckdb / vortex-compact (0.970x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 233068450 237107442 0.98
tpch_q02/duckdb:vortex-compact 58801462 59437389 0.99
tpch_q03/duckdb:vortex-compact 145043832 150791921 0.96
tpch_q04/duckdb:vortex-compact 182539111 182543158 1.00
tpch_q05/duckdb:vortex-compact 153424980 157946634 0.97
tpch_q06/duckdb:vortex-compact 91501079 90050637 1.02
tpch_q07/duckdb:vortex-compact 203611684 214664662 0.95
tpch_q08/duckdb:vortex-compact 199853882 199506778 1.00
tpch_q09/duckdb:vortex-compact 365714015 377870711 0.97
tpch_q10/duckdb:vortex-compact 182346176 192731629 0.95
tpch_q11/duckdb:vortex-compact 41268904 43839224 0.94
tpch_q12/duckdb:vortex-compact 205307219 213576165 0.96
tpch_q13/duckdb:vortex-compact 292132436 297583667 0.98
tpch_q14/duckdb:vortex-compact 101546847 106771666 0.95
tpch_q15/duckdb:vortex-compact 116493380 122661939 0.95
tpch_q16/duckdb:vortex-compact 88414960 89740795 0.99
tpch_q17/duckdb:vortex-compact 115625095 121765755 0.95
tpch_q18/duckdb:vortex-compact 291325437 304990088 0.96
tpch_q19/duckdb:vortex-compact 109789793 112037786 0.98
tpch_q20/duckdb:vortex-compact 210720239 216247569 0.97
tpch_q21/duckdb:vortex-compact 645104864 680894504 0.95
tpch_q22/duckdb:vortex-compact 87669931 90285327 0.97
duckdb / parquet (0.981x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257073080 259391279 0.99
tpch_q02/duckdb:parquet 102219037 100714134 1.01
tpch_q03/duckdb:parquet 212878345 213835093 1.00
tpch_q04/duckdb:parquet 134588885 135570656 0.99
tpch_q05/duckdb:parquet 216784623 225584363 0.96
tpch_q06/duckdb:parquet 68962344 67558367 1.02
tpch_q07/duckdb:parquet 180186007 187632844 0.96
tpch_q08/duckdb:parquet 254520922 263605733 0.97
tpch_q09/duckdb:parquet 505550870 516779979 0.98
tpch_q10/duckdb:parquet 619815765 630924025 0.98
tpch_q11/duckdb:parquet 60098383 61896322 0.97
tpch_q12/duckdb:parquet 125934156 127215221 0.99
tpch_q13/duckdb:parquet 455903058 462333538 0.99
tpch_q14/duckdb:parquet 176121746 183323558 0.96
tpch_q15/duckdb:parquet 96237678 98823650 0.97
tpch_q16/duckdb:parquet 164954845 168718905 0.98
tpch_q17/duckdb:parquet 177406498 180945833 0.98
tpch_q18/duckdb:parquet 350376095 366709364 0.96
tpch_q19/duckdb:parquet 291933970 297089726 0.98
tpch_q20/duckdb:parquet 232212514 242286645 0.96
tpch_q21/duckdb:parquet 586732311 597531824 0.98
tpch_q22/duckdb:parquet 298727049 298624428 1.00
duckdb / duckdb (0.977x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117604926 118727406 0.99
tpch_q02/duckdb:duckdb 46961628 51028414 0.92
tpch_q03/duckdb:duckdb 98891713 100769213 0.98
tpch_q04/duckdb:duckdb 139788261 143100346 0.98
tpch_q05/duckdb:duckdb 115384705 119029273 0.97
tpch_q06/duckdb:duckdb 38283917 41204100 0.93
tpch_q07/duckdb:duckdb 90192477 89969705 1.00
tpch_q08/duckdb:duckdb 114640097 115322846 0.99
tpch_q09/duckdb:duckdb 283844887 292820342 0.97
tpch_q10/duckdb:duckdb 212000204 220987173 0.96
tpch_q11/duckdb:duckdb 15467873 16294765 0.95
tpch_q12/duckdb:duckdb 86253468 91629385 0.94
tpch_q13/duckdb:duckdb 232991903 237053145 0.98
tpch_q14/duckdb:duckdb 72356121 75448947 0.96
tpch_q15/duckdb:duckdb 78642532 79846382 0.98
tpch_q16/duckdb:duckdb 75652308 78497051 0.96
tpch_q17/duckdb:duckdb 85745154 87205359 0.98
tpch_q18/duckdb:duckdb 222606616 225336922 0.99
tpch_q19/duckdb:duckdb 119838921 121034846 0.99
tpch_q20/duckdb:duckdb 114024067 115048760 0.99
tpch_q21/duckdb:duckdb 316420719 316328967 1.00
tpch_q22/duckdb:duckdb 72612146 67479660 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.1% -2.4% -0.7% +10.0% ➖ noise
1 datafusion:vortex-compact -2.5% -2.4% -0.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -6.0% -2.4% -3.6% +10.0% ➖ noise
1 duckdb:duckdb -0.9% -2.4% +1.5% +10.0% ➖ noise
1 duckdb:vortex-compact -1.7% -2.4% +0.7% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.4% -2.4% +2.1% +10.0% ➖ noise
2 datafusion:arrow -4.4% -0.7% -3.8% +10.0% ➖ noise
2 datafusion:vortex-compact +5.8% -0.7% +6.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.6% -0.7% -3.9% +10.0% ➖ noise
2 duckdb:duckdb -8.0% -0.7% -7.3% +10.0% ➖ noise
2 duckdb:vortex-compact -1.1% -0.7% -0.4% +11.7% ➖ noise
2 duckdb:vortex-file-compressed +1.4% -0.7% +2.1% +10.0% ➖ noise
3 datafusion:arrow -4.2% -4.5% +0.3% +10.0% ➖ noise
3 datafusion:vortex-compact -0.4% -4.5% +4.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -6.3% -4.5% -1.9% +10.0% ➖ noise
3 duckdb:duckdb -1.9% -4.5% +2.8% +10.0% ➖ noise
3 duckdb:vortex-compact -3.8% -4.5% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.6% -4.5% +9.5% +10.0% ➖ noise
4 datafusion:arrow -3.3% -2.7% -0.6% +10.0% ➖ noise
4 datafusion:vortex-compact -5.3% -2.7% -2.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.8% -2.7% -5.2% +10.0% ➖ noise
4 duckdb:duckdb -2.3% -2.7% +0.4% +10.0% ➖ noise
4 duckdb:vortex-compact -0.0% -2.7% +2.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +5.0% -2.7% +7.8% +10.0% ➖ noise
5 datafusion:arrow -3.8% -4.5% +0.8% +10.0% ➖ noise
5 datafusion:vortex-compact -8.9% -4.5% -4.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -11.3% -4.5% -7.1% +10.0% ➖ noise
5 duckdb:duckdb -3.1% -4.5% +1.5% +10.0% ➖ noise
5 duckdb:vortex-compact -2.9% -4.5% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% -4.5% +4.1% +10.0% ➖ noise
6 datafusion:arrow -2.4% -0.9% -1.5% +10.0% ➖ noise
6 datafusion:vortex-compact -9.1% -0.9% -8.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -7.4% -0.9% -6.6% +12.2% ➖ noise
6 duckdb:duckdb -7.1% -0.9% -6.2% +10.8% ➖ noise
6 duckdb:vortex-compact +1.6% -0.9% +2.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.1% -0.9% +1.0% +11.3% ➖ noise
7 datafusion:arrow -2.7% -4.1% +1.4% +10.0% ➖ noise
7 datafusion:vortex-compact -3.7% -4.1% +0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.9% -4.1% -3.0% +10.0% ➖ noise
7 duckdb:duckdb +0.2% -4.1% +4.5% +10.0% ➖ noise
7 duckdb:vortex-compact -5.1% -4.1% -1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.2% -4.1% +6.5% +10.0% ➖ noise
8 datafusion:arrow -0.6% -4.0% +3.6% +10.0% ➖ noise
8 datafusion:vortex-compact -2.6% -4.0% +1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.3% -4.0% -2.5% +10.0% ➖ noise
8 duckdb:duckdb -0.6% -4.0% +3.5% +10.0% ➖ noise
8 duckdb:vortex-compact +0.2% -4.0% +4.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.7% -4.0% +8.0% +10.0% ➖ noise
9 datafusion:arrow -3.1% -4.4% +1.4% +10.0% ➖ noise
9 datafusion:vortex-compact +1.8% -4.4% +6.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -6.3% -4.4% -2.0% +10.0% ➖ noise
9 duckdb:duckdb -3.1% -4.4% +1.4% +10.0% ➖ noise
9 duckdb:vortex-compact -3.2% -4.4% +1.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.7% -4.4% +5.3% +10.0% ➖ noise
10 datafusion:arrow -2.7% -2.9% +0.2% +10.0% ➖ noise
10 datafusion:vortex-compact +0.7% -2.9% +3.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -5.1% -2.9% -2.3% +10.0% ➖ noise
10 duckdb:duckdb -4.1% -2.9% -1.2% +10.0% ➖ noise
10 duckdb:vortex-compact -5.4% -2.9% -2.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.0% -2.9% +5.0% +10.0% ➖ noise
11 datafusion:arrow -3.6% -2.6% -1.1% +10.9% ➖ noise
11 datafusion:vortex-compact +0.6% -2.6% +3.3% +10.1% ➖ noise
11 datafusion:vortex-file-compressed -5.6% -2.6% -3.1% +10.0% ➖ noise
11 duckdb:duckdb -5.1% -2.6% -2.6% +12.5% ➖ noise
11 duckdb:vortex-compact -5.9% -2.6% -3.4% +11.6% ➖ noise
11 duckdb:vortex-file-compressed +2.3% -2.6% +5.0% +12.4% ➖ noise
12 datafusion:arrow -9.5% -5.6% -4.1% +35.9% ➖ noise
12 datafusion:vortex-compact -3.2% -5.6% +2.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -6.6% -5.6% -1.1% +10.0% ➖ noise
12 duckdb:duckdb -5.9% -5.6% -0.3% +10.0% ➖ noise
12 duckdb:vortex-compact -3.9% -5.6% +1.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.3% -5.6% +0.3% +10.0% ➖ noise
13 datafusion:arrow +0.5% -2.8% +3.4% +10.0% ➖ noise
13 datafusion:vortex-compact -1.9% -2.8% +0.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -3.9% -2.8% -1.1% +10.0% ➖ noise
13 duckdb:duckdb -1.7% -2.8% +1.1% +10.0% ➖ noise
13 duckdb:vortex-compact -1.8% -2.8% +1.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.8% -2.8% +2.0% +10.0% ➖ noise
14 datafusion:arrow -1.4% -4.0% +2.7% +10.0% ➖ noise
14 datafusion:vortex-compact -3.0% -4.0% +1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -4.6% -4.0% -0.6% +10.0% ➖ noise
14 duckdb:duckdb -4.1% -4.0% -0.1% +10.0% ➖ noise
14 duckdb:vortex-compact -4.9% -4.0% -1.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.4% -4.0% +5.6% +10.8% ➖ noise
15 datafusion:arrow -0.1% -3.9% +4.0% +10.0% ➖ noise
15 datafusion:vortex-compact -3.8% -3.9% +0.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.2% -3.9% +4.3% +10.0% ➖ noise
15 duckdb:duckdb -1.5% -3.9% +2.5% +10.0% ➖ noise
15 duckdb:vortex-compact -5.0% -3.9% -1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.3% -3.9% +6.5% +10.0% ➖ noise
16 datafusion:arrow -5.5% -2.9% -2.7% +10.0% ➖ noise
16 datafusion:vortex-compact -2.4% -2.9% +0.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.1% -2.9% +5.1% +10.0% ➖ noise
16 duckdb:duckdb -3.6% -2.9% -0.8% +10.0% ➖ noise
16 duckdb:vortex-compact -1.5% -2.9% +1.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.3% -2.9% +3.3% +10.0% ➖ noise
17 datafusion:arrow -3.6% -3.5% -0.1% +10.0% ➖ noise
17 datafusion:vortex-compact -3.4% -3.5% +0.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.0% -3.5% +2.6% +10.0% ➖ noise
17 duckdb:duckdb -1.7% -3.5% +1.9% +10.0% ➖ noise
17 duckdb:vortex-compact -5.0% -3.5% -1.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.8% -3.5% +5.5% +10.0% ➖ noise
18 datafusion:arrow -3.8% -5.4% +1.6% +10.0% ➖ noise
18 datafusion:vortex-compact -1.7% -5.4% +3.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.6% -5.4% +2.9% +10.0% ➖ noise
18 duckdb:duckdb -1.2% -5.4% +4.4% +10.0% ➖ noise
18 duckdb:vortex-compact -4.5% -5.4% +0.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.1% -5.4% +1.3% +10.0% ➖ noise
19 datafusion:arrow -1.8% -4.7% +3.1% +10.0% ➖ noise
19 datafusion:vortex-compact -5.0% -4.7% -0.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.6% -4.7% +0.1% +10.0% ➖ noise
19 duckdb:duckdb -1.0% -4.7% +3.9% +10.0% ➖ noise
19 duckdb:vortex-compact -2.0% -4.7% +2.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.9% -4.7% +3.9% +10.0% ➖ noise
20 datafusion:arrow -3.9% -4.1% +0.2% +10.0% ➖ noise
20 datafusion:vortex-compact -2.6% -4.1% +1.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -7.7% -4.1% -3.7% +10.0% ➖ noise
20 duckdb:duckdb -0.9% -4.1% +3.4% +10.0% ➖ noise
20 duckdb:vortex-compact -2.6% -4.1% +1.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -4.7% -4.1% -0.6% +10.0% ➖ noise
21 datafusion:arrow -2.1% -3.9% +1.9% +10.0% ➖ noise
21 datafusion:vortex-compact -4.6% -3.9% -0.7% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -11.6% -3.9% -8.1% +10.0% ➖ noise
21 duckdb:duckdb +0.0% -3.9% +4.1% +10.0% ➖ noise
21 duckdb:vortex-compact -5.3% -3.9% -1.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -4.0% -3.9% -0.1% +10.0% ➖ noise
22 datafusion:arrow -6.0% -0.9% -5.2% +10.0% ➖ noise
22 datafusion:vortex-compact -5.0% -0.9% -4.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -9.7% -0.9% -8.9% +10.0% ➖ noise
22 duckdb:duckdb +7.6% -0.9% +8.6% +10.0% ➖ noise
22 duckdb:vortex-compact -2.9% -0.9% -2.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.0% -0.9% +0.9% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: TPC-H SF=10 on NVME

File Size Changes (29 files changed, -0.0% overall, 0↑ 29↓)
File Scale Format Base HEAD Change %
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.15 MB 56 B -0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 164.00 MB 56 B -0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.92 MB 56 B -0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.87 MB 56 B -0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 56 B -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.65 MB 56 B -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.52 MB 56 B -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.51 MB 56 B -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.43 MB 56 B -0.0%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.38 MB 56 B -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.27 MB 56 B -0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 134.06 MB 56 B -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 134.01 MB 56 B -0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.86 MB 56 B -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.74 MB 56 B -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.23 MB 56 B -0.0%
customer_0.vortex 10.0 vortex-file-compressed 104.73 MB 104.73 MB 56 B -0.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 100.58 MB 188 B -0.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 204 B -0.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 204 B -0.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 100.64 MB 212 B -0.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 100.56 MB 212 B -0.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 114.79 MB 256 B -0.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 100.62 MB 228 B -0.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 100.59 MB 248 B -0.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 100.70 MB 492 B -0.0%
part_1.vortex 10.0 vortex-file-compressed 26.99 MB 26.99 MB 224 B -0.0%
supplier_0.vortex 10.0 vortex-file-compressed 6.69 MB 6.69 MB 256 B -0.0%
region_0.vortex 10.0 vortex-file-compressed 6.13 KB 6.01 KB 120 B -1.9%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (-0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -5.5%
Vortex (geomean): 0.830x ✅
Parquet (geomean): 0.878x ✅
Shifts: Parquet (control) -12.2% · Median polish -15.5%


duckdb / vortex-file-compressed (0.822x ✅, 11↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚀 11601767 14338501 0.81
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20077865 28707923 0.70
statpopgen_q02/duckdb:vortex-file-compressed 🚀 1392949025 1599603409 0.87
statpopgen_q03/duckdb:vortex-file-compressed 🚀 3080808993 3804071351 0.81
statpopgen_q04/duckdb:vortex-file-compressed 🚀 3144645308 3720829362 0.85
statpopgen_q05/duckdb:vortex-file-compressed 🚀 1450823869 1752731248 0.83
statpopgen_q06/duckdb:vortex-file-compressed 🚀 2149403728 2450917644 0.88
statpopgen_q07/duckdb:vortex-file-compressed 🚀 223118228 270987409 0.82
statpopgen_q08/duckdb:vortex-file-compressed 🚀 254672526 322013743 0.79
statpopgen_q09/duckdb:vortex-file-compressed 🚀 3006094804 3518385360 0.85
statpopgen_q10/duckdb:vortex-file-compressed 🚀 4737522364 5548392576 0.85
duckdb / vortex-compact (0.838x ✅, 10↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚀 11156024 13840089 0.81
statpopgen_q01/duckdb:vortex-compact 🚀 165923108 212765334 0.78
statpopgen_q02/duckdb:vortex-compact 🚀 1821688045 2262157811 0.81
statpopgen_q03/duckdb:vortex-compact 🚀 3526727219 4185602253 0.84
statpopgen_q04/duckdb:vortex-compact 🚀 3547693362 4082136892 0.87
statpopgen_q05/duckdb:vortex-compact 🚀 1866557006 2337751997 0.80
statpopgen_q06/duckdb:vortex-compact 🚀 2697396587 3130780624 0.86
statpopgen_q07/duckdb:vortex-compact 892362742 989855519 0.90
statpopgen_q08/duckdb:vortex-compact 🚀 923739285 1095734843 0.84
statpopgen_q09/duckdb:vortex-compact 🚀 3319219735 3840731564 0.86
statpopgen_q10/duckdb:vortex-compact 🚀 5409023764 6321191465 0.86
duckdb / parquet (0.878x ✅, 9↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 328252480 355776343 0.92
statpopgen_q01/duckdb:parquet 414715824 442110617 0.94
statpopgen_q02/duckdb:parquet 🚀 1003401524 1125895460 0.89
statpopgen_q03/duckdb:parquet 🚀 1503760229 1700968211 0.88
statpopgen_q04/duckdb:parquet 🚀 1506018387 1815587001 0.83
statpopgen_q05/duckdb:parquet 🚀 1009673570 1229643713 0.82
statpopgen_q06/duckdb:parquet 🚀 1495782943 1712800614 0.87
statpopgen_q07/duckdb:parquet 🚀 1291052621 1485521505 0.87
statpopgen_q08/duckdb:parquet 🚀 1309321620 1461242813 0.90
statpopgen_q09/duckdb:parquet 🚀 1401991182 1564943794 0.90
statpopgen_q10/duckdb:parquet 🚀 2665050155 3147496751 0.85
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -19.4% -7.7% -12.6% +11.2% ✅ faster
0 duckdb:vortex-file-compressed -19.1% -7.7% -12.3% +14.1% ➖ noise
1 duckdb:vortex-compact -22.0% -6.2% -16.9% +11.2% ✅ faster
1 duckdb:vortex-file-compressed -30.1% -6.2% -25.4% +202.0% ➖ noise
2 duckdb:vortex-compact -19.5% -10.9% -9.6% +11.2% ➖ noise
2 duckdb:vortex-file-compressed -12.9% -10.9% -2.3% +11.2% ➖ noise
3 duckdb:vortex-compact -15.7% -11.6% -4.7% +11.2% ➖ noise
3 duckdb:vortex-file-compressed -19.0% -11.6% -8.4% +11.2% ➖ noise
4 duckdb:vortex-compact -13.1% -17.1% +4.8% +11.2% ➖ noise
4 duckdb:vortex-file-compressed -15.5% -17.1% +1.9% +11.2% ➖ noise
5 duckdb:vortex-compact -20.2% -17.9% -2.8% +11.2% ➖ noise
5 duckdb:vortex-file-compressed -17.2% -17.9% +0.8% +11.2% ➖ noise
6 duckdb:vortex-compact -13.8% -12.7% -1.3% +11.2% ➖ noise
6 duckdb:vortex-file-compressed -12.3% -12.7% +0.4% +11.2% ➖ noise
7 duckdb:vortex-compact -9.8% -13.1% +3.7% +11.2% ➖ noise
7 duckdb:vortex-file-compressed -17.7% -13.1% -5.3% +11.2% ➖ noise
8 duckdb:vortex-compact -15.7% -10.4% -5.9% +11.2% ➖ noise
8 duckdb:vortex-file-compressed -20.9% -10.4% -11.7% +15.5% ➖ noise
9 duckdb:vortex-compact -13.6% -10.4% -3.5% +11.2% ➖ noise
9 duckdb:vortex-file-compressed -14.6% -10.4% -4.6% +11.2% ➖ noise
10 duckdb:vortex-compact -14.4% -15.3% +1.1% +11.2% ➖ noise
10 duckdb:vortex-file-compressed -14.6% -15.3% +0.8% +11.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, +0.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.35 MB 959.39 MB +38.07 KB +0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.97 GB 1.97 GB 5.62 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.65 MB (+0.0%)
  • vortex-file-compressed: 1.97 GB → 1.97 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Random Access

Vortex (geomean): 0.964x ➖
Parquet (geomean): 0.976x ➖


unknown / unknown (0.972x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2231927 2452507 0.91
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1353036 1378111 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8317986494 8597414030 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8281378592 8534829422 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7537937 7798277 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6750434 7475189 0.90
random-access/feature-vectors/uniform/lance-tokio-local-disk 5621214 5716889 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6296365 6412367 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8289504074 8410389828 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8274933265 8443827809 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13017687 13371183 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12981846 13196299 0.98
random-access/lance-tokio-local-disk 735496 725583 1.01
random-access/lance-tokio-local-disk-footer 1209602 1231489 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 243014 247131 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 606105 610853 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk 130610462 132524239 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 127704998 132478285 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk 550844 574337 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 564956 563064 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk 1035227 1067931 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1395991 1443145 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 129562365 132147187 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130314872 132109092 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk 2064543 2077249 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2061449 2069412 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 380080 399062 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 567483 582494 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 24968850 26991645 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 24603358 26563619 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk 729505 717679 1.02
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 724477 745604 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2546609 2649983 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2750850 2876049 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 25026172 26422656 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 24576276 26414732 0.93
random-access/nested-structs/uniform/vortex-tokio-local-disk 1614958 1549606 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1584716 1642085 0.97
random-access/parquet-tokio-local-disk 174952079 174748798 1.00
random-access/parquet-tokio-local-disk-footer 175551804 175361201 1.00
random-access/taxi/correlated/lance-tokio-local-disk 910160 911849 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1503297 1516312 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 262496542 261730692 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 264328938 261601034 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1527025 1802352 0.85
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1705731 1809325 0.94
random-access/taxi/uniform/lance-tokio-local-disk 9490384 9703505 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 10044958 10335316 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 278693583 275709190 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 278059341 277521326 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 4404816 4556933 0.97
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4377718 4535548 0.97
random-access/vortex-tokio-local-disk 1188735 1268685 0.94
random-access/vortex-tokio-local-disk-footer 1206097 1287853 0.94

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.965x ➖
Parquet (geomean): 0.970x ➖
Shifts: Parquet (control) -3.0% · Median polish -3.4%


datafusion / vortex-file-compressed (0.969x ➖, 1↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1654850 1677299 0.99
clickbench_q01/datafusion:vortex-file-compressed 18704202 19439686 0.96
clickbench_q02/datafusion:vortex-file-compressed 36251914 38220023 0.95
clickbench_q03/datafusion:vortex-file-compressed 43013653 41085453 1.05
clickbench_q04/datafusion:vortex-file-compressed 278654464 289497732 0.96
clickbench_q05/datafusion:vortex-file-compressed 297660789 308269358 0.97
clickbench_q06/datafusion:vortex-file-compressed 1603949 1730083 0.93
clickbench_q07/datafusion:vortex-file-compressed 22248794 22423361 0.99
clickbench_q08/datafusion:vortex-file-compressed 343694352 366672355 0.94
clickbench_q09/datafusion:vortex-file-compressed 544970528 594384427 0.92
clickbench_q10/datafusion:vortex-file-compressed 74362312 77674099 0.96
clickbench_q11/datafusion:vortex-file-compressed 89750266 91875425 0.98
clickbench_q12/datafusion:vortex-file-compressed 267551560 280271904 0.95
clickbench_q13/datafusion:vortex-file-compressed 403848289 445895807 0.91
clickbench_q14/datafusion:vortex-file-compressed 🚀 247953046 282877203 0.88
clickbench_q15/datafusion:vortex-file-compressed 318510734 351699100 0.91
clickbench_q16/datafusion:vortex-file-compressed 630025774 676140812 0.93
clickbench_q17/datafusion:vortex-file-compressed 626164435 649394279 0.96
clickbench_q18/datafusion:vortex-file-compressed 1266572636 1331017759 0.95
clickbench_q19/datafusion:vortex-file-compressed 🚨 34919407 30992546 1.13
clickbench_q20/datafusion:vortex-file-compressed 341241918 348817384 0.98
clickbench_q21/datafusion:vortex-file-compressed 365798218 383921382 0.95
clickbench_q22/datafusion:vortex-file-compressed 443278852 472660263 0.94
clickbench_q23/datafusion:vortex-file-compressed 612907475 673635158 0.91
clickbench_q24/datafusion:vortex-file-compressed 44181838 47965459 0.92
clickbench_q25/datafusion:vortex-file-compressed 72887461 72859502 1.00
clickbench_q26/datafusion:vortex-file-compressed 45733331 46930354 0.97
clickbench_q27/datafusion:vortex-file-compressed 716977489 720539071 1.00
clickbench_q28/datafusion:vortex-file-compressed 6750565318 6900741788 0.98
clickbench_q29/datafusion:vortex-file-compressed 236903621 237819782 1.00
clickbench_q30/datafusion:vortex-file-compressed 220119275 223674954 0.98
clickbench_q31/datafusion:vortex-file-compressed 258999120 256951076 1.01
clickbench_q32/datafusion:vortex-file-compressed 1108005079 1118106317 0.99
clickbench_q33/datafusion:vortex-file-compressed 1280371369 1282811266 1.00
clickbench_q34/datafusion:vortex-file-compressed 1280722113 1262284101 1.01
clickbench_q35/datafusion:vortex-file-compressed 445920756 450361226 0.99
clickbench_q36/datafusion:vortex-file-compressed 70207113 69218757 1.01
clickbench_q37/datafusion:vortex-file-compressed 34423899 35924110 0.96
clickbench_q38/datafusion:vortex-file-compressed 18563303 19346893 0.96
clickbench_q39/datafusion:vortex-file-compressed 134677289 134533879 1.00
clickbench_q40/datafusion:vortex-file-compressed 16249879 16315549 1.00
clickbench_q41/datafusion:vortex-file-compressed 15050621 15767004 0.95
clickbench_q42/datafusion:vortex-file-compressed 17466695 17573442 0.99
datafusion / parquet (0.961x ➖, 2↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1572734 1612590 0.98
clickbench_q01/datafusion:parquet 18626492 19091363 0.98
clickbench_q02/datafusion:parquet 🚀 46038811 52274527 0.88
clickbench_q03/datafusion:parquet 37080471 38691938 0.96
clickbench_q04/datafusion:parquet 295278660 317274234 0.93
clickbench_q05/datafusion:parquet 362028935 362481850 1.00
clickbench_q06/datafusion:parquet 1582784 1626706 0.97
clickbench_q07/datafusion:parquet 22953183 23410987 0.98
clickbench_q08/datafusion:parquet 368041292 381223111 0.97
clickbench_q09/datafusion:parquet 615121677 662195005 0.93
clickbench_q10/datafusion:parquet 111945782 116052733 0.96
clickbench_q11/datafusion:parquet 136681081 138988036 0.98
clickbench_q12/datafusion:parquet 349097759 375686848 0.93
clickbench_q13/datafusion:parquet 519751789 530495668 0.98
clickbench_q14/datafusion:parquet 347810942 367871750 0.95
clickbench_q15/datafusion:parquet 341420422 362671099 0.94
clickbench_q16/datafusion:parquet 662725359 710148017 0.93
clickbench_q17/datafusion:parquet 645667523 674471627 0.96
clickbench_q18/datafusion:parquet 1319232278 1339235538 0.99
clickbench_q19/datafusion:parquet 29414911 30268846 0.97
clickbench_q20/datafusion:parquet 607054641 615755240 0.99
clickbench_q21/datafusion:parquet 661809977 700381525 0.94
clickbench_q22/datafusion:parquet 976413050 1028421086 0.95
clickbench_q23/datafusion:parquet 3734607729 3892902438 0.96
clickbench_q24/datafusion:parquet 88467587 90266497 0.98
clickbench_q25/datafusion:parquet 133192834 142579762 0.93
clickbench_q26/datafusion:parquet 83249340 89289454 0.93
clickbench_q27/datafusion:parquet 1048549991 1086972097 0.96
clickbench_q28/datafusion:parquet 6742219876 6739845246 1.00
clickbench_q29/datafusion:parquet 229280953 247246685 0.93
clickbench_q30/datafusion:parquet 331851558 345860623 0.96
clickbench_q31/datafusion:parquet 372700037 373919692 1.00
clickbench_q32/datafusion:parquet 1185417224 1255483666 0.94
clickbench_q33/datafusion:parquet 1462465134 1533586469 0.95
clickbench_q34/datafusion:parquet 1465434830 1562438774 0.94
clickbench_q35/datafusion:parquet 448310999 467410310 0.96
clickbench_q36/datafusion:parquet 🚀 138205199 153633533 0.90
clickbench_q37/datafusion:parquet 59861222 59048127 1.01
clickbench_q38/datafusion:parquet 82750666 88251125 0.94
clickbench_q39/datafusion:parquet 255985106 264431830 0.97
clickbench_q40/datafusion:parquet 30000593 29811635 1.01
clickbench_q41/datafusion:parquet 27610043 27633189 1.00
clickbench_q42/datafusion:parquet 30436194 29411655 1.03
duckdb / vortex-file-compressed (0.962x ➖, 2↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5809565 6067603 0.96
clickbench_q01/duckdb:vortex-file-compressed 13037053 13601925 0.96
clickbench_q02/duckdb:vortex-file-compressed 26390340 27189566 0.97
clickbench_q03/duckdb:vortex-file-compressed 29829101 31244426 0.95
clickbench_q04/duckdb:vortex-file-compressed 182587147 187589629 0.97
clickbench_q05/duckdb:vortex-file-compressed 166037935 177019394 0.94
clickbench_q06/duckdb:vortex-file-compressed 18022373 18768627 0.96
clickbench_q07/duckdb:vortex-file-compressed 14489100 15270246 0.95
clickbench_q08/duckdb:vortex-file-compressed 254358768 259477488 0.98
clickbench_q09/duckdb:vortex-file-compressed 328670491 337423856 0.97
clickbench_q10/duckdb:vortex-file-compressed 67181795 67002107 1.00
clickbench_q11/duckdb:vortex-file-compressed 76916472 79994825 0.96
clickbench_q12/duckdb:vortex-file-compressed 191987263 198074954 0.97
clickbench_q13/duckdb:vortex-file-compressed 397388789 408965783 0.97
clickbench_q14/duckdb:vortex-file-compressed 229206532 230235071 1.00
clickbench_q15/duckdb:vortex-file-compressed 245009177 242033203 1.01
clickbench_q16/duckdb:vortex-file-compressed 570407987 590757862 0.97
clickbench_q17/duckdb:vortex-file-compressed 466918423 479630831 0.97
clickbench_q18/duckdb:vortex-file-compressed 957082113 968670140 0.99
clickbench_q19/duckdb:vortex-file-compressed 20928712 21776801 0.96
clickbench_q20/duckdb:vortex-file-compressed 323768537 344819647 0.94
clickbench_q21/duckdb:vortex-file-compressed 361688715 369569421 0.98
clickbench_q22/duckdb:vortex-file-compressed 🚀 493355974 590848389 0.83
clickbench_q23/duckdb:vortex-file-compressed 🚀 666152487 1541221845 0.43
clickbench_q24/duckdb:vortex-file-compressed 40791198 42622032 0.96
clickbench_q25/duckdb:vortex-file-compressed 75386183 77389590 0.97
clickbench_q26/duckdb:vortex-file-compressed 42375926 46578948 0.91
clickbench_q27/duckdb:vortex-file-compressed 466486871 478327023 0.98
clickbench_q28/duckdb:vortex-file-compressed 2952961521 2983138067 0.99
clickbench_q29/duckdb:vortex-file-compressed 27928109 30068151 0.93
clickbench_q30/duckdb:vortex-file-compressed 187345811 192229966 0.97
clickbench_q31/duckdb:vortex-file-compressed 272943283 283037661 0.96
clickbench_q32/duckdb:vortex-file-compressed 1191315193 1189162986 1.00
clickbench_q33/duckdb:vortex-file-compressed 1191876331 1162947186 1.02
clickbench_q34/duckdb:vortex-file-compressed 1196901952 1212468851 0.99
clickbench_q35/duckdb:vortex-file-compressed 377575223 379255062 1.00
clickbench_q36/duckdb:vortex-file-compressed 28835855 28187361 1.02
clickbench_q37/duckdb:vortex-file-compressed 🚨 23479729 20621872 1.14
clickbench_q38/duckdb:vortex-file-compressed 23960473 22220228 1.08
clickbench_q39/duckdb:vortex-file-compressed 41235561 43153302 0.96
clickbench_q40/duckdb:vortex-file-compressed 22375666 21160481 1.06
clickbench_q41/duckdb:vortex-file-compressed 21486989 20731497 1.04
clickbench_q42/duckdb:vortex-file-compressed 24009408 22006399 1.09
duckdb / parquet (0.980x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 23525061 26684427 0.88
clickbench_q01/duckdb:parquet 26918109 27886813 0.97
clickbench_q02/duckdb:parquet 49069917 49592595 0.99
clickbench_q03/duckdb:parquet 38281005 38671665 0.99
clickbench_q04/duckdb:parquet 201199162 201023766 1.00
clickbench_q05/duckdb:parquet 264666808 274398482 0.96
clickbench_q06/duckdb:parquet 46635547 46882069 0.99
clickbench_q07/duckdb:parquet 30375843 29079490 1.04
clickbench_q08/duckdb:parquet 268157685 270068305 0.99
clickbench_q09/duckdb:parquet 396290636 399135622 0.99
clickbench_q10/duckdb:parquet 80762092 81789297 0.99
clickbench_q11/duckdb:parquet 97388471 96660885 1.01
clickbench_q12/duckdb:parquet 287205116 297380767 0.97
clickbench_q13/duckdb:parquet 488238208 485410268 1.01
clickbench_q14/duckdb:parquet 326060744 323353297 1.01
clickbench_q15/duckdb:parquet 256372393 257452597 1.00
clickbench_q16/duckdb:parquet 634894304 659444786 0.96
clickbench_q17/duckdb:parquet 530224336 548074895 0.97
clickbench_q18/duckdb:parquet 1061689013 1081709671 0.98
clickbench_q19/duckdb:parquet 25399333 26198283 0.97
clickbench_q20/duckdb:parquet 423762458 431039594 0.98
clickbench_q21/duckdb:parquet 540529172 557743376 0.97
clickbench_q22/duckdb:parquet 919434476 946609182 0.97
clickbench_q23/duckdb:parquet 307301060 324342344 0.95
clickbench_q24/duckdb:parquet 68147311 68380455 1.00
clickbench_q25/duckdb:parquet 157654649 157052956 1.00
clickbench_q26/duckdb:parquet 51201088 50455599 1.01
clickbench_q27/duckdb:parquet 639104919 653448011 0.98
clickbench_q28/duckdb:parquet 4835993542 4858790693 1.00
clickbench_q29/duckdb:parquet 39951614 42193420 0.95
clickbench_q30/duckdb:parquet 297542567 303379285 0.98
clickbench_q31/duckdb:parquet 356481253 366961428 0.97
clickbench_q32/duckdb:parquet 1160219747 1190921796 0.97
clickbench_q33/duckdb:parquet 1243535011 1316746562 0.94
clickbench_q34/duckdb:parquet 1288098914 1331044524 0.97
clickbench_q35/duckdb:parquet 361410747 367721677 0.98
clickbench_q36/duckdb:parquet 43562214 47167764 0.92
clickbench_q37/duckdb:parquet 32261183 32011393 1.01
clickbench_q38/duckdb:parquet 33950571 34271989 0.99
clickbench_q39/duckdb:parquet 73776381 79670261 0.93
clickbench_q40/duckdb:parquet 18944924 19151398 0.99
clickbench_q41/duckdb:parquet 17079614 18028817 0.95
clickbench_q42/duckdb:parquet 22032163 20414072 1.08
duckdb / duckdb (0.945x ➖, 4↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17422756 18599347 0.94
clickbench_q01/duckdb:duckdb 31440418 33589923 0.94
clickbench_q02/duckdb:duckdb 43910865 46467726 0.94
clickbench_q03/duckdb:duckdb 46098233 48619856 0.95
clickbench_q04/duckdb:duckdb 186369533 195261232 0.95
clickbench_q05/duckdb:duckdb 267844723 275692330 0.97
clickbench_q06/duckdb:duckdb 🚀 27927531 36794534 0.76
clickbench_q07/duckdb:duckdb 34821224 35607718 0.98
clickbench_q08/duckdb:duckdb 248513779 255514448 0.97
clickbench_q09/duckdb:duckdb 367079902 381769949 0.96
clickbench_q10/duckdb:duckdb 98394412 100381719 0.98
clickbench_q11/duckdb:duckdb 108055316 108771012 0.99
clickbench_q12/duckdb:duckdb 240912965 243545564 0.99
clickbench_q13/duckdb:duckdb 483611674 503979234 0.96
clickbench_q14/duckdb:duckdb 273276195 289548336 0.94
clickbench_q15/duckdb:duckdb 220474721 225128429 0.98
clickbench_q16/duckdb:duckdb 641806802 688276550 0.93
clickbench_q17/duckdb:duckdb 575210983 604090214 0.95
clickbench_q18/duckdb:duckdb 1223073240 1292091934 0.95
clickbench_q19/duckdb:duckdb 34619156 35088999 0.99
clickbench_q20/duckdb:duckdb 959688800 1044024690 0.92
clickbench_q21/duckdb:duckdb 1026397624 1054741935 0.97
clickbench_q22/duckdb:duckdb 1127799739 1199526402 0.94
clickbench_q23/duckdb:duckdb 248999023 270730199 0.92
clickbench_q24/duckdb:duckdb 60800486 67476326 0.90
clickbench_q25/duckdb:duckdb 🚀 141871887 158147478 0.90
clickbench_q26/duckdb:duckdb 59232330 63944759 0.93
clickbench_q27/duckdb:duckdb 1104097064 1085057740 1.02
clickbench_q28/duckdb:duckdb 4642319812 4717202337 0.98
clickbench_q29/duckdb:duckdb 47497552 48778044 0.97
clickbench_q30/duckdb:duckdb 265638365 271986218 0.98
clickbench_q31/duckdb:duckdb 🚀 413408923 476878228 0.87
clickbench_q32/duckdb:duckdb 🚀 1408723130 1643252824 0.86
clickbench_q33/duckdb:duckdb 2008905981 2118817656 0.95
clickbench_q34/duckdb:duckdb 2097106657 2227486246 0.94
clickbench_q35/duckdb:duckdb 275593076 288347040 0.96
clickbench_q36/duckdb:duckdb 40988661 43679524 0.94
clickbench_q37/duckdb:duckdb 31065319 32529249 0.95
clickbench_q38/duckdb:duckdb 30414471 32565094 0.93
clickbench_q39/duckdb:duckdb 65560044 69266449 0.95
clickbench_q40/duckdb:duckdb 31448589 32764584 0.96
clickbench_q41/duckdb:duckdb 30589992 31755614 0.96
clickbench_q42/duckdb:duckdb 31438210 32552690 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -1.3% -7.3% +6.4% +769.6% ➖ noise
0 duckdb:duckdb -6.3% -7.3% +1.0% +286.7% ➖ noise
0 duckdb:vortex-file-compressed -4.3% -7.3% +3.3% +496.5% ➖ noise
1 datafusion:vortex-file-compressed -3.8% -3.0% -0.9% +22.6% ➖ noise
1 duckdb:duckdb -6.4% -3.0% -3.5% +63.1% ➖ noise
1 duckdb:vortex-file-compressed -4.2% -3.0% -1.2% +22.5% ➖ noise
2 datafusion:vortex-file-compressed -5.1% -6.6% +1.6% +14.4% ➖ noise
2 duckdb:duckdb -5.5% -6.6% +1.2% +20.7% ➖ noise
2 duckdb:vortex-file-compressed -2.9% -6.6% +4.0% +12.4% ➖ noise
3 datafusion:vortex-file-compressed +4.7% -2.6% +7.5% +142.6% ➖ noise
3 duckdb:duckdb -5.2% -2.6% -2.7% +46.3% ➖ noise
3 duckdb:vortex-file-compressed -4.5% -2.6% -2.0% +63.0% ➖ noise
4 datafusion:vortex-file-compressed -3.7% -3.5% -0.3% +10.0% ➖ noise
4 duckdb:duckdb -4.6% -3.5% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.7% -3.5% +0.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.4% -1.9% -1.6% +10.0% ➖ noise
5 duckdb:duckdb -2.8% -1.9% -1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.2% -1.9% -4.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -7.3% -1.6% -5.8% +40.0% ➖ noise
6 duckdb:duckdb -24.1% -1.6% -22.8% +29.0% ✅ faster
6 duckdb:vortex-file-compressed -4.0% -1.6% -2.4% +21.0% ➖ noise
7 datafusion:vortex-file-compressed -0.8% +1.2% -2.0% +14.3% ➖ noise
7 duckdb:duckdb -2.2% +1.2% -3.4% +11.4% ➖ noise
7 duckdb:vortex-file-compressed -5.1% +1.2% -6.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -6.3% -2.1% -4.3% +10.0% ➖ noise
8 duckdb:duckdb -2.7% -2.1% -0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.0% -2.1% +0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -8.3% -4.0% -4.5% +10.0% ➖ noise
9 duckdb:duckdb -3.8% -4.0% +0.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.6% -4.0% +1.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.3% -2.4% -1.9% +10.1% ➖ noise
10 duckdb:duckdb -2.0% -2.4% +0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% -2.4% +2.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.3% -0.5% -1.9% +10.0% ➖ noise
11 duckdb:duckdb -0.7% -0.5% -0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -3.8% -0.5% -3.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.5% -5.3% +0.8% +10.0% ➖ noise
12 duckdb:duckdb -1.1% -5.3% +4.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.1% -5.3% +2.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -9.4% -0.7% -8.8% +10.0% ➖ noise
13 duckdb:duckdb -4.0% -0.7% -3.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.8% -0.7% -2.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -12.3% -2.4% -10.2% +10.0% ✅ faster
14 duckdb:duckdb -5.6% -2.4% -3.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.4% -2.4% +2.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -9.4% -3.2% -6.5% +10.0% ➖ noise
15 duckdb:duckdb -2.1% -3.2% +1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.2% -3.2% +4.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -6.8% -5.2% -1.7% +10.0% ➖ noise
16 duckdb:duckdb -6.8% -5.2% -1.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.4% -5.2% +1.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -3.6% -3.8% +0.2% +10.0% ➖ noise
17 duckdb:duckdb -4.8% -3.8% -1.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.7% -3.8% +1.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.8% -1.7% -3.2% +10.0% ➖ noise
18 duckdb:duckdb -5.3% -1.7% -3.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -1.7% +0.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +12.7% -2.9% +16.1% +27.1% ➖ noise
19 duckdb:duckdb -1.3% -2.9% +1.6% +15.8% ➖ noise
19 duckdb:vortex-file-compressed -3.9% -2.9% -1.0% +17.4% ➖ noise
20 datafusion:vortex-file-compressed -2.2% -1.6% -0.6% +206.5% ➖ noise
20 duckdb:duckdb -8.1% -1.6% -6.6% +25.4% ➖ noise
20 duckdb:vortex-file-compressed -6.1% -1.6% -4.6% +56.7% ➖ noise
21 datafusion:vortex-file-compressed -4.7% -4.3% -0.4% +10.0% ➖ noise
21 duckdb:duckdb -2.7% -4.3% +1.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -2.1% -4.3% +2.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -6.2% -4.0% -2.3% +13.8% ➖ noise
22 duckdb:duckdb -6.0% -4.0% -2.1% +12.4% ➖ noise
22 duckdb:vortex-file-compressed -16.5% -4.0% -13.0% +21.4% ➖ noise
23 datafusion:vortex-file-compressed -9.0% -4.7% -4.6% +54.1% ➖ noise
23 duckdb:duckdb -8.0% -4.7% -3.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -56.8% -4.7% -54.7% +35.4% ✅ faster
24 datafusion:vortex-file-compressed -7.9% -1.2% -6.8% +10.4% ➖ noise
24 duckdb:duckdb -9.9% -1.2% -8.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -4.3% -1.2% -3.2% +18.3% ➖ noise
25 datafusion:vortex-file-compressed +0.0% -3.2% +3.3% +10.0% ➖ noise
25 duckdb:duckdb -10.3% -3.2% -7.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.6% -3.2% +0.6% +10.9% ➖ noise
26 datafusion:vortex-file-compressed -2.6% -2.7% +0.2% +11.0% ➖ noise
26 duckdb:duckdb -7.4% -2.7% -4.8% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -9.0% -2.7% -6.5% +32.2% ➖ noise
27 datafusion:vortex-file-compressed -0.5% -2.9% +2.4% +10.0% ➖ noise
27 duckdb:duckdb +1.8% -2.9% +4.8% +14.8% ➖ noise
27 duckdb:vortex-file-compressed -2.5% -2.9% +0.4% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -2.2% -0.2% -2.0% +10.0% ➖ noise
28 duckdb:duckdb -1.6% -0.2% -1.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.0% -0.2% -0.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.4% -6.3% +6.3% +10.0% ➖ noise
29 duckdb:duckdb -2.6% -6.3% +3.9% +10.4% ➖ noise
29 duckdb:vortex-file-compressed -7.1% -6.3% -0.9% +30.4% ➖ noise
30 datafusion:vortex-file-compressed -1.6% -3.0% +1.4% +10.0% ➖ noise
30 duckdb:duckdb -2.3% -3.0% +0.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -2.5% -3.0% +0.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.8% -1.6% +2.4% +10.0% ➖ noise
31 duckdb:duckdb -13.3% -1.6% -11.9% +11.2% ✅ faster
31 duckdb:vortex-file-compressed -3.6% -1.6% -2.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -0.9% -4.1% +3.3% +10.0% ➖ noise
32 duckdb:duckdb -14.3% -4.1% -10.6% +10.0% ✅ faster
32 duckdb:vortex-file-compressed +0.2% -4.1% +4.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.2% -5.1% +5.2% +10.0% ➖ noise
33 duckdb:duckdb -5.2% -5.1% -0.1% +10.4% ➖ noise
33 duckdb:vortex-file-compressed +2.5% -5.1% +8.0% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.5% -4.7% +6.5% +10.0% ➖ noise
34 duckdb:duckdb -5.9% -4.7% -1.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.3% -4.7% +3.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.0% -2.9% +2.0% +10.0% ➖ noise
35 duckdb:duckdb -4.4% -2.9% -1.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.4% -2.9% +2.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.4% -8.9% +11.3% +10.0% 🚨 regression
36 duckdb:duckdb -6.2% -8.9% +3.0% +12.4% ➖ noise
36 duckdb:vortex-file-compressed +2.3% -8.9% +12.2% +13.9% ➖ noise
37 datafusion:vortex-file-compressed -4.2% +1.1% -5.2% +10.0% ➖ noise
37 duckdb:duckdb -4.5% +1.1% -5.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +13.9% +1.1% +12.6% +12.5% 🚨 regression
38 datafusion:vortex-file-compressed -4.1% -3.6% -0.4% +11.1% ➖ noise
38 duckdb:duckdb -6.6% -3.6% -3.1% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +7.8% -3.6% +11.9% +10.9% 🚨 regression
39 datafusion:vortex-file-compressed +0.1% -5.3% +5.7% +10.2% ➖ noise
39 duckdb:duckdb -5.4% -5.3% -0.0% +12.7% ➖ noise
39 duckdb:vortex-file-compressed -4.4% -5.3% +0.9% +16.1% ➖ noise
40 datafusion:vortex-file-compressed -0.4% -0.2% -0.2% +11.0% ➖ noise
40 duckdb:duckdb -4.0% -0.2% -3.8% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +5.7% -0.2% +6.0% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -4.5% -2.7% -1.9% +10.0% ➖ noise
41 duckdb:duckdb -3.7% -2.7% -1.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +3.6% -2.7% +6.5% +10.8% ➖ noise
42 datafusion:vortex-file-compressed -0.6% +5.7% -6.0% +10.0% ➖ noise
42 duckdb:duckdb -3.4% +5.7% -8.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +9.1% +5.7% +3.2% +12.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

File Sizes: Clickbench on NVME

File Size Changes (110 files changed, +0.0% overall, 98↑ 12↓)
File Scale Format Base HEAD Change %
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 74.22 MB +42.85 KB +0.1%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 80.31 MB +42.31 KB +0.1%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 81.45 MB +41.89 KB +0.1%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 135.21 MB +67.91 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 238.15 MB +110.71 KB +0.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 123.26 MB +55.98 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 305.84 MB +133.78 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 221.78 MB +96.56 KB +0.0%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 125.39 MB +52.33 KB +0.0%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 98.29 MB +39.95 KB +0.0%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 300.61 MB +121.43 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 140.10 MB +55.80 KB +0.0%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 243.74 MB +96.20 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 298.90 MB +117.69 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 181.23 MB +69.05 KB +0.0%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 145.53 MB +55.14 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 219.04 MB +80.30 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 97.58 MB +35.73 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 147.66 MB +53.31 KB +0.0%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 104.42 MB +37.58 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 193.18 MB +68.40 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 103.67 MB +36.67 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 124.28 MB +42.47 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 126.45 MB +43.16 KB +0.0%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 121.23 MB +41.26 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 158.43 MB +53.65 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 77.14 MB +25.38 KB +0.0%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 122.81 MB +40.31 KB +0.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 120.82 MB +39.56 KB +0.0%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.70 MB +28.88 KB +0.0%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 241.53 MB +74.58 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 144.09 MB +44.10 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 95.30 MB +28.60 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 124.25 MB +36.23 KB +0.0%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.98 MB +18.34 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 118.46 MB +34.23 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 138.84 MB +39.93 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 67.55 MB +19.21 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 143.03 MB +39.06 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 196.52 MB +53.61 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 185.17 MB +50.42 KB +0.0%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 137.37 MB +36.64 KB +0.0%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 131.00 MB +34.86 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.89 MB +32.48 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 115.17 MB +30.32 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 180.80 MB +47.02 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 121.87 MB +30.96 KB +0.0%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.89 MB +31.21 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 112.20 MB +27.82 KB +0.0%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.85 MB +30.66 KB +0.0%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 172.21 MB +42.20 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 126.58 MB +30.73 KB +0.0%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.77 MB +19.37 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 122.67 MB +28.68 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 114.36 MB +26.55 KB +0.0%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 158.91 MB +36.59 KB +0.0%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 204.21 MB +46.90 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 104.02 MB +23.19 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 107.68 MB +23.91 KB +0.0%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 148.39 MB +32.32 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 138.89 MB +29.66 KB +0.0%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 131.86 MB +28.04 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 116.26 MB +24.41 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.80 MB +23.72 KB +0.0%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.64 MB +16.24 KB +0.0%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 96.29 MB +19.17 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 150.58 MB +29.83 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 111.70 MB +21.66 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 105.36 MB +19.65 KB +0.0%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 137.03 MB +24.59 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 101.30 MB +18.16 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 80.33 MB +13.93 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 82.12 MB +13.83 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 103.73 MB +17.32 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.89 MB +59.45 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 106.38 MB +16.73 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 126.08 MB +19.38 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 145.07 MB +21.16 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 204.15 MB +29.65 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 152.14 MB +20.41 KB +0.0%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 94.07 MB +12.46 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 87.60 MB +11.56 KB +0.0%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 97.02 MB +12.41 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 163.78 MB +20.88 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 114.45 MB +14.21 KB +0.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 81.18 MB +9.48 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 96.08 MB +10.96 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 251.58 MB +27.64 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 80.37 MB +7.27 KB +0.0%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 265.96 MB +23.07 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 79.71 MB +6.79 KB +0.0%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 266.03 MB +21.37 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 255.26 MB +19.14 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 167.56 MB +10.36 KB +0.0%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 174.62 MB +8.37 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 238.60 MB +7.12 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 65.48 MB +1.65 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 428.84 MB +5.41 KB +0.0%
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.78 MB 80 B -0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB 80 B -0.0%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.11 MB 64 B -0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB 176 B -0.0%
hits_13.vortex 1.0 vortex-compact 67.96 MB 67.96 MB 80 B -0.0%
hits_8.vortex 1.0 vortex-compact 62.89 MB 62.89 MB 80 B -0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB 80 B -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.86 MB 128 B -0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.99 MB 1008 B -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.53 MB 448 B -0.0%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.64 MB 16.16 KB -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.930x ➖
Parquet (geomean): 0.948x ➖
Shifts: Parquet (control) -5.2% · Median polish -4.9%


datafusion / vortex-file-compressed (0.883x ➖, 4↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 252288712 270197057 0.93
tpch_q02/datafusion:vortex-file-compressed 468597845 484137379 0.97
tpch_q03/datafusion:vortex-file-compressed 437820197 482545035 0.91
tpch_q04/datafusion:vortex-file-compressed 242857827 328185182 0.74
tpch_q05/datafusion:vortex-file-compressed 468530790 538341283 0.87
tpch_q06/datafusion:vortex-file-compressed 333655281 456952841 0.73
tpch_q07/datafusion:vortex-file-compressed 🚀 440521285 646676475 0.68
tpch_q08/datafusion:vortex-file-compressed 🚀 602661017 988647871 0.61
tpch_q09/datafusion:vortex-file-compressed 🚀 355831943 834998319 0.43
tpch_q10/datafusion:vortex-file-compressed 🚀 478506080 687054741 0.70
tpch_q11/datafusion:vortex-file-compressed 286648478 351265325 0.82
tpch_q12/datafusion:vortex-file-compressed 477690370 449778714 1.06
tpch_q13/datafusion:vortex-file-compressed 🚨 211385279 146960586 1.44
tpch_q14/datafusion:vortex-file-compressed 267931163 348950531 0.77
tpch_q15/datafusion:vortex-file-compressed 540261554 533477886 1.01
tpch_q16/datafusion:vortex-file-compressed 178464613 244506735 0.73
tpch_q17/datafusion:vortex-file-compressed 428555360 414986566 1.03
tpch_q18/datafusion:vortex-file-compressed 386331867 367482391 1.05
tpch_q19/datafusion:vortex-file-compressed 525119174 531458476 0.99
tpch_q20/datafusion:vortex-file-compressed 518274894 441361755 1.17
tpch_q21/datafusion:vortex-file-compressed 601108822 632704719 0.95
tpch_q22/datafusion:vortex-file-compressed 🚨 236952461 146871204 1.61
datafusion / vortex-compact (0.930x ➖, 0↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 253075244 265204429 0.95
tpch_q02/datafusion:vortex-compact 417675859 457015440 0.91
tpch_q03/datafusion:vortex-compact 391240912 364550789 1.07
tpch_q04/datafusion:vortex-compact 208359390 230899907 0.90
tpch_q05/datafusion:vortex-compact 356668644 392056475 0.91
tpch_q06/datafusion:vortex-compact 332245058 343811899 0.97
tpch_q07/datafusion:vortex-compact 360237558 402177712 0.90
tpch_q08/datafusion:vortex-compact 492580677 608741339 0.81
tpch_q09/datafusion:vortex-compact 389473222 464517494 0.84
tpch_q10/datafusion:vortex-compact 426416562 565884504 0.75
tpch_q11/datafusion:vortex-compact 246038346 269313722 0.91
tpch_q12/datafusion:vortex-compact 413574597 490271037 0.84
tpch_q13/datafusion:vortex-compact 117028869 125485112 0.93
tpch_q14/datafusion:vortex-compact 248703898 315418036 0.79
tpch_q15/datafusion:vortex-compact 445299683 465086560 0.96
tpch_q16/datafusion:vortex-compact 177422507 203411012 0.87
tpch_q17/datafusion:vortex-compact 333100710 372870679 0.89
tpch_q18/datafusion:vortex-compact 285580908 317189440 0.90
tpch_q19/datafusion:vortex-compact 447512468 607832498 0.74
tpch_q20/datafusion:vortex-compact 🚨 735093582 458657586 1.60
tpch_q21/datafusion:vortex-compact 🚨 777150980 545315806 1.43
tpch_q22/datafusion:vortex-compact 144248712 154267488 0.94
datafusion / parquet (0.932x ➖, 2↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 228902039 280606788 0.82
tpch_q02/datafusion:parquet 493029290 592315737 0.83
tpch_q03/datafusion:parquet 323142295 327315438 0.99
tpch_q04/datafusion:parquet 182904696 204565997 0.89
tpch_q05/datafusion:parquet 553561257 479281333 1.15
tpch_q06/datafusion:parquet 168845200 139363699 1.21
tpch_q07/datafusion:parquet 495424916 500826043 0.99
tpch_q08/datafusion:parquet 656120982 596986922 1.10
tpch_q09/datafusion:parquet 540818599 453076355 1.19
tpch_q10/datafusion:parquet 540972707 570727550 0.95
tpch_q11/datafusion:parquet 346112897 367522030 0.94
tpch_q12/datafusion:parquet 235946483 260619491 0.91
tpch_q13/datafusion:parquet 426509097 445782442 0.96
tpch_q14/datafusion:parquet 170142331 191327092 0.89
tpch_q15/datafusion:parquet 349107361 338378047 1.03
tpch_q16/datafusion:parquet 204345222 184337629 1.11
tpch_q17/datafusion:parquet 377697954 461290529 0.82
tpch_q18/datafusion:parquet 473094080 456904698 1.04
tpch_q19/datafusion:parquet 367789163 413831326 0.89
tpch_q20/datafusion:parquet 🚀 347603273 503809071 0.69
tpch_q21/datafusion:parquet 🚀 504735439 755787836 0.67
tpch_q22/datafusion:parquet 103435590 145530628 0.71
duckdb / vortex-file-compressed (0.946x ➖, 1↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 259878527 262446291 0.99
tpch_q02/duckdb:vortex-file-compressed 984503666 965349369 1.02
tpch_q03/duckdb:vortex-file-compressed 648768209 671375900 0.97
tpch_q04/duckdb:vortex-file-compressed 398067812 404461279 0.98
tpch_q05/duckdb:vortex-file-compressed 888470216 918991891 0.97
tpch_q06/duckdb:vortex-file-compressed 🚀 326907575 469349869 0.70
tpch_q07/duckdb:vortex-file-compressed 787229646 878163841 0.90
tpch_q08/duckdb:vortex-file-compressed 994117264 975547976 1.02
tpch_q09/duckdb:vortex-file-compressed 899027968 927790222 0.97
tpch_q10/duckdb:vortex-file-compressed 739315094 760609395 0.97
tpch_q11/duckdb:vortex-file-compressed 496901747 494744151 1.00
tpch_q12/duckdb:vortex-file-compressed 467181359 517406730 0.90
tpch_q13/duckdb:vortex-file-compressed 449850448 457459244 0.98
tpch_q14/duckdb:vortex-file-compressed 515748796 568103387 0.91
tpch_q15/duckdb:vortex-file-compressed 274643160 285694654 0.96
tpch_q16/duckdb:vortex-file-compressed 359041437 388419614 0.92
tpch_q17/duckdb:vortex-file-compressed 679434335 700532102 0.97
tpch_q18/duckdb:vortex-file-compressed 522229819 569943700 0.92
tpch_q19/duckdb:vortex-file-compressed 456583960 428666886 1.07
tpch_q20/duckdb:vortex-file-compressed 796015238 825610276 0.96
tpch_q21/duckdb:vortex-file-compressed 1059244963 1173793370 0.90
tpch_q22/duckdb:vortex-file-compressed 345691951 388914260 0.89
duckdb / vortex-compact (0.961x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 261418026 284538585 0.92
tpch_q02/duckdb:vortex-compact 938015810 942243792 1.00
tpch_q03/duckdb:vortex-compact 657553020 626534457 1.05
tpch_q04/duckdb:vortex-compact 378800545 372006511 1.02
tpch_q05/duckdb:vortex-compact 850597337 902932374 0.94
tpch_q06/duckdb:vortex-compact 377941459 400883428 0.94
tpch_q07/duckdb:vortex-compact 784934726 892824977 0.88
tpch_q08/duckdb:vortex-compact 927621045 938557195 0.99
tpch_q09/duckdb:vortex-compact 887361035 871051812 1.02
tpch_q10/duckdb:vortex-compact 690790084 716833638 0.96
tpch_q11/duckdb:vortex-compact 512097954 507606198 1.01
tpch_q12/duckdb:vortex-compact 486337438 482928574 1.01
tpch_q13/duckdb:vortex-compact 459774089 479271113 0.96
tpch_q14/duckdb:vortex-compact 459489774 521284353 0.88
tpch_q15/duckdb:vortex-compact 302936027 290763429 1.04
tpch_q16/duckdb:vortex-compact 362848431 379783806 0.96
tpch_q17/duckdb:vortex-compact 626177295 628186237 1.00
tpch_q18/duckdb:vortex-compact 458318195 522710722 0.88
tpch_q19/duckdb:vortex-compact 408078753 461523199 0.88
tpch_q20/duckdb:vortex-compact 739919676 759503476 0.97
tpch_q21/duckdb:vortex-compact 951898890 1015388090 0.94
tpch_q22/duckdb:vortex-compact 329937092 354190872 0.93
duckdb / parquet (0.965x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 412077700 473424112 0.87
tpch_q02/duckdb:parquet 1224137161 1226253673 1.00
tpch_q03/duckdb:parquet 954691263 1073547351 0.89
tpch_q04/duckdb:parquet 594962703 635185114 0.94
tpch_q05/duckdb:parquet 1551094573 1572310371 0.99
tpch_q06/duckdb:parquet 444143230 423418044 1.05
tpch_q07/duckdb:parquet 1254329953 1330686907 0.94
tpch_q08/duckdb:parquet 1587635641 1792460898 0.89
tpch_q09/duckdb:parquet 1437700524 1427084736 1.01
tpch_q10/duckdb:parquet 1290259688 1322359983 0.98
tpch_q11/duckdb:parquet 849162672 898607787 0.94
tpch_q12/duckdb:parquet 647257099 667029672 0.97
tpch_q13/duckdb:parquet 894491417 909942123 0.98
tpch_q14/duckdb:parquet 668243987 692490592 0.96
tpch_q15/duckdb:parquet 532403235 571590393 0.93
tpch_q16/duckdb:parquet 666225786 628463912 1.06
tpch_q17/duckdb:parquet 779270958 821323074 0.95
tpch_q18/duckdb:parquet 820410647 814542698 1.01
tpch_q19/duckdb:parquet 788264725 833024199 0.95
tpch_q20/duckdb:parquet 1084658526 1097436147 0.99
tpch_q21/duckdb:parquet 1148449477 1163372432 0.99
tpch_q22/duckdb:parquet 551459541 562907634 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.6% -15.7% +13.2% +83.9% ➖ noise
1 datafusion:vortex-file-compressed -6.6% -15.7% +10.8% +73.8% ➖ noise
1 duckdb:vortex-compact -8.1% -15.7% +9.0% +57.9% ➖ noise
1 duckdb:vortex-file-compressed -1.0% -15.7% +17.5% +43.0% ➖ noise
2 datafusion:vortex-compact -8.6% -8.8% +0.3% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -3.2% -8.8% +6.2% +30.0% ➖ noise
2 duckdb:vortex-compact -0.4% -8.8% +9.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +2.0% -8.8% +11.9% +30.0% ➖ noise
3 datafusion:vortex-compact +7.3% -6.3% +14.5% +46.8% ➖ noise
3 datafusion:vortex-file-compressed -9.3% -6.3% -3.2% +57.4% ➖ noise
3 duckdb:vortex-compact +5.0% -6.3% +12.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -3.4% -6.3% +3.1% +31.3% ➖ noise
4 datafusion:vortex-compact -9.8% -8.5% -1.4% +36.5% ➖ noise
4 datafusion:vortex-file-compressed -26.0% -8.5% -19.1% +33.9% ➖ noise
4 duckdb:vortex-compact +1.8% -8.5% +11.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -1.6% -8.5% +7.5% +30.0% ➖ noise
5 datafusion:vortex-compact -9.0% +6.7% -14.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -13.0% +6.7% -18.5% +30.0% ➖ noise
5 duckdb:vortex-compact -5.8% +6.7% -11.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.3% +6.7% -9.4% +30.0% ➖ noise
6 datafusion:vortex-compact -3.4% +12.7% -14.3% +33.6% ➖ noise
6 datafusion:vortex-file-compressed -27.0% +12.7% -35.2% +37.9% ✅ faster
6 duckdb:vortex-compact -5.7% +12.7% -16.4% +33.6% ➖ noise
6 duckdb:vortex-file-compressed -30.3% +12.7% -38.2% +34.5% ✅ faster
7 datafusion:vortex-compact -10.4% -3.4% -7.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -31.9% -3.4% -29.5% +30.0% ✅ faster
7 duckdb:vortex-compact -12.1% -3.4% -9.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -10.4% -3.4% -7.2% +30.0% ➖ noise
8 datafusion:vortex-compact -19.1% -1.3% -18.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -39.0% -1.3% -38.2% +36.3% ✅ faster
8 duckdb:vortex-compact -1.2% -1.3% +0.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +1.9% -1.3% +3.3% +30.0% ➖ noise
9 datafusion:vortex-compact -16.2% +9.7% -23.5% +30.0% ✅ faster
9 datafusion:vortex-file-compressed -57.4% +9.7% -61.1% +30.0% ✅ faster
9 duckdb:vortex-compact +1.9% +9.7% -7.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -3.1% +9.7% -11.6% +30.0% ➖ noise
10 datafusion:vortex-compact -24.6% -3.8% -21.6% +30.9% ➖ noise
10 datafusion:vortex-file-compressed -30.4% -3.8% -27.6% +30.0% ✅ faster
10 duckdb:vortex-compact -3.6% -3.8% +0.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -2.8% -3.8% +1.1% +37.0% ➖ noise
11 datafusion:vortex-compact -8.6% -5.7% -3.2% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -18.4% -5.7% -13.5% +31.8% ➖ noise
11 duckdb:vortex-compact +0.9% -5.7% +6.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +0.4% -5.7% +6.5% +30.0% ➖ noise
12 datafusion:vortex-compact -15.6% -6.3% -10.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +6.2% -6.3% +13.3% +30.0% ➖ noise
12 duckdb:vortex-compact +0.7% -6.3% +7.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -9.7% -6.3% -3.7% +30.0% ➖ noise
13 datafusion:vortex-compact -6.7% -3.0% -3.8% +47.4% ➖ noise
13 datafusion:vortex-file-compressed +43.8% -3.0% +48.3% +36.5% 🚨 regression
13 duckdb:vortex-compact -4.1% -3.0% -1.1% +30.1% ➖ noise
13 duckdb:vortex-file-compressed -1.7% -3.0% +1.4% +30.6% ➖ noise
14 datafusion:vortex-compact -21.2% -7.4% -14.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -23.2% -7.4% -17.1% +30.0% ➖ noise
14 duckdb:vortex-compact -11.9% -7.4% -4.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -9.2% -7.4% -2.0% +37.3% ➖ noise
15 datafusion:vortex-compact -4.3% -2.0% -2.3% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +1.3% -2.0% +3.3% +30.0% ➖ noise
15 duckdb:vortex-compact +4.2% -2.0% +6.3% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -3.9% -2.0% -1.9% +31.7% ➖ noise
16 datafusion:vortex-compact -12.8% +8.4% -19.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -27.0% +8.4% -32.7% +30.0% ✅ faster
16 duckdb:vortex-compact -4.5% +8.4% -11.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -7.6% +8.4% -14.7% +30.0% ➖ noise
17 datafusion:vortex-compact -10.7% -11.9% +1.4% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +3.3% -11.9% +17.2% +30.0% ➖ noise
17 duckdb:vortex-compact -0.3% -11.9% +13.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -3.0% -11.9% +10.0% +30.0% ➖ noise
18 datafusion:vortex-compact -10.0% +2.1% -11.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +5.1% +2.1% +2.9% +30.0% ➖ noise
18 duckdb:vortex-compact -12.3% +2.1% -14.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -8.4% +2.1% -10.3% +30.0% ➖ noise
19 datafusion:vortex-compact -26.4% -8.3% -19.7% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -1.2% -8.3% +7.7% +30.0% ➖ noise
19 duckdb:vortex-compact -11.6% -8.3% -3.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +6.5% -8.3% +16.1% +30.0% ➖ noise
20 datafusion:vortex-compact +60.3% -17.4% +94.1% +30.0% 🚨 regression
20 datafusion:vortex-file-compressed +17.4% -17.4% +42.2% +30.0% 🚨 regression
20 duckdb:vortex-compact -2.6% -17.4% +18.0% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -3.6% -17.4% +16.8% +30.0% ➖ noise
21 datafusion:vortex-compact +42.5% -18.8% +75.5% +35.7% 🚨 regression
21 datafusion:vortex-file-compressed -5.0% -18.8% +17.0% +30.0% ➖ noise
21 duckdb:vortex-compact -6.3% -18.8% +15.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -9.8% -18.8% +11.1% +30.0% ➖ noise
22 datafusion:vortex-compact -6.5% -16.6% +12.1% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +61.3% -16.6% +93.3% +30.0% 🚨 regression
22 duckdb:vortex-compact -6.8% -16.6% +11.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -11.1% -16.6% +6.5% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: Compression

Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.998x ➖


unknown / unknown (0.997x ➖, 0↑ 2↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
compress time/Arade 1121326057 1135259905 0.99
compress time/Bimbo 6490429081 6749532528 0.96
compress time/CMSprovider 2866586505 2867976990 1.00
compress time/Euro2016 416604350 432559849 0.96
compress time/Food 371207434 371141674 1.00
compress time/HashTags 806368939 823627248 0.98
compress time/TPC-H l_comment canonical 1293820542 1316254717 0.98
compress time/TPC-H l_comment chunked 1283657952 1322223003 0.97
compress time/taxi 699366827 720125427 0.97
compress time/wide table cols=100 chunks=1 rows=1000 🚨 12425244 11004121 1.13
compress time/wide table cols=100 chunks=50 rows=1000 11708365 11559238 1.01
compress time/wide table cols=1000 chunks=1 rows=1000 125520093 129210307 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 126024606 126696442 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1396701446 1385082007 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1405314282 1432374640 0.98
decompress time/Arade 27447819 27331498 1.00
decompress time/Bimbo 94187909 92879897 1.01
decompress time/CMSprovider 84285159 81223869 1.04
decompress time/Euro2016 17501004 19188760 0.91
decompress time/Food 8805578 9407333 0.94
decompress time/HashTags 70930240 69435076 1.02
decompress time/TPC-H l_comment canonical 39423085 39558258 1.00
decompress time/TPC-H l_comment chunked 40211700 39626546 1.01
decompress time/taxi 15896583 16423506 0.97
decompress time/wide table cols=100 chunks=1 rows=1000 2368321 2495708 0.95
decompress time/wide table cols=100 chunks=50 rows=1000 2490501 2566969 0.97
decompress time/wide table cols=1000 chunks=1 rows=1000 23320364 22832315 1.02
decompress time/wide table cols=1000 chunks=50 rows=1000 23449396 22889748 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 248107869 246308363 1.01
decompress time/wide table cols=10000 chunks=50 rows=1000 250746115 243113311 1.03
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2907443482 2948314245 0.99
parquet_rs-zstd compress time/Bimbo 14516437514 15170580858 0.96
parquet_rs-zstd compress time/CMSprovider 7621194650 7545257989 1.01
parquet_rs-zstd compress time/Euro2016 1340735840 1361837922 0.98
parquet_rs-zstd compress time/Food 862880038 872807757 0.99
parquet_rs-zstd compress time/HashTags 2260618981 2307466014 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3063624236 3119689903 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3036290148 3096191052 0.98
parquet_rs-zstd compress time/taxi 1352885503 1379794264 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6718208 6740033 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6883313 6718017 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 81082611 80784499 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 81562282 80847563 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 868487912 864308213 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 875504451 879668801 1.00
parquet_rs-zstd decompress time/Arade 640784374 634266385 1.01
parquet_rs-zstd decompress time/Bimbo 1708047997 1731323710 0.99
parquet_rs-zstd decompress time/CMSprovider 1914078491 1925165943 0.99
parquet_rs-zstd decompress time/Euro2016 382077133 383375089 1.00
parquet_rs-zstd decompress time/Food 215528155 216582475 1.00
parquet_rs-zstd decompress time/HashTags 611378660 622153016 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 569222191 558174481 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 566174581 558576208 1.01
parquet_rs-zstd decompress time/taxi 244878008 247221951 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2842431 2743707 1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2807133 2720914 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32137074 30922050 1.04
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32282936 31510292 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 348589349 348222072 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 345556382 340661379 1.01
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417932116 417907812 1.00
vortex-file-compressed size/Euro2016 163486340 163599156 1.00
vortex-file-compressed size/Food 41927160 41926936 1.00
vortex-file-compressed size/HashTags 197634140 195647828 1.01
vortex-file-compressed size/TPC-H l_comment canonical 179087304 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087304 179087360 1.00
vortex-file-compressed size/taxi 52363996 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 1 1 1.13
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.99
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.92
vortex:parquet-zstd ratio decompress time/Food 0 0 0.94
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.92
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.01
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 23, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.5%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish +0.7%


datafusion / vortex-file-compressed (1.002x ➖, 0↑ 1↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 714182706 678700793 1.05
tpch_q02/datafusion:vortex-file-compressed 808033497 791783282 1.02
tpch_q03/datafusion:vortex-file-compressed 801768660 976892282 0.82
tpch_q04/datafusion:vortex-file-compressed 599299263 712180329 0.84
tpch_q05/datafusion:vortex-file-compressed 1056195234 996743373 1.06
tpch_q06/datafusion:vortex-file-compressed 714699724 631384718 1.13
tpch_q07/datafusion:vortex-file-compressed 1117748950 1058229424 1.06
tpch_q08/datafusion:vortex-file-compressed 1471356154 1259738491 1.17
tpch_q09/datafusion:vortex-file-compressed 1492968806 1324243117 1.13
tpch_q10/datafusion:vortex-file-compressed 1013116883 1012449991 1.00
tpch_q11/datafusion:vortex-file-compressed 482957613 502391113 0.96
tpch_q12/datafusion:vortex-file-compressed 🚨 1648541545 942448137 1.75
tpch_q13/datafusion:vortex-file-compressed 539034779 439095282 1.23
tpch_q14/datafusion:vortex-file-compressed 635058921 730213053 0.87
tpch_q15/datafusion:vortex-file-compressed 1098087284 1236042996 0.89
tpch_q16/datafusion:vortex-file-compressed 406654228 453351582 0.90
tpch_q17/datafusion:vortex-file-compressed 1125415336 1244217304 0.90
tpch_q18/datafusion:vortex-file-compressed 1188965102 1529869934 0.78
tpch_q19/datafusion:vortex-file-compressed 754061493 855077411 0.88
tpch_q20/datafusion:vortex-file-compressed 972329957 992060828 0.98
tpch_q21/datafusion:vortex-file-compressed 1574929903 1734247298 0.91
tpch_q22/datafusion:vortex-file-compressed 390019584 364071749 1.07
datafusion / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 685286454 728496041 0.94
tpch_q02/datafusion:vortex-compact 625550846 660586913 0.95
tpch_q03/datafusion:vortex-compact 767605388 828438165 0.93
tpch_q04/datafusion:vortex-compact 708650135 738045326 0.96
tpch_q05/datafusion:vortex-compact 1106562540 984260116 1.12
tpch_q06/datafusion:vortex-compact 893894779 698977008 1.28
tpch_q07/datafusion:vortex-compact 1169645492 1101857917 1.06
tpch_q08/datafusion:vortex-compact 1148025492 1093619882 1.05
tpch_q09/datafusion:vortex-compact 1198825409 1244408615 0.96
tpch_q10/datafusion:vortex-compact 966692524 868861653 1.11
tpch_q11/datafusion:vortex-compact 387945842 408191090 0.95
tpch_q12/datafusion:vortex-compact 748650723 885185068 0.85
tpch_q13/datafusion:vortex-compact 411033128 416836212 0.99
tpch_q14/datafusion:vortex-compact 583157079 643249583 0.91
tpch_q15/datafusion:vortex-compact 1076150470 1152212584 0.93
tpch_q16/datafusion:vortex-compact 346540980 312761233 1.11
tpch_q17/datafusion:vortex-compact 1148963699 1226434746 0.94
tpch_q18/datafusion:vortex-compact 1078842493 1192768942 0.90
tpch_q19/datafusion:vortex-compact 784133177 780546094 1.00
tpch_q20/datafusion:vortex-compact 862649367 886503197 0.97
tpch_q21/datafusion:vortex-compact 1656694277 1404202113 1.18
tpch_q22/datafusion:vortex-compact 401989865 393505538 1.02
datafusion / parquet (0.938x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 654168052 726537339 0.90
tpch_q02/datafusion:parquet 661527435 877176800 0.75
tpch_q03/datafusion:parquet 889825745 1048164389 0.85
tpch_q04/datafusion:parquet 629951958 607117509 1.04
tpch_q05/datafusion:parquet 1445096649 1311878919 1.10
tpch_q06/datafusion:parquet 527474711 517561093 1.02
tpch_q07/datafusion:parquet 1250484808 1785836631 0.70
tpch_q08/datafusion:parquet 1590960229 1938375810 0.82
tpch_q09/datafusion:parquet 1733116989 2024678318 0.86
tpch_q10/datafusion:parquet 2340725149 2164943464 1.08
tpch_q11/datafusion:parquet 640308339 673291076 0.95
tpch_q12/datafusion:parquet 736356384 812103837 0.91
tpch_q13/datafusion:parquet 749622340 731069188 1.03
tpch_q14/datafusion:parquet 787424462 856933171 0.92
tpch_q15/datafusion:parquet 1179442986 1391659349 0.85
tpch_q16/datafusion:parquet 409606916 444697030 0.92
tpch_q17/datafusion:parquet 1343328791 1393765492 0.96
tpch_q18/datafusion:parquet 1518605769 1469015724 1.03
tpch_q19/datafusion:parquet 995114847 959873804 1.04
tpch_q20/datafusion:parquet 1173886466 1121011275 1.05
tpch_q21/datafusion:parquet 1643538766 1575777519 1.04
tpch_q22/datafusion:parquet 656829972 678888255 0.97
duckdb / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 659955615 775982301 0.85
tpch_q02/duckdb:vortex-file-compressed 1250939237 1184149291 1.06
tpch_q03/duckdb:vortex-file-compressed 995700887 1192261899 0.84
tpch_q04/duckdb:vortex-file-compressed 679084856 787215133 0.86
tpch_q05/duckdb:vortex-file-compressed 1131750729 1152991676 0.98
tpch_q06/duckdb:vortex-file-compressed 799702866 864943755 0.92
tpch_q07/duckdb:vortex-file-compressed 1298330012 1206653338 1.08
tpch_q08/duckdb:vortex-file-compressed 1523494152 1403671955 1.09
tpch_q09/duckdb:vortex-file-compressed 1479753252 1479223648 1.00
tpch_q10/duckdb:vortex-file-compressed 1221639162 1247391236 0.98
tpch_q11/duckdb:vortex-file-compressed 662262623 707957527 0.94
tpch_q12/duckdb:vortex-file-compressed 788890448 765563850 1.03
tpch_q13/duckdb:vortex-file-compressed 1070262274 975424722 1.10
tpch_q14/duckdb:vortex-file-compressed 988586287 881447412 1.12
tpch_q15/duckdb:vortex-file-compressed 582749227 517823389 1.13
tpch_q16/duckdb:vortex-file-compressed 597533856 484734038 1.23
tpch_q17/duckdb:vortex-file-compressed 1024897820 1006776101 1.02
tpch_q18/duckdb:vortex-file-compressed 1019514531 924006184 1.10
tpch_q19/duckdb:vortex-file-compressed 800088042 831328861 0.96
tpch_q20/duckdb:vortex-file-compressed 1294642352 1360219215 0.95
tpch_q21/duckdb:vortex-file-compressed 2091764785 2085299875 1.00
tpch_q22/duckdb:vortex-file-compressed 746768187 694943216 1.07
duckdb / vortex-compact (1.047x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 658654163 601876148 1.09
tpch_q02/duckdb:vortex-compact 1230897310 1015363713 1.21
tpch_q03/duckdb:vortex-compact 931541936 811548976 1.15
tpch_q04/duckdb:vortex-compact 556594281 535349899 1.04
tpch_q05/duckdb:vortex-compact 1084444438 1173129777 0.92
tpch_q06/duckdb:vortex-compact 742321188 738477511 1.01
tpch_q07/duckdb:vortex-compact 1007709288 1076681442 0.94
tpch_q08/duckdb:vortex-compact 1380681916 1424939513 0.97
tpch_q09/duckdb:vortex-compact 1371405389 1426390882 0.96
tpch_q10/duckdb:vortex-compact 1192582520 1062705583 1.12
tpch_q11/duckdb:vortex-compact 727531020 717169825 1.01
tpch_q12/duckdb:vortex-compact 740442020 699064708 1.06
tpch_q13/duckdb:vortex-compact 1007313695 896970978 1.12
tpch_q14/duckdb:vortex-compact 903475886 909785686 0.99
tpch_q15/duckdb:vortex-compact 603262755 554544501 1.09
tpch_q16/duckdb:vortex-compact 489966088 490091901 1.00
tpch_q17/duckdb:vortex-compact 941972545 900902399 1.05
tpch_q18/duckdb:vortex-compact 805344431 714873665 1.13
tpch_q19/duckdb:vortex-compact 813687393 769313092 1.06
tpch_q20/duckdb:vortex-compact 1391532262 1280149862 1.09
tpch_q21/duckdb:vortex-compact 1932527271 1792796192 1.08
tpch_q22/duckdb:vortex-compact 730008816 729209850 1.00
duckdb / parquet (1.045x ➖, 0↑ 0↓)
name PR 94bcb3d (ns) base cc06c60 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 841622663 795377968 1.06
tpch_q02/duckdb:parquet 1441513368 1454818571 0.99
tpch_q03/duckdb:parquet 1680550724 1717536032 0.98
tpch_q04/duckdb:parquet 1221245166 950684461 1.28
tpch_q05/duckdb:parquet 2096717740 2129814679 0.98
tpch_q06/duckdb:parquet 693638507 752548123 0.92
tpch_q07/duckdb:parquet 1772856834 1804488311 0.98
tpch_q08/duckdb:parquet 2376895972 2543689197 0.93
tpch_q09/duckdb:parquet 2586068648 2524107172 1.02
tpch_q10/duckdb:parquet 3159216254 3167166925 1.00
tpch_q11/duckdb:parquet 1143124718 1140940425 1.00
tpch_q12/duckdb:parquet 1251457621 1168750467 1.07
tpch_q13/duckdb:parquet 1601594667 1400448656 1.14
tpch_q14/duckdb:parquet 1290296581 1273344693 1.01
tpch_q15/duckdb:parquet 1052970146 829792118 1.27
tpch_q16/duckdb:parquet 996573724 869076285 1.15
tpch_q17/duckdb:parquet 1385818880 1271978228 1.09
tpch_q18/duckdb:parquet 1499289672 1528799602 0.98
tpch_q19/duckdb:parquet 1752784162 1473673166 1.19
tpch_q20/duckdb:parquet 1884260382 1992025557 0.95
tpch_q21/duckdb:parquet 2034196879 1941884233 1.05
tpch_q22/duckdb:parquet 1109881413 1078795396 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.9% -2.4% -3.6% +46.6% ➖ noise
1 datafusion:vortex-file-compressed +5.2% -2.4% +7.8% +52.8% ➖ noise
1 duckdb:vortex-compact +9.4% -2.4% +12.1% +38.4% ➖ noise
1 duckdb:vortex-file-compressed -15.0% -2.4% -12.9% +30.7% ➖ noise
2 datafusion:vortex-compact -5.3% -13.6% +9.5% +53.0% ➖ noise
2 datafusion:vortex-file-compressed +2.1% -13.6% +18.1% +42.6% ➖ noise
2 duckdb:vortex-compact +21.2% -13.6% +40.2% +31.2% 🚨 regression
2 duckdb:vortex-file-compressed +5.6% -13.6% +22.2% +33.0% ➖ noise
3 datafusion:vortex-compact -7.3% -8.9% +1.7% +44.1% ➖ noise
3 datafusion:vortex-file-compressed -17.9% -8.9% -9.9% +51.8% ➖ noise
3 duckdb:vortex-compact +14.8% -8.9% +25.9% +39.9% ➖ noise
3 duckdb:vortex-file-compressed -16.5% -8.9% -8.4% +37.4% ➖ noise
4 datafusion:vortex-compact -4.0% +15.5% -16.8% +38.8% ➖ noise
4 datafusion:vortex-file-compressed -15.9% +15.5% -27.1% +30.0% ✅ faster
4 duckdb:vortex-compact +4.0% +15.5% -9.9% +46.3% ➖ noise
4 duckdb:vortex-file-compressed -13.7% +15.5% -25.3% +30.4% ✅ faster
5 datafusion:vortex-compact +12.4% +4.1% +8.0% +32.7% ➖ noise
5 datafusion:vortex-file-compressed +6.0% +4.1% +1.8% +30.1% ➖ noise
5 duckdb:vortex-compact -7.6% +4.1% -11.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.8% +4.1% -5.7% +30.0% ➖ noise
6 datafusion:vortex-compact +27.9% -3.1% +31.9% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed +13.2% -3.1% +16.8% +30.0% ➖ noise
6 duckdb:vortex-compact +0.5% -3.1% +3.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -7.5% -3.1% -4.6% +30.0% ➖ noise
7 datafusion:vortex-compact +6.2% -17.1% +28.0% +30.3% ➖ noise
7 datafusion:vortex-file-compressed +5.6% -17.1% +27.3% +30.0% ➖ noise
7 duckdb:vortex-compact -6.4% -17.1% +12.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +7.6% -17.1% +29.7% +30.0% ➖ noise
8 datafusion:vortex-compact +5.0% -12.4% +19.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +16.8% -12.4% +33.4% +30.0% 🚨 regression
8 duckdb:vortex-compact -3.1% -12.4% +10.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +8.5% -12.4% +23.9% +30.0% ➖ noise
9 datafusion:vortex-compact -3.7% -6.4% +2.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +12.7% -6.4% +20.4% +30.0% ➖ noise
9 duckdb:vortex-compact -3.9% -6.4% +2.7% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +0.0% -6.4% +6.8% +30.0% ➖ noise
10 datafusion:vortex-compact +11.3% +3.8% +7.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +0.1% +3.8% -3.6% +30.0% ➖ noise
10 duckdb:vortex-compact +12.2% +3.8% +8.1% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -2.1% +3.8% -5.7% +30.0% ➖ noise
11 datafusion:vortex-compact -5.0% -2.4% -2.6% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -3.9% -2.4% -1.5% +30.0% ➖ noise
11 duckdb:vortex-compact +1.4% -2.4% +3.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -6.5% -2.4% -4.2% +30.4% ➖ noise
12 datafusion:vortex-compact -15.4% -1.5% -14.2% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +74.9% -1.5% +77.5% +53.6% 🚨 regression
12 duckdb:vortex-compact +5.9% -1.5% +7.5% +34.1% ➖ noise
12 duckdb:vortex-file-compressed +3.0% -1.5% +4.6% +30.0% ➖ noise
13 datafusion:vortex-compact -1.4% +8.3% -8.9% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +22.8% +8.3% +13.4% +58.3% ➖ noise
13 duckdb:vortex-compact +12.3% +8.3% +3.7% +37.0% ➖ noise
13 duckdb:vortex-file-compressed +9.7% +8.3% +1.3% +41.5% ➖ noise
14 datafusion:vortex-compact -9.3% -3.5% -6.0% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -13.0% -3.5% -9.9% +59.8% ➖ noise
14 duckdb:vortex-compact -0.7% -3.5% +2.9% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +12.2% -3.5% +16.2% +30.0% ➖ noise
15 datafusion:vortex-compact -6.6% +3.7% -9.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -11.2% +3.7% -14.3% +30.0% ➖ noise
15 duckdb:vortex-compact +8.8% +3.7% +4.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +12.5% +3.7% +8.5% +30.0% ➖ noise
16 datafusion:vortex-compact +10.8% +2.8% +7.8% +30.8% ➖ noise
16 datafusion:vortex-file-compressed -10.3% +2.8% -12.7% +30.0% ➖ noise
16 duckdb:vortex-compact -0.0% +2.8% -2.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +23.3% +2.8% +19.9% +30.0% ➖ noise
17 datafusion:vortex-compact -6.3% +2.5% -8.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -9.5% +2.5% -11.7% +30.0% ➖ noise
17 duckdb:vortex-compact +4.6% +2.5% +2.0% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +1.8% +2.5% -0.7% +30.0% ➖ noise
18 datafusion:vortex-compact -9.6% +0.7% -10.2% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -22.3% +0.7% -22.8% +30.0% ➖ noise
18 duckdb:vortex-compact +12.7% +0.7% +11.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +10.3% +0.7% +9.6% +30.0% ➖ noise
19 datafusion:vortex-compact +0.5% +11.0% -9.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -11.8% +11.0% -20.6% +30.0% ➖ noise
19 duckdb:vortex-compact +5.8% +11.0% -4.8% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -3.8% +11.0% -13.3% +61.3% ➖ noise
20 datafusion:vortex-compact -2.7% -0.5% -2.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -2.0% -0.5% -1.5% +30.0% ➖ noise
20 duckdb:vortex-compact +8.7% -0.5% +9.2% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -4.8% -0.5% -4.4% +30.0% ➖ noise
21 datafusion:vortex-compact +18.0% +4.5% +12.9% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -9.2% +4.5% -13.1% +30.0% ➖ noise
21 duckdb:vortex-compact +7.8% +4.5% +3.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +0.3% +4.5% -4.0% +30.0% ➖ noise
22 datafusion:vortex-compact +2.2% -0.2% +2.4% +35.6% ➖ noise
22 datafusion:vortex-file-compressed +7.1% -0.2% +7.4% +30.0% ➖ noise
22 duckdb:vortex-compact +0.1% -0.2% +0.3% +34.7% ➖ noise
22 duckdb:vortex-file-compressed +7.5% -0.2% +7.7% +30.0% ➖ noise

@connortsui20
Copy link
Copy Markdown
Contributor Author

so compress time definitely improved, but there are regressions in file size. I think I know why (chooses FSST instead of Dict), and I can fix that

@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 23, 2026
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 24, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 24, 2026
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 24, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 24, 2026
@connortsui20
Copy link
Copy Markdown
Contributor Author

so it is quite hard to do this (or at least codex has not been able to find holistically good improvements, so I'm going to close this.

@connortsui20 connortsui20 deleted the ct/fsst-estimate branch April 24, 2026 17:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant