Conversation
Polar Signals Profiling ResultsLatest Run
Previous Runs (4)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 0.939x ➖ datafusion / vortex-file-compressed (0.939x ➖, 1↑ 0↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.052x ➖, 0↑ 3↓)
datafusion / vortex-compact (1.021x ➖, 0↑ 0↓)
datafusion / parquet (1.021x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.992x ➖, 2↑ 1↓)
duckdb / vortex-compact (0.997x ➖, 1↑ 0↓)
duckdb / parquet (1.020x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.084x ➖, 0↑ 7↓)
datafusion / vortex-compact (1.082x ➖, 0↑ 6↓)
datafusion / parquet (1.083x ➖, 0↑ 6↓)
datafusion / arrow (1.165x ❌, 0↑ 17↓)
duckdb / vortex-file-compressed (1.055x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.052x ➖, 0↑ 1↓)
duckdb / parquet (1.032x ➖, 1↑ 2↓)
duckdb / duckdb (1.040x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.113x ❌, 1↑ 58↓)
datafusion / vortex-compact (1.137x ❌, 0↑ 83↓)
datafusion / parquet (1.073x ➖, 0↑ 28↓)
duckdb / vortex-file-compressed (1.089x ➖, 0↑ 40↓)
duckdb / vortex-compact (1.117x ❌, 0↑ 60↓)
duckdb / parquet (1.077x ➖, 0↑ 28↓)
duckdb / duckdb (1.139x ❌, 0↑ 74↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.959x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.973x ➖, 0↑ 0↓)
datafusion / parquet (0.978x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.060x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.041x ➖, 0↑ 0↓)
duckdb / parquet (0.957x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.979x ➖, 0↑ 1↓)
datafusion / parquet (0.982x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.955x ➖, 3↑ 1↓)
duckdb / parquet (0.990x ➖, 1↑ 1↓)
duckdb / duckdb (0.980x ➖, 2↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.981x ➖, 0↑ 0↓)
datafusion / parquet (0.989x ➖, 0↑ 0↓)
datafusion / arrow (0.980x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.978x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.989x ➖, 0↑ 0↓)
duckdb / parquet (0.995x ➖, 0↑ 0↓)
duckdb / duckdb (0.984x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.943x ➖, 1↑ 0↓)
duckdb / vortex-compact (0.986x ➖, 0↑ 0↓)
duckdb / parquet (0.988x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.965x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.857x ➖, 1↑ 0↓)
datafusion / parquet (0.920x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
duckdb / parquet (0.955x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.937x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.969x ➖, 0↑ 0↓)
datafusion / parquet (0.891x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.091x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.085x ➖, 0↑ 0↓)
duckdb / parquet (1.050x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.933x ➖ unknown / unknown (0.959x ➖, 5↑ 0↓)
|
Benchmarks: CompressionVortex (geomean): 1.006x ➖ unknown / unknown (0.994x ➖, 3↑ 3↓)
|
a3e6376 to
c54684f
Compare
c54684f to
32f5e43
Compare
5cb2217 to
b0f2e4a
Compare
8325606 to
696cff3
Compare
Merging this PR will degrade performance by 10.6%
Performance Changes
Comparing Footnotes
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
|
@joseph-isaacs The particularly hacky stuff here is adding partition indices, however, I can't imagine another way to filter files in a stable manner. |
|
nice. let me review this tomorrow and get this over the line. what is the perf results? |
Add file_index, file_row_number virtual columns.
Add file-based filtering (range, selection) to ScanRequest.
Add partition index method (TODO hacky).
Add late materialization support and row id columns support in duckdb.