[WIP] TakeExecute for FilterArray#7393
Conversation
Polar Signals Profiling ResultsLatest Run
Previous Runs (1)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 1.010x ➖ datafusion / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.939x ➖, 1↑ 0↓)
datafusion / parquet (0.961x ➖, 2↑ 1↓)
datafusion / arrow (0.941x ➖, 5↑ 1↓)
duckdb / vortex-file-compressed (0.950x ➖, 1↑ 0↓)
duckdb / vortex-compact (0.951x ➖, 0↑ 0↓)
duckdb / parquet (1.002x ➖, 0↑ 2↓)
duckdb / duckdb (0.975x ➖, 2↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.954x ➖, 3↑ 0↓)
datafusion / vortex-compact (1.015x ➖, 0↑ 0↓)
datafusion / parquet (1.007x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.022x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.022x ➖, 0↑ 0↓)
duckdb / parquet (1.028x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.955x ➖, 14↑ 0↓)
datafusion / vortex-compact (0.973x ➖, 0↑ 0↓)
datafusion / parquet (0.917x ➖, 36↑ 0↓)
duckdb / vortex-file-compressed (0.993x ➖, 1↑ 1↓)
duckdb / vortex-compact (0.993x ➖, 0↑ 2↓)
duckdb / parquet (0.992x ➖, 4↑ 2↓)
duckdb / duckdb (0.960x ➖, 8↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.855x ✅, 21↑ 0↓)
datafusion / vortex-compact (0.923x ➖, 3↑ 0↓)
datafusion / parquet (0.856x ✅, 20↑ 0↓)
datafusion / arrow (0.949x ➖, 5↑ 0↓)
duckdb / vortex-file-compressed (0.932x ➖, 2↑ 0↓)
duckdb / vortex-compact (0.917x ➖, 5↑ 0↓)
duckdb / parquet (0.954x ➖, 1↑ 0↓)
duckdb / duckdb (0.991x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.892x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.963x ➖, 2↑ 0↓)
datafusion / parquet (0.805x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.034x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.059x ➖, 1↑ 1↓)
duckdb / parquet (0.976x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.677x ✅, 13↑ 0↓)
datafusion / vortex-compact (0.871x ➖, 0↑ 0↓)
datafusion / parquet (0.776x ➖, 7↑ 0↓)
duckdb / vortex-file-compressed (0.963x ➖, 1↑ 0↓)
duckdb / vortex-compact (0.965x ➖, 0↑ 0↓)
duckdb / parquet (0.950x ➖, 1↑ 0↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.771x ✅ unknown / unknown (0.850x ✅, 36↑ 1↓)
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
duckdb / parquet (0.949x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.009x ➖, 0↑ 1↓)
datafusion / parquet (1.002x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.022x ➖, 0↑ 2↓)
duckdb / parquet (1.011x ➖, 0↑ 0↓)
duckdb / duckdb (1.039x ➖, 0↑ 5↓)
Full attributed analysis
|
File Sizes: Clickbench on NVMEFile Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
Totals:
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.933x ➖, 1↑ 1↓)
datafusion / vortex-compact (0.918x ➖, 1↑ 0↓)
datafusion / parquet (0.839x ➖, 4↑ 0↓)
duckdb / vortex-file-compressed (0.854x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.875x ➖, 0↑ 0↓)
duckdb / parquet (0.922x ➖, 1↑ 0↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 1.013x ➖ unknown / unknown (1.029x ➖, 0↑ 18↓)
|
|
Random access benchmark changes seem real. I think take on a bitbuffer would always be faster than take on the filtered array that needs to copy values. I will do some refactoring here before this is ready for review |
2a6b29b to
0ba188e
Compare
0ba188e to
7571b7d
Compare
7571b7d to
bbf2662
Compare
bbf2662 to
215f31a
Compare
Signed-off-by: Robert Kruszewski <github@robertk.io>
215f31a to
6261f49
Compare
This seems to be an improvement if the take array is small. Falls over if we are taking too many indices. Needs more investigation before can be integrated
Signed-off-by: Robert Kruszewski github@robertk.io