Feature: introduce a high-performance hybrid row-columnar storage engine (4/4)#1044

Merged

jiaqizho merged 86 commits intoapache:mainfrom

jiaqizho:pax-split-380-commit-4

Apr 14, 2025

Commits on Apr 14, 2025

PAX: Support dict encoding
jiaqizho
committed
PAX: support record batch return with dictionary
jiaqizho
committed
Regularly synchronize CBDB and update CI

gfphoenix78
authored and
jiaqizho
committed
PAX: Support parallel-scan

gongxun0928
authored and
jiaqizho
committed
bugfix: tuples loss issue in bitmap index scan

gongxun0928
authored and
jiaqizho
committed
PAX: Refactor memory management to allow thread-safe scan

wuhao
authored and
jiaqizho
committed
PAX: remove the opfamily and build scan will not use the BRINAM
jiaqizho
committed
PAX: Support bloom filter in the statistics
jiaqizho
committed
PAX: Move the logic of checking whether stmt is supported in dfs tablespace to pax

gongxun0928
authored and
jiaqizho
committed
PAX: Support parallel scan pax table by threads for vectorization

yangkaidi
authored and
jiaqizho
committed
PAX: support almost min/max oper
jiaqizho
committed
Regularly synchronize CBDB and update CI

fanfuxiaoran
authored and
jiaqizho
committed
PAX: Support lexical cluster

gongxun0928
authored and
jiaqizho
committed
PAX: support more types for filtering in parallel scan

gfphoenix78
authored and
jiaqizho
committed
Regularly synchronize CBDB and update CI

foreyes
authored and
jiaqizho
committed
PAX: Add icw test in greenplum_schedule for pax table

gongxun0928
authored and
jiaqizho
committed
Fix UFileClose failed, call UFileGetLastError to get error msg will coredump

gongxun0928
authored and
jiaqizho
committed
PAX: Remove the gtest mock `Palloc/Palloc0/Pfree`
jiaqizho
committed
PAX: Fix compile issue that may install bad pax.so

gfphoenix78
authored and
jiaqizho
committed
PAX: disable numeric in bloom filter
jiaqizho
committed
PAX: Support IN expression filter for vector scan

wuhao
authored and
jiaqizho
committed
PAX: move the CBDB_CHECK into MicroPartitionStats::FromValue
jiaqizho
committed
Fix answer files when the collation changes to en_US.utf8

wuhao
authored and
jiaqizho
committed
Fix the icw test failure case of pax under orca optimizer

gongxun0928
authored and
jiaqizho
committed
Fix parallel scan for pax tables

wuhao
authored and
jiaqizho
committed
Remove the function assign_enable_vectorization
jiaqizho
committed
Fix crash when insert large column value and pax_enable_toast is off

gfphoenix78
authored and
jiaqizho
committed
Regularly synchronize CBDB and update CI

gfphoenix78
authored and
jiaqizho
committed
PAX: re-enable install libpaxformat and header
jiaqizho
committed
PAX: support python3 api
jiaqizho
committed
Fix: PAX fast sequence will return the same seq in concurrent case
jiaqizho
committed
Fix: can't insert into pax auxiliary table after blockid more than 32768
jiaqizho
committed
PAX: Fix error that parallel scan ignores toast files

wuhao
authored and
jiaqizho
committed
Fix index scan using bitmap index on paxr #137

gongxun0928
authored and
jiaqizho
committed
PAX: don't detoast unread and short header datum
jiaqizho
committed
Performance/improve pax insert performance

gongxun0928
authored and
jiaqizho
committed
Fix two toast issues that may cause crash

gfphoenix78
authored and
jiaqizho
committed
PAX: new implements of PAX filter
jiaqizho
committed
PAX:Filter support CAST in PG path
jiaqizho
committed
PAX: filter support arithmetic op exprs
jiaqizho
committed
PAX: do the encoding options cache in tablewriter
jiaqizho
committed
Fix: pax reloption without order will cause the statistics no effect.
jiaqizho
committed
PAX: Use unique pointer instead of shared pointer for some cases

gfphoenix78
authored and
jiaqizho
committed
PAX: remove the memalign in non-fixed column
jiaqizho
committed
performance: refactor stats to improve pax writing performance

gongxun0928
authored and
jiaqizho
committed
minor performance improve in data reading

gongxun0928
authored and
jiaqizho
committed
Decouple the parallel-scan code and MicroPartitionMetadata

wuhao
authored and
jiaqizho
committed
Pax/eliminate offsets array when data writing

gongxun0928
authored and
jiaqizho
committed
optimize: refactor OrcGroup::ReadTuple to improve performance

gongxun0928
authored and
jiaqizho
committed
PAX: split unstable filter_tree test case
jiaqizho
committed
Fix: memory leak in VEC path when read the PG Nuemric
jiaqizho
committed
PAX: use the atomic in filter statistics
jiaqizho
committed
Regularly synchronize CBDB and update CI

gongxun0928
authored and
jiaqizho
committed
Support custom smgr for pax

gongxun0928
authored and
jiaqizho
committed
PAX: remove the unaligned(bypass) logic.
jiaqizho
committed
PAX: Add wal log

gongxun0928
authored and
jiaqizho
committed
PAX: Add isolation2 tests in ci

gongxun0928
authored and
jiaqizho
committed
PAX: Fix isolation2 for test files

gfphoenix78
authored and
jiaqizho
committed
PAX: create a per-tablespace subdirectory when redo pax create directory log.

gongxun0928
authored and
jiaqizho
committed
PAX: Add manifest api

gfphoenix78
authored and
jiaqizho
committed
Adapt pax auxiliary table to manifest API

gfphoenix78
authored and
jiaqizho
committed
PAX: Fix nullptr after toast compress failed
jiaqizho
committed
PAXPY: Changed the CmakeLists
jiaqizho
committed
Pax: fix io error in pax table when transaction abort

gongxun0928
authored and
jiaqizho
committed
build: pax supports incremental compilation.

gongxun0928
authored and
jiaqizho
committed
PAX: remove the GUC VECTOR_MAX_BATCH_SIZE_GUC_NAME
jiaqizho
committed
Update vectoried scan interface

gfphoenix78
authored and
jiaqizho
committed
PAX: Remove internal partition support

wuhao
authored and
jiaqizho
committed
Fix the failure case in icw test.

gongxun0928
authored and
jiaqizho
committed
PAX: Fix test cases with or without vectorization

wuhao
authored and
jiaqizho
committed
PAX: Add manifest implementation for catalog

wuhao
authored and
jiaqizho
committed
Add Apache license to pax files

wuhao
authored and
jiaqizho
committed
PAX: change length array to offset array
jiaqizho
committed
PAX: Remove support for RemoteFileSystem

gfphoenix78
authored and
jiaqizho
committed
PAX: fix failture case in isolation2 testcase

gongxun0928
authored and
jiaqizho
committed
PAX: Add doc/* and update README
jiaqizho
committed
PAX: Adapt to the latest access method
jiaqizho
committed
Missing AM function swap_relation_files call
jiaqizho
committed
PAX: Adapt to 32-bit relnode
jiaqizho
committed
FIX: Invalid USE_ASSERT_CHECKING in DeleteWithVisibilityMap
jiaqizho
committed
Adapt PAX regression test to CBDB
jiaqizho
committed
Adapt PAX isolation2 test to CBDB
jiaqizho
committed
PAX: Remove vectorization related tests
jiaqizho
committed
PAX: update submodule
jiaqizho
committed
PAX: Change the default catalog to auxiliary table and enable CI
jiaqizho
committed
PAX: fix icw_test in github CI
jiaqizho
committed