Feature: introduce a high-performance hybrid row-columnar storage engine (3/4)#1043

Merged

jiaqizho merged 98 commits intoapache:mainfrom

jiaqizho:pax-split-380-commit-3

Apr 14, 2025

Commits on Apr 14, 2025

Add ExecClearTuple before read or fetch index tuple
jiaqizho
committed
Pax: add MicroPartitionWriter merging logic back to optimize performance
jiaqizho
committed
Fix: pax broken gtest and add it into CI
jiaqizho
committed
Feature: pax store the vec-format decimal128
jiaqizho
committed
Fix: pax got nullptr in table writer when exception happen
jiaqizho
committed
bugfix: Pax storage format fixes incorrect mapping of pg timestamp/timestamptz types

gongxun0928
authored and
jiaqizho
committed
Fix: pax fast sequence will lost when swap table happen
jiaqizho
committed
Fix: the index in pax aux table should be same as aux table
jiaqizho
committed
Fix: fix pax-storage make install will compile again

lss602726449
authored and
jiaqizho
committed
PAX: check the value of gp_interconnect_queue_depth and warning if it's less than 64

gongxun0928
authored and
jiaqizho
committed
bugfix: check resource owner in FdHandleAbortCallback

gongxun0928
authored and
jiaqizho
committed
Fix: pax cluster index will make aux table invisible
jiaqizho
committed
Fix: PAX split by file size does not calculate the written sizes
jiaqizho
committed
Enable pg statistics in pax
jiaqizho
committed
PAX: Fix null test for all columns

gfphoenix78
authored and
jiaqizho
committed
Fix: PAX will cache the wrong text locale
jiaqizho
committed
Pax change the default file split strategy to guc
jiaqizho
committed
Bugfix: fix incorrect micro partition file skip logic

gongxun0928
authored and
jiaqizho
committed
Fix: pax custom object support some of event_trigger callback
jiaqizho
committed
Fix: PAX numeric vec format memory leak
jiaqizho
committed
PAX:optimize queries with large wide tables

gongxun0928
authored and
jiaqizho
committed
PAX: paxformat supports vectorized scan operators

gongxun0928
authored and
jiaqizho
committed
Use scan_flags to indicate whether the table AM support vectorization

leo
authored and
jiaqizho
committed
PAX: Preload pax extension and sync some GUCs

gfphoenix78
authored and
jiaqizho
committed
PAX: doesn't support non-btree index

gfphoenix78
authored and
jiaqizho
committed
Fix: PAX format need build CTID
jiaqizho
committed
Fix: the projection in orc group not right
jiaqizho
committed
Fix: new add column may cause array bounds violation
jiaqizho
committed
Fix: pax update table with dropped column return not-null tuple
jiaqizho
committed
PAX support bpchar type vectorization build
jiaqizho
committed
bugfix: pax filter does not filter NaN values correctly

gongxun0928
authored and
jiaqizho
committed
Pax: RelationCopyData need do pending delete
jiaqizho
committed
feature: skip read the column which is all null

gongxun0928
authored and
jiaqizho
committed
PAX: Rename orc to porc

wuhao
authored and
jiaqizho
committed
pax: port regress tests to pax
jiaqizho
committed
Fix: parallel_schedule pg optimizer test cases
jiaqizho
committed
Fix: fd handle owner ans some of test cases

gongxun0928
authored and
jiaqizho
committed
Fix: parallel_schedule ORCA test cases
jiaqizho
committed
PAX: add single CI to run icw and icw-orca with access method PAX
jiaqizho
committed
PAX: Add bitpacked column for arrow boolean type

gongxun0928
authored and
jiaqizho
committed
bugfix: incorrect data stream origin length of bpchar type without compression

gongxun0928
authored and
jiaqizho
committed
PAX: Add reloption to set minmax columns

wuhao
authored and
jiaqizho
committed
Pax: merge reloption numeric_vec_storage to reloption storage_format
jiaqizho
committed
PAX: Update dependency management

gfphoenix78
authored and
jiaqizho
committed
Feature: PAX support visibility map for delete/update

gongxun0928
authored and
jiaqizho
committed
Pax: storage format porc_vec support big group
jiaqizho
committed
Feature: pax length stream support encoding options

jiaqizho
and
gongxun0928
committed
PAX: Improve the performance of analyze

gongxun0928
authored and
jiaqizho
committed
Fix: link paxformat.so error

gongxun0928
authored and
jiaqizho
committed
PAX: install pax_dump into rpm
jiaqizho
committed
PAX: Fix compile warnings and enable -Wextra and -Werror

lizhaohan
authored and
jiaqizho
committed
Fix: The cache_group cache hit condition is incorrect.

gongxun0928
authored and
jiaqizho
committed
Bugfix: pax fix coredump with vectorization enable

gongxun0928
authored and
jiaqizho
committed
Regularly synchronize CBDB and update CI

zhangwenchao-123
authored and
jiaqizho
committed
Pax: add new interface to combine two of MicroPartitionStatisticsInfo
jiaqizho
committed
PAX: Fix visibility map to build ctid for vectorization

wuhao
authored and
jiaqizho
committed
Fix: use BITS_TO_BYTES to calculte the length of bitpacked buffer.

gongxun0928
authored and
jiaqizho
committed
Pax: TupleDesc in TableTupleSlot is no longer used
jiaqizho
committed
Fix: the max value of pax_max_tuples_per_file is wrong

gongxun0928
authored and
jiaqizho
committed
PAX: Refactor the writer/reader options
jiaqizho
committed
PAX: bpchar support porc_vec
jiaqizho
committed
PAX: bitpacked support porc_vec
jiaqizho
committed
Fix: pax return wrong value of bool type when vectorization is enabled

gongxun0928
authored and
jiaqizho
committed
Pax: feature support store toast datum
jiaqizho
committed
bugfix: fix compilation errors in pax

gongxun0928
authored and
jiaqizho
committed
bugfix: pax support default values when vectorization is enable

gongxun0928
authored and
jiaqizho
committed
Fix nullptr in missing column
jiaqizho
committed
PAX: optimize min-max memory state
jiaqizho
committed
Fix: compile error when CBDB_BUILD_TYPE is release

gongxun0928
authored and
jiaqizho
committed
PAX: Add SCAN_SUPPORT_COLUMN_ORIENTED_SCAN in scan flags
jiaqizho
committed
Regularly synchronize CBDB and update CI

Dongxiao Song
authored and
jiaqizho
committed
Op: PAX Precompute null counts array in GetTuple
jiaqizho
committed
Fix: length 0 and all null bpchar in record batch
jiaqizho
committed
feature: support dfs_tablespace in pax storage

gongxun0928
authored and
jiaqizho
committed
PAX: refactor vec adapter and split the format into different paths
jiaqizho
committed
PAX: plasma is no longer supported
jiaqizho
committed
Fix PAX scanning with visimap for vectorization
jiaqizho
committed
PAX: icw support vectorization regress test cases
jiaqizho
committed
PAX: support porc_vec format no filling datum header when typlen is not -1
jiaqizho
committed
PAX: add more exception message
jiaqizho
committed
PAX: enable porc_vec format ICW
jiaqizho
committed
PAX: add existexttoast to summary callback
jiaqizho
committed
PAX: Support SUM and COUNT in statistics
jiaqizho
committed
Ignore extension misc_sanity case primary key check.

avamingli
authored and
jiaqizho
committed
PAX: re-enable the sql tests which defined in pax-tests target
jiaqizho
committed
PAX: support update stats when delete/update happend
jiaqizho
committed
Regularly synchronize CBDB and update CI

foreyes
authored and
jiaqizho
committed
PAX: support sum/count pb info combine
jiaqizho
committed
PAX: pax_dump support dump toast datum
jiaqizho
committed
PAX: AM can't insert into table which use object storage

gongxun0928
authored and
jiaqizho
committed
PAX: enable kind of UDF to dump the PAX file
jiaqizho
committed
PAX: Disable the unsupport indexes
jiaqizho
committed
pax: suport index cluster

gongxun0928
authored and
jiaqizho
committed
PAX: Support zorder curve

gongxun0928
authored and
jiaqizho
committed
PAX: reset row filter memory context to avoid OOM
jiaqizho
committed
PAX: support varchar min/max operator
jiaqizho
committed
Fix: pfree may free NULL datum
jiaqizho
committed
PAX: The type of ptblockname is changed to int type

gongxun0928
authored and
jiaqizho
committed