Pax test source -380#60

Open

tuhaihe wants to merge 378 commits into380-commit-testfrom

pax-test-source

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 11, 2025

Op: Refactor PaxEncodingColumn and PaxNonFixedEncodingColumn

jiaqizho
authored and
tuhaihe
committed
PAX: Fix CI submodule can't pull

jiaqizho
authored and
tuhaihe
committed
Save and validate opfamily instead of oids of compare functions

gfphoenix78
authored and
tuhaihe
committed
Feature: storage type orc_vec support pg executor

jiaqizho
authored and
tuhaihe
committed
PAX: Add base partition support functions

wuhao
authored and
tuhaihe
committed
Feature: filter support AND oper which not been flatten

jiaqizho
authored and
tuhaihe
committed
Refactor ItemPointerData to use index for offline

gfphoenix78
authored and
tuhaihe
committed
Fix: group offset not right

jiaqizho
authored and
tuhaihe
committed
Fix: use new item ptr to build vec ctid

jiaqizho
authored and
tuhaihe
committed
Feature: TableParitionWriter support parition reloption

jiaqizho
authored and
tuhaihe
committed
Feature: support GetTuple interface to direct get tuple

jiaqizho
authored and
tuhaihe
committed
Generate file name by fast-sequence to support index

wuhao
authored and
tuhaihe
committed
PAX: Add support for index build and scan

wuhao
authored and
tuhaihe
committed
Feature: support resowner to manage fd

jiaqizho
authored and
tuhaihe
committed
Fix: VEC format no need do align in non-fixed column

jiaqizho
authored and
tuhaihe
committed
Fix: group stats is not right after merge

jiaqizho
authored and
tuhaihe
committed
Feature: catch pg error when long jump happend

jiaqizho
authored and
tuhaihe
committed
PAX: Allow empty columns in PAX table

jiaqizho
authored and
tuhaihe
committed
PAX: Use the correctness flags when open file

gongxun0928
authored and
tuhaihe
committed
PAX: Implement index_unique_check

wuhao
authored and
tuhaihe
committed
PAX: Add regress test

wuhao
authored and
tuhaihe
committed
Fix: missing attrno in row filter reader

jiaqizho
authored and
tuhaihe
committed
PAX: Fix compile error

gfphoenix78
authored and
tuhaihe
committed
Fix: Invalid read in MergeGroup

jiaqizho
authored and
tuhaihe
committed
Fix: RUNPATH in the so file

wuhao
authored and
tuhaihe
committed
Fix compile error in release mode

gongxun0928
authored and
tuhaihe
committed
Move pg_pax_tables from kernel to pax

wuhao
authored and
tuhaihe
committed
Update the signature of TransformColumnEncodingClauses

gfphoenix78
authored and
tuhaihe
committed
Move PAX repo

my-ship-it
authored and
tuhaihe
committed
Op: cleanup some of pax tests, replace with the same function

jiaqizho
authored and
tuhaihe
committed
PAX: Always create index for auxiliary relation

gfphoenix78
authored and
tuhaihe
committed
Dynamic reuse_buffer size

gongxun0928
authored and
tuhaihe
committed
PAX: Build pax_storage as an internal extension by default

wuhao
authored and
tuhaihe
committed
Pax re-enable vectorization build

jiaqizho
authored and
tuhaihe
committed
PAX: Compile pax with vectorization only if the kernel builds vectorization

gfphoenix78
authored and
tuhaihe
committed
Feature: Introduce pax_dump to dump single pax file

jiaqizho
authored and
tuhaihe
committed
PAX: Add google benchmark

gongxun0928
authored and
tuhaihe
committed
bugfix: fix the error when hashdata cloud work with paxformat

gongxun0928
authored and
tuhaihe
committed
Feature: pax FD resource owner supports concurrent reading and writing

jiaqizho
authored and
tuhaihe
committed
Feature: implementing part of PG min/max operator in PAX

jiaqizho
authored and
tuhaihe
committed
Use dynamic link library instead of static compilation

gongxun0928
authored and
tuhaihe
committed
PAX: Add PAX_NEW/PAX_DELETE to replace global new/delete operator

wuhao
authored and
tuhaihe
committed
Pax/remove zstd submodule

gongxun0928
authored and
tuhaihe
committed
Feature: use stripe stats instead of repeated mix/max update operations

jiaqizho
authored and
tuhaihe
committed
Pax build type follow lighting pipeline

jiaqizho
authored and
tuhaihe
committed
Pax: Remove the struct CTupleSlot

jiaqizho
authored and
tuhaihe
committed
PAX: both build pax.so and paxformat.so

gongxun0928
authored and
tuhaihe
committed
PAX: Reduct get relation path function call times

jiaqizho
authored and
tuhaihe
committed
PAX: Rename the namespace of orc proto objects

gfphoenix78
authored and
tuhaihe
committed
Fix: install the libpax.so, libpaxformat.so, and headers into ${prefix}

lss602726449
authored and
tuhaihe
committed
Enable local index by default and remove the else code

wuhao
authored and
tuhaihe
committed
PAX: Add new guc pax.enable_filter

gfphoenix78
authored and
tuhaihe
committed
PAX: Use macro SO_TYPE_VECTOR instead of hard-coded value

gfphoenix78
authored and
tuhaihe
committed
Fix struct layout of PaxIndexScanDesc

gfphoenix78
authored and
tuhaihe
committed
PAX: Limit the maximum number of concurrent jobs to 8

gfphoenix78
authored and
tuhaihe
committed
Pax: Avoid stack overflow when reading footer

gongxun0928
authored and
tuhaihe
committed
Fix: delete pax_itemptr.cc in build libpaxformat.so

lss602726449
authored and
tuhaihe
committed
PAX: Fix guc name to not contain dot

wuhao
authored and
tuhaihe
committed
Pax: Add regression tests

wuhao
authored and
tuhaihe
committed
PAX: Add a configure option to build pax optionally.

wuhao
authored and
tuhaihe
committed
Fix: toast will make pax operators not work

jiaqizho
authored and
tuhaihe
committed
PAX: Fix guc issue that needs to sync pax_scan_reuse_buffer_size

gfphoenix78
authored and
tuhaihe
committed
Fix: alter PAX table will got cast problem

jiaqizho
authored and
tuhaihe
committed
Op: Make the functions in DataBuffer inline

jiaqizho
authored and
tuhaihe
committed
Fix: pax object access hook assert false

jiaqizho
authored and
tuhaihe
committed
Fix: pax group footer will not reocrd compress level

jiaqizho
authored and
tuhaihe
committed
performance: length_stream changes from int64 type to int32 type

gongxun0928
authored and
tuhaihe
committed
Fix: pax operator without set null field also should not assert unimplemented sk_strategy

jiaqizho
authored and
tuhaihe
committed
Add ExecClearTuple before read or fetch index tuple

jiaqizho
authored and
tuhaihe
committed
Pax: add MicroPartitionWriter merging logic back to optimize performance

jiaqizho
authored and
tuhaihe
committed
Fix: pax broken gtest and add it into CI

jiaqizho
authored and
tuhaihe
committed
Feature: pax store the vec-format decimal128

jiaqizho
authored and
tuhaihe
committed
Fix: pax got nullptr in table writer when exception happen

jiaqizho
authored and
tuhaihe
committed
bugfix: Pax storage format fixes incorrect mapping of pg timestamp/timestamptz types

gongxun0928
authored and
tuhaihe
committed
Fix: pax fast sequence will lost when swap table happen

jiaqizho
authored and
tuhaihe
committed
Fix: the index in pax aux table should be same as aux table

jiaqizho
authored and
tuhaihe
committed
Fix: fix pax-storage make install will compile again

lss602726449
authored and
tuhaihe
committed
PAX: check the value of gp_interconnect_queue_depth and warning if it's less than 64

gongxun0928
authored and
tuhaihe
committed
bugfix: check resource owner in FdHandleAbortCallback

gongxun0928
authored and
tuhaihe
committed
Fix: pax cluster index will make aux table invisible

jiaqizho
authored and
tuhaihe
committed
Fix: PAX split by file size does not calculate the written sizes

jiaqizho
authored and
tuhaihe
committed
Enable pg statistics in pax

jiaqizho
authored and
tuhaihe
committed
PAX: Fix null test for all columns

gfphoenix78
authored and
tuhaihe
committed
Fix: PAX will cache the wrong text locale

jiaqizho
authored and
tuhaihe
committed
Pax change the default file split strategy to guc

jiaqizho
authored and
tuhaihe
committed
Bugfix: fix incorrect micro partition file skip logic

gongxun0928
authored and
tuhaihe
committed
Fix: pax custom object support some of event_trigger callback

jiaqizho
authored and
tuhaihe
committed
Fix: PAX numeric vec format memory leak

jiaqizho
authored and
tuhaihe
committed
PAX:optimize queries with large wide tables

gongxun0928
authored and
tuhaihe
committed
PAX: paxformat supports vectorized scan operators

gongxun0928
authored and
tuhaihe
committed
Use scan_flags to indicate whether the table AM support vectorization

leo
authored and
tuhaihe
committed
PAX: Preload pax extension and sync some GUCs

gfphoenix78
authored and
tuhaihe
committed
PAX: doesn't support non-btree index

gfphoenix78
authored and
tuhaihe
committed
Fix: PAX format need build CTID

jiaqizho
authored and
tuhaihe
committed
Fix: the projection in orc group not right

jiaqizho
authored and
tuhaihe
committed
Fix: new add column may cause array bounds violation

jiaqizho
authored and
tuhaihe
committed
Fix: pax update table with dropped column return not-null tuple

jiaqizho
authored and
tuhaihe
committed
PAX support bpchar type vectorization build

jiaqizho
authored and
tuhaihe
committed
bugfix: pax filter does not filter NaN values correctly

gongxun0928
authored and
tuhaihe
committed
Pax: RelationCopyData need do pending delete

jiaqizho
authored and
tuhaihe
committed
feature: skip read the column which is all null

gongxun0928
authored and
tuhaihe
committed
PAX: Rename orc to porc

wuhao
authored and
tuhaihe
committed
pax: port regress tests to pax

jiaqizho
authored and
tuhaihe
committed
Fix: parallel_schedule pg optimizer test cases

jiaqizho
authored and
tuhaihe
committed
Fix: fd handle owner ans some of test cases

gongxun0928
authored and
tuhaihe
committed
Fix: parallel_schedule ORCA test cases

jiaqizho
authored and
tuhaihe
committed
PAX: add single CI to run icw and icw-orca with access method PAX

jiaqizho
authored and
tuhaihe
committed
PAX: Add bitpacked column for arrow boolean type

gongxun0928
authored and
tuhaihe
committed
bugfix: incorrect data stream origin length of bpchar type without compression

gongxun0928
authored and
tuhaihe
committed
PAX: Add reloption to set minmax columns

wuhao
authored and
tuhaihe
committed
Pax: merge reloption numeric_vec_storage to reloption storage_format

jiaqizho
authored and
tuhaihe
committed
PAX: Update dependency management

gfphoenix78
authored and
tuhaihe
committed
Feature: PAX support visibility map for delete/update

gongxun0928
authored and
tuhaihe
committed
Pax: storage format porc_vec support big group

jiaqizho
authored and
tuhaihe
committed
Feature: pax length stream support encoding options

authored and
tuhaihe
committed
PAX: Improve the performance of analyze

gongxun0928
authored and
tuhaihe
committed
Fix: link paxformat.so error

gongxun0928
authored and
tuhaihe
committed
PAX: install pax_dump into rpm

jiaqizho
authored and
tuhaihe
committed
PAX: Fix compile warnings and enable -Wextra and -Werror

lizhaohan
authored and
tuhaihe
committed
Fix: The cache_group cache hit condition is incorrect.

gongxun0928
authored and
tuhaihe
committed
Bugfix: pax fix coredump with vectorization enable

gongxun0928
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

zhangwenchao-123
authored and
tuhaihe
committed
Pax: add new interface to combine two of MicroPartitionStatisticsInfo

jiaqizho
authored and
tuhaihe
committed
PAX: Fix visibility map to build ctid for vectorization

wuhao
authored and
tuhaihe
committed
Fix: use BITS_TO_BYTES to calculte the length of bitpacked buffer.

gongxun0928
authored and
tuhaihe
committed
Pax: TupleDesc in TableTupleSlot is no longer used

jiaqizho
authored and
tuhaihe
committed
Fix: the max value of pax_max_tuples_per_file is wrong

gongxun0928
authored and
tuhaihe
committed
PAX: Refactor the writer/reader options

jiaqizho
authored and
tuhaihe
committed
PAX: bpchar support porc_vec

jiaqizho
authored and
tuhaihe
committed
PAX: bitpacked support porc_vec

jiaqizho
authored and
tuhaihe
committed
Fix: pax return wrong value of bool type when vectorization is enabled

gongxun0928
authored and
tuhaihe
committed
Pax: feature support store toast datum

jiaqizho
authored and
tuhaihe
committed
bugfix: fix compilation errors in pax

gongxun0928
authored and
tuhaihe
committed
bugfix: pax support default values when vectorization is enable

gongxun0928
authored and
tuhaihe
committed
Fix nullptr in missing column

jiaqizho
authored and
tuhaihe
committed
PAX: optimize min-max memory state

jiaqizho
authored and
tuhaihe
committed
Fix: compile error when CBDB_BUILD_TYPE is release

gongxun0928
authored and
tuhaihe
committed
PAX: Add SCAN_SUPPORT_COLUMN_ORIENTED_SCAN in scan flags

jiaqizho
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

Dongxiao Song
authored and
tuhaihe
committed
Op: PAX Precompute null counts array in GetTuple

jiaqizho
authored and
tuhaihe
committed
Fix: length 0 and all null bpchar in record batch

jiaqizho
authored and
tuhaihe
committed
feature: support dfs_tablespace in pax storage

gongxun0928
authored and
tuhaihe
committed
PAX: refactor vec adapter and split the format into different paths

jiaqizho
authored and
tuhaihe
committed
PAX: plasma is no longer supported

jiaqizho
authored and
tuhaihe
committed
Fix PAX scanning with visimap for vectorization

jiaqizho
authored and
tuhaihe
committed
PAX: icw support vectorization regress test cases

jiaqizho
authored and
tuhaihe
committed
PAX: support porc_vec format no filling datum header when typlen is not -1

jiaqizho
authored and
tuhaihe
committed
PAX: add more exception message

jiaqizho
authored and
tuhaihe
committed
PAX: enable porc_vec format ICW

jiaqizho
authored and
tuhaihe
committed
PAX: add existexttoast to summary callback

jiaqizho
authored and
tuhaihe
committed
PAX: Support SUM and COUNT in statistics

jiaqizho
authored and
tuhaihe
committed
Ignore extension misc_sanity case primary key check.

avamingli
authored and
tuhaihe
committed
PAX: re-enable the sql tests which defined in pax-tests target

jiaqizho
authored and
tuhaihe
committed
PAX: support update stats when delete/update happend

jiaqizho
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

foreyes
authored and
tuhaihe
committed
PAX: support sum/count pb info combine

jiaqizho
authored and
tuhaihe
committed
PAX: pax_dump support dump toast datum

jiaqizho
authored and
tuhaihe
committed
PAX: AM can't insert into table which use object storage

gongxun0928
authored and
tuhaihe
committed
PAX: enable kind of UDF to dump the PAX file

jiaqizho
authored and
tuhaihe
committed
PAX: Disable the unsupport indexes

jiaqizho
authored and
tuhaihe
committed
pax: suport index cluster

gongxun0928
authored and
tuhaihe
committed
PAX: Support zorder curve

gongxun0928
authored and
tuhaihe
committed
PAX: reset row filter memory context to avoid OOM

jiaqizho
authored and
tuhaihe
committed
PAX: support varchar min/max operator

jiaqizho
authored and
tuhaihe
committed
Fix: pfree may free NULL datum

jiaqizho
authored and
tuhaihe
committed
PAX: The type of ptblockname is changed to int type

gongxun0928
authored and
tuhaihe
committed
PAX: Support dict encoding

jiaqizho
authored and
tuhaihe
committed
PAX: support record batch return with dictionary

jiaqizho
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

gfphoenix78
authored and
tuhaihe
committed
PAX: Support parallel-scan

gongxun0928
authored and
tuhaihe
committed
bugfix: tuples loss issue in bitmap index scan

gongxun0928
authored and
tuhaihe
committed
PAX: Refactor memory management to allow thread-safe scan

wuhao
authored and
tuhaihe
committed
PAX: remove the opfamily and build scan will not use the BRINAM

jiaqizho
authored and
tuhaihe
committed
PAX: Support bloom filter in the statistics

jiaqizho
authored and
tuhaihe
committed
PAX: Move the logic of checking whether stmt is supported in dfs tablespace to pax

gongxun0928
authored and
tuhaihe
committed
PAX: Support parallel scan pax table by threads for vectorization

yangkaidi
authored and
tuhaihe
committed
PAX: support almost min/max oper

jiaqizho
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

fanfuxiaoran
authored and
tuhaihe
committed
PAX: Support lexical cluster

gongxun0928
authored and
tuhaihe
committed
PAX: support more types for filtering in parallel scan

gfphoenix78
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

foreyes
authored and
tuhaihe
committed
PAX: Add icw test in greenplum_schedule for pax table

gongxun0928
authored and
tuhaihe
committed
Fix UFileClose failed, call UFileGetLastError to get error msg will coredump

gongxun0928
authored and
tuhaihe
committed
PAX: Remove the gtest mock `Palloc/Palloc0/Pfree`

jiaqizho
authored and
tuhaihe
committed
PAX: Fix compile issue that may install bad pax.so

gfphoenix78
authored and
tuhaihe
committed
PAX: disable numeric in bloom filter

jiaqizho
authored and
tuhaihe
committed
PAX: Support IN expression filter for vector scan

wuhao
authored and
tuhaihe
committed
PAX: move the CBDB_CHECK into MicroPartitionStats::FromValue

jiaqizho
authored and
tuhaihe
committed
Fix answer files when the collation changes to en_US.utf8

wuhao
authored and
tuhaihe
committed
Fix the icw test failure case of pax under orca optimizer

gongxun0928
authored and
tuhaihe
committed
Fix parallel scan for pax tables

wuhao
authored and
tuhaihe
committed
Remove the function assign_enable_vectorization

jiaqizho
authored and
tuhaihe
committed
Fix crash when insert large column value and pax_enable_toast is off

gfphoenix78
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

gfphoenix78
authored and
tuhaihe
committed
PAX: re-enable install libpaxformat and header

jiaqizho
authored and
tuhaihe
committed
PAX: support python3 api

jiaqizho
authored and
tuhaihe
committed
Fix: PAX fast sequence will return the same seq in concurrent case

jiaqizho
authored and
tuhaihe
committed
Fix: can't insert into pax auxiliary table after blockid more than 32768

jiaqizho
authored and
tuhaihe
committed
PAX: Fix error that parallel scan ignores toast files

wuhao
authored and
tuhaihe
committed
Fix index scan using bitmap index on paxr #137

gongxun0928
authored and
tuhaihe
committed
PAX: don't detoast unread and short header datum

jiaqizho
authored and
tuhaihe
committed
Performance/improve pax insert performance

gongxun0928
authored and
tuhaihe
committed
Fix two toast issues that may cause crash

gfphoenix78
authored and
tuhaihe
committed
PAX: new implements of PAX filter

jiaqizho
authored and
tuhaihe
committed
PAX:Filter support CAST in PG path

jiaqizho
authored and
tuhaihe
committed
PAX: filter support arithmetic op exprs

jiaqizho
authored and
tuhaihe
committed
PAX: do the encoding options cache in tablewriter

jiaqizho
authored and
tuhaihe
committed
Fix: pax reloption without order will cause the statistics no effect.

jiaqizho
authored and
tuhaihe
committed
PAX: Use unique pointer instead of shared pointer for some cases

gfphoenix78
authored and
tuhaihe
committed
PAX: remove the memalign in non-fixed column

jiaqizho
authored and
tuhaihe
committed
performance: refactor stats to improve pax writing performance

gongxun0928
authored and
tuhaihe
committed
minor performance improve in data reading

gongxun0928
authored and
tuhaihe
committed
Decouple the parallel-scan code and MicroPartitionMetadata

wuhao
authored and
tuhaihe
committed
Pax/eliminate offsets array when data writing

gongxun0928
authored and
tuhaihe
committed
optimize: refactor OrcGroup::ReadTuple to improve performance

gongxun0928
authored and
tuhaihe
committed
PAX: split unstable filter_tree test case

jiaqizho
authored and
tuhaihe
committed
Fix: memory leak in VEC path when read the PG Nuemric

jiaqizho
authored and
tuhaihe
committed
PAX: use the atomic in filter statistics

jiaqizho
authored and
tuhaihe
committed
Regularly synchronize CBDB and update CI

gongxun0928
authored and
tuhaihe
committed
Support custom smgr for pax

gongxun0928
authored and
tuhaihe
committed
PAX: remove the unaligned(bypass) logic.

jiaqizho
authored and
tuhaihe
committed
PAX: Add wal log

gongxun0928
authored and
tuhaihe
committed
PAX: Add isolation2 tests in ci

gongxun0928
authored and
tuhaihe
committed
PAX: Fix isolation2 for test files

gfphoenix78
authored and
tuhaihe
committed
PAX: create a per-tablespace subdirectory when redo pax create directory log.

gongxun0928
authored and
tuhaihe
committed
PAX: Add manifest api

gfphoenix78
authored and
tuhaihe
committed
Adapt pax auxiliary table to manifest API

gfphoenix78
authored and
tuhaihe
committed
PAX: Fix nullptr after toast compress failed

jiaqizho
authored and
tuhaihe
committed
PAXPY: Changed the CmakeLists

jiaqizho
authored and
tuhaihe
committed
Pax: fix io error in pax table when transaction abort

gongxun0928
authored and
tuhaihe
committed
build: pax supports incremental compilation.

gongxun0928
authored and
tuhaihe
committed
PAX: remove the GUC VECTOR_MAX_BATCH_SIZE_GUC_NAME

jiaqizho
authored and
tuhaihe
committed
Update vectoried scan interface

gfphoenix78
authored and
tuhaihe
committed
PAX: Remove internal partition support

wuhao
authored and
tuhaihe
committed
Fix the failure case in icw test.

gongxun0928
authored and
tuhaihe
committed
PAX: Fix test cases with or without vectorization

wuhao
authored and
tuhaihe
committed
PAX: Add manifest implementation for catalog

wuhao
authored and
tuhaihe
committed
Add Apache license to pax files

wuhao
authored and
tuhaihe
committed
PAX: change length array to offset array

jiaqizho
authored and
tuhaihe
committed
PAX: Remove support for RemoteFileSystem

gfphoenix78
authored and
tuhaihe
committed
PAX: fix failture case in isolation2 testcase

gongxun0928
authored and
tuhaihe
committed
PAX: Add doc/* and update README

jiaqizho
authored and
tuhaihe
committed
PAX: Adapt to the latest access method

jiaqizho
authored and
tuhaihe
committed
Missing AM function swap_relation_files call

jiaqizho
authored and
tuhaihe
committed
PAX: Adapt to 32-bit relnode

jiaqizho
authored and
tuhaihe
committed
FIX: Invalid USE_ASSERT_CHECKING in DeleteWithVisibilityMap

jiaqizho
authored and
tuhaihe
committed
Adapt PAX regression test to CBDB

jiaqizho
authored and
tuhaihe
committed
Adapt PAX isolation2 test to CBDB

jiaqizho
authored and
tuhaihe
committed
PAX: Remove vectorization related tests

jiaqizho
authored and
tuhaihe
committed
PAX: update submodule

jiaqizho
authored and
tuhaihe
committed