Skip to content

[DNM] Verify the high memory issue under wide-column table scenarios (v7.5.6) #10256

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 8 commits into
base: release-7.5
Choose a base branch
from
Open

[DNM] Verify the high memory issue under wide-column table scenarios (v7.5.6) #10256

wants to merge 8 commits into from

Conversation

@JaySon-Huang
Copy link
Contributor

What problem does this PR solve?

Issue Number: ref #10253

Problem Summary:

What is changed and how it works?

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Documentation

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Changes MySQL compatibility

Release note

None

@JaySon-Huang
Storage: Adapt to ingesting snapshot with irregular region range (rel…
bcd7efa 
…ease-7.5) (pingcap#10153)

close pingcap#10147

Storage: Adapt to ingesting snapshot with irregular region range
If the key format is "t${tableID}_r${handleID1}{AnySuffix}", and `AnySuffix` is not empty, `"t${tableID}_r${handleID1}{AnySuffix}" > "t${tableID}_r${handleID1}"` according to the the comparison semantics of "Key" on TiDB/TiKV.

For example,
If a table is non-clustered, that is with Int64 as the HandleID type.
And the range of a Region is `["xxx_r{handleId1}{AnySuffix}", "xxx_r{handleId2}{AnySuffix}")`, where handleId1 = 100, handleId2 = 200.

If `AnySuffix` is empty, then Region contains the left-closed-right-open range of `[handleID1, handleID2)`
If `AnySuffix` is not empty, then Region contains the range `(handleID1, handleID2]`, which is actually the left-closed-right-open range of `[handleID1+1, handleID2+1)`.

Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
Update proxy
7e7db25 
Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
Update find_jemalloc
123995d 
Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
save work
132cf98 
Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
try
41eff1c 
Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
save
16257c6 
Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
Save test
7513fe3 
Signed-off-by: JaySon-Huang <[email protected]>
@JaySon-Huang
Save test
e40555d 
Signed-off-by: JaySon-Huang <[email protected]>
@ti-chi-bot ti-chi-bot bot added do-not-merge/cherry-pick-not-approved release-note-none Denotes a PR that doesn't merit a release note. labels Jun 23, 2025
@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Jun 23, 2025

This cherry pick PR is for a release branch and has not yet been approved by triage owners.
Adding the do-not-merge/cherry-pick-not-approved label.

To merge this cherry pick:

  1. It must be approved by the approvers firstly.
  2. AFTER it has been approved by approvers, please wait for the cherry-pick merging approval from triage owners.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Jun 23, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign hongyunyan for approval. For more information see the Code Review Process.
Please ensure that each of them provides their approval before proceeding.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ti-chi-bot ti-chi-bot bot added the size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. label Jun 23, 2025
@JaySon-Huang
Copy link
Contributor Author

JaySon-Huang commented Jun 23, 2025 •
edited
Loading

The test result show that 5k segment with 4MB mem-table each lead to 52 GB memory consumption.

[2025/06/23 01:28:23.729 +08:00] [INFO] [gtest_segment.cpp:143] ["lvl=0 beg_seg_id=1 rowkey=[-9223372036854775808,9223372036854775807)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:28:24.085 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=0 split_point=500 next_seg_id=5 mem_resident_set=1160.367MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:28:57.759 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=100 split_point=50500 next_seg_id=305 mem_resident_set=187.090MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:29:30.320 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=200 split_point=100500 next_seg_id=605 mem_resident_set=219.027MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:30:02.715 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=300 split_point=150500 next_seg_id=905 mem_resident_set=252.082MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:30:35.570 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=400 split_point=200500 next_seg_id=1205 mem_resident_set=282.320MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:31:09.425 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=500 split_point=250500 next_seg_id=1505 mem_resident_set=312.789MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:31:41.816 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=600 split_point=300500 next_seg_id=1805 mem_resident_set=345.973MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:32:14.277 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=700 split_point=350500 next_seg_id=2105 mem_resident_set=377.383MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:32:46.707 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=800 split_point=400500 next_seg_id=2405 mem_resident_set=410.910MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:33:18.991 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=0 round=900 split_point=450500 next_seg_id=2705 mem_resident_set=442.023MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:33:51.071 +08:00] [INFO] [gtest_segment.cpp:167] ["lvl=0 round=1000 mem_resident_set=475.148MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:33:51.071 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=0 written_rows=0 mem_resident_set=475.148MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:34:32.429 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=100 written_rows=50000 mem_resident_set=1518.230MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:35:13.387 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=200 written_rows=100000 mem_resident_set=2550.996MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:35:54.501 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=300 written_rows=150000 mem_resident_set=3582.379MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:36:35.766 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=400 written_rows=200000 mem_resident_set=4616.164MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:37:17.028 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=500 written_rows=250000 mem_resident_set=5650.152MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:37:58.057 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=600 written_rows=300000 mem_resident_set=6685.934MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:38:39.167 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=700 written_rows=350000 mem_resident_set=7722.648MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:39:20.344 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=800 written_rows=400000 mem_resident_set=8757.645MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:40:01.682 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=0 round=900 written_rows=450000 mem_resident_set=9789.746MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:40:43.045 +08:00] [INFO] [gtest_segment.cpp:202] ["TestMassiveSegment done, segments.size()=0 lvl=1001 mem_resident_set=10826.152MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:40:43.045 +08:00] [INFO] [gtest_segment.cpp:143] ["lvl=1 beg_seg_id=3002 rowkey=[500000,9223372036854775807)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:40:43.384 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=0 split_point=500500 next_seg_id=3005 mem_resident_set=10826.152MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:41:16.039 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=100 split_point=550500 next_seg_id=3305 mem_resident_set=10849.938MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:41:48.674 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=200 split_point=600500 next_seg_id=3605 mem_resident_set=10883.551MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:42:21.349 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=300 split_point=650500 next_seg_id=3905 mem_resident_set=10916.988MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:42:53.729 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=400 split_point=700500 next_seg_id=4205 mem_resident_set=10948.539MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:43:26.278 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=500 split_point=750500 next_seg_id=4505 mem_resident_set=10981.715MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:43:58.712 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=600 split_point=800500 next_seg_id=4805 mem_resident_set=11016.047MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:44:31.209 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=700 split_point=850500 next_seg_id=5105 mem_resident_set=11047.848MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:45:03.611 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=800 split_point=900500 next_seg_id=5405 mem_resident_set=11081.434MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:45:36.167 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=1 round=900 split_point=950500 next_seg_id=5705 mem_resident_set=11116.535MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:46:08.335 +08:00] [INFO] [gtest_segment.cpp:167] ["lvl=1 round=1000 mem_resident_set=11149.340MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:46:08.336 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=0 written_rows=0 mem_resident_set=11149.340MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:46:49.793 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=100 written_rows=50000 mem_resident_set=12194.055MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:47:31.228 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=200 written_rows=100000 mem_resident_set=13229.121MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:48:12.906 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=300 written_rows=150000 mem_resident_set=14265.309MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:48:54.388 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=400 written_rows=200000 mem_resident_set=15299.164MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:49:35.820 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=500 written_rows=250000 mem_resident_set=16336.438MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:50:17.359 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=600 written_rows=300000 mem_resident_set=17371.438MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:50:58.710 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=700 written_rows=350000 mem_resident_set=18406.199MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:51:40.185 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=800 written_rows=400000 mem_resident_set=19441.695MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:52:21.757 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=1 round=900 written_rows=450000 mem_resident_set=20477.641MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:53:03.360 +08:00] [INFO] [gtest_segment.cpp:202] ["TestMassiveSegment done, segments.size()=1 lvl=2001 mem_resident_set=21514.551MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:53:03.361 +08:00] [INFO] [gtest_segment.cpp:143] ["lvl=2 beg_seg_id=6002 rowkey=[1000000,9223372036854775807)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:53:03.695 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=0 split_point=1000500 next_seg_id=6005 mem_resident_set=21511.695MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:53:36.155 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=100 split_point=1050500 next_seg_id=6305 mem_resident_set=21536.652MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:54:08.737 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=200 split_point=1100500 next_seg_id=6605 mem_resident_set=21569.363MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:54:41.391 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=300 split_point=1150500 next_seg_id=6905 mem_resident_set=21601.324MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:55:13.886 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=400 split_point=1200500 next_seg_id=7205 mem_resident_set=21633.258MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:55:46.710 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=500 split_point=1250500 next_seg_id=7505 mem_resident_set=21663.508MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:56:19.298 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=600 split_point=1300500 next_seg_id=7805 mem_resident_set=21697.156MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:56:52.068 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=700 split_point=1350500 next_seg_id=8105 mem_resident_set=21730.570MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:57:24.614 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=800 split_point=1400500 next_seg_id=8405 mem_resident_set=21763.934MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:57:56.998 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=2 round=900 split_point=1450500 next_seg_id=8705 mem_resident_set=21797.340MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:58:29.252 +08:00] [INFO] [gtest_segment.cpp:167] ["lvl=2 round=1000 mem_resident_set=21829.855MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:58:29.254 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=0 written_rows=0 mem_resident_set=21829.855MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:59:11.153 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=100 written_rows=50000 mem_resident_set=22876.539MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 01:59:53.144 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=200 written_rows=100000 mem_resident_set=23911.586MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:00:34.934 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=300 written_rows=150000 mem_resident_set=24947.492MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:01:16.951 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=400 written_rows=200000 mem_resident_set=25983.156MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:01:58.875 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=500 written_rows=250000 mem_resident_set=27018.629MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:02:40.790 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=600 written_rows=300000 mem_resident_set=28054.574MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:03:22.779 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=700 written_rows=350000 mem_resident_set=29090.254MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:04:04.538 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=800 written_rows=400000 mem_resident_set=30125.273MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:04:46.294 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=2 round=900 written_rows=450000 mem_resident_set=31160.848MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:05:28.443 +08:00] [INFO] [gtest_segment.cpp:202] ["TestMassiveSegment done, segments.size()=2 lvl=3001 mem_resident_set=32196.559MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:05:28.443 +08:00] [INFO] [gtest_segment.cpp:143] ["lvl=3 beg_seg_id=9002 rowkey=[1500000,9223372036854775807)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:05:28.784 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=0 split_point=1500500 next_seg_id=9005 mem_resident_set=32196.559MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:06:01.172 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=100 split_point=1550500 next_seg_id=9305 mem_resident_set=32217.297MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:06:33.907 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=200 split_point=1600500 next_seg_id=9605 mem_resident_set=32249.922MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:07:06.391 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=300 split_point=1650500 next_seg_id=9905 mem_resident_set=32281.422MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:07:38.953 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=400 split_point=1700500 next_seg_id=10205 mem_resident_set=32314.609MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:08:11.586 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=500 split_point=1750500 next_seg_id=10505 mem_resident_set=32348.359MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:08:44.232 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=600 split_point=1800500 next_seg_id=10805 mem_resident_set=32380.984MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:09:16.915 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=700 split_point=1850500 next_seg_id=11105 mem_resident_set=32414.172MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:09:49.549 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=800 split_point=1900500 next_seg_id=11405 mem_resident_set=32446.797MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:10:22.141 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=3 round=900 split_point=1950500 next_seg_id=11705 mem_resident_set=32478.859MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:10:54.557 +08:00] [INFO] [gtest_segment.cpp:167] ["lvl=3 round=1000 mem_resident_set=32511.484MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:10:54.558 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=0 written_rows=0 mem_resident_set=32511.484MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:11:35.998 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=100 written_rows=50000 mem_resident_set=33559.180MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:12:17.565 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=200 written_rows=100000 mem_resident_set=34594.469MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:12:59.123 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=300 written_rows=150000 mem_resident_set=35629.023MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:13:40.875 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=400 written_rows=200000 mem_resident_set=36666.715MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:14:22.574 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=500 written_rows=250000 mem_resident_set=37700.727MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:15:04.101 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=600 written_rows=300000 mem_resident_set=38736.105MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:15:45.724 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=700 written_rows=350000 mem_resident_set=39771.535MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:16:27.392 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=800 written_rows=400000 mem_resident_set=40807.391MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:17:08.891 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=3 round=900 written_rows=450000 mem_resident_set=41845.512MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:17:50.490 +08:00] [INFO] [gtest_segment.cpp:202] ["TestMassiveSegment done, segments.size()=3 lvl=4001 mem_resident_set=42878.730MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:17:50.490 +08:00] [INFO] [gtest_segment.cpp:143] ["lvl=4 beg_seg_id=12002 rowkey=[2000000,9223372036854775807)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:17:50.834 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=0 split_point=2000500 next_seg_id=12005 mem_resident_set=42878.730MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:18:23.338 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=100 split_point=2050500 next_seg_id=12305 mem_resident_set=42900.625MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:18:56.091 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=200 split_point=2100500 next_seg_id=12605 mem_resident_set=42935.910MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:19:28.752 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=300 split_point=2150500 next_seg_id=12905 mem_resident_set=42969.785MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:20:01.304 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=400 split_point=2200500 next_seg_id=13205 mem_resident_set=43002.129MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:20:33.853 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=500 split_point=2250500 next_seg_id=13505 mem_resident_set=43036.020MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:21:06.364 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=600 split_point=2300500 next_seg_id=13805 mem_resident_set=43070.723MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:21:38.959 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=700 split_point=2350500 next_seg_id=14105 mem_resident_set=43104.613MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:22:11.613 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=800 split_point=2400500 next_seg_id=14405 mem_resident_set=43138.617MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:22:44.230 +08:00] [INFO] [gtest_segment.cpp:162] ["lvl=4 round=900 split_point=2450500 next_seg_id=14705 mem_resident_set=43170.293MB)"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:23:16.997 +08:00] [INFO] [gtest_segment.cpp:167] ["lvl=4 round=1000 mem_resident_set=43204.270MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:23:16.997 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=0 written_rows=0 mem_resident_set=43204.270MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:23:58.686 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=100 written_rows=50000 mem_resident_set=44248.117MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:24:40.512 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=200 written_rows=100000 mem_resident_set=45285.355MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:25:22.340 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=300 written_rows=150000 mem_resident_set=46319.086MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:26:05.046 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=400 written_rows=200000 mem_resident_set=47354.230MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:26:47.768 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=500 written_rows=250000 mem_resident_set=48389.938MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:27:30.994 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=600 written_rows=300000 mem_resident_set=49427.434MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:28:13.943 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=700 written_rows=350000 mem_resident_set=50462.180MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:28:57.733 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=800 written_rows=400000 mem_resident_set=51496.715MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:29:40.752 +08:00] [INFO] [gtest_segment.cpp:190] ["lvl=4 round=900 written_rows=450000 mem_resident_set=52534.266MB"] [source=SegmentOperationTest] [thread_id=1]
[2025/06/23 02:30:23.484 +08:00] [INFO] [gtest_segment.cpp:202] ["TestMassiveSegment done, segments.size()=4 lvl=5001 mem_resident_set=53567.371MB"] [source=SegmentOperationTest] [thread_id=1]

@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Jun 23, 2025

@JaySon-Huang: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-unit-test e40555d link true /test pull-unit-test
pull-integration-test e40555d link true /test pull-integration-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

do-not-merge/cherry-pick-not-approved release-note-none Denotes a PR that doesn't merit a release note. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@JaySon-Huang