Is this normal having a certain amount of logs in gc.log and massive logs in performance-analyzer?
$ ls -alh
total 1.9G
drwxr-xr-x 1 opensearch opensearch 4.0K Apr 12 10:24 .
drwx------ 1 opensearch opensearch 4.0K Mar 15 05:53 ..
-rw-rw-r-- 1 opensearch opensearch 4.4M Apr 12 16:34 gc.log
-rw-rw-r-- 1 opensearch opensearch 2.0K Mar 15 05:53 gc.log.00
-rw-rw-r-- 1 opensearch opensearch 65M Mar 18 08:20 gc.log.01
-rw-rw-r-- 1 opensearch opensearch 65M Mar 20 05:26 gc.log.02
-rw-rw-r-- 1 opensearch opensearch 64M Mar 22 20:27 gc.log.03
-rw-rw-r-- 1 opensearch opensearch 65M Mar 25 13:47 gc.log.04
-rw-rw-r-- 1 opensearch opensearch 65M Mar 28 12:48 gc.log.05
-rw-rw-r-- 1 opensearch opensearch 65M Mar 30 20:35 gc.log.06
-rw-rw-r-- 1 opensearch opensearch 65M Mar 31 16:38 gc.log.07
-rw-rw-r-- 1 opensearch opensearch 65M Apr 1 11:22 gc.log.08
-rw-rw-r-- 1 opensearch opensearch 65M Apr 2 20:56 gc.log.09
-rw-rw-r-- 1 opensearch opensearch 65M Apr 5 14:15 gc.log.10
-rw-rw-r-- 1 opensearch opensearch 65M Apr 6 16:20 gc.log.11
-rw-rw-r-- 1 opensearch opensearch 65M Apr 7 07:51 gc.log.12
-rw-rw-r-- 1 opensearch opensearch 65M Apr 7 23:07 gc.log.13
-rw-rw-r-- 1 opensearch opensearch 65M Apr 8 15:12 gc.log.14
-rw-rw-r-- 1 opensearch opensearch 65M Apr 9 07:22 gc.log.15
-rw-rw-r-- 1 opensearch opensearch 65M Apr 9 22:04 gc.log.16
-rw-rw-r-- 1 opensearch opensearch 65M Apr 10 15:20 gc.log.17
-rw-rw-r-- 1 opensearch opensearch 65M Apr 11 06:50 gc.log.18
-rw-rw-r-- 1 opensearch opensearch 65M Apr 12 10:24 gc.log.19
-rw-rw-r-- 1 opensearch opensearch 681M Apr 12 16:34 performance-analyzer.log
[opensearch@opensearch-cluster-data-0 logs]$ tail performance-analyzer.log
Apr 12, 2022 4:34:55 PM org.jooq.tools.JooqLogger info
INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Apr 12, 2022 4:34:55 PM org.jooq.tools.JooqLogger info
INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Apr 12, 2022 4:34:55 PM org.jooq.tools.JooqLogger info
INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Apr 12, 2022 4:34:55 PM org.jooq.tools.JooqLogger info
INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Apr 12, 2022 4:34:55 PM org.jooq.tools.JooqLogger info
INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
[opensearch@opensearch-cluster-data-0 logs]$ tail -n 100 gc.log
[2022-04-12T16:34:12.210+0000][46][gc,marking ] GC(420012) Concurrent Rebuild Remembered Sets
[2022-04-12T16:34:12.413+0000][46][gc,marking ] GC(420012) Concurrent Rebuild Remembered Sets 202.695ms
[2022-04-12T16:34:12.413+0000][46][gc,start ] GC(420012) Pause Cleanup
[2022-04-12T16:34:12.415+0000][46][gc ] GC(420012) Pause Cleanup 861M->861M(4096M) 1.264ms
[2022-04-12T16:34:12.415+0000][46][gc,cpu ] GC(420012) User=0.00s Sys=0.00s Real=0.00s
[2022-04-12T16:34:12.415+0000][46][safepoint ] Safepoint "G1Concurrent", Time since last: 202858619 ns, Reaching safepoint: 559223 ns, At safepoint: 1337473 ns, Total: 1896696 ns
[2022-04-12T16:34:12.415+0000][46][gc,marking ] GC(420012) Concurrent Cleanup for Next Mark
[2022-04-12T16:34:12.426+0000][46][gc,marking ] GC(420012) Concurrent Cleanup for Next Mark 11.143ms
[2022-04-12T16:34:12.426+0000][46][gc ] GC(420012) Concurrent Cycle 594.804ms
[2022-04-12T16:34:37.818+0000][46][gc,start ] GC(420013) Pause Young (Normal) (G1 Evacuation Pause)
[2022-04-12T16:34:37.818+0000][46][gc,task ] GC(420013) Using 1 workers of 1 for evacuation
[2022-04-12T16:34:37.818+0000][46][gc,age ] GC(420013) Desired survivor size 152043520 bytes, new threshold 15 (max threshold 15)
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) Age table with threshold 15 (max threshold 15)
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 1: 3711600 bytes, 3711600 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 2: 102528 bytes, 3814128 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 3: 167488 bytes, 3981616 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 4: 277496 bytes, 4259112 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 5: 4232 bytes, 4263344 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 6: 84792 bytes, 4348136 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 7: 3640 bytes, 4351776 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 8: 183952 bytes, 4535728 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 9: 427400 bytes, 4963128 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 10: 3272 bytes, 4966400 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 11: 92016 bytes, 5058416 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 12: 1768 bytes, 5060184 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 13: 78096 bytes, 5138280 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 14: 86464 bytes, 5224744 total
[2022-04-12T16:34:37.837+0000][46][gc,age ] GC(420013) - age 15: 5120 bytes, 5229864 total
[2022-04-12T16:34:37.837+0000][46][gc,phases ] GC(420013) Pre Evacuate Collection Set: 0.7ms
[2022-04-12T16:34:37.837+0000][46][gc,phases ] GC(420013) Merge Heap Roots: 0.4ms
[2022-04-12T16:34:37.837+0000][46][gc,phases ] GC(420013) Evacuate Collection Set: 14.1ms
[2022-04-12T16:34:37.837+0000][46][gc,phases ] GC(420013) Post Evacuate Collection Set: 3.7ms
[2022-04-12T16:34:37.837+0000][46][gc,phases ] GC(420013) Other: 0.4ms
[2022-04-12T16:34:37.837+0000][46][gc,heap ] GC(420013) Eden regions: 1152->0(1154)
[2022-04-12T16:34:37.837+0000][46][gc,heap ] GC(420013) Survivor regions: 4->3(145)
[2022-04-12T16:34:37.837+0000][46][gc,heap ] GC(420013) Old regions: 344->344
[2022-04-12T16:34:37.837+0000][46][gc,heap ] GC(420013) Archive regions: 2->2
[2022-04-12T16:34:37.837+0000][46][gc,heap ] GC(420013) Humongous regions: 24->24
[2022-04-12T16:34:37.837+0000][46][gc,metaspace] GC(420013) Metaspace: 126479K(130436K)->126479K(130436K) NonClass: 112181K(115204K)->112181K(115204K) Class: 14297K(15232K)->14297K(15232K)
[2022-04-12T16:34:37.837+0000][46][gc ] GC(420013) Pause Young (Normal) (G1 Evacuation Pause) 3048M->742M(4096M) 19.434ms
[2022-04-12T16:34:37.837+0000][46][gc,cpu ] GC(420013) User=0.01s Sys=0.00s Real=0.02s
[2022-04-12T16:34:37.837+0000][46][safepoint ] Safepoint "G1CollectForAllocation", Time since last: 25403026334 ns, Reaching safepoint: 280618 ns, At safepoint: 19546076 ns, Total: 19826694 ns
[2022-04-12T16:35:03.874+0000][46][gc,start ] GC(420014) Pause Young (Concurrent Start) (G1 Evacuation Pause)
[2022-04-12T16:35:03.874+0000][46][gc,task ] GC(420014) Using 1 workers of 1 for evacuation
[2022-04-12T16:35:03.874+0000][46][gc,age ] GC(420014) Desired survivor size 152043520 bytes, new threshold 15 (max threshold 15)
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) Age table with threshold 15 (max threshold 15)
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 1: 3023584 bytes, 3023584 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 2: 507840 bytes, 3531424 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 3: 89872 bytes, 3621296 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 4: 166248 bytes, 3787544 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 5: 276904 bytes, 4064448 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 6: 2992 bytes, 4067440 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 7: 84792 bytes, 4152232 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 8: 2400 bytes, 4154632 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 9: 182712 bytes, 4337344 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 10: 427400 bytes, 4764744 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 11: 3272 bytes, 4768016 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 12: 92016 bytes, 4860032 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 13: 1768 bytes, 4861800 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 14: 78096 bytes, 4939896 total
[2022-04-12T16:35:03.899+0000][46][gc,age ] GC(420014) - age 15: 86464 bytes, 5026360 total
[2022-04-12T16:35:03.899+0000][46][gc,phases ] GC(420014) Pre Evacuate Collection Set: 1.0ms
[2022-04-12T16:35:03.899+0000][46][gc,phases ] GC(420014) Merge Heap Roots: 0.4ms
[2022-04-12T16:35:03.899+0000][46][gc,phases ] GC(420014) Evacuate Collection Set: 18.8ms
[2022-04-12T16:35:03.899+0000][46][gc,phases ] GC(420014) Post Evacuate Collection Set: 3.7ms
[2022-04-12T16:35:03.899+0000][46][gc,phases ] GC(420014) Other: 1.1ms
[2022-04-12T16:35:03.899+0000][46][gc,heap ] GC(420014) Eden regions: 1154->0(1155)
[2022-04-12T16:35:03.899+0000][46][gc,heap ] GC(420014) Survivor regions: 3->3(145)
[2022-04-12T16:35:03.899+0000][46][gc,heap ] GC(420014) Old regions: 344->344
[2022-04-12T16:35:03.899+0000][46][gc,heap ] GC(420014) Archive regions: 2->2
[2022-04-12T16:35:03.899+0000][46][gc,heap ] GC(420014) Humongous regions: 24->24
[2022-04-12T16:35:03.899+0000][46][gc,metaspace] GC(420014) Metaspace: 126479K(130436K)->126479K(130436K) NonClass: 112181K(115204K)->112181K(115204K) Class: 14297K(15232K)->14297K(15232K)
[2022-04-12T16:35:03.899+0000][46][gc ] GC(420014) Pause Young (Concurrent Start) (G1 Evacuation Pause) 3050M->741M(4096M) 25.296ms
[2022-04-12T16:35:03.900+0000][46][gc,cpu ] GC(420014) User=0.03s Sys=0.00s Real=0.03s
[2022-04-12T16:35:03.900+0000][46][gc ] GC(420015) Concurrent Cycle
[2022-04-12T16:35:03.900+0000][46][gc,marking ] GC(420015) Concurrent Clear Claimed Marks
[2022-04-12T16:35:03.900+0000][46][safepoint ] Safepoint "G1CollectForAllocation", Time since last: 26036306259 ns, Reaching safepoint: 343288 ns, At safepoint: 25493991 ns, Total: 25837279 ns
[2022-04-12T16:35:03.900+0000][46][gc,marking ] GC(420015) Concurrent Clear Claimed Marks 0.107ms
[2022-04-12T16:35:03.900+0000][46][gc,marking ] GC(420015) Concurrent Scan Root Regions
[2022-04-12T16:35:03.911+0000][46][gc,marking ] GC(420015) Concurrent Scan Root Regions 10.887ms
[2022-04-12T16:35:03.911+0000][46][gc,marking ] GC(420015) Concurrent Mark (2457694.239s)
[2022-04-12T16:35:03.911+0000][46][gc,marking ] GC(420015) Concurrent Mark From Roots
[2022-04-12T16:35:03.911+0000][46][gc,task ] GC(420015) Using 1 workers of 1 for marking
[2022-04-12T16:35:04.285+0000][46][gc,marking ] GC(420015) Concurrent Mark From Roots 374.296ms
[2022-04-12T16:35:04.285+0000][46][gc,marking ] GC(420015) Concurrent Preclean
[2022-04-12T16:35:04.287+0000][46][gc,marking ] GC(420015) Concurrent Preclean 2.371ms
[2022-04-12T16:35:04.287+0000][46][gc,marking ] GC(420015) Concurrent Mark (2457694.239s, 2457694.616s) 376.787ms
[2022-04-12T16:35:04.288+0000][46][gc,start ] GC(420015) Pause Remark
[2022-04-12T16:35:04.341+0000][46][gc ] GC(420015) Pause Remark 767M->767M(4096M) 52.959ms
[2022-04-12T16:35:04.341+0000][46][gc,cpu ] GC(420015) User=0.06s Sys=0.00s Real=0.05s
[2022-04-12T16:35:04.341+0000][46][safepoint ] Safepoint "G1Concurrent", Time since last: 387934538 ns, Reaching safepoint: 443301 ns, At safepoint: 53145283 ns, Total: 53588584 ns
[2022-04-12T16:35:04.344+0000][46][gc,marking ] GC(420015) Concurrent Rebuild Remembered Sets
[2022-04-12T16:35:04.555+0000][46][gc,marking ] GC(420015) Concurrent Rebuild Remembered Sets 211.330ms
[2022-04-12T16:35:04.556+0000][46][gc,start ] GC(420015) Pause Cleanup
[2022-04-12T16:35:04.557+0000][46][gc ] GC(420015) Pause Cleanup 786M->786M(4096M) 1.404ms
[2022-04-12T16:35:04.557+0000][46][gc,cpu ] GC(420015) User=0.00s Sys=0.00s Real=0.00s
[2022-04-12T16:35:04.557+0000][46][safepoint ] Safepoint "G1Concurrent", Time since last: 214029358 ns, Reaching safepoint: 410096 ns, At safepoint: 1511764 ns, Total: 1921860 ns
[2022-04-12T16:35:04.557+0000][46][gc,marking ] GC(420015) Concurrent Cleanup for Next Mark
[2022-04-12T16:35:04.571+0000][46][gc,marking ] GC(420015) Concurrent Cleanup for Next Mark 13.986ms
[2022-04-12T16:35:04.571+0000][46][gc ] GC(420015) Concurrent Cycle 671.577ms
[opensearch@opensearch-cluster-data-0 logs]
Perhaps this is a dumb question. I’m transforming myself from a user to a contributor and learning.
Thanks // Hugo