Doris2.1.7 FE服务除了堆内存不变,其他内存使用都在持续上涨,是FE自身服务问题吗?

Viewed 45

Doris版本: 2.1.7
FE服务内存持续上涨,经过VM.native_memory前后对比,发现除了堆内存,Thread、Code、Class等内存都在增加,是FE服务的问题吗?后续应该如何分析和处理?
image.png

FE GC算法使用的是G1
image.png

FE服务2024-11-18号内存占用情况

jcmd 12093 VM.native_memory

[root@ali-doris-fe-test-01 conf]# jcmd 12093 VM.native_memory
12093:

Native Memory Tracking:

Total: reserved=5914494KB, committed=4700758KB
-                 Java Heap (reserved=2621440KB, committed=2621440KB)
                            (mmap: reserved=2621440KB, committed=2621440KB) 
 
-                     Class (reserved=1176920KB, committed=146336KB)
                            (classes #20692)
                            (malloc=3416KB #45064) 
                            (mmap: reserved=1173504KB, committed=142920KB) 
 
-                    Thread (reserved=1621064KB, committed=1621064KB)
                            (thread #407)
                            (stack: reserved=1619144KB, committed=1619144KB)
                            (malloc=1446KB #2436) 
                            (arena=474KB #810)
 
-                      Code (reserved=264601KB, committed=86569KB)
                            (malloc=15001KB #20725) 
                            (mmap: reserved=249600KB, committed=71568KB) 
 
-                        GC (reserved=159375KB, committed=159375KB)
                            (malloc=29327KB #76625) 
                            (mmap: reserved=130048KB, committed=130048KB) 
 
-                  Compiler (reserved=786KB, committed=786KB)
                            (malloc=654KB #2721) 
                            (arena=133KB #5)
 
-                  Internal (reserved=26187KB, committed=26187KB)
                            (malloc=26155KB #68996) 
                            (mmap: reserved=32KB, committed=32KB) 
 
-                    Symbol (reserved=29037KB, committed=29037KB)
                            (malloc=26408KB #288342) 
                            (arena=2629KB #1)
 
-    Native Memory Tracking (reserved=8399KB, committed=8399KB)
                            (malloc=406KB #5674) 
                            (tracking overhead=7993KB)
 
-               Arena Chunk (reserved=1564KB, committed=1564KB)
                            (malloc=1564KB) 
 
-                   Unknown (reserved=5120KB, committed=0KB)
                            (mmap: reserved=5120KB, committed=0KB) 
 
[root@ali-doris-fe-test-01 conf]# date
Mon Nov 18 16:48:46 CST 2024

FE服务2024-11-20号内存占用情况

jcmd 12093 VM.native_memory

[root@ali-doris-fe-test-01 ~]# jcmd 12093 VM.native_memory
12093:

Native Memory Tracking:

Total: reserved=7454296KB, committed=6389992KB
-                 Java Heap (reserved=2621440KB, committed=2621440KB)
                            (mmap: reserved=2621440KB, committed=2621440KB) 
 
-                     Class (reserved=1653193KB, committed=685073KB)
                            (classes #92443)
                            (malloc=12745KB #161559) 
                            (mmap: reserved=1640448KB, committed=672328KB) 
 
-                    Thread (reserved=2605969KB, committed=2605969KB)
                            (thread #646)
                            (stack: reserved=2602916KB, committed=2602916KB)
                            (malloc=2299KB #3870) 
                            (arena=754KB #1288)
 
-                      Code (reserved=280913KB, committed=189849KB)
                            (malloc=31313KB #37095) 
                            (mmap: reserved=249600KB, committed=158536KB) 
 
-                        GC (reserved=180368KB, committed=180368KB)
                            (malloc=50320KB #145224) 
                            (mmap: reserved=130048KB, committed=130048KB) 
 
-                  Compiler (reserved=1335KB, committed=1335KB)
                            (malloc=1203KB #4098) 
                            (arena=133KB #5)
 
-                  Internal (reserved=50237KB, committed=50237KB)
                            (malloc=50205KB #194301) 
                            (mmap: reserved=32KB, committed=32KB) 
 
-                    Symbol (reserved=40016KB, committed=40016KB)
                            (malloc=35917KB #389793) 
                            (arena=4099KB #1)
 
-    Native Memory Tracking (reserved=15507KB, committed=15507KB)
                            (malloc=706KB #9903) 
                            (tracking overhead=14801KB)
 
-               Arena Chunk (reserved=198KB, committed=198KB)
                            (malloc=198KB) 
 
-                   Unknown (reserved=5120KB, committed=0KB)
                            (mmap: reserved=5120KB, committed=0KB) 
 
[root@ali-doris-fe-test-01 ~]# date
Wed Nov 20 18:15:31 CST 2024
1 Answers

需要提供堆内存监控看下,服务器监控不太好分析。

同时如果堆内存占用比较多,且不释放的话,可以收集个内存镜像,方便排查,如果正常GC就是正常的。