Doris2.1.7版本FE内存使用率持续上升,还有内存泄露吗?

Viewed 69

Doris版本:2.1.7
问题:FE内存使用率处于一个上升趋势,目前最大堆内存设置-Xmx3072m,不知道该版本是不是还存在内存泄露问题

image.png
image.png

jcmd 29506 VM.native_memory

[root@ali-doris-fe-test-01 ~]# jcmd 29506 VM.native_memory
29506:

Native Memory Tracking:

Total: reserved=8188879KB, committed=7166631KB
-                 Java Heap (reserved=3145728KB, committed=3145728KB)
                            (mmap: reserved=3145728KB, committed=3145728KB) 
 
-                     Class (reserved=1957446KB, committed=1027430KB)
                            (classes #135915)
                            (malloc=24134KB #228859) 
                            (mmap: reserved=1933312KB, committed=1003296KB) 
 
-                    Thread (reserved=2610065KB, committed=2610065KB)
                            (thread #644)
                            (stack: reserved=2607020KB, committed=2607020KB)
                            (malloc=2294KB #3858) 
                            (arena=752KB #1284)
 
-                      Code (reserved=284183KB, committed=191951KB)
                            (malloc=34583KB #39931) 
                            (mmap: reserved=249600KB, committed=157368KB) 
 
-                        GC (reserved=14731KB, committed=14731KB)
                            (malloc=2771KB #1641) 
                            (mmap: reserved=11960KB, committed=11960KB) 
 
-                  Compiler (reserved=1396KB, committed=1396KB)
                            (malloc=1263KB #4102) 
                            (arena=133KB #5)
 
-                  Internal (reserved=38773KB, committed=38773KB)
                            (malloc=38741KB #187272) 
                            (mmap: reserved=32KB, committed=32KB) 
 
-                    Symbol (reserved=40593KB, committed=40593KB)
                            (malloc=36494KB #395993) 
                            (arena=4099KB #1)
 
-    Native Memory Tracking (reserved=14343KB, committed=14343KB)
                            (malloc=702KB #9881) 
                            (tracking overhead=13641KB)
 
-               Arena Chunk (reserved=1632KB, committed=1632KB)
                            (malloc=1632KB) 
 
-                   Unknown (reserved=79988KB, committed=79988KB)
                            (mmap: reserved=79988KB, committed=79988KB) 
 

jcmd 29506 GC.heap_info

[root@ali-doris-fe-test-01 ~]# jcmd 29506 GC.heap_info
29506:
 par new generation   total 153344K, used 58594K [0x0000000700000000, 0x000000070a660000, 0x000000070a660000)
  eden space 136320K,  36% used [0x0000000700000000, 0x000000070307cad8, 0x0000000708520000)
  from space 17024K,  52% used [0x0000000708520000, 0x0000000708ddbd48, 0x00000007095c0000)
  to   space 17024K,   0% used [0x00000007095c0000, 0x00000007095c0000, 0x000000070a660000)
 concurrent mark-sweep generation total 2975360K, used 1689182K [0x000000070a660000, 0x00000007c0000000, 0x00000007c0000000)
 Metaspace       used 951739K, capacity 1002911K, committed 1003296K, reserved 1933312K
  class space    used 106202K, capacity 120430K, committed 120524K, reserved 1048576K
2 Answers

是有什么任务在跑不?而且堆内存设置的确实有些少了些,你这个配置文件应该是比较老的了,2.1.7 GC 已经改成了 G1 ,已经不是CMS了,可以调整下。

今天我临时加了一下-XX:MaxMetaspaceSize=140m,设置了Metaspace的最大值,执行一会也就直接报java.lang.OutOfMemoryError: Metaspace,说明Metaspace是会越来越大的
image.png