doris 2.1.5通过broker load导入数据,FE内存阶梯上升,然后重启

Viewed 21

在使用broker load导入数据过程中,出现fe隔一段时间重启一次情况,内存oom后dump内存得到结果如何下:

上传中...

1 Answers

问题补充:fe使用jdk17,jvm参数: java_opts:JAVA_OPTS_FOR_JDK_17="-Djava.net.preferIPv4Stack=true -Djavax.security.auth.useSubjectCredsOnly=false -XX:+UseG1GC -Xmx8192m -Xms256m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=$LOG_DIR/doris.hprof -Xlog:gc*:$LOG_DIR/fe.gc.log.$CUR_DATE:time"

图片无法上传成功,
problem suspect 1(917.7M):
One instance of "java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue" loaded by "" occupies 962,271,808 (11.43%) bytes. The instance is referenced by org.apache.hadoop.metrics2.lib.MutableQuantiles @ 0x605c27050 , loaded by "jdk.internal.loader.ClassLoaders$AppClassLoader @ 0x7ffb5c4c8". The memory is accumulated in one instance of "java.util.concurrent.RunnableScheduledFuture[]" loaded by "".

Keywords
jdk.internal.loader.ClassLoaders$AppClassLoader @ 0x7ffb5c4c8
java.util.concurrent.RunnableScheduledFuture[]
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue

problem suspect 2(5.4G):
224,167 instances of "org.apache.hadoop.metrics2.impl.MetricsSourceAdapter", loaded by "jdk.internal.loader.ClassLoaders$AppClassLoader @ 0x7ffb5c4c8" occupy 5,778,000,776 (68.64%) bytes. These instances are referenced from one instance of "java.util.HashMap$Node[]", loaded by ""

Keywords
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter
jdk.internal.loader.ClassLoaders$AppClassLoader @ 0x7ffb5c4c8
java.util.HashMap$Node[]