大批sql脚本同时执行,有些正常,有些报空指针。

Viewed 36

年前放假前把服务器都关了,年后上班重新都启动后,由于ds会把历史没跑的任务重新拉起运行。大批任务一起加载爆冲doris,会有好多任务节点报错。查看doris的fe.warn.log中有大量如下报错日志。之前也存在过类型的问题,是否有办法解决?

insert [label_5c21aa0052114370_928c557405b54984] with query id 5c21aa0052114370-928c557405b54984 failed, (192.168.0.212)[CANCELLED]failed to call frontend service, FE address=192.168.0.210:9020, reason: Internal error processing replacePartition
2025-02-08 10:07:35,867 WARN (mysql-nio-pool-208|1958) [OlapInsertExecutor.onFail():238] insert [label_5c21aa0052114370_928c557405b54984] with query id 5c21aa0052114370-928c557405b54984 failed
org.apache.doris.common.DdlException: errCode = 2, detailMessage = (192.168.0.212)[CANCELLED]failed to call frontend service, FE address=192.168.0.210:9020, reason: Internal error processing replacePartition
at org.apache.doris.common.ErrorReport.reportDdlException(ErrorReport.java:68) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.AbstractInsertExecutor.execImpl(AbstractInsertExecutor.java:151) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.AbstractInsertExecutor.executeSingleInsert(AbstractInsertExecutor.java:187) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertIntoTableCommand.runInternal(InsertIntoTableCommand.java:226) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertIntoTableCommand.run(InsertIntoTableCommand.java:105) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertOverwriteTableCommand.runInsertCommand(InsertOverwriteTableCommand.java:212) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertOverwriteTableCommand.insertInto(InsertOverwriteTableCommand.java:300) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.nereids.trees.plans.commands.insert.InsertOverwriteTableCommand.run(InsertOverwriteTableCommand.java:176) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.StmtExecutor.executeByNereids(StmtExecutor.java:715) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:545) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:521) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.ConnectProcessor.executeQuery(ConnectProcessor.java:323) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:206) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.MysqlConnectProcessor.handleQuery(MysqlConnectProcessor.java:272) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.MysqlConnectProcessor.dispatch(MysqlConnectProcessor.java:300) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.qe.MysqlConnectProcessor.processOnce(MysqlConnectProcessor.java:358) ~[doris-fe.jar:1.2-SNAPSHOT]
at org.apache.doris.mysql.ReadListener.lambda$handleEvent$0(ReadListener.java:52) ~[doris-fe.jar:1.2-SNAPSHOT]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_371]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_371]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_371]

2 Answers

具体的版本是什么呢?看看同时跑这么多任务的时候,集群的资源压力

2.1.6版本。集群的资源压力在哪里看。。不会求教