Doris2.1.0调用Flink连接器api写入数据报错报错

Viewed 33

版本:2.1.0
在IDEA中调用FlinkSQL和Flinkapi可以查询doris的数据,但写入时会报错,linux中已经将/opt/module/doris/be/storage/data设置为777

Caused by: org.apache.doris.flink.exception.DorisRuntimeException: table test.table1 stream load error: [CANCELLED][INTERNAL_ERROR]tablet error: [E-125]failed to create file /opt/module/doris/be/storage/data/0/12006/313149110/02000000000000bfc24c248b4e19b49e0df10961071c16ba_0.dat, host: hadoop102, see more in null
	at org.apache.doris.flink.sink.writer.DorisWriter.prepareCommit(DorisWriter.java:254)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.emitCommittables(SinkWriterOperator.java:196)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.endInput(SinkWriterOperator.java:183)
	at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.endOperatorInput(StreamOperatorWrapper.java:96)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.endInput(RegularOperatorChain.java:97)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:550)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:839)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:788)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:931)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562)
	at java.lang.Thread.run(Thread.java:750)

Process finished with exit code 1

be的日志:

W20240824 12:06:11.996560 26440 stream_load.cpp:112] handle streaming load failed, id=eb417fd95bb43e71-a5c0dae2f8bf61a2, errmsg=[CANCELLED][INTERNAL_ERROR]tablet error: [E-125]failed to create file /opt/module/doris/be/storage/data/0/12006/313149110/0200000000000097c24c248b4e19b49e0df10961071c16ba_0.dat, host: hadoop102
1 Answers

重装doris后没问题了,可能和之前的扩容缩容操作有关?但是IP什么的都没问题,FE上也能正常看到BE,不太清楚原因,供出现同样问题的人参考。