broker导出导入失败

Viewed 39

报错显示close broker writer failed
broker日志
[ TThreadPoolServer WorkerProcess-1:6629867677]- [ WARN ] failed to close writer: TBrokerFD(high:e, low:e)
org.apache.doris.broker.hdfs.BrokerException: the fd is not owned by client null
at org.apache.doris. broker.hdfs.ClientContextNanager.getFsDataOutputStream(ClientContextManager.fava:89)
at org.apache.doris.broker.hdfs,FileSystemManager.closewriter(FileSystemManager.java:1251)
at org-apache.doris.broker.hdfs.HDFSBrokerServiceImpl.closewriter(HDFSBrokerServiceImpl.java:246)
at org.apache.doris. thrift.TPaloBrokerServiceSProcessorscloseMritercgetResult(TPaloBrokerService.fava:1125)at org.apache.doris. thrift.TPaloBrokerServiceSPracessonscloseriter-getResult(TPaloBrokenService.java:1105)at org.apache. thrift.ProcessFunction.pracess(PracessFunction.java:38)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache. thrift.server.TThreadPoolServerSWorkerProcess.run(TThreadPooIServer.java:250)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:745)
2024-04-02 10:08:27 [ TThreadPoolServer WorkerProcess-6:6629867677]-[ WARN] failed to close writer: TBrokerFD(high:0, low:0)
org-apache.doris.broker.hdfs.BrokerException: the fd is not ouned by client null
at org.apache.doris.broker.hdfs.ClientContextManager.getFsDataOutputStream(ClientContextManager.java:89)
at org.apache.doris.broker.hdfs.FileSystemManager.closeWriter(FileSystenManager.java:1251)
at org.apache.doris.broker.hdfs, HDFSBrokerServiceImpl.closeWriter(HDFSBrokerServiceImpl.java:246)
at org.apache.doris,thrift.TPaloBrokerServicesProcessorscloseWriter.getResult(TPaloBrokerService.java:1125)at org.apache.doris, thrift, TPaloBrokerServicesProcessorscloseWriter.getResult(TPaloBrokerService.java:1105)at org.apache, thrift, ProcessFunction.process(ProcessFunction.java:38)

2 Answers

具体是哪个版本呢,方便用HDFS Load尝试下吗?Broker Load可能会有些问题,现在Doris内部已经集成了HDFS LOAD等功能,可以不依赖Broker这个组件,可以先试试的:HDFS LOAD

2.0.3版本,我尝试一下hdfs load