【已记录】spark load start spark app failed. error: Waiting too much time to get appId from handle

Viewed 51

doris version: 2.0.5
spark version:3.2.2
hadoop version:3.1.1

broker load导数已成功,想尝试spark load导数,提交任务后显示 type:ETL_SUBMIT_FAIL; msg:errCode = 2, detailMessage = start spark app failed. error: Waiting too much time to get appId from handle. spark app state: UNKNOWN, loadJobId:37975

Doris官网建议: 在<SPARK_HOME>/conf下,添加log4j.properties配置文件,并配置日志级别为INFO,这个好像没有效果。然后看SR论坛是说网络不通,测试网络是通的。

1 Answers

目前建议先换用其它的方式(比如spark connector sink)替换spark load,这块兼容问题较多;预计4月底会进行重构、届时可以再考虑spark load。