flink-doris-connector写入doris报[INTERNAL_ERROR]cancelled: sender is gone错误，导致flink作业异常退出

Viewed 120
1.2

flink-doris-connector版本：1.4.0
doris版本：1.2.7

BE日志信息如下：
760d233f7948338d83137afa6f4036d.png

Flink日志如下：
org.apache.doris.flink.sink.committer.DorisCommitter - load result {
"status": "ANALYSIS_ERROR",
"msg": "errCode = 2, detailMessage = transaction [76527147] is already visible, not pre-committed."
}

yugunsung91
2 Answers

可以增加下面的配置看下
webserver_num_workers=4096
fragment_pool_queue_size=4096
fragment_pool_thread_num_max=4096
doris_max_remote_scanner_thread_pool_thread_num=4096
load_process_max_memory_limit_percent=80
doris_scanner_row_num=2048
flush_thread_num_per_store=24

徐振超@SelectDB6501

看着像 flink 某个 task 失败（但实际成功了），然后重试，就会这样

mink211