BE频繁报"failed to do cumulative compaction" E-6003 错误

Viewed 24
2.1

复现步骤:
通过CCR从别的集群同步历史数据过来。
CCR同步状态变成FINISHED后，暂停CCR任务，删除CCR任务。
应用程序通过stream load方式往当前集群写数据。
之后BE Compaction Score不断飙升，BE FD 指标也同步飙升。
看BE日志发现，在同步完数据换成stream load方式写数据后，日志中出现大量“failed to do cumulative compaction, tablet=11046 : [E-6003]inverted index path: /data/doris/be/be_storage/data/5/11046/699588404 not exist.”类似异常信息。

tlllll1
2 Answers

这里是 cumulative compaction，不一定是当时的 stream load 出的。
stream load 返回的是什么结果？，能发一下更多的be的日志吗？

徐振超@SelectDB6251

stream load没有返回过异常信息。

BE日志如下:
W20241114 16:41:49.378297 2992226 file_system.cpp:68] [NOT_FOUND]failed to get file size /data/doris/be/be_storage/data/240/12945/626064715/0200000000001e3ce1427cb34b6e1443a3080e24535b6285_0_3282154.idx
W20241114 16:41:49.378436 2992226 tablet.cpp:2069] failed to do cumulative compaction, tablet=12945 : [E-6003]inverted index path: /data/doris/be/be_storage/data/240/12945/626064715 not exist.
W20241114 16:41:49.406967 2992227 file_system.cpp:68] [NOT_FOUND]failed to get file size /data/doris/be/be_storage/data/206/12693/560953838/0200000000001e42e1427cb34b6e1443a3080e24535b6285_0_5527139.idx
W20241114 16:41:49.407030 2992227 tablet.cpp:2069] failed to do cumulative compaction, tablet=12693 : [E-6003]inverted index path: /data/doris/be/be_storage/data/206/12693/560953838 not exist.
W20241114 16:41:51.470269 2992217 file_system.cpp:68] [NOT_FOUND]failed to get file size /data/doris/be/be_storage/data/35/11276/904345567/0200000000001d23e1427cb34b6e1443a3080e24535b6285_0_5511674.idx
W20241114 16:41:51.470389 2992217 tablet.cpp:2069] failed to do cumulative compaction, tablet=11276 : [E-6003]inverted index path: /data/doris/be/be_storage/data/35/11276/904345567 not exist.
W20241114 16:41:51.475826 2992190 file_system.cpp:68] [NOT_FOUND]failed to get file size /data/doris/be/be_storage/data/34/11263/1309752517/0200000000001d16e1427cb34b6e1443a3080e24535b6285_0_5511655.idx
W20241114 16:41:51.475903 2992190 tablet.cpp:2069] failed to do cumulative compaction, tablet=11263 : [E-6003]inverted index path: /data/doris/be/be_storage/data/34/11263/1309752517 not exist.
W20241114 16:41:51.498633 2992223 file_system.cpp:68] [NOT_FOUND]failed to get file size /data/doris/be/be_storage/data/175/12473/211550679/0200000000001f81e1427cb34b6e1443a3080e24535b6285_0_3281836.idx
W20241114 16:41:51.498855 2992223 tablet.cpp:2069] failed to do cumulative compaction, tablet=12473 : [E-6003]inverted index path: /data/doris/be/be_storage/data/175/12473/211550679 not exist.

tlllll1