2.1.3 升级2.1.4 版本后,doris-spark-connector 写入数据异常 (doris sync_request_ids)

Viewed 33

版本环境: selectdb-doris 2.1.4
错误提示内容: [CANCELLED][THRIFT_RPC_ERROR]auto inc sync result length > front buffer. 1 vs 0 doris::vectorized::AutoIncIDBuffer::sync_request_ids

具体错误

org.apache.doris.spark.exception.StreamLoadException: stream load error, load status:Fail, response:StreamLoadResponse(200,OK,{
"TxnId": 13437082,
"Label": "spark_streamload_20240629_110258_51e3a05794a64cf5831d919123bebcdd",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Fail",
"Message": "[CANCELLED][THRIFT_RPC_ERROR]auto inc sync result length > front buffer. 1 vs 0\n\n\t0# doris::vectorized::AutoIncIDBuffer::sync_request_ids(unsigned long, std::vector<std::pair<long, unsigned long>, std::allocator<std::pair<long, unsigned long> > >) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187\n\t1# doris::vectorized::OlapTableBlockConvertor::_fill_auto_inc_cols(doris::vectorized::Block, unsigned long) at /home/zcp/repo_center/doris_enterprise/doris/be/src/common/status.h:481\n\t2# doris::vectorized::OlapTableBlockConvertor::validate_and_convert_block(doris::RuntimeState*, doris::vectorized::Block*, std::shared_ptr&, std::vector<std::shared_ptr, std::allocator<std::shared_ptr > >, unsigned long, bool&) at /home/zcp/repo_center/doris_enterprise/doris/be/src/vec/sink/vtablet_block_convertor.cpp:0\n\t3# doris::vectorized::VRowDistribution::generate_rows_distribution(doris::vectorized::Block&, std::shared_ptr&, long&, bool&, std::vector<doris::vectorized::RowPartTabletIds, std::allocator >&, long&) at /home/zcp/repo_center/doris_enterprise/doris/be/src/vec/sink/vrow_distribution.cpp:413\n\t4# doris::vectorized::VTabletWriter::write(doris::vectorized::Block&) at /home/zcp/repo_center/doris_enterprise/doris/be/src/vec/sink/writer/vtablet_writer.cpp:1696\n\t5# doris::vectorized::AsyncResultWriter::process_block(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_enterprise/doris/be/src/common/status.h:481\n\t6# std::_Function_handler<void (), doris::vectorized::AsyncResultWriter::start_writer(doris::RuntimeState*, doris::RuntimeProfile*)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/ext/atomicity.h:98\n\t7# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_enterprise/doris/be/src/util/threadpool.cpp:0\n\t8# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562\n\t9# start_thread\n\t10# clone\n",
"NumberTotalRows": 1,
"NumberLoadedRows": 1,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 104,
"LoadTimeMs": 13,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 7,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 4,
"CommitAndPublishTimeMs": 0
}
)

0 Answers