【已解决】Doris 2.0.4,be 节点报错:Array of size is too large to be manipulated as single field

Viewed 38

Doris 2.0.4 在使用Aggregate模型的时候,不小心使用了Array类型,并且Array列设置为了REPLACE方式聚合
运行一小段时间,即出现be节点崩溃

现在be节点始终无法正常启动,报错信息:

F0614 10:06:43.028738 69037 column_array.cpp:179] Array of size 18446744073709551601 is too large to be manipulated as single field, maximum size 1000000
*** Check failure stack trace: ***
F0614 10:06:43.047709 69036 column_array.cpp:179] Array of size 18446744073709551610 is too large to be manipulated as single field, maximum size 1000000
*** Check failure stack trace: ***
F0614 10:06:43.047709 69036 column_array.cpp:179] Array of size 18446744073709551610 is too large to be manipulated as single field, maximum size 1000000F0614 10:06:43.059342 69035 column_array.cpp:179] Array of size 18446744073709551612 is too large to be manipulated as single field, maximum size 1000000
*** Check failure stack trace: ***
@ 0x559dced53d2d google::LogMessage::Fail()
F0614 10:06:43.047709 69036 column_array.cpp:179] Array of size 18446744073709551610 is too large to be manipulated as single field, maximum size 1000000F0614 10:06:43.059342 69035 column_array.cpp:179] Array of size 18446744073709551612 is too large to be manipulated as single field, maximum size 1000000F0614 10:06:43.085438 69034 column_array.cpp:179] Array of size 18446744073709551606 is too large to be manipulated as single field, maximum size 1000000
*** Check failure stack trace: ***
@ 0x559dced56269 google::LogMessage::SendToLog()
@ 0x559dced53d2d google::LogMessage::Fail()
@ 0x559dced53d2d google::LogMessage::Fail()
@ 0x559dced56269 google::LogMessage::SendToLog()
@ 0x559dced56269 google::LogMessage::SendToLog()
@ 0x559dced53d2d google::LogMessage::Fail()
@ 0x559dced56269 google::LogMessage::SendToLog()
@ 0x559dced53896 google::LogMessage::Flush()
@ 0x559dced53896 google::LogMessage::Flush()
@ 0x559dced53896 google::LogMessage::Flush()
@ 0x559dced568d9 google::LogMessageFatal::~LogMessageFatal()
@ 0x559dced568d9 google::LogMessageFatal::~LogMessageFatal()
@ 0x559dced568d9 google::LogMessageFatal::~LogMessageFatal()
@ 0x559dced53896 google::LogMessage::Flush()
@ 0x559dced568d9 google::LogMessageFatal::~LogMessageFatal()
@ 0x559dc97d6f04 doris::vectorized::ColumnArray::get()
@ 0x559dc97d6f04 doris::vectorized::ColumnArray::get()
@ 0x559dc97d6f04 doris::vectorized::ColumnArray::get()
@ 0x559dc97d6f04 doris::vectorized::ColumnArray::get()
@ 0x559dc893eaab doris::vectorized::IAggregateFunctionHelper<>::add_batch_range()
@ 0x559dc893eaab doris::vectorized::IAggregateFunctionHelper<>::add_batch_range()
@ 0x559dc893eaab doris::vectorized::IAggregateFunctionHelper<>::add_batch_range()
@ 0x559dc893eaab doris::vectorized::IAggregateFunctionHelper<>::add_batch_range()
@ 0x559dce8450c3 doris::vectorized::VerticalBlockReader::_update_agg_value()
@ 0x559dce8450c3 doris::vectorized::VerticalBlockReader::_update_agg_value()
@ 0x559dce8450c3 doris::vectorized::VerticalBlockReader::_update_agg_value()
@ 0x559dce8450c3 doris::vectorized::VerticalBlockReader::_update_agg_value()
@ 0x559dce84482e doris::vectorized::VerticalBlockReader::_update_agg_data()
@ 0x559dce84482e doris::vectorized::VerticalBlockReader::_update_agg_data()
@ 0x559dce84482e doris::vectorized::VerticalBlockReader::_update_agg_data()
@ 0x559dce84482e doris::vectorized::VerticalBlockReader::_update_agg_data()
@ 0x559dce844382 doris::vectorized::VerticalBlockReader::_agg_key_next_block()
@ 0x559dc68fe108 doris::Merger::vertical_compact_one_group()
@ 0x559dc68ff6c6 doris::Merger::vertical_merge_rowsets()
@ 0x559dce844382 doris::vectorized::VerticalBlockReader::_agg_key_next_block()
@ 0x559dce844382 doris::vectorized::VerticalBlockReader::_agg_key_next_block()
@ 0x559dce844382 doris::vectorized::VerticalBlockReader::_agg_key_next_block()
@ 0x559dc68ecacf doris::Compaction::do_compaction_impl()
@ 0x559dc68fe108 doris::Merger::vertical_compact_one_group()
@ 0x559dc68fe108 doris::Merger::vertical_compact_one_group()
@ 0x559dc68ebe8a doris::Compaction::do_compaction()
@ 0x559dc68fe108 doris::Merger::vertical_compact_one_group()
@ 0x559dc68ff6c6 doris::Merger::vertical_merge_rowsets()
@ 0x559dc70e4fd6 doris::CumulativeCompaction::execute_compact_impl()
@ 0x559dc68ff6c6 doris::Merger::vertical_merge_rowsets()
@ 0x559dc68ecacf doris::Compaction::do_compaction_impl()
@ 0x559dc68ff6c6 doris::Merger::vertical_merge_rowsets()
@ 0x559dc68ebb63 doris::Compaction::execute_compact()
@ 0x559dc68ecacf doris::Compaction::do_compaction_impl()
@ 0x559dc68ebe8a doris::Compaction::do_compaction()
@ 0x559dc68ecacf doris::Compaction::do_compaction_impl()
@ 0x559dc70be044 doris::Tablet::execute_compaction()
@ 0x559dc688a9fe std::_Function_handler<>::_M_invoke()
@ 0x559dc68ebe8a doris::Compaction::do_compaction()
@ 0x559dc70e4fd6 doris::CumulativeCompaction::execute_compact_impl()
@ 0x559dc68ebe8a doris::Compaction::do_compaction()
@ 0x559dc744474f doris::ThreadPool::dispatch_thread()
@ 0x559dc70e4fd6 doris::CumulativeCompaction::execute_compact_impl()
@ 0x559dc68ebe8a doris::Compaction::do_compaction()
@ 0x559dc744474f doris::ThreadPool::dispatch_thread()
@ 0x559dc70e4fd6 doris::CumulativeCompaction::execute_compact_impl()
@ 0x559dc68ebb63 doris::Compaction::execute_compact()
@ 0x559dc70e4fd6 doris::CumulativeCompaction::execute_compact_impl()
@ 0x559dc743a6cc doris::Thread::supervise_thread()
@ 0x559dc68ebb63 doris::Compaction::execute_compact()
@ 0x559dc70be044 doris::Tablet::execute_compaction()
@ 0x559dc688a9fe std::_Function_handler<>::_M_invoke()
@ 0x559dc68ebb63 doris::Compaction::execute_compact()
@ 0x7fde8f350ea5 start_thread
@ 0x559dc70be044 doris::Tablet::execute_compaction()
@ 0x559dc688a9fe std::_Function_handler<>::_M_invoke()
@ 0x559dc744474f doris::ThreadPool::dispatch_thread()
@ 0x559dc70be044 doris::Tablet::execute_compaction()
@ 0x559dc688a9fe std::_Function_handler<>::_M_invoke()
@ 0x7fde8fd7fb0d __clone
@ 0x559dc744474f doris::ThreadPool::dispatch_thread()
@ 0x559dc743a6cc doris::Thread::supervise_thread()
@ 0x559dc744474f doris::ThreadPool::dispatch_thread()
@ (nil) (unknown)
*** Query id: 0-0 ***
*** tablet id: 24376583 ***
*** Aborted at 1718330803 (unix time) try "date -d @1718330803" if you are using GNU date ***
*** Current BE git commitID: 003a815b63 ***
*** SIGABRT unknown detail explain (@0x3e9000108ca) received by PID 67786 (TID 69037 OR 0x7fdbcd9d8700) from PID 67786; stack trace: ***
@ 0x559dc743a6cc doris::Thread::supervise_thread()
@ 0x7fde8f350ea5 start_thread
@ 0x559dc743a6cc doris::Thread::supervise_thread()
@ 0x7fde8f350ea5 start_thread
@ 0x7fde8fd7fb0d __clone
@ 0x7fde8f350ea5 start_thread
@ 0x7fde8fd7fb0d __clone
@ (nil) (unknown)
@ 0x7fde8fd7fb0d __clone
@ (nil) (unknown)
@ (nil) (unknown)
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:417
1# 0x00007FDE8FCB7400 in /lib64/libc.so.6
2# gsignal in /lib64/libc.so.6
3# abort in /lib64/libc.so.6
4# 0x0000559DCED5E719 in /home/admin/doris-2.0.4/be/lib/doris_be
5# 0x0000559DCED53D2D in /home/admin/doris-2.0.4/be/lib/doris_be
6# google::LogMessage::SendToLog() in /home/admin/doris-2.0.4/be/lib/doris_be
7# google::LogMessage::Flush() in /home/admin/doris-2.0.4/be/lib/doris_be
8# google::LogMessageFatal::~LogMessageFatal() in /home/admin/doris-2.0.4/be/lib/doris_be
9# doris::vectorized::ColumnArray::get(unsigned long, doris::vectorized::Field&) const in /home/admin/doris-2.0.4/be/lib/doris_be
10# doris::vectorized::IAggregateFunctionHelper<doris::vectorized::ReaderFunctionData<doris::vectorized::ReaderFunctionFirstData<doris::vectorized::ReaderFirstAndLastData<doris::vectorized::ColumnArray, true, true, true> > > >::add_batch_range(unsigned long, unsigned long, char*, doris::vectorized::IColumn const**, doris::vectorized::Arena*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/vec/aggregate_functions/aggregate_function.h:308
11# doris::vectorized::VerticalBlockReader::_update_agg_value(std::vector<COW::mutable_ptr, std::allocator<COW::mutable_ptr > >&, int, int, bool) at /home/zcp/repo_center/doris_release/doris/be/src/vec/olap/vertical_block_reader.cpp:302
12# doris::vectorized::VerticalBlockReader::_update_agg_data(std::vector<COW::mutable_ptr, std::allocator<COW::mutable_ptr > >&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/olap/vertical_block_reader.cpp:276
13# doris::vectorized::VerticalBlockReader::_agg_key_next_block(doris::vectorized::Block*, bool*) at /home/zcp/repo_center/doris_release/doris/be/src/vec/olap/vertical_block_reader.cpp:390
14# doris::Merger::vertical_compact_one_group(std::shared_ptr, doris::ReaderType, std::shared_ptr, bool, std::vector<unsigned int, std::allocator > const&, doris::vectorized::RowSourcesBuffer*, std::vector<std::shared_ptr, std::allocator<std::shared_ptr > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/merger.cpp:242
15# doris::Merger::vertical_merge_rowsets(std::shared_ptr, doris::ReaderType, std::shared_ptr, std::vector<std::shared_ptr, std::allocator<std::shared_ptr > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/merger.cpp:349
16# doris::Compaction::do_compaction_impl(long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:354
17# doris::Compaction::do_compaction(long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:125
18# doris::CumulativeCompaction::execute_compact_impl() at /home/zcp/repo_center/doris_release/doris/be/src/olap/cumulative_compaction.cpp:79
19# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:107
20# doris::Tablet::execute_compaction(doris::Compaction&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/tablet.cpp:1910
21# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr, doris::CompactionType, bool)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291
22# doris::ThreadPool::dispatch_thread() in /home/admin/doris-2.0.4/be/lib/doris_be
23# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
24# start_thread in /lib64/libpthread.so.0
25# clone in /lib64/libc.so.6

寻求启动be节点的解决方案

1 Answers