Doris3.0.2,执行一个sql,三个be都挂了

Viewed 152

3.0.2 存算分离

1. be.out Query id: 2e454c419be44390-b6a3b5c438997762
   I20241106 00:19:39.327404 769385 config.cpp:1694] set config enable_file_cache true [OK]
OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-3.0.2-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-3.0.2-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-3.0.2-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
start BE in cloud mode, cloud_unique_id: 1:123:vUTsyGdq, meta_service_endpoint: 192.168.6.11:5001,192.168.6.13:5001,192.168.6.15:5001
F20241107 14:03:14.760818 771347 assert_cast.h:57] Bad cast from type:doris::vectorized::ColumnStr<unsigned long> to doris::vectorized::ColumnStr<unsigned int>
*** Check failure stack trace: ***
    @     0x560b14a58366  google::LogMessage::SendToLog()
    @     0x560b14a54db0  google::LogMessage::Flush()
    @     0x560b14a58ba9  google::LogMessageFatal::~LogMessageFatal()
    @     0x560b0a00e7f6  _ZZ11assert_castIRKN5doris10vectorized9ColumnStrIjEEL18TypeCheckOnRelease1ERKNS1_7IColumnEET_OT1_ENKUlOSA_E_clIS9_EES5_SD_
    @     0x560b0a00e467  assert_cast<>()
    @     0x560b0e82f66b  doris::vectorized::ColumnStr<>::insert_range_from()
    @     0x560b0e7aea6e  doris::vectorized::ColumnArray::insert_from()
    @     0x560b0e7b181e  doris::vectorized::ColumnArray::insert_indices_from()
    @     0x560b0e802b82  doris::vectorized::ColumnNullable::insert_indices_from_not_has_null()
    @     0x560b143692da  doris::pipeline::ProcessHashTableProbe<>::build_side_output_column()
    @     0x560b14375763  doris::pipeline::ProcessHashTableProbe<>::do_process<>()
    @     0x560b14375469  _ZZN5doris8pipeline21ProcessHashTableProbeILi3EE7processILb1ELb1ENS_10vectorized16MethodSerializedINS_13JoinHashTableINS_9StringRefE11DefaultHashIS7_vEEEEEEENS_6StatusERT1_PKNS4_8PODArrayIhLm4096E9AllocatorILb0ELb0ELb0E22DefaultMemoryAllocatorELm16ELm15EEERNS4_12MutableBlockEPNS4_5BlockEmbbENKUlT_T0_E_clISt17integral_constantIbLb0EESV_EEDaSQ_SR_
    @     0x560b1436a13b  doris::pipeline::ProcessHashTableProbe<>::process<>()
    @     0x560b1416458c  std::__detail::__variant::__gen_vtable_impl<>::__visit_invoke()
    @     0x560b1415bbba  doris::pipeline::HashJoinProbeOperatorX::pull()
    @     0x560b13bf0fd1  doris::pipeline::StatefulOperatorX<>::get_block()
    @     0x560b13bda25c  doris::pipeline::OperatorXBase::get_block_after_projects()
    @     0x560b1498c365  doris::pipeline::PipelineTask::execute()
    @     0x560b1499a6ed  doris::pipeline::TaskScheduler::_do_work()
    @     0x560b0ad227a8  doris::ThreadPool::dispatch_thread()
    @     0x560b0ad17871  doris::Thread::supervise_thread()
    @     0x7fe92d294ac3  (unknown)
    @     0x7fe92d326850  (unknown)
    @              (nil)  (unknown)
*** Query id: 2e454c419be44390-b6a3b5c438997762 ***
*** is nereids: 1 ***
*** tablet id: 0 ***
*** Aborted at 1730959395 (unix time) try "date -d @1730959395" if you are using GNU date ***
*** Current BE git commitID: c21b9f5bce ***
*** SIGABRT unknown detail explain (@0xbbd69) received by PID 769385 (TID 771347 OR 0x7fe570240640) from PID 769385; stack trace: ***
F20241107 14:03:15.811507 771351 assert_cast.h:57] Bad cast from type:doris::vectorized::ColumnStr<unsigned long> to doris::vectorized::ColumnStr<unsigned int>
*** Check failure stack trace: ***
F20241107 14:03:15.811507 771351 assert_cast.h:57] Bad cast from type:doris::vectorized::ColumnStr<unsigned long> to doris::vectorized::ColumnStr<unsigned int>F20241107 14:03:27.943596 771404 assert_cast.h:57] Bad cast from type:doris::vectorized::ColumnStr<unsigned long> to doris::vectorized::ColumnStr<unsigned int>
*** Check failure stack trace: ***
    @     0x560b14a58366  google::LogMessage::SendToLog()
    @     0x560b14a58366  google::LogMessage::SendToLog()
    @     0x560b14a54db0  google::LogMessage::Flush()
    @     0x560b14a58ba9  google::LogMessageFatal::~LogMessageFatal()
    @     0x560b14a54db0  google::LogMessage::Flush()
    @     0x560b0a00e7f6  _ZZ11assert_castIRKN5doris10vectorized9ColumnStrIjEEL18TypeCheckOnRelease1ERKNS1_7IColumnEET_OT1_ENKUlOSA_E_clIS9_EES5_SD_
    @     0x560b14a58ba9  google::LogMessageFatal::~LogMessageFatal()
    @     0x560b0a00e467  assert_cast<>()
    @     0x560b0a00e7f6  _ZZ11assert_castIRKN5doris10vectorized9ColumnStrIjEEL18TypeCheckOnRelease1ERKNS1_7IColumnEET_OT1_ENKUlOSA_E_clIS9_EES5_SD_
    @     0x560b0a00e467  assert_cast<>()
    @     0x560b0e82f66b  doris::vectorized::ColumnStr<>::insert_range_from()
    @     0x560b0e82f66b  doris::vectorized::ColumnStr<>::insert_range_from()
    @     0x560b0e7aea6e  doris::vectorized::ColumnArray::insert_from()
    @     0x560b0e7aea6e  doris::vectorized::ColumnArray::insert_from()
    @     0x560b0e7b181e  doris::vectorized::ColumnArray::insert_indices_from()
    @     0x560b0e7b181e  doris::vectorized::ColumnArray::insert_indices_from()
    @     0x560b0e802b82  doris::vectorized::ColumnNullable::insert_indices_from_not_has_null()
    @     0x560b0e802b82  doris::vectorized::ColumnNullable::insert_indices_from_not_has_null()
    @     0x560b143692da  doris::pipeline::ProcessHashTableProbe<>::build_side_output_column()
    @     0x560b143692da  doris::pipeline::ProcessHashTableProbe<>::build_side_output_column()
    @     0x560b14375763  doris::pipeline::ProcessHashTableProbe<>::do_process<>()
    @     0x560b14375763  doris::pipeline::ProcessHashTableProbe<>::do_process<>()
    @     0x560b14375469  _ZZN5doris8pipeline21ProcessHashTableProbeILi3EE7processILb1ELb1ENS_10vectorized16MethodSerializedINS_13JoinHashTableINS_9StringRefE11DefaultHashIS7_vEEEEEEENS_6StatusERT1_PKNS4_8PODArrayIhLm4096E9AllocatorILb0ELb0ELb0E22DefaultMemoryAllocatorELm16ELm15EEERNS4_12MutableBlockEPNS4_5BlockEmbbENKUlT_T0_E_clISt17integral_constantIbLb0EESV_EEDaSQ_SR_
    @     0x560b14375469  _ZZN5doris8pipeline21ProcessHashTableProbeILi3EE7processILb1ELb1ENS_10vectorized16MethodSerializedINS_13JoinHashTableINS_9StringRefE11DefaultHashIS7_vEEEEEEENS_6StatusERT1_PKNS4_8PODArrayIhLm4096E9AllocatorILb0ELb0ELb0E22DefaultMemoryAllocatorELm16ELm15EEERNS4_12MutableBlockEPNS4_5BlockEmbbENKUlT_T0_E_clISt17integral_constantIbLb0EESV_EEDaSQ_SR_
    @     0x560b1436a13b  doris::pipeline::ProcessHashTableProbe<>::process<>()
    @     0x560b1436a13b  doris::pipeline::ProcessHashTableProbe<>::process<>()
    @     0x560b1416458c  std::__detail::__variant::__gen_vtable_impl<>::__visit_invoke()
    @     0x560b1416458c  std::__detail::__variant::__gen_vtable_impl<>::__visit_invoke()
    @     0x560b1415bbba  doris::pipeline::HashJoinProbeOperatorX::pull()
    @     0x560b1415bbba  doris::pipeline::HashJoinProbeOperatorX::pull()
    @     0x560b13bf0fd1  doris::pipeline::StatefulOperatorX<>::get_block()
    @     0x560b13bf0fd1  doris::pipeline::StatefulOperatorX<>::get_block()
    @     0x560b13bda25c  doris::pipeline::OperatorXBase::get_block_after_projects()
    @     0x560b13bda25c  doris::pipeline::OperatorXBase::get_block_after_projects()
    @     0x560b1498c365  doris::pipeline::PipelineTask::execute()
    @     0x560b1498c365  doris::pipeline::PipelineTask::execute()
    @     0x560b1499a6ed  doris::pipeline::TaskScheduler::_do_work()
    @     0x560b1499a6ed  doris::pipeline::TaskScheduler::_do_work()
    @     0x560b0ad227a8  doris::ThreadPool::dispatch_thread()
    @     0x560b0ad227a8  doris::ThreadPool::dispatch_thread()
    @     0x560b0ad17871  doris::Thread::supervise_thread()
    @     0x560b0ad17871  doris::Thread::supervise_thread()
    @     0x7fe92d294ac3  (unknown)
    @     0x7fe92d294ac3  (unknown)
    @     0x7fe92d326850  (unknown)
    @     0x7fe92d326850  (unknown)
    @              (nil)  (unknown)
    @              (nil)  (unknown)
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:421
 1# 0x00007FE92D242520 in /lib/x86_64-linux-gnu/libc.so.6
 2# pthread_kill at ./nptl/pthread_kill.c:89
 3# raise at ../sysdeps/posix/raise.c:27
 4# abort at ./stdlib/abort.c:81
 5# 0x0000560B14A62C3D in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
 6# 0x0000560B14A5527A in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
 7# google::LogMessage::SendToLog() in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
 8# google::LogMessage::Flush() in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
 9# google::LogMessageFatal::~LogMessageFatal() in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
10# doris::vectorized::ColumnStr<unsigned int> const& assert_cast<doris::vectorized::ColumnStr<unsigned int> const&, (TypeCheckOnRelease)1, doris::vectorized::IColumn const&>(doris::vectorized::IColumn const&)::{lambda(auto:1&&)#1}::operator()<doris::vectorized::IColumn const&>(doris::vectorized::IColumn const&) const at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/assert_cast.h:57
11# doris::vectorized::ColumnStr<unsigned int> const& assert_cast<doris::vectorized::ColumnStr<unsigned int> const&, (TypeCheckOnRelease)1, doris::vectorized::IColumn const&>(doris::vectorized::IColumn const&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/common/assert_cast.h:72
12# doris::vectorized::ColumnStr<unsigned int>::insert_range_from(doris::vectorized::IColumn const&, unsigned long, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/vec/columns/column_string.cpp:138
13# doris::vectorized::ColumnArray::insert_from(doris::vectorized::IColumn const&, unsigned long) in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
14# doris::vectorized::ColumnArray::insert_indices_from(doris::vectorized::IColumn const&, unsigned int const*, unsigned int const*) at /home/zcp/repo_center/doris_release/doris/be/src/vec/columns/column_array.cpp:837
15# doris::vectorized::ColumnNullable::insert_indices_from_not_has_null(doris::vectorized::IColumn const&, unsigned int const*, unsigned int const*) at /home/zcp/repo_center/doris_release/doris/be/src/vec/columns/column_nullable.cpp:305
16# doris::pipeline::ProcessHashTableProbe<3>::build_side_output_column(std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >&, std::vector<bool, std::allocator<bool> > const&, int, bool, bool) in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
17# doris::Status doris::pipeline::ProcessHashTableProbe<3>::do_process<true, true, doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > >, false, false>(doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > >&, doris::vectorized::PODArray<unsigned char, 4096ul, Allocator<false, false, false, DefaultMemoryAllocator>, 16ul, 15ul> const*, doris::vectorized::MutableBlock&, doris::vectorized::Block*, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/join/process_hash_table_probe_impl.h:287
18# auto doris::pipeline::ProcessHashTableProbe<3>::process<true, true, doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > > >(doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > >&, doris::vectorized::PODArray<unsigned char, 4096ul, Allocator<false, false, false, DefaultMemoryAllocator>, 16ul, 15ul> const*, doris::vectorized::MutableBlock&, doris::vectorized::Block*, unsigned long, bool, bool)::{lambda(auto:1, auto:2)#1}::operator()<std::integral_constant<bool, false>, std::integral_constant<bool, false> >(std::integral_constant<bool, false>, std::integral_constant<bool, false>) const at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/join/process_hash_table_probe_impl.h:681
19# doris::Status doris::pipeline::ProcessHashTableProbe<3>::process<true, true, doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > > >(doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > >&, doris::vectorized::PODArray<unsigned char, 4096ul, Allocator<false, false, false, DefaultMemoryAllocator>, 16ul, 15ul> const*, doris::vectorized::MutableBlock&, doris::vectorized::Block*, unsigned long, bool, bool) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/join/process_hash_table_probe_impl.h:688
20# std::__detail::__variant::__gen_vtable_impl<std::__detail::__variant::_Multi_array<std::__detail::__variant::__deduce_visit_result<void> (*)(doris::pipeline::HashJoinProbeOperatorX::pull(doris::RuntimeState*, doris::vectorized::Block*, bool*) const::$_0&&, std::variant<std::monostate, doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > >, doris::vectorized::MethodOneNumber<unsigned char, doris::JoinHashTable<unsigned char, HashCRC32<unsigned char> > >, doris::vectorized::MethodOneNumber<unsigned short, doris::JoinHashTable<unsigned short, HashCRC32<unsigned short> > >, doris::vectorized::MethodOneNumber<unsigned int, doris::JoinHashTable<unsigned int, HashCRC32<unsigned int> > >, doris::vectorized::MethodOneNumber<unsigned long, doris::JoinHashTable<unsigned long, HashCRC32<unsigned long> > >, doris::vectorized::MethodOneNumber<wide::integer<128ul, unsigned int>, doris::JoinHashTable<wide::integer<128ul, unsigned int>, HashCRC32<wide::integer<128ul, unsigned int> > > >, doris::vectorized::MethodOneNumber<wide::integer<256ul, unsigned int>, doris::JoinHashTable<wide::integer<256ul, unsigned int>, HashCRC32<wide::integer<256ul, unsigned int> > > >, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<unsigned long, HashCRC32<unsigned long> >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<unsigned long, HashCRC32<unsigned long> >, false>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<128ul, unsigned int>, HashCRC32<wide::integer<128ul, unsigned int> > >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<128ul, unsigned int>, HashCRC32<wide::integer<128ul, unsigned int> > >, false>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<256ul, unsigned int>, HashCRC32<wide::integer<256ul, unsigned int> > >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<256ul, unsigned int>, HashCRC32<wide::integer<256ul, unsigned int> > >, false>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<doris::vectorized::UInt136, HashCRC32<doris::vectorized::UInt136> >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<doris::vectorized::UInt136, HashCRC32<doris::vectorized::UInt136> >, false> >&, std::variant<std::monostate, doris::pipeline::ProcessHashTableProbe<0>, doris::pipeline::ProcessHashTableProbe<2>, doris::pipeline::ProcessHashTableProbe<8>, doris::pipeline::ProcessHashTableProbe<1>, doris::pipeline::ProcessHashTableProbe<4>, doris::pipeline::ProcessHashTableProbe<3>, doris::pipeline::ProcessHashTableProbe<5>, doris::pipeline::ProcessHashTableProbe<7>, doris::pipeline::ProcessHashTableProbe<9>, doris::pipeline::ProcessHashTableProbe<10>, doris::pipeline::ProcessHashTableProbe<11> >&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >&&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >&&)>, std::integer_sequence<unsigned long, 1ul, 6ul, 1ul, 1ul> >::__visit_invoke(doris::pipeline::HashJoinProbeOperatorX::pull(doris::RuntimeState*, doris::vectorized::Block*, bool*) const::$_0&&, std::variant<std::monostate, doris::vectorized::MethodSerialized<doris::JoinHashTable<doris::StringRef, DefaultHash<doris::StringRef, void> > >, doris::vectorized::MethodOneNumber<unsigned char, doris::JoinHashTable<unsigned char, HashCRC32<unsigned char> > >, doris::vectorized::MethodOneNumber<unsigned short, doris::JoinHashTable<unsigned short, HashCRC32<unsigned short> > >, doris::vectorized::MethodOneNumber<unsigned int, doris::JoinHashTable<unsigned int, HashCRC32<unsigned int> > >, doris::vectorized::MethodOneNumber<unsigned long, doris::JoinHashTable<unsigned long, HashCRC32<unsigned long> > >, doris::vectorized::MethodOneNumber<wide::integer<128ul, unsigned int>, doris::JoinHashTable<wide::integer<128ul, unsigned int>, HashCRC32<wide::integer<128ul, unsigned int> > > >, doris::vectorized::MethodOneNumber<wide::integer<256ul, unsigned int>, doris::JoinHashTable<wide::integer<256ul, unsigned int>, HashCRC32<wide::integer<256ul, unsigned int> > > >, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<unsigned long, HashCRC32<unsigned long> >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<unsigned long, HashCRC32<unsigned long> >, false>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<128ul, unsigned int>, HashCRC32<wide::integer<128ul, unsigned int> > >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<128ul, unsigned int>, HashCRC32<wide::integer<128ul, unsigned int> > >, false>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<256ul, unsigned int>, HashCRC32<wide::integer<256ul, unsigned int> > >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<wide::integer<256ul, unsigned int>, HashCRC32<wide::integer<256ul, unsigned int> > >, false>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<doris::vectorized::UInt136, HashCRC32<doris::vectorized::UInt136> >, true>, doris::vectorized::MethodKeysFixed<doris::JoinHashTable<doris::vectorized::UInt136, HashCRC32<doris::vectorized::UInt136> >, false> >&, std::variant<std::monostate, doris::pipeline::ProcessHashTableProbe<0>, doris::pipeline::ProcessHashTableProbe<2>, doris::pipeline::ProcessHashTableProbe<8>, doris::pipeline::ProcessHashTableProbe<1>, doris::pipeline::ProcessHashTableProbe<4>, doris::pipeline::ProcessHashTableProbe<3>, doris::pipeline::ProcessHashTableProbe<5>, doris::pipeline::ProcessHashTableProbe<7>, doris::pipeline::ProcessHashTableProbe<9>, doris::pipeline::ProcessHashTableProbe<10>, doris::pipeline::ProcessHashTableProbe<11> >&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >&&, std::variant<std::integral_constant<bool, false>, std::integral_constant<bool, true> >&&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/variant:1013
21# doris::pipeline::HashJoinProbeOperatorX::pull(doris::RuntimeState*, doris::vectorized::Block*, bool*) const at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/hashjoin_probe_operator.cpp:291
22# doris::pipeline::StatefulOperatorX<doris::pipeline::HashJoinProbeLocalState>::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/operator.cpp:610
23# doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/operator.cpp:329
24# doris::pipeline::PipelineTask::execute(bool*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/pipeline_task.cpp:353
25# doris::pipeline::TaskScheduler::_do_work(unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/task_scheduler.cpp:138
26# doris::ThreadPool::dispatch_thread() in /home/doris/apache-doris-3.0.2-bin-x64/be/lib/doris_be
27# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
28# start_thread at ./nptl/pthread_create.c:442
29# 0x00007FE92D326850 at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:83

INFO: java_cmd /home/doris/jdk-17.0.1/bin/java
INFO: jdk_version 17
StdoutLogger 2024-11-07 14:40:52,676 Start time: 2024年 11月 07日 星期四 14:40:52 CST
INFO: java_cmd /home/doris/jdk-17.0.1/bin/java
INFO: jdk_version 17
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20241107 14:40:52.899318 2153312 config.cpp:1694] set config enable_file_cache true [OK]
I20241107 14:40:52.900174 2153312 config.cpp:1694] set config enable_file_cache true [OK]
OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-3.0.2-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-3.0.2-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/doris/apache-doris-3.0.2-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
start BE in cloud mode, cloud_unique_id: 1:123:vUTsyGdq, meta_service_endpoint: 192.168.6.11:5001,192.168.6.13:5001,192.168.6.15:5001


2. fe.audit.log

2024-11-07 14:04:32,125 [query] |Client=192.168.6.30:41766|User=datacenter|Ctl=internal|Db=yutu_datacenter|State=ERR|ErrorCode=1105|ErrorMessage=errCode = 2, detailMessage = Backend Backend [id=11359, |Time(ms)=67648|ScanBytes=314511616|ScanRows=9651913|ReturnRows=0|StmtId=82226|QueryId=2e454c419be44390-b6a3b5c438997762|IsQuery=true|isNereids=true|feIp=192.168.6.11|StmtType=SELECT|Stmt=SELECT\n        gridHash as hash,\n        t.update_time,\n        t3.full_name as regionName,\n        t2.area_name,\n        t2.name as code,\n        t2.address,\n        t4.longitude,\n        t4.latitude,\n        element_at(alarm_reason_list,ARRAY_POSITION(alarm_list,gridHash)) as reason\n        from (\n        SELECT\n         \n            update_time,\n         \n        region_key,\n        grid_type,\n        alarm_list,\n        alarm_reason_list,\n        area_key,\n        gridHash FROM (\n        SELECT\n         \n                update_time,\n             \n        region_key,\n        grid_type,\n        factor,\n         \n                regular_alarm_list as alarm_list,\n                regular_alarm_reason_list as alarm_reason_list,\n                JSON_UNQUOTE(JSON_EXTRACT(e1, '$.area_key')) as area_key,\n                json_extract(e1, '$.regular_alarm_list') as area_alarm_list\n                FROM dc_dm_air_grid_hot_city_d\n                lateral view explode_json_array_json(area_regular_alarm_json) tmp1 as e1\n             \n        ) t lateral view explode(CAST(area_alarm_list as  ARRAY<string> )) tmp2 as gridHash\n        WHERE (update_time BETWEEN '2024-11-01 00:00:00' AND '2024-11-01 00:00:00' AND factor = 'pm25' AND grid_type = '1' AND region_key = '414f1fd51' AND area_key IN ('4145f5c63','415e8949e','41ddf203b','411d45fed','41d2d4edb','41e4024e9','41ebe6322','41ef4fd7d','415ad2e6b','412e8b978','41588ab41','41f71d27b','4153e40eb','4183bd941','41666c931','411ce6b1a','41365387f','417b69e21','41afbadf1','41184f2a7','41aa36b45','412c8f3b4','413fab590','413c9258c','4184600a5','4180dc02b','41739e2de','4197e5b44','41ad91703','41023339c','41532046f','41d1bb067','41394bd9f','41c9c27ad','4153cb1db','41fab452e','410134f82','4160a5789','412b948eb','411883aa1','41ff2906a','413622c0e','41dfc4a56','4102aa469','4175276a4','41ee1cb87','41616118a','4181ab945','412fe1817','41ba1e0e9','41c41802b','413cea6f9','41180f208','41d5d7ad7','4181bac66','413cd86f0','4101e43d5','41640b504','41b6422ff','4146544c3','4180003e0','41fbd4082','41db988ef','415915ea3','419bda5d9','41167925c','419fadd45','41554f4e6','41accc223','410a7b2d6','418941757','4144033c6','41a86d93b','412c388ef','41238f607','41b176ae0','418e8d252','41b73d3eb','41a9aa264','4102852eb','4166a1c9f','41a21c9ee','41dc7aee4','415247556','41e199ad6','4136c73ad','419dd61fe','410ba9d21','4184a29ae','417e42567','41e21543e','41f6c6546','41a2970cc','4162b3159','4155680ad','4115241f6','418b0e69b','414d8c7cb','41719479d','41eb270d0','41591877a','41440f8bb','41e96d061','41fdea9b0','41385231b','4153f6697','41dd67f99','41540548b','414271366','410698a2c','41b336f84','410b9c13c','411588e60','419701643','41f9bc3ac','41d16ae93','41229425c','417d92177','418aa4d34','410eb0f92','4122f0cc3','41ebf370f','41e477c2b','41fef70de','41f6f4a11','41d22a45d','411dc7110','41f795b0f','41e5981a0'))\n        ) t\n        LEFT JOIN dc_dim_base_grid as t2 on t.gridHash = t2.hash and t.region_key= t2.region_key and t.grid_type =\n        t2.type\n        LEFT JOIN dc_dim_general_administrative_region as t3 on t.area_key = t3.region_key\n        LEFT JOIN dc_dim_base_coordinates as t4 on t.gridHash = t4.hash\n         \n         \n                ORDER BY t.update_time,t3.full_name,t2.area_name|CpuTimeMS=155620|ShuffleSendBytes=357737780|ShuffleSendRows=6356|SqlHash=887290343a7ba7cffb9af4a85b3f4c08|peakMemoryBytes=19777677120|SqlDigest=|cloudClusterName=default_compute_group|TraceId=|WorkloadGroup=normal|FuzzyVariables=|scanBytesFromLocalStorage=0|scanBytesFromRemoteStorage=0
2024-11-07 14:04:32,125 [slow_query] |Client=192.168.6.30:41766|User=datacenter|Ctl=internal|Db=yutu_datacenter|State=ERR|ErrorCode=1105|ErrorMessage=errCode = 2, detailMessage = Backend Backend [id=11359, |Time(ms)=67648|ScanBytes=314511616|ScanRows=9651913|ReturnRows=0|StmtId=82226|QueryId=2e454c419be44390-b6a3b5c438997762|IsQuery=true|isNereids=true|feIp=192.168.6.11|StmtType=SELECT|Stmt=SELECT\n        gridHash as hash,\n        t.update_time,\n        t3.full_name as regionName,\n        t2.area_name,\n        t2.name as code,\n        t2.address,\n        t4.longitude,\n        t4.latitude,\n        element_at(alarm_reason_list,ARRAY_POSITION(alarm_list,gridHash)) as reason\n        from (\n        SELECT\n         \n            update_time,\n         \n        region_key,\n        grid_type,\n        alarm_list,\n        alarm_reason_list,\n        area_key,\n        gridHash FROM (\n        SELECT\n         \n                update_time,\n             \n        region_key,\n        grid_type,\n        factor,\n         \n                regular_alarm_list as alarm_list,\n                regular_alarm_reason_list as alarm_reason_list,\n                JSON_UNQUOTE(JSON_EXTRACT(e1, '$.area_key')) as area_key,\n                json_extract(e1, '$.regular_alarm_list') as area_alarm_list\n                FROM dc_dm_air_grid_hot_city_d\n                lateral view explode_json_array_json(area_regular_alarm_json) tmp1 as e1\n             \n        ) t lateral view explode(CAST(area_alarm_list as  ARRAY<string> )) tmp2 as gridHash\n        WHERE (update_time BETWEEN '2024-11-01 00:00:00' AND '2024-11-01 00:00:00' AND factor = 'pm25' AND grid_type = '1' AND region_key = '414f1fd51' AND area_key IN ('4145f5c63','415e8949e','41ddf203b','411d45fed','41d2d4edb','41e4024e9','41ebe6322','41ef4fd7d','415ad2e6b','412e8b978','41588ab41','41f71d27b','4153e40eb','4183bd941','41666c931','411ce6b1a','41365387f','417b69e21','41afbadf1','41184f2a7','41aa36b45','412c8f3b4','413fab590','413c9258c','4184600a5','4180dc02b','41739e2de','4197e5b44','41ad91703','41023339c','41532046f','41d1bb067','41394bd9f','41c9c27ad','4153cb1db','41fab452e','410134f82','4160a5789','412b948eb','411883aa1','41ff2906a','413622c0e','41dfc4a56','4102aa469','4175276a4','41ee1cb87','41616118a','4181ab945','412fe1817','41ba1e0e9','41c41802b','413cea6f9','41180f208','41d5d7ad7','4181bac66','413cd86f0','4101e43d5','41640b504','41b6422ff','4146544c3','4180003e0','41fbd4082','41db988ef','415915ea3','419bda5d9','41167925c','419fadd45','41554f4e6','41accc223','410a7b2d6','418941757','4144033c6','41a86d93b','412c388ef','41238f607','41b176ae0','418e8d252','41b73d3eb','41a9aa264','4102852eb','4166a1c9f','41a21c9ee','41dc7aee4','415247556','41e199ad6','4136c73ad','419dd61fe','410ba9d21','4184a29ae','417e42567','41e21543e','41f6c6546','41a2970cc','4162b3159','4155680ad','4115241f6','418b0e69b','414d8c7cb','41719479d','41eb270d0','41591877a','41440f8bb','41e96d061','41fdea9b0','41385231b','4153f6697','41dd67f99','41540548b','414271366','410698a2c','41b336f84','410b9c13c','411588e60','419701643','41f9bc3ac','41d16ae93','41229425c','417d92177','418aa4d34','410eb0f92','4122f0cc3','41ebf370f','41e477c2b','41fef70de','41f6f4a11','41d22a45d','411dc7110','41f795b0f','41e5981a0'))\n        ) t\n        LEFT JOIN dc_dim_base_grid as t2 on t.gridHash = t2.hash and t.region_key= t2.region_key and t.grid_type =\n        t2.type\n        LEFT JOIN dc_dim_general_administrative_region as t3 on t.area_key = t3.region_key\n        LEFT JOIN dc_dim_base_coordinates as t4 on t.gridHash = t4.hash\n         \n         \n                ORDER BY t.update_time,t3.full_name,t2.area_name|CpuTimeMS=155620|ShuffleSendBytes=357737780|ShuffleSendRows=6356|SqlHash=887290343a7ba7cffb9af4a85b3f4c08|peakMemoryBytes=19777677120|SqlDigest=|cloudClusterName=default_compute_group|TraceId=|WorkloadGroup=normal|FuzzyVariables=|scanBytesFromLocalStorage=0|scanBytesFromRemoteStorage=0
2024-11-07 14:04:32,126 [query] |Client=192.168.6.30:43284|User=datacenter|Ctl=internal|Db=yutu_datacenter|State=ERR|ErrorCode=1105|ErrorMessage=errCode = 2, detailMessage = Backend Backend [id=11359, |Time(ms)=68782|ScanBytes=314511616|ScanRows=9651913|ReturnRows=0|StmtId=82222|QueryId=d28e48db28b94907-81fd9251a4940b5d|IsQuery=true|isNereids=true|feIp=192.168.6.11|StmtType=SELECT|Stmt=SELECT\n        gridHash as hash,\n        t.update_time,\n        t3.full_name as regionName,\n        t2.area_name,\n        t2.name as code,\n        t2.address,\n        t4.longitude,\n        t4.latitude,\n        element_at(alarm_reason_list,ARRAY_POSITION(alarm_list,gridHash)) as reason\n        from (\n        SELECT\n         \n            update_time,\n         \n        region_key,\n        grid_type,\n        alarm_list,\n        alarm_reason_list,\n        area_key,\n        gridHash FROM (\n        SELECT\n         \n                update_time,\n             \n        region_key,\n        grid_type,\n        factor,\n         \n                regular_alarm_list as alarm_list,\n                regular_alarm_reason_list as alarm_reason_list,\n                JSON_UNQUOTE(JSON_EXTRACT(e1, '$.area_key')) as area_key,\n                json_extract(e1, '$.regular_alarm_list') as area_alarm_list\n                FROM dc_dm_air_grid_hot_city_d\n                lateral view explode_json_array_json(area_regular_alarm_json) tmp1 as e1\n             \n        ) t lateral view explode(CAST(area_alarm_list as  ARRAY<string> )) tmp2 as gridHash\n        WHERE (update_time BETWEEN '2024-11-03 00:00:00' AND '2024-11-03 00:00:00' AND factor = 'pm25' AND grid_type = '1' AND region_key = '414f1fd51' AND area_key IN ('4145f5c63','415e8949e','41ddf203b','411d45fed','41d2d4edb','41e4024e9','41ebe6322','41ef4fd7d','415ad2e6b','412e8b978','41588ab41','41f71d27b','4153e40eb','4183bd941','41666c931','411ce6b1a','41365387f','417b69e21','41afbadf1','41184f2a7','41aa36b45','412c8f3b4','413fab590','413c9258c','4184600a5','4180dc02b','41739e2de','4197e5b44','41ad91703','41023339c','41532046f','41d1bb067','41394bd9f','41c9c27ad','4153cb1db','41fab452e','410134f82','4160a5789','412b948eb','411883aa1','41ff2906a','413622c0e','41dfc4a56','4102aa469','4175276a4','41ee1cb87','41616118a','4181ab945','412fe1817','41ba1e0e9','41c41802b','413cea6f9','41180f208','41d5d7ad7','4181bac66','413cd86f0','4101e43d5','41640b504','41b6422ff','4146544c3','4180003e0','41fbd4082','41db988ef','415915ea3','419bda5d9','41167925c','419fadd45','41554f4e6','41accc223','410a7b2d6','418941757','4144033c6','41a86d93b','412c388ef','41238f607','41b176ae0','418e8d252','41b73d3eb','41a9aa264','4102852eb','4166a1c9f','41a21c9ee','41dc7aee4','415247556','41e199ad6','4136c73ad','419dd61fe','410ba9d21','4184a29ae','417e42567','41e21543e','41f6c6546','41a2970cc','4162b3159','4155680ad','4115241f6','418b0e69b','414d8c7cb','41719479d','41eb270d0','41591877a','41440f8bb','41e96d061','41fdea9b0','41385231b','4153f6697','41dd67f99','41540548b','414271366','410698a2c','41b336f84','410b9c13c','411588e60','419701643','41f9bc3ac','41d16ae93','41229425c','417d92177','418aa4d34','410eb0f92','4122f0cc3','41ebf370f','41e477c2b','41fef70de','41f6f4a11','41d22a45d','411dc7110','41f795b0f','41e5981a0'))\n        ) t\n        LEFT JOIN dc_dim_base_grid as t2 on t.gridHash = t2.hash and t.region_key= t2.region_key and t.grid_type =\n        t2.type\n        LEFT JOIN dc_dim_general_administrative_region as t3 on t.area_key = t3.region_key\n        LEFT JOIN dc_dim_base_coordinates as t4 on t.gridHash = t4.hash\n         \n         \n                ORDER BY t.update_time,t3.full_name,t2.area_name|CpuTimeMS=135810|ShuffleSendBytes=357893120|ShuffleSendRows=6362|SqlHash=8f479b57548447495bbe9dbca22305e0|peakMemoryBytes=19942492672|SqlDigest=|cloudClusterName=default_compute_group|TraceId=|WorkloadGroup=normal|FuzzyVariables=|scanBytesFromLocalStorage=482795|scanBytesFromRemoteStorage=0

sql
SELECT gridHash as hash, t.update_time, t3.full_name as regionName, t2.area_name, t2.name as code, t2.address, t4.longitude, t4.latitude, element_at(alarm_reason_list,ARRAY_POSITION(alarm_list,gridHash)) as reason from ( SELECT update_time, region_key, grid_type, alarm_list, alarm_reason_list, area_key, gridHash FROM ( SELECT update_time, region_key, grid_type, factor, regular_alarm_list as alarm_list, regular_alarm_reason_list as alarm_reason_list, JSON_UNQUOTE(JSON_EXTRACT(e1, '$.area_key')) as area_key, json_extract(e1, '$.regular_alarm_list') as area_alarm_list FROM dc_dm_air_grid_hot_city_d lateral view explode_json_array_json(area_regular_alarm_json) tmp1 as e1 ) t lateral view explode(CAST(area_alarm_list as ARRAY )) tmp2 as gridHash WHERE (update_time BETWEEN '2024-11-01 00:00:00' AND '2024-11-01 00:00:00' AND factor = 'pm25' AND grid_type = '1' AND region_key = '414f1fd51' AND area_key IN ('4145f5c63','415e8949e','41ddf203b','411d45fed','41d2d4edb','41e4024e9','41ebe6322','41ef4fd7d','415ad2e6b','412e8b978','41588ab41','41f71d27b','4153e40eb','4183bd941','41666c931','411ce6b1a','41365387f','417b69e21','41afbadf1','41184f2a7','41aa36b45','412c8f3b4','413fab590','413c9258c','4184600a5','4180dc02b','41739e2de','4197e5b44','41ad91703','41023339c','41532046f','41d1bb067','41394bd9f','41c9c27ad','4153cb1db','41fab452e','410134f82','4160a5789','412b948eb','411883aa1','41ff2906a','413622c0e','41dfc4a56','4102aa469','4175276a4','41ee1cb87','41616118a','4181ab945','412fe1817','41ba1e0e9','41c41802b','413cea6f9','41180f208','41d5d7ad7','4181bac66','413cd86f0','4101e43d5','41640b504','41b6422ff','4146544c3','4180003e0','41fbd4082','41db988ef','415915ea3','419bda5d9','41167925c','419fadd45','41554f4e6','41accc223','410a7b2d6','418941757','4144033c6','41a86d93b','412c388ef','41238f607','41b176ae0','418e8d252','41b73d3eb','41a9aa264','4102852eb','4166a1c9f','41a21c9ee','41dc7aee4','415247556','41e199ad6','4136c73ad','419dd61fe','410ba9d21','4184a29ae','417e42567','41e21543e','41f6c6546','41a2970cc','4162b3159','4155680ad','4115241f6','418b0e69b','414d8c7cb','41719479d','41eb270d0','41591877a','41440f8bb','41e96d061','41fdea9b0','41385231b','4153f6697','41dd67f99','41540548b','414271366','410698a2c','41b336f84','410b9c13c','411588e60','419701643','41f9bc3ac','41d16ae93','41229425c','417d92177','418aa4d34','410eb0f92','4122f0cc3','41ebf370f','41e477c2b','41fef70de','41f6f4a11','41d22a45d','411dc7110','41f795b0f','41e5981a0')) ) t LEFT JOIN dc_dim_base_grid as t2 on t.gridHash = t2.hash and t.region_key= t2.region_key and t.grid_type = t2.type LEFT JOIN dc_dim_general_administrative_region as t3 on t.area_key = t3.region_key LEFT JOIN dc_dim_base_coordinates as t4 on t.gridHash = t4.hash ORDER BY t.update_time,t3.full_name,t2.area_name

3 Answers

3.0.3将进行fix:https://github.com/apache/doris/pull/43624

SELECT gridHash as hash, t.update_time, t3.full_name as regionName, t2.area_name, t2.name as code, t2.address, t4.longitude, t4.latitude, element_at(alarm_reason_list,ARRAY_POSITION(alarm_list,gridHash)) as reason from ( SELECT update_time, region_key, grid_type, alarm_list, alarm_reason_list, area_key, gridHash FROM ( SELECT update_time, region_key, grid_type, factor, regular_alarm_list as alarm_list, regular_alarm_reason_list as alarm_reason_list, JSON_UNQUOTE(JSON_EXTRACT(e1, '$.area_key')) as area_key, json_extract(e1, '$.regular_alarm_list') as area_alarm_list FROM dc_dm_air_grid_hot_city_d lateral view explode_json_array_json(area_regular_alarm_json) tmp1 as e1 ) t lateral view explode(CAST(area_alarm_list as ARRAY )) tmp2 as gridHash WHERE (update_time BETWEEN '2024-11-01 00:00:00' AND '2024-11-01 00:00:00' AND factor = 'pm25' AND grid_type = '1' AND region_key = '414f1fd51' AND area_key IN ('4145f5c63','415e8949e','41ddf203b','411d45fed','41d2d4edb','41e4024e9','41ebe6322','41ef4fd7d','415ad2e6b','412e8b978','41588ab41','41f71d27b','4153e40eb','4183bd941','41666c931','411ce6b1a','41365387f','417b69e21','41afbadf1','41184f2a7','41aa36b45','412c8f3b4','413fab590','413c9258c','4184600a5','4180dc02b','41739e2de','4197e5b44','41ad91703','41023339c','41532046f','41d1bb067','41394bd9f','41c9c27ad','4153cb1db','41fab452e','410134f82','4160a5789','412b948eb','411883aa1','41ff2906a','413622c0e','41dfc4a56','4102aa469','4175276a4','41ee1cb87','41616118a','4181ab945','412fe1817','41ba1e0e9','41c41802b','413cea6f9','41180f208','41d5d7ad7','4181bac66','413cd86f0','4101e43d5','41640b504','41b6422ff','4146544c3','4180003e0','41fbd4082','41db988ef','415915ea3','419bda5d9','41167925c','419fadd45','41554f4e6','41accc223','410a7b2d6','418941757','4144033c6','41a86d93b','412c388ef','41238f607','41b176ae0','418e8d252','41b73d3eb','41a9aa264','4102852eb','4166a1c9f','41a21c9ee','41dc7aee4','415247556','41e199ad6','4136c73ad','419dd61fe','410ba9d21','4184a29ae','417e42567','41e21543e','41f6c6546','41a2970cc','4162b3159','4155680ad','4115241f6','418b0e69b','414d8c7cb','41719479d','41eb270d0','41591877a','41440f8bb','41e96d061','41fdea9b0','41385231b','4153f6697','41dd67f99','41540548b','414271366','410698a2c','41b336f84','410b9c13c','411588e60','419701643','41f9bc3ac','41d16ae93','41229425c','417d92177','418aa4d34','410eb0f92','4122f0cc3','41ebf370f','41e477c2b','41fef70de','41f6f4a11','41d22a45d','411dc7110','41f795b0f','41e5981a0')) ) t LEFT JOIN dc_dim_base_grid as t2 on t.gridHash = t2.hash and t.region_key= t2.region_key and t.grid_type = t2.type LEFT JOIN dc_dim_general_administrative_region as t3 on t.area_key = t3.region_key LEFT JOIN dc_dim_base_coordinates as t4 on t.gridHash = t4.hash ORDER BY t.update_time,t3.full_name,t2.area_name

麻烦用explain verbose select ...打印一下查询计划。