【已解决】2.1.2 be日志大量[INTERNAL_ERROR]Function substring get failed

Viewed 128

be.WARNING 大量INTERNAL_ERROR

W20240420 00:57:44.054216 64942 internal_service.cpp:1351] exec fold constant expr failed, errmsg=[INTERNAL_ERROR]Function substring get failed, expr is VectorizedFnCall[substring](arguments=String, Int32, Int32,return=String) and return type is String.

        0#  doris::vectorized::VectorizedFnCall::prepare(doris::RuntimeState*, doris::RowDescriptor const&, doris::vectorized::VExprContext*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187
        1#  doris::vectorized::VExprContext::prepare(doris::RuntimeState*, doris::RowDescriptor const&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:345
        2#  doris::Status doris::FoldConstantExecutor::_prepare_and_open<doris::vectorized::VExprContext>(doris::vectorized::VExprContext*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:335
        3#  doris::FoldConstantExecutor::fold_constant_vexpr(doris::TFoldConstantParams const&, doris::PConstantExprResult*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
        4#  doris::PInternalServiceImpl::_fold_constant_expr(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, doris::PConstantExprResult*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
        5#  std::_Function_handler<void (), doris::PInternalServiceImpl::fold_constant_expr(google::protobuf::RpcController*, doris::PConstantExprRequest const*, doris::PConstantExprResult*, google::protobuf:
...skipping...
        8#  start_thread
        9#  __clone
W20240420 12:41:56.234839 64982 internal_service.cpp:1351] exec fold constant expr failed, errmsg=[INTERNAL_ERROR]Function substring get failed, expr is VectorizedFnCall[substring](arguments=String, Int32, Int32,return=String) and return type is String.

        0#  doris::vectorized::VectorizedFnCall::prepare(doris::RuntimeState*, doris::RowDescriptor const&, doris::vectorized::VExprContext*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187
        1#  doris::vectorized::VExprContext::prepare(doris::RuntimeState*, doris::RowDescriptor const&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:345
        2#  doris::Status doris::FoldConstantExecutor::_prepare_and_open<doris::vectorized::VExprContext>(doris::vectorized::VExprContext*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:335
        3#  doris::FoldConstantExecutor::fold_constant_vexpr(doris::TFoldConstantParams const&, doris::PConstantExprResult*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
        4#  doris::PInternalServiceImpl::_fold_constant_expr(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, doris::PConstantExprResult*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
        5#  std::_Function_handler<void (), doris::PInternalServiceImpl::fold_constant_expr(google::protobuf::RpcController*, doris::PConstantExprRequest const*, doris::PConstantExprResult*, google::protobuf::Closure*)::$_0>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/service/internal_service.cpp:1332
        6#  doris::WorkThreadPool<false>::work_thread(int) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/atomic_base.h:646
        7#  execute_native_thread_routine at /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/include/bits/unique_ptr.h:85
        8#  start_thread
        9#  __clone
 .and query_id_is: 3a8d9f5fbbdf488e-963494e60d479e5d

通过audit_log定位query_id

Name             |Value                                                    
-----------------+---------------------------------------------------------
query_id         |3a8d9f5fbbdf488e-963494e60d479e5d                        
time             |2024-04-20 12:41:56.0                                    
client_ip        |                                                         
user             |root                                                     
catalog          |internal                                                 
db               |__internal_schema                                        
state            |OK                                                       
error_code       |0                                                        
error_message    |                                                         
query_time       |27                                                       
scan_bytes       |774144                                                   
scan_rows        |2914                                                     
return_rows      |0                                                        
stmt_id          |0                                                        
is_query         |1                                                        
frontend_ip      |10.XXX.XXX.XXX                                           
cpu_time_ms      |5                                                        
sql_hash         |null                                                     
sql_digest       |                                                         
peak_memory_bytes|1615075                                                  
workload_group   |normal                                                   
stmt             |SELECT CONCAT('55133', '-', '-1', '-', 'comment') AS `id`, 0 AS `catalog_id`, 49984 AS `db_id`, 55133 AS `tbl_id`, -1 AS `idx_id`, 'comment' AS `col_id`, NULL AS `part_id`, 2975 AS `row_count`, SUM(`t1`.`count`) * COUNT(1) / (SUM(`t1`.`count`) - SUM(IF(`t1`.`count` = 1, 1, 0)) + SUM(IF(`t1`.`count` = 1, 1, 0)) * SUM(`t1`.`count`) / 2975) as `ndv`, IFNULL(SUM(IF(`t1`.`column_key` IS NULL, `t1`.`count`, 0)), 0) * 1.0 as `null_count`, SUBSTRING(CAST('' AS STRING), 1, 1024) AS `min`, SUBSTRING(CAST('' AS STRING), 1, 1024) AS `max`, SUM(LENGTH(`column_key`) * count) * 1.0 AS `data_size`, NOW() FROM (     SELECT t0.`comment` as `column_key`, COUNT(1) as `count`     FROM     (SELECT `comment` FROM `internal`.`test`.`table`       limit 2975) as `t0`     GROUP BY `t0`.`comment` ) as `t1` 

stmt里SUBSTRING出现大量\0

image.png

1 Answers