doris2.1.5 ,执行sql,be挂掉的问题

Viewed 126

执行的sql:select count(1) from dwd_score_test_file where cast(product_field['scoreylbase'] as decimal(12,6)) >12;

image.png

be报错日志:
W20240821 19:52:11.526293 8234 timezone_utils.cpp:94] Meet illegal tzdata file: iso3166.tab. skipped
W20240821 19:52:11.570943 8234 timezone_utils.cpp:94] Meet illegal tzdata file: leapseconds. skipped
W20240821 19:52:11.571018 8234 timezone_utils.cpp:94] Meet illegal tzdata file: tzdata.zi. skipped
W20240821 19:52:11.571069 8234 timezone_utils.cpp:94] Meet illegal tzdata file: zone.tab. skipped
W20240821 19:52:11.571108 8234 timezone_utils.cpp:94] Meet illegal tzdata file: zone1970.tab. skipped
E20240821 19:52:11.960983 8234 variable.cpp:179] Already exposed doris_cache_data_page_cache' whose value is 0'
E20240821 19:52:11.961024 8234 variable.cpp:179] Already exposed doris_cache_data_page_cache_persecond' whose value is 0'
E20240821 19:52:11.961246 8234 variable.cpp:179] Already exposed doris_cache_index_page_cache' whose value is 0'
E20240821 19:52:11.961262 8234 variable.cpp:179] Already exposed doris_cache_index_page_cache_persecond' whose value is 0'
E20240821 19:52:11.961468 8234 variable.cpp:179] Already exposed doris_cache_pkindex_page_cache' whose value is 0'
E20240821 19:52:11.961485 8234 variable.cpp:179] Already exposed doris_cache_pkindex_page_cache_persecond' whose value is 0'
E20240821 19:52:11.961649 8234 variable.cpp:179] Already exposed doris_cache_point_query_row_cache' whose value is 0'
E20240821 19:52:11.961665 8234 variable.cpp:179] Already exposed doris_cache_point_query_row_cache_persecond' whose value is 0'
E20240821 19:52:11.961768 8234 variable.cpp:179] Already exposed doris_cache_segment_cache' whose value is 0'
E20240821 19:52:11.961788 8234 variable.cpp:179] Already exposed doris_cache_segment_cache_persecond' whose value is 0'
E20240821 19:52:11.961853 8234 variable.cpp:179] Already exposed doris_cache_schema_cache' whose value is 0'
E20240821 19:52:11.961870 8234 variable.cpp:179] Already exposed doris_cache_schema_cache_persecond' whose value is 0'
E20240821 19:52:11.961921 8234 variable.cpp:179] Already exposed doris_cache_common_obj_lrucache' whose value is 0'
E20240821 19:52:11.961937 8234 variable.cpp:179] Already exposed doris_cache_common_obj_lrucache_persecond' whose value is 0'
E20240821 19:52:11.962008 8234 variable.cpp:179] Already exposed doris_cache_point_query_lookup_connection_cache' whose value is 0'
E20240821 19:52:11.962024 8234 variable.cpp:179] Already exposed doris_cache_point_query_lookup_connection_cache_persecond' whose value is 0'
E20240821 19:52:11.962198 8234 variable.cpp:179] Already exposed doris_cache_inverted_index_searcher_cache' whose value is 0'
E20240821 19:52:11.962216 8234 variable.cpp:179] Already exposed doris_cache_inverted_index_searcher_cache_persecond' whose value is 0'
E20240821 19:52:11.962425 8234 variable.cpp:179] Already exposed doris_cache_inverted_index_query_cache' whose value is 0'
E20240821 19:52:11.962442 8234 variable.cpp:179] Already exposed doris_cache_inverted_index_query_cache_persecond' whose value is 0'
E20240821 19:52:11.962662 8234 variable.cpp:179] Already exposed doris_cache_last_success_channel_cache' whose value is 0'
E20240821 19:52:11.962442 8234 variable.cpp:179] Already exposed doris_cache_inverted_index_query_cache_persecond' whose value is 0'
E20240821 19:52:11.962662 8234 variable.cpp:179] Already exposed doris_cache_last_success_channel_cache' whose value is 0'
E20240821 19:52:11.962680 8234 variable.cpp:179] Already exposed doris_cache_last_success_channel_cache_persecond' whose value is 0'
E20240821 19:52:11.965906 8234 variable.cpp:179] Already exposed doris_cache_tablet_schema_cache' whose value is 0'
E20240821 19:52:11.965934 8234 variable.cpp:179] Already exposed doris_cache_tablet_schema_cache_persecond' whose value is 0'
E20240821 19:52:11.967435 8234 variable.cpp:179] Already exposed doris_cache_mow_tablet_version_cache' whose value is 0'
E20240821 19:52:11.967478 8234 variable.cpp:179] Already exposed doris_cache_mow_tablet_version_cache_persecond' whose value is 0'
E20240821 19:52:11.967559 8234 variable.cpp:179] Already exposed doris_cache_create_tablet_rridx_cache' whose value is 0'
E20240821 19:52:11.967577 8234 variable.cpp:179] Already exposed doris_cache_create_tablet_rridx_cache_persecond' whose value is 0'
E20240821 19:52:11.989331 8990 variable.cpp:179] Already exposed doris_cache_mow_delete_bitmap_agg_cache' whose value is 0'
E20240821 19:52:11.989362 8990 variable.cpp:179] Already exposed doris_cache_mow_delete_bitmap_agg_cache_persecond' whose value is 0'
W20240821 19:52:12.108232 9021 olap_server.cpp:712] Have not get FE Master heartbeat yet

be.out 日志
StdoutLogger 2024-08-21 18:27:38,724 Start time: Wed Aug 21 18:27:38 CST 2024
INFO: java_cmd /opt/doris/jdk1.8.0_191/bin/java
INFO: jdk_version 8
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/doris/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/doris/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/doris/apache-doris-2.0.2-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
*** Query id: a8e988e6ee78485b-803428577ac5c7dd ***
*** is nereids: 1 ***
*** tablet id: 0 ***
*** Aborted at 1724241071 (unix time) try "date -d @1724241071" if you are using GNU date ***
*** Current BE git commitID: d5a02e095d ***
*** SIGFPE integer divide by zero (@0x563e641aea3a) received by PID 184506 (TID 186337 OR 0x7f33bb3e8700) from PID 1679485498; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:421
1# os::Linux::chained_handler(int, siginfo*, void*) in /opt/doris/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
2# JVM_handle_linux_signal in /opt/doris/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
3# signalHandler(int, siginfo*, void*) in /opt/doris/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
4# 0x00007F3802C572F0 in /lib64/libc.so.6
5# std::__cxx11::basic_string<char, std::char_traits, std::allocator > doris::vectorized::decimal_to_string(long const&, unsigned int) at /home/zcp/repo_center/doris_release/doris/be/src/vec/core/types.h:401
6# doris::ColumnValueRange<(doris::PrimitiveType)29>::to_olap_filter(std::vector<doris::TCondition, std::allocator >&) at /home/zcp/repo_center/doris_release/doris/be/src/exec/olap_common.h:225
7# doris::pipeline::OlapScanLocalState::_build_key_ranges_and_filters() at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/olap_scan_operator.cpp:489
8# doris::pipeline::OlapScanLocalState::_process_conjuncts() at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/olap_scan_operator.cpp:153
9# doris::pipeline::ScanLocalState::open(doris::RuntimeState*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/scan_operator.cpp:153
10# doris::pipeline::PipelineXTask::_open() at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/pipeline_x/pipeline_x_task.cpp:214
11# doris::pipeline::PipelineXTask::execute(bool*) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/pipeline_x/pipeline_x_task.cpp:266
12# doris::pipeline::TaskScheduler::_do_work(unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/task_scheduler.cpp:347
13# doris::ThreadPool::dispatch_thread() in /opt/doris/apache-doris-2.0.2-bin-x64/be/lib/doris_be
14# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
15# start_thread in /lib64/libpthread.so.0
16# __clone in /lib64/libc.so.6

StdoutLogger 2024-08-21 19:52:08,607 Start time: Wed Aug 21 19:52:08 CST 2024
INFO: java_cmd /opt/doris/jdk1.8.0_191/bin/java
INFO: jdk_version 8
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/doris/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/doris/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/doris/apache-doris-2.0.2-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]

建表语句:
CREATE TABLE dwd_score_test_file (
request_time VARCHAR(256) NULL,
batch_number VARCHAR(256) NULL,
cus_num VARCHAR(256) NULL,
strategy_id VARCHAR(256) NULL,
version VARCHAR(256) NULL,
cell VARCHAR(256) NULL,
id VARCHAR(256) NULL,
userType VARCHAR(256) NULL,
dataPackage VARCHAR(256) NULL,
product_field VARIANT NULL,
INDEX idx_payload (product_field) USING INVERTED PROPERTIES("parser" = "english", "lower_case" = "true", "support_phrase" = "true") COMMENT 'inverted index for product_field'
) ENGINE=OLAP
DUPLICATE KEY(request_time)
DISTRIBUTED BY HASH(cus_num) BUCKETS 10;

2 Answers

所用的版本是2.1.5的,至于截图中显示2.0.2,是我用manager工具从2.0.2直接升级到2.1.5的,单表1.9亿的数据量,字段类型里面含有Varint 类型