DorisBE启动后崩溃,无法正常启动

Viewed 49

之前可以正常启动,seaTunnel导入百万数据时,be崩溃,怀疑文件打开数超限,修改为最大文件打开数位1000000后,DorisBe一直启动不了


Doris BE启动后崩溃, 重启也无法解决,进程一会就会自己崩溃,请教各位大佬如何解决?非常感谢!
INFO: jdk_version 17
OpenJDK 64-Bit Server VM warning: Option CriticalJNINatives was deprecated in version 16.0 and will likely be removed in a future release.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/doris/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/doris/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/doris/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 1247305 ***
*** Aborted at 1721720560 (unix time) try "date -d @1721720560" if you are using GNU date ***
*** Current BE git commitID: 2dc65ce356 ***
*** SIGSEGV unknown detail explain (@0x0) received by PID 100238 (TID 101379 OR 0x7f3c18367640) from PID 0; stack trace: ***
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:421
1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
3# 0x00007F3F51FD3520 in /lib/x86_64-linux-gnu/libc.so.6
4# memcpy at /home/zcp/repo_center/doris_release/doris/be/src/glibc-compatibility/memcpy/memcpy_x86_64.cpp:219
5# lucene::index::SDocumentsWriter::ThreadState::FieldData::invertField(lucene::document::Field*, lucene::analysis::Analyzer*, int) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:643
6# lucene::index::SDocumentsWriter::ThreadState::FieldData::processField(lucene::analysis::Analyzer*) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:344
7# lucene::index::SDocumentsWriter::ThreadState::processDocument(lucene::analysis::Analyzer*) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:688
8# lucene::index::SDocumentsWriter::updateDocument(lucene::document::Document*, lucene::analysis::Analyzer*) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:868
9# lucene::index::IndexWriter::addDocument(lucene::document::Document*, lucene::analysis::Analyzer*) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/IndexWriter.cpp:729
10# doris::segment_v2::InvertedIndexColumnWriterImpl<(doris::FieldType)17>::add_document() at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/inverted_index_writer.cpp:275
11# doris::segment_v2::InvertedIndexColumnWriterImpl<(doris::FieldType)17>::add_array_values(unsigned long, void const*, unsigned char const*, unsigned char const*, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/inverted_index_writer.cpp:421
12# doris::segment_v2::ArrayColumnWriter::append_data(unsigned char const**, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/column_writer.cpp:992
13# doris::segment_v2::ArrayColumnWriter::append_nullable(unsigned char const*, unsigned char const**, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/column_writer.cpp:1010
14# doris::segment_v2::ColumnWriter::append(unsigned char const*, void const*, unsigned long) in /opt/doris/be/lib/doris_be
15# doris::segment_v2::SegmentWriter::append_block(doris::vectorized::Block const*, unsigned long, unsigned long) in /opt/doris/be/lib/doris_be
16# doris::VerticalBetaRowsetWriter::add_columns(doris::vectorized::Block const*, std::vector<unsigned int, std::allocator > const&, bool, unsigned int) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/vertical_beta_rowset_writer.cpp:125
17# doris::Merger::vertical_compact_one_group(std::shared_ptr, doris::ReaderType, std::shared_ptr, bool, std::vector<unsigned int, std::allocator > const&, doris::vectorized::RowSourcesBuffer*, std::vector<std::shared_ptr, std::allocator<std::shared_ptr > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*, std::vector<unsigned int, std::allocator >) in /opt/doris/be/lib/doris_be
18# doris::Merger::vertical_merge_rowsets(std::shared_ptr, doris::ReaderType, std::shared_ptr, std::vector<std::shared_ptr, std::allocator<std::shared_ptr > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/merger.cpp:383
19# doris::Compaction::do_compaction_impl(long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:371
20# doris::Compaction::do_compaction(long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:136
21# doris::CumulativeCompaction::execute_compact_impl() at /home/zcp/repo_center/doris_release/doris/be/src/olap/cumulative_compaction.cpp:79
22# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/olap/compaction.cpp:118
23# doris::Tablet::execute_compaction(doris::Compaction&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/tablet.cpp:1947
24# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr, doris::CompactionType, bool)::$_1>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291
25# doris::ThreadPool::dispatch_thread() in /opt/doris/be/lib/doris_be
26# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
27# 0x00007F3F52025AC3 in /lib/x86_64-linux-gnu/libc.so.6
28# 0x00007F3F520B7850 in /lib/x86_64-linux-gnu/libc.so.6

2 Answers
  1. 2.1 be目前主要支持的jdk是1.8
  2. 麻烦看看具体的版本号:select @@version_comment
  3. show tablet 1247305 然后执行最后一列的cmd detail看看是不是有数据副本异常
  1. Doris version doris-2.1.3-rc09-2dc65ce356
  2. +-----------+-----------+---------+-------------------+------------------+---------------+------------+---------------+----------------+----------+--------+-------+------------+--------------+----------------------+-----------------------+-------------------------------------------------+---------------------------------------------------------------+-------------------+----------------+-----------+
    | ReplicaId | BackendId | Version | LstSuccessVersion | LstFailedVersion | LstFailedTime | SchemaHash | LocalDataSize | RemoteDataSize | RowCount | State | IsBad | IsUserDrop | VersionCount | PathHash | Path | MetaUrl | CompactionStatus | CooldownReplicaId | CooldownMetaId | QueryHits |
    +-----------+-----------+---------+-------------------+------------------+---------------+------------+---------------+----------------+----------+--------+-------+------------+--------------+----------------------+-----------------------+-------------------------------------------------+---------------------------------------------------------------+-------------------+----------------+-----------+
    | 1247306 | 10377 | 2 | 2 | -1 | NULL | 1748434293 | 162363155 | 0 | 1871594 | NORMAL | false | false | 2 | -4514199887863223570 | /opt/doris/be/storage | http://129.0.0.226:8040/api/meta/header/1247305 | http://129.0.0.226:8040/api/compaction/show?tablet_id=1247305 | -1 | | 0 |
    +-----------+-----------+---------+-------------------+------------------+---------------+------------+---------------+----------------+----------+--------+-------+------------+--------------+----------------------+-----------------------+-------------------------------------------------+---------------------------------------------------------------+-------------------+----------------+-----------+