flinkcdc3.0.1整库同步到Doris2.0.4,分库分表合成一张表,Doris中数据突然不更新了

Viewed 69

Flinkcdc3.0.1整库同步到Doris2.0.4,mysql分库分表合成一张表,flink程序运行一段时间后,突然发现Doris不再更新了,但mysql库表在正常新增和更新,flink程序以及Doris使用也都是正常的。

> const&, unsigned long, unsigned long, bool) at /home/zcp/repo_center/doris_release/doris/be/src/vec/functions/function.h:183	7#  doris::vectorized::VectorizedFnCall::execute(doris::vectorized::VExprContext*, doris::vectorized::Block*, int*) at /home/zcp/repo_center/doris_release/doris/be/src/vec/exprs/vectorized_fn_call.cpp:159	8#  doris::vectorized::VectorizedFnCall::execute(doris::vectorized::VExprContext*, doris::vectorized::Block*, int*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:442	9#  doris::vectorized::VectorizedFnCall::execute(doris::vectorized::VExprContext*, doris::vectorized::Block*, int*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:442	10# doris::vectorized::VectorizedFnCall::execute(doris::vectorized::VExprContext*, doris::vectorized::Block*, int*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:442	11# doris::vectorized::VExprContext::execute(doris::vectorized::Block*, int*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:354	12# doris::vectorized::VExprContext::get_output_block_after_execute_exprs(std::vector
, std::allocator > > const&, doris::vectorized::Block const&, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:442	13# doris::vectorized::VMysqlResultWriter
::append_block(doris::vectorized::Block&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:442	14# doris::vectorized::VResultSink::send(doris::RuntimeState*, doris::vectorized::Block*, bool) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:442	15# doris::pipeline::DataSinkOperator
::sink(doris::RuntimeState*, doris::vectorized::Block*, doris::pipeline::SourceState) at /home/zcp/repo_center/doris_release/doris/be/src/pipeline/exec/operator.h:0	16# doris::pipeline::PipelineTask::execute(bool*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:437	17# doris::pipeline::TaskScheduler::_do_work(unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:354	18# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0	19# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562	20# start_thread	21# __clone2024-04-02 13:07:00,419 WARN (mysql-nio-pool-2853|775382) [Coordinator.getNext():1175] Query a7bb9eea2b2447cd-92a6ca6e5f354b27 failed: (10.196.71.170)[CANCELLED][BUFFER_ALLOCATION_FAILED]concat output is too large to allocate	0#  doris::vectorized::FunctionStringConcat::execute_impl(doris::FunctionContext*, doris::vectorized::Block&, std::vector

3 Answers

信息长时间未更新,先close了。后续有问题可以加一下我的微信Faith_xzc,来具体看看

核心报错信息 [BUFFER_ALLOCATION_FAILED]concat output is too large to allocate

贴一下task manager日志,flink资源够吗?