2.1.6，大佬们请教一个问题：使用delete from {tb_name} where _id in {tuple(id_list)} 这种sql批量删除数据后，程序显示已经删完了但是还是可以查询到删除的数据，这是啥原因啊

doris版本是2.1.6的，数据量有5更多亿，看日志大概率是数据的删除更新很慢导致。
fe的log日志：
246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305872, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305876, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305880, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305884, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305888, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305892, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305896, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17305900, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17570859, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17570875, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17307423, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17307427, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17307431, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17307435, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,246 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 17307439, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,247 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320169, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,247 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320173, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,247 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320177, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,247 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320181, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320185, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320189, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320193, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6320197, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletScheduler.addTablet():272] Add tablet to pending queue, tablet id: 6328562, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletChecker.handlePartitionTablet():407] tablet scheduler return: LIMIT_EXCEED. stop tablet checker
2024-06-21 18:51:17,248 INFO (tablet checker|39) [TabletChecker.checkTablets():347] finished to check tablets. unhealth/total/added/in_sched/not_ready: 114/2062/96/1905/0, cost: 3 ms
2024-06-21 18:51:17,272 INFO (report-thread|169) [ReportHandler.taskReport():561] finished to handle task report from backend 11002, diff task num: 0. cost: 0 ms
2024-06-21 18:51:17,272 INFO (thrift-server-pool-11454|51139) [ReportHandler.handleReport():200] receive report from be 11002. type: TASK, current queue size: 1
2024-06-21 18:51:17,801 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570847, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 4094, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:17,801 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17307419, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: 1, committed version: 1. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:17,801 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570879, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 4076, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:17,801 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570883, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 4550, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:17,801 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570851, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 4962, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:17,801 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570867, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 4808, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:18,232 INFO (binlog-gcer|56) [BinlogManager.gc():358] begin gc binlog
2024-06-21 18:51:18,232 INFO (binlog-gcer|56) [BinlogManager.gc():369] gc binlog, dbBinlogMap is null
2024-06-21 18:51:18,232 INFO (binlog-gcer|56) [BinlogGcer.runAfterCatalogReady():63] no gc binlog
2024-06-21 18:51:19,000 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570871, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 3812, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:19,000 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570863, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 3716, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:19,000 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17570855, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 5257, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:19,000 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17572643, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 806, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:19,000 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17571900, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 871, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
2024-06-21 18:51:19,000 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1691] remove the tablet tablet id: 17573421, status: REPLICA_MISSING, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: 2, committed version: 2. err: unable to find dest path for new replica. because: unable to find dest path for new replica
be的log日志：
I20240911 15:33:22.647430 96519 merger.cpp:369] Start to do vertical compaction, tablet_id: 647198
I20240911 15:33:22.656351 96519 compaction.cpp:725] succeed to do cumulative compaction is_vertical=1. tablet=647198, output_version=[213697-213747], current_max_version=213747, disk=/opt/module/doris-2.1.3-bin-x64-noavx2/doris-data, segments=8, input_rowset_size=44154, output_rowset_size=12408, input_row_num=78, output_row_num=62, filtered_row_num=0, merged_row_num=16. elapsed time=0.009088s. cumulative_compaction_policy=size_based, compact_row_per_second=8575
I20240911 15:33:22.658215 96898 tablets_channel.cpp:135] open tablets channel: (load_id=41445902096a4d67-873f93fc98d27d05, index_id=263282), tablets num: 3, timeout(s): 40
I20240911 15:33:22.671892 96795 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.699978 96782 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.720634 96771 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.739349 96747 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.742519 96512 storage_engine.cpp:1077] start to delete unused rowset, size: 113
I20240911 15:33:22.742723 96512 storage_engine.cpp:1111] collected 0 unused rowsets to remove, skipped 113 rowsets due to use count > 1, skipped 0 rowsets due to don't need to delete file, skipped 0 rowsets due to delayed expired timestamp.
I20240911 15:33:22.742733 96512 storage_engine.cpp:1127] removed all collected unused rowsets
I20240911 15:33:22.758009 96822 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.782354 96848 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.819639 96864 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.832597 96778 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.837420 96762 tablets_channel.cpp:227] close tablets channel: (load_id=129e3e5636424575-b0f619bf49291100, index_id=650128), sender id: 0, backend id: 10202
I20240911 15:33:22.842074 96762 load_channel.cpp:69] load channel removed load_id=129e3e5636424575-b0f619bf49291100, is high priority=1, sender_ip=169.169.53.12, index id: 650128, total_received_rows: 0, num_rows_filtered: 0
I20240911 15:33:22.856956 96736 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.868991 96842 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.869233 96884 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.904940 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554901
I20240911 15:33:22.906304 96559 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650127, tablet=650129, transaction_id=15554901, version=37357, num_rows=0, res=[OK], cost: 1323(us)
I20240911 15:33:22.907313 96577 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650127, tablet=650147, transaction_id=15554901, version=37357, num_rows=0, res=[OK], cost: 2289(us)
I20240911 15:33:22.907338 96579 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650127, tablet=650135, transaction_id=15554901, version=37357, num_rows=0, res=[OK], cost: 2342(us)
I20240911 15:33:22.907342 96570 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650127, tablet=650141, transaction_id=15554901, version=37357, num_rows=0, res=[OK], cost: 2337(us)
I20240911 15:33:22.907418 96681 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554901, cost(us): 2471, error_tablet_size=0, res=[OK]
I20240911 15:33:22.907438 96681 task_worker_pool.cpp:1593] successfully publish version|signature=15554901|transaction_id=15554901|tablets_num=4|cost(s)=0
I20240911 15:33:22.920771 96846 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.926649 96788 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.933552 96861 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.944339 96729 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.954898 96793 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.956815 96779 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.968922 96883 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.974777 96850 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:22.985976 96985 tablets_channel.cpp:135] open tablets channel: (load_id=107f7141ff744333-a1964d1fb66d732a, index_id=316913), tablets num: 3, timeout(s): 40
I20240911 15:33:23.000382 96722 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.017962 96844 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.018808 96906 tablets_channel.cpp:135] open tablets channel: (load_id=a9e47f15b75147b0-bc05143bd6686c1a, index_id=262776), tablets num: 3, timeout(s): 40
I20240911 15:33:23.035451 96726 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.059209 96880 tablets_channel.cpp:227] close tablets channel: (load_id=da3816ff83a44c47-be2e258205e28c5c, index_id=671172), sender id: 0, backend id: 10202
I20240911 15:33:23.060079 96807 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.078457 96811 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.082230 96727 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.088652 96730 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.088771 115012 data_consumer.cpp:253] consumer meet partition eof: c64e60323bc84771-aac75534e7b78b84 partition offset: 1018525
I20240911 15:33:23.088805 115012 data_consumer.cpp:274] kafka consumer done: c64e60323bc84771-aac75534e7b78b84, grp: b644fa6603e72f49-2cbd497b380bb6b0. cancelled: 0, left time(ms): 19494, total cost(ms): 506, consume cost(ms): 506, received rows: 7, put rows: 7
I20240911 15:33:23.088817 115012 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: b644fa6603e72f49-2cbd497b380bb6b0
I20240911 15:33:23.088832 115011 data_consumer_group.cpp:128] consumer group done: b644fa6603e72f49-2cbd497b380bb6b0. consume time(ms)=506, received rows=7, received bytes=5957, eos: 1, left_time: 19494, left_rows: 499993, left_bytes: 1048570043, blocking get time(us): 506166, blocking put time(us): 0, id=46c2310fb62647ce-9d2115905e1e593c, job_id=650149, txn_id=15554903, label=ods_appointment_center_jas1_rt_load-650149-46c2310fb62647ce-9d2115905e1e593c-15554903, elapse(s)=0
I20240911 15:33:23.088860 115011 data_consumer.cpp:470] kafka consumer cancelled. c64e60323bc84771-aac75534e7b78b84
I20240911 15:33:23.091140 115017 vtablet_writer.cpp:943] VNodeChannel[650082-10107], load_id=46c2310fb62647ce-9d2115905e1e593c, txn_id=15554903, node=169.169.53.12:18060 mark closed, left pending batch size: 1
I20240911 15:33:23.091161 115017 vtablet_writer.cpp:943] VNodeChannel[650082-10202], load_id=46c2310fb62647ce-9d2115905e1e593c, txn_id=15554903, node=169.169.53.14:18060 mark closed, left pending batch size: 1
I20240911 15:33:23.091167 115017 vtablet_writer.cpp:943] VNodeChannel[650082-10144], load_id=46c2310fb62647ce-9d2115905e1e593c, txn_id=15554903, node=169.169.53.13:18060 mark closed, left pending batch size: 1
I20240911 15:33:23.092306 97280 vtablet_writer.cpp:983] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. 46c2310fb62647ce-9d2115905e1e593c
I20240911 15:33:23.092319 96791 tablets_channel.cpp:227] close tablets channel: (load_id=46c2310fb62647ce-9d2115905e1e593c, index_id=650082), sender id: 0, backend id: 10202
I20240911 15:33:23.113426 96880 load_channel.cpp:69] load channel removed load_id=da3816ff83a44c47-be2e258205e28c5c, is high priority=1, sender_ip=169.169.53.12, index id: 671172, total_received_rows: 1, num_rows_filtered: 0
I20240911 15:33:23.118139 96806 tablets_channel.cpp:227] close tablets channel: (load_id=0de86bbf4bb34d40-901b582cca5a065b, index_id=675496), sender id: 0, backend id: 10202
I20240911 15:33:23.121747 96806 load_channel.cpp:69] load channel removed load_id=0de86bbf4bb34d40-901b582cca5a065b, is high priority=1, sender_ip=169.169.53.12, index id: 675496, total_received_rows: 0, num_rows_filtered: 0
I20240911 15:33:23.123163 96775 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.129340 96733 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.135223 96776 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.146521 96791 load_channel.cpp:69] load channel removed load_id=46c2310fb62647ce-9d2115905e1e593c, is high priority=1, sender_ip=169.169.53.14, index id: 650082, total_received_rows: 3, num_rows_filtered: 0
I20240911 15:33:23.147881 115017 vtablet_writer.cpp:1484] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=387053, load id=46c2310fb62647ce-9d2115905e1e593c
I20240911 15:33:23.147913 115017 vtablet_writer.cpp:1531] finished to close olap table sink. load_id=46c2310fb62647ce-9d2115905e1e593c, txn_id=15554903, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10144:(53)(0)(56)(1)} {10202:(54)(0)(56)(1)} {10107:(55)(0)(56)(1)}
I20240911 15:33:23.148241 96860 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.148505 105460 fragment_mgr.cpp:584] Removing query 46c2310fb62647ce-9d2115905e1e593c instance 46c2310fb62647ce-9d2115905e1e593d, all done? true
I20240911 15:33:23.148528 105460 fragment_mgr.cpp:590] Query 46c2310fb62647ce-9d2115905e1e593c finished
I20240911 15:33:23.148553 105460 query_context.cpp:122] Query 46c2310fb62647ce-9d2115905e1e593c deconstructed, , deregister query/load memory tracker, queryId=46c2310fb62647ce-9d2115905e1e593c, Limit=2.00 GB, CurrUsed=2.26 MB, PeakUsed=5.12 MB
I20240911 15:33:23.148705 105460 query_context.cpp:154] Query 46c2310fb62647ce-9d2115905e1e593c deconstructed, , deregister query/load memory tracker, queryId=46c2310fb62647ce-9d2115905e1e593c, Limit=2.00 GB, CurrUsed=2.26 MB, PeakUsed=5.12 MB
I20240911 15:33:23.148783 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554902
I20240911 15:33:23.148818 105460 stream_load_executor.cpp:138] finished to execute stream load. label=ods_appointment_center_jas1_rt_load-650149-46c2310fb62647ce-9d2115905e1e593c-15554903, txn_id=15554903, query_id=46c2310fb62647ce-9d2115905e1e593c, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=567
I20240911 15:33:23.149772 96574 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=671171, tablet=671175, transaction_id=15554902, version=91439, num_rows=0, res=[OK], cost: 936(us)
I20240911 15:33:23.150596 96587 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=671171, tablet=671187, transaction_id=15554902, version=91439, num_rows=0, res=[OK], cost: 1725(us)
I20240911 15:33:23.150615 96571 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=671171, tablet=671181, transaction_id=15554902, version=91439, num_rows=1, res=[OK], cost: 1773(us)
I20240911 15:33:23.150671 96683 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554902, cost(us): 1889, error_tablet_size=0, res=[OK]
I20240911 15:33:23.150708 96683 task_worker_pool.cpp:1593] successfully publish version|signature=15554902|transaction_id=15554902|tablets_num=3|cost(s)=0
I20240911 15:33:23.154825 96764 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.158986 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554903
I20240911 15:33:23.160534 96574 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650081, tablet=650097, transaction_id=15554903, version=112626, num_rows=0, res=[OK], cost: 1484(us)
I20240911 15:33:23.160948 96862 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.161360 96571 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650081, tablet=650091, transaction_id=15554903, version=112626, num_rows=2, res=[OK], cost: 2321(us)
I20240911 15:33:23.161379 96587 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=650081, tablet=650085, transaction_id=15554903, version=112626, num_rows=0, res=[OK], cost: 2349(us)
I20240911 15:33:23.161438 96683 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554903, cost(us): 2452, error_tablet_size=0, res=[OK]
I20240911 15:33:23.161474 96683 task_worker_pool.cpp:1593] successfully publish version|signature=15554903|transaction_id=15554903|tablets_num=3|cost(s)=0
I20240911 15:33:23.162972 96863 tablets_channel.cpp:227] close tablets channel: (load_id=41445902096a4d67-873f93fc98d27d05, index_id=263282), sender id: 0, backend id: 10202
I20240911 15:33:23.171211 115011 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.174221 115011 routine_load_task_executor.cpp:293] finished routine load task id=46c2310fb62647ce-9d2115905e1e593c, job_id=650149, txn_id=15554903, label=ods_appointment_center_jas1_rt_load-650149-46c2310fb62647ce-9d2115905e1e593c-15554903, elapse(s)=0, status: [OK], current tasks num: 0
I20240911 15:33:23.191959 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554904
I20240911 15:33:23.193101 96571 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=675495, tablet=675499, transaction_id=15554904, version=76342, num_rows=0, res=[OK], cost: 1100(us)
I20240911 15:33:23.193761 96587 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=675495, tablet=675511, transaction_id=15554904, version=76342, num_rows=0, res=[OK], cost: 1729(us)
I20240911 15:33:23.193768 96574 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=675495, tablet=675505, transaction_id=15554904, version=76342, num_rows=0, res=[OK], cost: 1752(us)
I20240911 15:33:23.193837 96683 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554904, cost(us): 1881, error_tablet_size=0, res=[OK]
I20240911 15:33:23.193874 96683 task_worker_pool.cpp:1593] successfully publish version|signature=15554904|transaction_id=15554904|tablets_num=3|cost(s)=0
I20240911 15:33:23.202746 96734 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.213122 96781 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.216380 96863 load_channel.cpp:69] load channel removed load_id=41445902096a4d67-873f93fc98d27d05, is high priority=1, sender_ip=169.169.53.13, index id: 263282, total_received_rows: 2, num_rows_filtered: 0
I20240911 15:33:23.232787 96859 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.233827 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554905
I20240911 15:33:23.235143 96586 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=263281, tablet=263291, transaction_id=15554905, version=110054, num_rows=0, res=[OK], cost: 1257(us)
I20240911 15:33:23.235167 96574 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=263281, tablet=263297, transaction_id=15554905, version=110054, num_rows=1, res=[OK], cost: 1272(us)
I20240911 15:33:23.235150 96590 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=263281, tablet=263285, transaction_id=15554905, version=110054, num_rows=1, res=[OK], cost: 1288(us)
I20240911 15:33:23.235224 96683 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554905, cost(us): 1397, error_tablet_size=0, res=[OK]
I20240911 15:33:23.235266 96683 task_worker_pool.cpp:1593] successfully publish version|signature=15554905|transaction_id=15554905|tablets_num=3|cost(s)=0
I20240911 15:33:23.245502 96813 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.251484 96868 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.265138 96756 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.293375 96851 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.311789 96871 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.316780 96742 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.329018 96992 tablets_channel.cpp:135] open tablets channel: (load_id=329745ac4e6849f9-897c9b24f7f1b9a1, index_id=313302), tablets num: 3, timeout(s): 40
I20240911 15:33:23.364472 96831 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.410060 96814 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.416935 96751 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.435343 96769 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.437484 96798 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.450677 96757 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.454869 96731 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.464818 96801 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.479533 96773 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.489354 96774 tablets_channel.cpp:227] close tablets channel: (load_id=107f7141ff744333-a1964d1fb66d732a, index_id=316913), sender id: 0, backend id: 10202
I20240911 15:33:23.492287 96877 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.498418 96797 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.501669 96766 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.520237 96748 tablets_channel.cpp:227] close tablets channel: (load_id=a9e47f15b75147b0-bc05143bd6686c1a, index_id=262776), sender id: 0, backend id: 10202
I20240911 15:33:23.522902 96875 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.524776 96748 load_channel.cpp:69] load channel removed load_id=a9e47f15b75147b0-bc05143bd6686c1a, is high priority=1, sender_ip=169.169.53.13, index id: 262776, total_received_rows: 0, num_rows_filtered: 0
I20240911 15:33:23.542505 96774 load_channel.cpp:69] load channel removed load_id=107f7141ff744333-a1964d1fb66d732a, is high priority=1, sender_ip=169.169.53.12, index id: 316913, total_received_rows: 5, num_rows_filtered: 0
I20240911 15:33:23.548154 96755 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.548378 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554906
I20240911 15:33:23.549474 96581 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=316912, tablet=316918, transaction_id=15554906, version=35127, num_rows=1, res=[OK], cost: 1053(us)
I20240911 15:33:23.552492 96557 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=316912, tablet=316930, transaction_id=15554906, version=35127, num_rows=2, res=[OK], cost: 4035(us)
I20240911 15:33:23.552510 96566 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=316912, tablet=316924, transaction_id=15554906, version=35127, num_rows=1, res=[OK], cost: 4065(us)
I20240911 15:33:23.552580 96680 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554906, cost(us): 4204, error_tablet_size=0, res=[OK]
I20240911 15:33:23.552652 96680 task_worker_pool.cpp:1593] successfully publish version|signature=15554906|transaction_id=15554906|tablets_num=3|cost(s)=0
I20240911 15:33:23.561477 96746 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.590159 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554907
I20240911 15:33:23.591488 96573 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=262775, tablet=262781, transaction_id=15554907, version=36450, num_rows=0, res=[OK], cost: 1289(us)
I20240911 15:33:23.592881 96560 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=262775, tablet=262787, transaction_id=15554907, version=36450, num_rows=0, res=[OK], cost: 2670(us)
I20240911 15:33:23.592892 96562 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=262775, tablet=262793, transaction_id=15554907, version=36450, num_rows=0, res=[OK], cost: 2672(us)
I20240911 15:33:23.592968 96680 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554907, cost(us): 2810, error_tablet_size=0, res=[OK]
I20240911 15:33:23.593003 96680 task_worker_pool.cpp:1593] successfully publish version|signature=15554907|transaction_id=15554907|tablets_num=3|cost(s)=0
I20240911 15:33:23.594766 96830 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.607393 96834 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.627003 96768 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.663028 96876 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.686872 96881 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.694195 96758 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.715893 72463 routine_load_task_executor.cpp:303] submit a new routine load task: id=d814efc8bdd84ab3-a6f0a1a2ca823d83, job_id=755599, txn_id=15554909, label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, elapse(s)=0, current tasks num: 1
I20240911 15:33:23.716014 115404 routine_load_task_executor.cpp:321] begin to execute routine load task: id=d814efc8bdd84ab3-a6f0a1a2ca823d83, job_id=755599, txn_id=15554909, label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, elapse(s)=0
I20240911 15:33:23.716162 115404 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.716396 115404 data_consumer_pool.cpp:103] get consumer group 1f46c577b65466f2-7c33c7e044ff41b7 with 1 consumers
I20240911 15:33:23.716411 115404 data_consumer.cpp:169] consumer: 434056608f5c74ac-543f184fccb32fb5, grp: 1f46c577b65466f2-7c33c7e044ff41b7 assign topic partitions: ods_iho_emr_vac1_rt, [1: 782172]
I20240911 15:33:23.716570 115404 stream_load_executor.cpp:71] begin to execute stream load. label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, txn_id=15554909, query_id=d814efc8bdd84ab3-a6f0a1a2ca823d83
I20240911 15:33:23.716838 115404 fragment_mgr.cpp:633] query_id: d814efc8bdd84ab3-a6f0a1a2ca823d83 coord_addr TNetworkAddress(hostname=169.169.53.14, port=19020) total fragment num on current host: 0 fe process uuid: 0
I20240911 15:33:23.716861 115404 fragment_mgr.cpp:659] Query/load id: d814efc8bdd84ab3-a6f0a1a2ca823d83, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 84.95 GB, enable_memory_overcommit = false, version = 10, cpu_hard_limit = 70, scan_thread_num = 48, max_remote_scan_thread_num = 512, min_remote_scan_thread_num = 512, spill_low_watermark=50, spill_high_watermark=80, is_shutdown=false, query_num=13], is pipeline: 1, enable cgroup soft limit: 1
I20240911 15:33:23.716879 115404 fragment_mgr.cpp:672] Register query/load memory tracker, query/load id: d814efc8bdd84ab3-a6f0a1a2ca823d83 limit: 0
I20240911 15:33:23.717002 115404 pipeline_fragment_context.cpp:251] Preparing instance d814efc8bdd84ab3-a6f0a1a2ca823d83|d814efc8bdd84ab3-a6f0a1a2ca823d84, backend_num 0
I20240911 15:33:23.718129 115404 data_consumer_group.cpp:108] start consumer group: 1f46c577b65466f2-7c33c7e044ff41b7. max time(ms): 20000, batch rows: 500000, batch size: 1048576000. id=d814efc8bdd84ab3-a6f0a1a2ca823d83, job_id=755599, txn_id=15554909, label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, elapse(s)=0
I20240911 15:33:23.718185 115405 data_consumer.cpp:194] start kafka consumer: 434056608f5c74ac-543f184fccb32fb5, grp: 1f46c577b65466f2-7c33c7e044ff41b7, max running time(ms): 20000
I20240911 15:33:23.718631 115410 cgroup_cpu_ctl.cpp:101] add thread 115410 to group success
I20240911 15:33:23.719393 96790 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.720055 96971 tablets_channel.cpp:135] open tablets channel: (load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, index_id=753262), tablets num: 3, timeout(s): 40
I20240911 15:33:23.755280 96720 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.761386 96885 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.796204 96821 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.796315 96990 tablets_channel.cpp:135] open tablets channel: (load_id=3bb1a94e646b4a1f-801d9b99a03b074a, index_id=264593), tablets num: 4, timeout(s): 40
I20240911 15:33:23.816982 96840 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.886410 96802 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.900857 96878 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.901068 96847 tablets_channel.cpp:227] close tablets channel: (load_id=329745ac4e6849f9-897c9b24f7f1b9a1, index_id=313302), sender id: 0, backend id: 10202
I20240911 15:33:23.903440 96763 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:23.955461 96847 load_channel.cpp:69] load channel removed load_id=329745ac4e6849f9-897c9b24f7f1b9a1, is high priority=1, sender_ip=169.169.53.13, index id: 313302, total_received_rows: 33, num_rows_filtered: 0
I20240911 15:33:23.965670 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554908
I20240911 15:33:23.967728 96565 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=313301, tablet=313313, transaction_id=15554908, version=90334, num_rows=11, res=[OK], cost: 1992(us)
I20240911 15:33:23.970412 96572 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=313301, tablet=313319, transaction_id=15554908, version=90334, num_rows=9, res=[OK], cost: 4654(us)
I20240911 15:33:23.970419 96567 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=313301, tablet=313307, transaction_id=15554908, version=90334, num_rows=7, res=[OK], cost: 4700(us)
I20240911 15:33:23.970513 96676 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554908, cost(us): 4841, error_tablet_size=0, res=[OK]
I20240911 15:33:23.970554 96676 task_worker_pool.cpp:1593] successfully publish version|signature=15554908|transaction_id=15554908|tablets_num=3|cost(s)=0
I20240911 15:33:24.003691 96738 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.018913 96873 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.022080 96754 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.075528 96799 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.105887 96974 tablets_channel.cpp:135] open tablets channel: (load_id=3c48382c06c742ef-b69306b38be06cb4, index_id=648766), tablets num: 3, timeout(s): 40
I20240911 15:33:24.119951 96823 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.140770 96752 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.157415 96770 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.182552 72463 routine_load_task_executor.cpp:303] submit a new routine load task: id=b7a001c6d79d445c-93795c1600141ee8, job_id=269260, txn_id=15554912, label=ods_iho_opd_vaf1_rt_load-269260-b7a001c6d79d445c-93795c1600141ee8-15554912, elapse(s)=0, current tasks num: 2
I20240911 15:33:24.182699 115488 routine_load_task_executor.cpp:321] begin to execute routine load task: id=b7a001c6d79d445c-93795c1600141ee8, job_id=269260, txn_id=15554912, label=ods_iho_opd_vaf1_rt_load-269260-b7a001c6d79d445c-93795c1600141ee8-15554912, elapse(s)=0
I20240911 15:33:24.182850 115488 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.183091 115488 data_consumer_pool.cpp:103] get consumer group 2c4b763769b7c3d5-ae5518114eaeb4a8 with 1 consumers
I20240911 15:33:24.183106 115488 data_consumer.cpp:169] consumer: 284f1a0472d65ee9-1444326d03d0b69e, grp: 2c4b763769b7c3d5-ae5518114eaeb4a8 assign topic partitions: ods_iho_opd_vaf1_rt, [0: 12041679]
I20240911 15:33:24.183127 96725 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.183292 115488 stream_load_executor.cpp:71] begin to execute stream load. label=ods_iho_opd_vaf1_rt_load-269260-b7a001c6d79d445c-93795c1600141ee8-15554912, txn_id=15554912, query_id=b7a001c6d79d445c-93795c1600141ee8
I20240911 15:33:24.183584 115488 fragment_mgr.cpp:633] query_id: b7a001c6d79d445c-93795c1600141ee8 coord_addr TNetworkAddress(hostname=169.169.53.14, port=19020) total fragment num on current host: 0 fe process uuid: 0
I20240911 15:33:24.183624 115488 fragment_mgr.cpp:659] Query/load id: b7a001c6d79d445c-93795c1600141ee8, use workload group: TG[id = 1, name = normal, cpu_share = 1024, memory_limit = 84.95 GB, enable_memory_overcommit = false, version = 10, cpu_hard_limit = 70, scan_thread_num = 48, max_remote_scan_thread_num = 512, min_remote_scan_thread_num = 512, spill_low_watermark=50, spill_high_watermark=80, is_shutdown=false, query_num=14], is pipeline: 1, enable cgroup soft limit: 1
I20240911 15:33:24.183650 115488 fragment_mgr.cpp:672] Register query/load memory tracker, query/load id: b7a001c6d79d445c-93795c1600141ee8 limit: 0
I20240911 15:33:24.183672 115488 pipeline_fragment_context.cpp:251] Preparing instance b7a001c6d79d445c-93795c1600141ee8|b7a001c6d79d445c-93795c1600141ee9, backend_num 0
I20240911 15:33:24.185165 115488 data_consumer_group.cpp:108] start consumer group: 2c4b763769b7c3d5-ae5518114eaeb4a8. max time(ms): 20000, batch rows: 500000, batch size: 1048576000. id=b7a001c6d79d445c-93795c1600141ee8, job_id=269260, txn_id=15554912, label=ods_iho_opd_vaf1_rt_load-269260-b7a001c6d79d445c-93795c1600141ee8-15554912, elapse(s)=0
I20240911 15:33:24.185318 115489 data_consumer.cpp:194] start kafka consumer: 284f1a0472d65ee9-1444326d03d0b69e, grp: 2c4b763769b7c3d5-ae5518114eaeb4a8, max running time(ms): 20000
I20240911 15:33:24.185853 115500 cgroup_cpu_ctl.cpp:101] add thread 115500 to group success
I20240911 15:33:24.187501 96947 tablets_channel.cpp:135] open tablets channel: (load_id=b7a001c6d79d445c-93795c1600141ee8, index_id=263167), tablets num: 3, timeout(s): 40
I20240911 15:33:24.226429 115405 data_consumer.cpp:253] consumer meet partition eof: 434056608f5c74ac-543f184fccb32fb5 partition offset: 782179
I20240911 15:33:24.226482 115405 data_consumer.cpp:274] kafka consumer done: 434056608f5c74ac-543f184fccb32fb5, grp: 1f46c577b65466f2-7c33c7e044ff41b7. cancelled: 0, left time(ms): 19492, total cost(ms): 508, consume cost(ms): 508, received rows: 7, put rows: 7
I20240911 15:33:24.226496 115405 data_consumer_group.cpp:87] all consumers are finished. shutdown queue. group id: 1f46c577b65466f2-7c33c7e044ff41b7
I20240911 15:33:24.226517 115404 data_consumer_group.cpp:128] consumer group done: 1f46c577b65466f2-7c33c7e044ff41b7. consume time(ms)=508, received rows=7, received bytes=11120, eos: 1, left_time: 19492, left_rows: 499993, left_bytes: 1048564880, blocking get time(us): 508300, blocking put time(us): 0, id=d814efc8bdd84ab3-a6f0a1a2ca823d83, job_id=755599, txn_id=15554909, label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, elapse(s)=0
I20240911 15:33:24.226579 115404 data_consumer.cpp:470] kafka consumer cancelled. 434056608f5c74ac-543f184fccb32fb5
I20240911 15:33:24.230296 115410 vtablet_writer.cpp:943] VNodeChannel[753262-10202], load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, txn_id=15554909, node=169.169.53.14:18060 mark closed, left pending batch size: 1
I20240911 15:33:24.230332 115410 vtablet_writer.cpp:943] VNodeChannel[753262-10144], load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, txn_id=15554909, node=169.169.53.13:18060 mark closed, left pending batch size: 1
I20240911 15:33:24.230336 115410 vtablet_writer.cpp:943] VNodeChannel[753262-10107], load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, txn_id=15554909, node=169.169.53.12:18060 mark closed, left pending batch size: 1
I20240911 15:33:24.231756 97064 vtablet_writer.cpp:983] All node channels are stopped(maybe finished/offending/cancelled), sender thread exit. d814efc8bdd84ab3-a6f0a1a2ca823d83
I20240911 15:33:24.233198 96816 tablets_channel.cpp:227] close tablets channel: (load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, index_id=753262), sender id: 0, backend id: 10202
I20240911 15:33:24.291363 96816 load_channel.cpp:69] load channel removed load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, is high priority=1, sender_ip=169.169.53.14, index id: 753262, total_received_rows: 2, num_rows_filtered: 0
I20240911 15:33:24.295173 115410 vtablet_writer.cpp:1484] total mem_exceeded_block_ns=0, total queue_push_lock_ns=0, total actual_consume_ns=629647, load id=d814efc8bdd84ab3-a6f0a1a2ca823d83
I20240911 15:33:24.295220 115410 vtablet_writer.cpp:1531] finished to close olap table sink. load_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, txn_id=15554909, node add batch time(ms)/wait execution time(ms)/close time(ms)/num: {10107:(61)(0)(65)(1)} {10144:(63)(0)(65)(1)} {10202:(60)(0)(61)(1)}
I20240911 15:33:24.296218 105461 fragment_mgr.cpp:584] Removing query d814efc8bdd84ab3-a6f0a1a2ca823d83 instance d814efc8bdd84ab3-a6f0a1a2ca823d84, all done? true
I20240911 15:33:24.296257 105461 fragment_mgr.cpp:590] Query d814efc8bdd84ab3-a6f0a1a2ca823d83 finished
I20240911 15:33:24.296283 105461 query_context.cpp:122] Query d814efc8bdd84ab3-a6f0a1a2ca823d83 deconstructed, , deregister query/load memory tracker, queryId=d814efc8bdd84ab3-a6f0a1a2ca823d83, Limit=2.00 GB, CurrUsed=3.62 MB, PeakUsed=7.51 MB
I20240911 15:33:24.296393 105461 query_context.cpp:154] Query d814efc8bdd84ab3-a6f0a1a2ca823d83 deconstructed, , deregister query/load memory tracker, queryId=d814efc8bdd84ab3-a6f0a1a2ca823d83, Limit=2.00 GB, CurrUsed=3.62 MB, PeakUsed=7.51 MB
I20240911 15:33:24.296545 105461 stream_load_executor.cpp:138] finished to execute stream load. label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, txn_id=15554909, query_id=d814efc8bdd84ab3-a6f0a1a2ca823d83, receive_data_cost_ms=0, read_data_cost_ms=0, write_data_cost_ms=579
I20240911 15:33:24.300829 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554909
I20240911 15:33:24.302335 96584 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=753261, tablet=753267, transaction_id=15554909, version=116453, num_rows=1, res=[OK], cost: 1472(us)
I20240911 15:33:24.304654 96589 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=753261, tablet=753279, transaction_id=15554909, version=116453, num_rows=1, res=[OK], cost: 3767(us)
I20240911 15:33:24.304673 96575 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=753261, tablet=753273, transaction_id=15554909, version=116453, num_rows=0, res=[OK], cost: 3799(us)
I20240911 15:33:24.304749 96682 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554909, cost(us): 3926, error_tablet_size=0, res=[OK]
I20240911 15:33:24.304785 96682 task_worker_pool.cpp:1593] successfully publish version|signature=15554909|transaction_id=15554909|tablets_num=3|cost(s)=0
I20240911 15:33:24.306186 96728 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.311820 115404 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.312136 96810 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.316272 115404 routine_load_task_executor.cpp:293] finished routine load task id=d814efc8bdd84ab3-a6f0a1a2ca823d83, job_id=755599, txn_id=15554909, label=ods_iho_emr_vac1_rt_load-755599-d814efc8bdd84ab3-a6f0a1a2ca823d83-15554909, elapse(s)=0, status: [OK], current tasks num: 1
I20240911 15:33:24.316813 96789 tablets_channel.cpp:227] close tablets channel: (load_id=3bb1a94e646b4a1f-801d9b99a03b074a, index_id=264593), sender id: 0, backend id: 10202
I20240911 15:33:24.320618 96721 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.330931 96750 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.335541 96767 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.356438 96739 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.372319 96760 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.372345 96789 load_channel.cpp:69] load channel removed load_id=3bb1a94e646b4a1f-801d9b99a03b074a, is high priority=1, sender_ip=169.169.53.13, index id: 264593, total_received_rows: 17, num_rows_filtered: 0
I20240911 15:33:24.379664 96828 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.383283 72463 task_worker_pool.cpp:331] successfully submit task|type=PUBLISH_VERSION|signature=15554910
I20240911 15:33:24.384668 96588 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=264592, tablet=264594, transaction_id=15554910, version=54300, num_rows=3, res=[OK], cost: 1335(us)
I20240911 15:33:24.385638 96589 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=264592, tablet=264612, transaction_id=15554910, version=54300, num_rows=3, res=[OK], cost: 2268(us)
I20240911 15:33:24.385650 96575 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=264592, tablet=264600, transaction_id=15554910, version=54300, num_rows=5, res=[OK], cost: 2307(us)
I20240911 15:33:24.385661 96584 engine_publish_version_task.cpp:405] publish version successfully on tablet, table_id=264592, tablet=264606, transaction_id=15554910, version=54300, num_rows=2, res=[OK], cost: 2302(us)
I20240911 15:33:24.385725 96682 engine_publish_version_task.cpp:326] finish to publish version on transaction.transaction_id=15554910, cost(us): 2426, error_tablet_size=0, res=[OK]
I20240911 15:33:24.385746 96682 task_worker_pool.cpp:1593] successfully publish version|signature=15554910|transaction_id=15554910|tablets_num=4|cost(s)=0
I20240911 15:33:24.403659 96724 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.437839 96741 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.451392 96743 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.458060 96759 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.459532 96719 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.473121 96819 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.509816 96808 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.515930 96780 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.553622 96772 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.574700 96882 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.581133 96794 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.593940 96735 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.599718 96825 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.612403 96796 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.619696 96872 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.620321 96784 tablets_channel.cpp:227] close tablets channel: (load_id=3c48382c06c742ef-b69306b38be06cb4, index_id=648766), sender id: 0, backend id: 10202
I20240911 15:33:24.626332 96870 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.632930 96761 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.660166 96744 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.667344 96855 data_consumer.cpp:132] init kafka consumer with group id: all_load_group
I20240911 15:33:24.674396 96784 load_channel.cpp:69] load channel removed load_id=3c48382c06c742ef-b69306b38be06cb4, is high priority=1, sender_ip=169.169.53.13, index id: 648766, total_received_rows: 1, num_rows_filtered: 0
I20240911 15:33:24.674649 96879 data_consumer.cpp:132] init kafka consumer with group id: all_load_group