doris-2.1.6已开启workload_group并且账号已经设置了default_workload_group,但是大部分查询的workload_group是空的

Viewed 83

Doris版本:doris-2.1.6-rc04-653e315ba5
账号root:"default_workload_group"="normal"
image.png
已开启workload_group
image.png
审计日志显示大部分查询是workload_group是空的。
image.png
image.png

2 Answers

select client_ip,workload_group,stmt from __internal_schema.audit_log where workload_group != 'normal'; 看下client_ip 是否同一个,且存在长链接情况@lcylgs

2024-10-29 00:24:03,615 INFO (audit loader thread|63) [AuditStreamLoader.loadBatch():140] AuditLoader plugin load with label: audit_log_20241029_002403_556_127_0_0_1_8030, response code: 200, msg: OK, content: { "TxnId": 732949, "Label": "audit_log_20241029_002403_556_127_0_0_1_8030", "Comment": "", "TwoPhaseCommit": "false", "Status": "Success", "Message": "OK", "NumberTotalRows": 30, "NumberLoadedRows": 30, "NumberFilteredRows": 0, "NumberUnselectedRows": 0, "LoadBytes": 8701, "LoadTimeMs": 53, "BeginTxnTimeMs": 0, "StreamLoadPutTimeMs": 2, "ReadDataTimeMs": 0, "WriteDataTimeMs": 17, "CommitAndPublishTimeMs": 33}
2024-10-29 00:24:04,378 INFO (InsertOverwriteDropDirtyPartitions|72) [InsertOverwriteManager.runAfterCatalogReady():302] start clean insert overwrite temp partitions
2024-10-29 00:24:06,651 INFO (report-thread|214) [ReportHandler.taskReport():629] finished to handle task report from backend 10092, diff task num: 1. cost: 0 ms
2024-10-29 00:24:06,651 INFO (thrift-server-pool-68|37239) [ReportHandler.handleReport():216] receive report from be 10092. type: TASK, report version -1, current queue size: 1
2024-10-29 00:24:06,651 WARN (thrift-server-pool-98|55732) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...89, be_port:9060, http_port:8040, brpc_port:8060, id:10092), task_type:PUBLISH_VERSION, signature:687365, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...89)[E-914]could not find related rowset for tablet 10628217, txn id 687365]), report_version:17298545415214, error_tablet_ids:[10628217], succ_tablets:{10628205=0, 10628213=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,325 INFO (report-thread|214) [ReportHandler.taskReport():629] finished to handle task report from backend 10091, diff task num: 6. cost: 0 ms
2024-10-29 00:24:07,325 INFO (thrift-server-pool-64|37164) [ReportHandler.handleReport():216] receive report from be 10091. type: TASK, report version -1, current queue size: 1
2024-10-29 00:24:07,326 WARN (thrift-server-pool-13|1035) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...81, be_port:9060, http_port:8040, brpc_port:8060, id:10091), task_type:PUBLISH_VERSION, signature:728731, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...81)[E-914]could not find related rowset for tablet 10628276, txn id 728731]), report_version:17298545435028, error_tablet_ids:[10628276], succ_tablets:{10628272=0, 10628288=0, 10628260=0, 10628268=0, 10628284=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,326 WARN (thrift-server-pool-57|37138) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...81, be_port:9060, http_port:8040, brpc_port:8060, id:10091), task_type:PUBLISH_VERSION, signature:723555, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...81)[E-914]could not find related rowset for tablet 10628672, txn id 723555]), report_version:17298545435028, error_tablet_ids:[10628672], succ_tablets:{10628640=0, 10628656=0, 10628644=0, 10628660=0, 10628648=0, 10628664=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,327 WARN (thrift-server-pool-8|435) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...81, be_port:9060, http_port:8040, brpc_port:8060, id:10091), task_type:PUBLISH_VERSION, signature:724437, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...81)[E-914]could not find related rowset for tablet 10628245, txn id 724437]), report_version:17298545435028, error_tablet_ids:[10628225, 10628237, 10628241, 10628245], succ_tablets:{10628229=0, 10628253=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,327 WARN (thrift-server-pool-77|37517) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...81, be_port:9060, http_port:8040, brpc_port:8060, id:10091), task_type:PUBLISH_VERSION, signature:712645, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...81)[E-914]could not find related rowset for tablet 10628276, txn id 712645]), report_version:17298545435028, error_tablet_ids:[10628276], succ_tablets:{10628272=0, 10628288=0, 10628260=0, 10628268=0, 10628284=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,327 WARN (thrift-server-pool-63|37156) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...81, be_port:9060, http_port:8040, brpc_port:8060, id:10091), task_type:PUBLISH_VERSION, signature:705048, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...81)[E-914]could not find related rowset for tablet 10628245, txn id 705048]), report_version:17298545435028, error_tablet_ids:[10628225, 10628237, 10628241, 10628245], succ_tablets:{10628229=0, 10628253=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,327 WARN (thrift-server-pool-96|55724) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...81, be_port:9060, http_port:8040, brpc_port:8060, id:10091), task_type:PUBLISH_VERSION, signature:686097, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...81)[E-914]could not find related rowset for tablet 10628245, txn id 686097]), report_version:17298545435028, error_tablet_ids:[10628225, 10628237, 10628241, 10628245], succ_tablets:{10628229=0, 10628253=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,793 INFO (report-thread|214) [ReportHandler.taskReport():629] finished to handle task report from backend 10090, diff task num: 1. cost: 0 ms
2024-10-29 00:24:07,793 INFO (thrift-server-pool-94|55722) [ReportHandler.handleReport():216] receive report from be 10090. type: TASK, report version -1, current queue size: 1
2024-10-29 00:24:07,794 WARN (thrift-server-pool-60|37142) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...47, be_port:9060, http_port:8040, brpc_port:8060, id:10090), task_type:PUBLISH_VERSION, signature:728680, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...47)[E-914]could not find related rowset for tablet 10628394, txn id 728680]), report_version:17298504955110, error_tablet_ids:[10628394], succ_tablets:{10628370=0, 10628386=0, 10628402=0, 10628362=0, 10628378=0, 10628366=0, 10628382=0, 10628398=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:07,926 INFO (binlog-gcer|57) [BinlogManager.gc():387] begin gc binlog
2024-10-29 00:24:07,926 INFO (binlog-gcer|57) [BinlogManager.gc():398] gc binlog, dbBinlogMap is null
2024-10-29 00:24:07,926 INFO (binlog-gcer|57) [BinlogGcer.runAfterCatalogReady():63] no gc binlog
2024-10-29 00:24:08,402 INFO (thrift-server-pool-102|55881) [ReportHandler.handleReport():216] receive report from be 9970814. type: TASK, report version -1, current queue size: 1
2024-10-29 00:24:08,402 INFO (report-thread|214) [ReportHandler.taskReport():629] finished to handle task report from backend 9970814, diff task num: 2. cost: 0 ms
2024-10-29 00:24:08,402 WARN (thrift-server-pool-97|55727) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...26, be_port:9060, http_port:8040, brpc_port:8060, id:9970814), task_type:PUBLISH_VERSION, signature:686097, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...26)[E-914]could not find related rowset for tablet 10628249, txn id 686097]), report_version:17298563445195, error_tablet_ids:[10628249], succ_tablets:{10628229=0, 10628245=0, 10628233=0, 10628237=0, 10628253=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:08,403 WARN (thrift-server-pool-65|37172) [MasterImpl.finishTask():94] finish task reports bad. request: TFinishTaskRequest(backend:TBackend(host:...26, be_port:9060, http_port:8040, brpc_port:8060, id:9970814), task_type:PUBLISH_VERSION, signature:712645, task_status:TStatus(status_code:INTERNAL_ERROR, error_msgs:[(...26)[E-914]could not find related rowset for tablet 10628268, txn id 712645]), report_version:17298563445195, error_tablet_ids:[10628268], succ_tablets:{10628260=0, 10628276=0, 10628264=0, 10628280=0, 10628284=0}, table_id_to_delta_num_rows:{})
2024-10-29 00:24:10,322 INFO (TopicPublisher|60) [TopicPublisherThread.runAfterCatalogReady():68] [topic_publish]begin publish topic info
2024-10-29 00:24:10,323 INFO (topic-publish-thread-5|440) [TopicPublisherThread$TopicPublishWorker.run():151] [topic_publish]publish topic info to be ...89 success, time cost=1 ms, details: WORKLOAD_GROUP=5 WORKLOAD_SCHED_POLICY=2
2024-10-29 00:24:10,323 INFO (topic-publish-thread-1|223) [TopicPublisherThread$TopicPublishWorker.run():151] [topic_publish]publish topic info to be ..
.26 success, time cost=1 ms, details: WORKLOAD_GROUP=5 WORKLOAD_SCHED_POLICY=2
2024-10-29 00:24:10,323 INFO (topic-publish-thread-4|439) [TopicPublisherThread$TopicPublishWorker.run():151] [topic_publish]publish topic info to be ...47 success, time cost=1 ms, details: WORKLOAD_GROUP=5 WORKLOAD_SCHED_POLICY=2
2024-10-29 00:24:10,323 INFO (topic-publish-thread-2|224) [TopicPublisherThread$TopicPublishWorker.run():151] [topic_publish]publish topic info to be ..
.81 success, time cost=1 ms, details: WORKLOAD_GROUP=5 WORKLOAD_SCHED_POLICY=2
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714289, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714291, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714293, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714295, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714297, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714299, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714301, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714303, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,739 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714305, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714307, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714796, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714798, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714800, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714802, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714804, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714806, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714808, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714810, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714812, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletScheduler.addTablet():285] Add tablet to pending queue, tablet id: 8714814, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: -1, committed version: -1
2024-10-29 00:24:10,740 INFO (tablet checker|39) [TabletChecker.checkTablets():348] finished to check tablets. unhealth/total/added/in_sched/not_ready: 20/358/20/0/0, cost: 1 ms
2024-10-29 00:24:11,208 INFO (tablet scheduler|38) [TabletScheduler.removeTabletCtx():1735] remove the tablet tablet id: 8714289, status: REPLICA_MISSING_FOR_TAG, state: PENDING, type: REPAIR, priority: NORMAL, tablet size: 0, visible version: 1, committed version: 1. err: tag {"location" : "sci"} does not exist. available tags: {"location" : "default"}. because: tag {"location" : "sci"} does not exist. available tags: {"location" : "default"}