从query_profile文件中分析不出耗时的原因,很多关键字文档上搜不到

Viewed 64
Query:
    Summary:
          -  Profile  ID:  6f4c207377da4a61-bdde979d542b2b0b
          -  Task  Type:  QUERY
          -  Start  Time:  2024-07-03  10:49:02
          -  End  Time:  2024-07-03  10:49:25
          -  Total:  22s617ms
          -  Task  State:  EOF
          -  User:  root
          -  Default  Db:  default_cluster:dm_bi
          -  Sql  Statement:  xx
    Execution  Summary:
          -  Workload  Group:  
          -  Analysis  Time:  7ms
          -  Plan  Time:  18ms
              -  JoinReorder  Time:  N/A
              -  CreateSingleNode  Time:  N/A
              -  QueryDistributed  Time:  N/A
              -  Init  Scan  Node  Time:  N/A
              -  Finalize  Scan  Node  Time:  N/A
                  -  Get  Splits  Time:  N/A
                      -  Get  PARTITIONS  Time:  N/A
                      -  Get  PARTITION  FILES  Time:  N/A
                  -  Create  Scan  Range  Time:  N/A
          -  Schedule  Time:  9ms
          -  Fetch  Result  Time:  22s583ms
          -  Write  Result  Time:  0ms
          -  Wait  and  Fetch  Result  Time:  22s583ms
          -  Doris  Version:  doris-2.0.10-2a5949cb9e
          -  Is  Nereids:  Yes
          -  Is  Pipeline:  Yes
          -  Is  Cached:  No
          -  Total  Instances  Num:  17
          -  Instances  Num  Per  BE:  10.0.161.20:8060:3,10.0.161.21:8060:3,10.0.161.22:8060:4,10.0.161.23:8060:3,10.0.161.24:8060:3,10.0.161.25:8060:1
          -  Parallel  Fragment  Exec  Instance  Num:  1
          -  Trace  ID:  
    Execution  Profile  6f4c207377da4a61-bdde979d542b2b0b:(Active:  22s617ms,  %  non-child:  0.00%)
        Fragments:
            Fragment  0:
                Instance  6f4c207377da4a61-bdde979d542b2b1c  (host=TNetworkAddress(hostname:10.0.161.22,  port:9060)):
                    VDataBufferSender  (dst_fragment_instance_id=6f4c207377da4a61--42216862abd4d4e4):
                          -  AppendBatchTime:  110.789us
                              -  CopyBufferTime:  0ns
                              -  ResultSendTime:  84.818us
                              -  TupleConvertTime:  18.794us
                          -  BytesSent:  57.00  B
                          -  NumSentRows:  1
                    VAGGREGATION_NODE  (id=3254):(Active:  115.83us,  %  non-child:  0.00%)
                          -  AggInfos:  (_is_merge:  true,  _needs_finalize:  true,  Streaming  Preaggregation:  false,  agg  size:  3,  limit:  -1)
                          -  BuildConvertToPartitionedTime:  0ns
                          -  DeserializeAndMergeTime:  4.9us
                          -  ExecTime:  58.303us
                          -  ExprTime:  0ns
                          -  GetResultsTime:  0ns
                          -  HashTableComputeTime:  0ns
                          -  HashTableInputCount:  0
                          -  HashTableIterateTime:  0ns
                          -  HashTableSize:  0
                          -  InsertKeysToColumnTime:  0ns
                          -  MaxRowSizeInBytes:  0
                          -  MemoryUsage:  
                              -  HashTable:  0.00  
                              -  PeakMemoryUsage:  4.00  KB
                              -  SerializeKeyArena:  4.00  KB
                          -  MergeTime:  10.705us
                          -  ProjectionTime:  0ns
                          -  RowsReturned:  1
                          -  RowsReturnedRate:  8.689K  /sec
                          -  SerializeDataTime:  0ns
                          -  SerializeKeyTime:  0ns
                          -  SerializeResultTime:  0ns
                          -  StreamingAggTime:  0ns
                        VEXCHANGE_NODE  (id=3251):(Active:  9.99us,  %  non-child:  0.00%)
                              -  BlocksProduced:  1
                              -  BytesReceived:  71.00  B
                              -  DataArrivalWaitTime:  0ns
                              -  DecompressBytes:  75.00  B
                              -  DecompressTime:  2.278us
                              -  DeserializeRowBatchTimer:  10.182us
                              -  FirstBatchArrivalWaitTime:  0ns
                              -  LocalBytesReceived:  384.00  B
                              -  MemoryUsage:  
                                  -  Blocks:  384.00  B
                                  -  PeakMemoryUsage:  3.41  KB
                              -  ProjectionTime:  0ns
                              -  RowsProduced:  1
                              -  RowsReturned:  2
                              -  RowsReturnedRate:  219.804K  /sec
                              -  SendersBlockedTotalTimer(*):  0ns
                    PipelineContext:(Active:  22s587ms,  %  non-child:  0.00%)
                          -  PrepareTime:  385.795us
                          -  StartTime:  8.374us
                        Pipeline  (pipeline  id=0):
                            PipelineTask  (index=0):(Active:  211.899us,  %  non-child:  0.00%)
                                  -  Sink:  ResultSinkOperator(dst_id=10000)
                                  -  OperatorIds(source2root):  [AggSourceOperator(node_id=3254)]
                                  -  CoreChangeTimes:  1
                                  -  ExecuteTime:  183.353us
                                      -  CloseTime:  13.908us
                                      -  FinalizeTime:  72ns
                                      -  GetBlockTime:  39.275us
                                      -  OpenTime:  2.252us
                                      -  PrepareTime:  4.211us
                                      -  SinkTime:  114.881us
                                  -  GetBlockCounter:  1
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  1
                                  -  NumBlockedTimes:  3
                                  -  NumScheduleTimes:  3
                                  -  NumYieldTimes:  0
                                  -  Task1BeginExecuteTime:  2.937ms
                                  -  Task2EosTime:  22s586ms
                                  -  Task3SrcPendingFinishOverTime:  22s586ms
                                  -  Task4DstPendingFinishOverTime:  22s586ms
                                  -  Task5TotalTime:  22s586ms
                                  -  Task6ClosePipelineTime:  22s586ms
                                  -  TaskCpuTime:  183.437us
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  22s583ms
                                  -  WaitWorkerTime:  34.106us
                        Pipeline  (pipeline  id=1):
                            PipelineTask  (index=1):(Active:  104.197us,  %  non-child:  0.00%)
                                  -  Sink:  AggSinkOperator(dst_id=3254)
                                  -  OperatorIds(source2root):  [ExchangeSourceOperator(node_id=3251)]
                                  -  CoreChangeTimes:  1
                                  -  ExecuteTime:  77.843us
                                      -  CloseTime:  5.112us
                                      -  FinalizeTime:  65ns
                                      -  GetBlockTime:  16.734us
                                      -  OpenTime:  9.360us
                                      -  PrepareTime:  6.90us
                                      -  SinkTime:  16.526us
                                  -  GetBlockCounter:  3
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  2
                                  -  NumBlockedTimes:  4
                                  -  NumScheduleTimes:  4
                                  -  NumYieldTimes:  0
                                  -  Task1BeginExecuteTime:  2.932ms
                                  -  Task2EosTime:  22s586ms
                                  -  Task3SrcPendingFinishOverTime:  22s586ms
                                  -  Task4DstPendingFinishOverTime:  22s586ms
                                  -  Task5TotalTime:  22s586ms
                                  -  Task6ClosePipelineTime:  22s586ms
                                  -  TaskCpuTime:  83.176us
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  22s583ms
                                  -  WaitWorkerTime:  34.26us
            Fragment  1:
                Instance  6f4c207377da4a61-bdde979d542b2b19  (host=TNetworkAddress(hostname:10.0.161.25,  port:9060)):
                    VDataStreamSender  (dst_id=3251,  dst_fragments=[{"6f4c207377da4a61-bdde979d542b2b1c"}]):(Active:  19.702us,  %  non-child:  0.00%)
                          -  BlocksSent:  1
                          -  BrpcSendTime:  0ns
                          -  BrpcSendTime.Wait:  0ns
                          -  BytesSent:  0.00  
                          -  CompressTime:  0ns
                          -  IgnoreRows:  0
                          -  LocalBytesSent:  0.00  
                          -  LocalSendTime:  0ns
                          -  LocalSentRows:  0
                          -  MemoryUsage:  
                              -  PeakMemoryUsage:  5.06  KB
                          -  OverallThroughput:  0.0  /sec
                          -  RpcAvgTime:  0ns
                          -  RpcCount:  1
                          -  RpcMaxTime:  0ns
                          -  RpcMinTime:  0ns
                          -  RpcSumTime:  0ns
                          -  SerializeBatchTime:  0ns
                          -  SplitBlockDistributeByChannelTime:  0ns
                          -  SplitBlockHashComputeTime:  0ns
                          -  UncompressedRowBatchSize:  0.00  
                    VAGGREGATION_NODE  (id=3248):(Active:  329.879us,  %  non-child:  0.00%)
                          -  AggInfos:  (_is_merge:  false,  _needs_finalize:  false,  Streaming  Preaggregation:  false,  agg  size:  3,  limit:  -1)
                          -  BuildConvertToPartitionedTime:  0ns
                          -  DeserializeAndMergeTime:  0ns
                          -  ExecTime:  42.609us
                          -  ExprTime:  0ns
                          -  GetResultsTime:  0ns
                          -  HashTableComputeTime:  0ns
                          -  HashTableInputCount:  0
                          -  HashTableIterateTime:  0ns
                          -  HashTableSize:  0
                          -  InsertKeysToColumnTime:  0ns
                          -  MaxRowSizeInBytes:  0
                          -  MemoryUsage:  
                              -  HashTable:  0.00  
                              -  PeakMemoryUsage:  0.00  
                              -  SerializeKeyArena:  0.00  
                          -  MergeTime:  0ns
                          -  ProjectionTime:  0ns
                          -  RowsReturned:  0
                          -  RowsReturnedRate:  0
                          -  SerializeDataTime:  0ns
                          -  SerializeKeyTime:  0ns
                          -  SerializeResultTime:  311ns
                          -  StreamingAggTime:  0ns
                        VCROSS_JOIN_NODE  (id=3242):(Active:  225.288us,  %  non-child:  0.00%)
                              -  JoinType:  INNER_JOIN
                              -  MemoryUsage:  
                                  -  PeakMemoryUsage:  0.00  
                              -  ProjectionTime:  0ns
                              -  PublishRuntimeFilterTime:  0ns
                              -  PushDownComputeTime:  0ns
                              -  RowsReturned:  0
                              -  RowsReturnedRate:  0
                            ProbePhase:
                                  -  ProbeRows:  12.314K  (12314)
                                  -  ProbeTime:  135.468ms
                                      -  BuildOutputBlock:  2.203ms
                                      -  JoinFilterTimer:  32.643us
                                      -  LoopGenerateJoin:  130.457ms
                            BuildPhase:
                                  -  BuildGetNextTime:  0ns
                                  -  BuildRows:  53
                                  -  BuildTime:  11.954us
                            VEXCHANGE_NODE  (id=3239):(Active:  7.709us,  %  non-child:  0.00%)
                                  -  BlocksProduced:  5
                                  -  BytesReceived:  1020.00  B
                                  -  DataArrivalWaitTime:  0ns
                                  -  DecompressBytes:  1.71  KB
                                  -  DecompressTime:  10.930us
                                  -  DeserializeRowBatchTimer:  49.588us
                                  -  FirstBatchArrivalWaitTime:  0ns
                                  -  LocalBytesReceived:  0.00  
                                  -  MemoryUsage:  
                                      -  Blocks:  896.00  B
                                      -  PeakMemoryUsage:  3.41  KB
                                  -  ProjectionTime:  0ns
                                  -  RowsProduced:  53
                                  -  RowsReturned:  53
                                  -  RowsReturnedRate:  6.875081M  /sec
                                  -  SendersBlockedTotalTimer(*):  0ns
                            VNewOlapScanNode(dm_doris_abstract_sum_sr)  (id=3196):(Active:  36.572us,  %  non-child:  0.00%)
                                  -  RuntimeFilters:  :  
                                  -  PushDownPredicates:  []
                                  -  KeyRanges:  ScanKeys:ScanKey=[  :  �]
                                  -  TabletIds:  [29276717,  29276725]
                                  -  UseSpecificThreadToken:  False
                                  -  AcquireRuntimeFilterTime:  261ns
                                  -  AllocateResourceTime:  91.58us
                                  -  GetNextTime:  38.639us
                                  -  MaxScannerThreadNum:  2
                                  -  MemoryUsage:  
                                      -  PeakMemoryUsage:  0.00  
                                  -  NumScanners:  2
                                  -  OpenTime:  0ns
                                  -  ProcessConjunctTime:  50.561us
                                  -  ProjectionTime:  146.618us
                                  -  RowsReturned:  12.314K  (12314)
                                  -  RowsReturnedRate:  336.705676M  /sec
                                  -  ScanByteRead:  1.81  MB
                                  -  ScanRowsRead:  12.314K  (12314)
                                  -  ScannerWorkerWaitTime:  48.393us
                                  -  TabletNum:  2
                                  -  TotalReadThroughput:  0
                                VScanner:
                                      -  ReadColumns:  [kqgs,  kqmj_code,  calmonth,  sjdata,  ysdata]
                                      -  PerScannerRunningTime:  [284.520us,  513.037us,  ]
                                      -  PerScannerRowsRead:  [4.20K,  8.11K,  ]
                                      -  PerScannerWaitTime:  [21.273us,  27.120us,  ]
                                      -  BlockConvertTime:  0ns
                                      -  BlockFetchTime:  618.310us
                                      -  DeleteBitmapGetAggTime:  0ns
                                      -  MemoryUsage:  
                                          -  FreeBlocks:  1.60  MB
                                          -  QueuedBlocks:  0.00  
                                      -  NewlyCreateFreeBlocksNum:  14
                                      -  ReaderInitTime:  0ns
                                      -  RowsDelFiltered:  0
                                      -  ScannerBatchWaitTime:  0ns
                                      -  ScannerConvertBlockTime:  0ns
                                      -  ScannerCpuTime:  1.870ms
                                      -  ScannerCtxSchedCount:  3
                                      -  ScannerCtxSchedTime:  11.434us
                                      -  ScannerFilterTime:  8.548us
                                      -  ScannerGetBlockTime:  783.949us
                                      -  ScannerInitTime:  21.14us
                                      -  ScannerPrefilterTime:  0ns
                                      -  ScannerSchedCount:  2
                                    SegmentIterator:
                                          -  BitmapIndexFilterTimer:  522ns
                                          -  BlockConditionsFilteredBloomFilterTime:  0ns
                                          -  BlockConditionsFilteredDictTime:  0ns
                                          -  BlockConditionsFilteredTime:  4.363us
                                          -  BlockConditionsFilteredZonemapRuntimePredicateTime:  0ns
                                          -  BlockConditionsFilteredZonemapTime:  0ns
                                          -  BlockInitSeekCount:  27
                                          -  BlockInitSeekTime:  42.651us
                                          -  BlockInitTime:  125.487us
                                          -  BlockLoadTime:  1.64ms
                                          -  BlocksLoad:  19
                                          -  CachedPagesNum:  29
                                          -  CompressedBytesRead:  0.00  
                                          -  DecompressorTimer:  0ns
                                          -  ExprFilterEvalTime:  0ns
                                          -  FirstReadSeekCount:  75
                                          -  FirstReadSeekTime:  109.227us
                                          -  FirstReadTime:  842.362us
                                          -  IOTimer:  0ns
                                          -  InvertedIndexFilterTime:  1.97us
                                          -  InvertedIndexQueryBitmapCopyTime:  0ns
                                          -  InvertedIndexQueryBitmapOpTime:  0ns
                                          -  InvertedIndexQueryCacheHit:  0
                                          -  InvertedIndexQueryCacheMiss:  0
                                          -  InvertedIndexQueryTime:  0ns
                                          -  InvertedIndexSearcherOpenTime:  0ns
                                          -  InvertedIndexSearcherSearchTime:  0ns
                                          -  LazyReadSeekCount:  0
                                          -  LazyReadSeekTime:  0ns
                                          -  LazyReadTime:  0ns
                                          -  NumSegmentFiltered:  0
                                          -  NumSegmentTotal:  4
                                          -  OutputColumnTime:  1.995us
                                          -  OutputIndexResultColumnTimer:  1.39us
                                          -  RawRowsRead:  12.314K  (12314)
                                          -  RowsBitmapIndexFiltered:  0
                                          -  RowsBloomFilterFiltered:  0
                                          -  RowsConditionsFiltered:  0
                                          -  RowsDictFiltered:  0
                                          -  RowsInvertedIndexFiltered:  0
                                          -  RowsKeyRangeFiltered:  0
                                          -  RowsShortCircuitPredFiltered:  0
                                          -  RowsShortCircuitPredInput:  0
                                          -  RowsVectorPredFiltered:  0
                                          -  RowsVectorPredInput:  0
                                          -  RowsZonemapFiltered:  0
                                          -  RowsZonemapRuntimePredicateFiltered:  0
                                          -  SecondReadTime:  0ns
                                          -  ShortPredEvalTime:  0ns
                                          -  TotalPagesNum:  29
                                          -  UncompressedBytesRead:  0.00  
                                          -  VectorPredEvalTime:  0ns
                    PipelineContext:(Active:  178.10ms,  %  non-child:  0.00%)
                          -  PrepareTime:  709.75us
                          -  StartTime:  2.759us
                        Pipeline  (pipeline  id=0):
                            PipelineTask  (index=0):(Active:  79.540us,  %  non-child:  0.00%)
                                  -  Sink:  ExchangeSinkOperator(dst_id=3251)
                                  -  OperatorIds(source2root):  [AggSourceOperator(node_id=3248)]
                                  -  CoreChangeTimes:  0
                                  -  ExecuteTime:  33.905us
                                      -  CloseTime:  18.920us
                                      -  FinalizeTime:  48ns
                                      -  GetBlockTime:  4.124us
                                      -  OpenTime:  10.958us
                                      -  PrepareTime:  8.740us
                                      -  SinkTime:  387ns
                                  -  GetBlockCounter:  1
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  1
                                  -  NumBlockedTimes:  3
                                  -  NumScheduleTimes:  4
                                  -  NumYieldTimes:  0
                                  -  Task1BeginExecuteTime:  1.705ms
                                  -  Task2EosTime:  163.103ms
                                  -  Task3SrcPendingFinishOverTime:  163.105ms
                                  -  Task4DstPendingFinishOverTime:  163.106ms
                                  -  Task5TotalTime:  177.386ms
                                  -  Task6ClosePipelineTime:  177.386ms
                                  -  TaskCpuTime:  48.730us
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  161.377ms
                                  -  WaitWorkerTime:  36.194us
                        Pipeline  (pipeline  id=1):
                            PipelineTask  (index=1):(Active:  139.286ms,  %  non-child:  0.00%)
                                  -  Sink:  AggSinkOperator(dst_id=3248)
                                  -  OperatorIds(source2root):  [ScanOperator(node_id=3196),  NestLoopJoinProbeOperator(node_id=3242)]
                                  -  CoreChangeTimes:  0
                                  -  ExecuteTime:  139.65ms
                                      -  CloseTime:  78.794us
                                      -  FinalizeTime:  49ns
                                      -  GetBlockTime:  138.794ms
                                      -  OpenTime:  134.562us
                                      -  PrepareTime:  2.850us
                                      -  SinkTime:  1.113us
                                  -  GetBlockCounter:  626
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  0
                                  -  NumBlockedTimes:  2
                                  -  NumScheduleTimes:  3
                                  -  NumYieldTimes:  1
                                  -  Task1BeginExecuteTime:  24.158ms
                                  -  Task2EosTime:  163.82ms
                                  -  Task3SrcPendingFinishOverTime:  163.84ms
                                  -  Task4DstPendingFinishOverTime:  163.84ms
                                  -  Task5TotalTime:  163.166ms
                                  -  Task6ClosePipelineTime:  163.166ms
                                  -  TaskCpuTime:  138.863ms
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  0ns
                                  -  WaitWorkerTime:  18.824us
                        Pipeline  (pipeline  id=2):
                            PipelineTask  (index=2):(Active:  253.73us,  %  non-child:  0.00%)
                                  -  Sink:  NestLoopJoinBuildOperator(dst_id=3242)
                                  -  OperatorIds(source2root):  [ExchangeSourceOperator(node_id=3239)]
                                  -  CoreChangeTimes:  0
                                  -  ExecuteTime:  155.741us
                                      -  CloseTime:  3.402us
                                      -  FinalizeTime:  74ns
                                      -  GetBlockTime:  13.881us
                                      -  OpenTime:  84.953us
                                      -  PrepareTime:  1.787us
                                      -  SinkTime:  13.557us
                                  -  GetBlockCounter:  6
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  6
                                  -  NumBlockedTimes:  8
                                  -  NumScheduleTimes:  8
                                  -  NumYieldTimes:  0
                                  -  Task1BeginExecuteTime:  1.699ms
                                  -  Task2EosTime:  24.144ms
                                  -  Task3SrcPendingFinishOverTime:  24.146ms
                                  -  Task4DstPendingFinishOverTime:  24.146ms
                                  -  Task5TotalTime:  24.150ms
                                  -  Task6ClosePipelineTime:  24.151ms
                                  -  TaskCpuTime:  204.262us
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  22.348ms
                                  -  WaitWorkerTime:  61.906us
                Instance  6f4c207377da4a61-bdde979d542b2b1b  (host=TNetworkAddress(hostname:10.0.161.22,  port:9060)):
                    VDataStreamSender  (dst_id=3251,  dst_fragments=[{"6f4c207377da4a61-bdde979d542b2b1c"}]):(Active:  37.595us,  %  non-child:  0.00%)
                          -  BlocksSent:  1
                          -  BrpcSendTime:  0ns
                          -  BrpcSendTime.Wait:  0ns
                          -  BytesSent:  0.00  
                          -  CompressTime:  0ns
                          -  IgnoreRows:  0
                          -  LocalBytesSent:  39.00  B
                          -  LocalSendTime:  7.911us
                          -  LocalSentRows:  1
                          -  MemoryUsage:  
                              -  PeakMemoryUsage:  3.70  KB
                          -  OverallThroughput:  0.0  /sec
                          -  RpcAvgTime:  0ns
                          -  RpcCount:  0
                          -  RpcMaxTime:  0ns
                          -  RpcMinTime:  0ns
                          -  RpcSumTime:  0ns
                          -  SerializeBatchTime:  0ns
                          -  SplitBlockDistributeByChannelTime:  0ns
                          -  SplitBlockHashComputeTime:  0ns
                          -  UncompressedRowBatchSize:  0.00  
                    VAGGREGATION_NODE  (id=3248):(Active:  436.49us,  %  non-child:  0.00%)
                          -  AggInfos:  (_is_merge:  false,  _needs_finalize:  false,  Streaming  Preaggregation:  false,  agg  size:  3,  limit:  -1)
                          -  BuildConvertToPartitionedTime:  0ns
                          -  DeserializeAndMergeTime:  0ns
                          -  ExecTime:  1s66ms
                          -  ExprTime:  1s42ms
                          -  GetResultsTime:  0ns
                          -  HashTableComputeTime:  0ns
                          -  HashTableInputCount:  0
                          -  HashTableIterateTime:  0ns
                          -  HashTableSize:  0
                          -  InsertKeysToColumnTime:  0ns
                          -  MaxRowSizeInBytes:  0
                          -  MemoryUsage:  
                              -  HashTable:  0.00  
                              -  PeakMemoryUsage:  4.00  KB
                              -  SerializeKeyArena:  4.00  KB
                          -  MergeTime:  0ns
                          -  ProjectionTime:  0ns
                          -  RowsReturned:  1
                          -  RowsReturnedRate:  2.293K  /sec
                          -  SerializeDataTime:  0ns
                          -  SerializeKeyTime:  0ns
                          -  SerializeResultTime:  6.37us
                          -  StreamingAggTime:  0ns
                        VCROSS_JOIN_NODE  (id=3242):(Active:  289.339us,  %  non-child:  0.00%)
                              -  JoinType:  INNER_JOIN
                              -  MemoryUsage:  
                                  -  PeakMemoryUsage:  0.00  
                              -  ProjectionTime:  271.662ms
                              -  PublishRuntimeFilterTime:  0ns
                              -  PushDownComputeTime:  0ns
                              -  RowsReturned:  192.393K  (192393)
                              -  RowsReturnedRate:  664.939741M  /sec
                            ProbePhase:
                                  -  ProbeRows:  2.447911M  (2447911)
                                  -  ProbeTime:  20s910ms
                                      -  BuildOutputBlock:  388.555ms
                                      -  JoinFilterTimer:  5.892ms
                                      -  LoopGenerateJoin:  20s90ms
                            BuildPhase:
                                  -  BuildGetNextTime:  0ns
                                  -  BuildRows:  53
                                  -  BuildTime:  4.145us
                            VEXCHANGE_NODE  (id=3239):(Active:  6.237us,  %  non-child:  0.00%)
                                  -  BlocksProduced:  4
                                  -  BytesReceived:  800.00  B
                                  -  DataArrivalWaitTime:  0ns
                                  -  DecompressBytes:  1.30  KB
                                  -  DecompressTime:  5.282us
                                  -  DeserializeRowBatchTimer:  40.121us
                                  -  FirstBatchArrivalWaitTime:  0ns
                                  -  LocalBytesReceived:  1.38  KB
                                  -  MemoryUsage:  
                                      -  Blocks:  1.38  KB
                                      -  PeakMemoryUsage:  3.41  KB
                                  -  ProjectionTime:  0ns
                                  -  RowsProduced:  40
                                  -  RowsReturned:  53
                                  -  RowsReturnedRate:  8.497675M  /sec
                                  -  SendersBlockedTotalTimer(*):  0ns
                            VNewOlapScanNode(dm_doris_abstract_sum_sr)  (id=3196):(Active:  7.169ms,  %  non-child:  0.00%)
                                  -  RuntimeFilters:  :  
                                  -  PushDownPredicates:  []
                                  -  KeyRanges:  ScanKeys:ScanKey=[  :  �]
                                  -  TabletIds:  [29276713]
                                  -  UseSpecificThreadToken:  False
                                  -  AcquireRuntimeFilterTime:  335ns
                                  -  AllocateResourceTime:  2.610ms
                                  -  GetNextTime:  7.519ms
                                  -  MaxScannerThreadNum:  1
                                  -  MemoryUsage:  
                                      -  PeakMemoryUsage:  0.00  
                                  -  NumScanners:  1
                                  -  OpenTime:  0ns
                                  -  ProcessConjunctTime:  2.580ms
                                  -  ProjectionTime:  25.957ms
                                  -  RowsReturned:  2.447911M  (2447911)
                                  -  RowsReturnedRate:  341.419657M  /sec
                                  -  ScanByteRead:  303.54  MB
                                  -  ScanRowsRead:  2.447911M  (2447911)
                                  -  ScannerWorkerWaitTime:  5.655ms
                                  -  TabletNum:  1
                                  -  TotalReadThroughput:  0
                                VScanner:
                                      -  ReadColumns:  [kqgs,  kqmj_code,  calmonth,  sjdata,  ysdata]
                                      -  PerScannerRunningTime:  [102.991ms,  ]
                                      -  PerScannerRowsRead:  [2.45M,  ]
                                      -  PerScannerWaitTime:  [5.655ms,  ]
                                      -  BlockConvertTime:  0ns
                                      -  BlockFetchTime:  98.330ms
                                      -  DeleteBitmapGetAggTime:  0ns
                                      -  MemoryUsage:  
                                          -  FreeBlocks:  53.19  MB
                                          -  QueuedBlocks:  0.00  
                                      -  NewlyCreateFreeBlocksNum:  419
                                      -  ReaderInitTime:  0ns
                                      -  RowsDelFiltered:  0
                                      -  ScannerBatchWaitTime:  0ns
                                      -  ScannerConvertBlockTime:  0ns
                                      -  ScannerCpuTime:  120.988ms
                                      -  ScannerCtxSchedCount:  151
                                      -  ScannerCtxSchedTime:  1.826ms
                                      -  ScannerFilterTime:  1.99ms
                                      -  ScannerGetBlockTime:  101.313ms
                                      -  ScannerInitTime:  14.436us
                                      -  ScannerPrefilterTime:  0ns
                                      -  ScannerSchedCount:  150
                                    SegmentIterator:
                                          -  BitmapIndexFilterTimer:  1.488us
                                          -  BlockConditionsFilteredBloomFilterTime:  0ns
                                          -  BlockConditionsFilteredDictTime:  0ns
                                          -  BlockConditionsFilteredTime:  6.936us
                                          -  BlockConditionsFilteredZonemapRuntimePredicateTime:  0ns
                                          -  BlockConditionsFilteredZonemapTime:  0ns
                                          -  BlockInitSeekCount:  27
                                          -  BlockInitSeekTime:  50.648us
                                          -  BlockInitTime:  224.644us
                                          -  BlockLoadTime:  98.496ms
                                          -  BlocksLoad:  2.394K  (2394)
                                          -  CachedPagesNum:  1.06K  (1060)
                                          -  CompressedBytesRead:  0.00  
                                          -  DecompressorTimer:  0ns
                                          -  ExprFilterEvalTime:  0ns
                                          -  FirstReadSeekCount:  11.955K  (11955)
                                          -  FirstReadSeekTime:  10.322ms
                                          -  FirstReadTime:  95.160ms
                                          -  IOTimer:  0ns
                                          -  InvertedIndexFilterTime:  2.130us
                                          -  InvertedIndexQueryBitmapCopyTime:  0ns
                                          -  InvertedIndexQueryBitmapOpTime:  0ns
                                          -  InvertedIndexQueryCacheHit:  0
                                          -  InvertedIndexQueryCacheMiss:  0
                                          -  InvertedIndexQueryTime:  0ns
                                          -  InvertedIndexSearcherOpenTime:  0ns
                                          -  InvertedIndexSearcherSearchTime:  0ns
                                          -  LazyReadSeekCount:  0
                                          -  LazyReadSeekTime:  0ns
                                          -  LazyReadTime:  0ns
                                          -  NumSegmentFiltered:  0
                                          -  NumSegmentTotal:  3
                                          -  OutputColumnTime:  351.326us
                                          -  OutputIndexResultColumnTimer:  161.842us
                                          -  RawRowsRead:  2.447911M  (2447911)
                                          -  RowsBitmapIndexFiltered:  0
                                          -  RowsBloomFilterFiltered:  0
                                          -  RowsConditionsFiltered:  0
                                          -  RowsDictFiltered:  0
                                          -  RowsInvertedIndexFiltered:  0
                                          -  RowsKeyRangeFiltered:  0
                                          -  RowsShortCircuitPredFiltered:  0
                                          -  RowsShortCircuitPredInput:  0
                                          -  RowsVectorPredFiltered:  0
                                          -  RowsVectorPredInput:  0
                                          -  RowsZonemapFiltered:  0
                                          -  RowsZonemapRuntimePredicateFiltered:  0
                                          -  SecondReadTime:  0ns
                                          -  ShortPredEvalTime:  0ns
                                          -  TotalPagesNum:  1.06K  (1060)
                                          -  UncompressedBytesRead:  0.00  
                                          -  VectorPredEvalTime:  0ns
                    PipelineContext:(Active:  22s586ms,  %  non-child:  0.00%)
                          -  PrepareTime:  877.897us
                          -  StartTime:  2.562us
                        Pipeline  (pipeline  id=0):
                            PipelineTask  (index=0):(Active:  95.906us,  %  non-child:  0.00%)
                                  -  Sink:  ExchangeSinkOperator(dst_id=3251)
                                  -  OperatorIds(source2root):  [AggSourceOperator(node_id=3248)]
                                  -  CoreChangeTimes:  1
                                  -  ExecuteTime:  49.838us
                                      -  CloseTime:  16.992us
                                      -  FinalizeTime:  63ns
                                      -  GetBlockTime:  8.330us
                                      -  OpenTime:  10.283us
                                      -  PrepareTime:  11.593us
                                      -  SinkTime:  10.250us
                                  -  GetBlockCounter:  1
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  1
                                  -  NumBlockedTimes:  3
                                  -  NumScheduleTimes:  3
                                  -  NumYieldTimes:  0
                                  -  Task1BeginExecuteTime:  2.86ms
                                  -  Task2EosTime:  22s585ms
                                  -  Task3SrcPendingFinishOverTime:  22s585ms
                                  -  Task4DstPendingFinishOverTime:  22s585ms
                                  -  Task5TotalTime:  22s585ms
                                  -  Task6ClosePipelineTime:  22s585ms
                                  -  TaskCpuTime:  65.728us
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  22s583ms
                                  -  WaitWorkerTime:  162.885us
                        Pipeline  (pipeline  id=1):
                            PipelineTask  (index=1):(Active:  22s573ms,  %  non-child:  0.00%)
                                  -  Sink:  AggSinkOperator(dst_id=3248)
                                  -  OperatorIds(source2root):  [ScanOperator(node_id=3196),  NestLoopJoinProbeOperator(node_id=3242)]
                                  -  CoreChangeTimes:  1
                                  -  ExecuteTime:  22s570ms
                                      -  CloseTime:  134.776us
                                      -  FinalizeTime:  61ns
                                      -  GetBlockTime:  21s360ms
                                      -  OpenTime:  2.644ms
                                      -  PrepareTime:  4.626us
                                      -  SinkTime:  1s72ms
                                  -  GetBlockCounter:  124.781K  (124781)
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  0
                                  -  NumBlockedTimes:  2
                                  -  NumScheduleTimes:  227
                                  -  NumYieldTimes:  225
                                  -  Task1BeginExecuteTime:  16.400ms
                                  -  Task2EosTime:  22s585ms
                                  -  Task3SrcPendingFinishOverTime:  22s585ms
                                  -  Task4DstPendingFinishOverTime:  22s585ms
                                  -  Task5TotalTime:  22s585ms
                                  -  Task6ClosePipelineTime:  22s585ms
                                  -  TaskCpuTime:  22s492ms
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  0ns
                                  -  WaitWorkerTime:  444.583us
                        Pipeline  (pipeline  id=2):
                            PipelineTask  (index=2):(Active:  128.505us,  %  non-child:  0.00%)
                                  -  Sink:  NestLoopJoinBuildOperator(dst_id=3242)
                                  -  OperatorIds(source2root):  [ExchangeSourceOperator(node_id=3239)]
                                  -  CoreChangeTimes:  0
                                  -  ExecuteTime:  86.266us
                                      -  CloseTime:  3.417us
                                      -  FinalizeTime:  68ns
                                      -  GetBlockTime:  11.232us
                                      -  OpenTime:  29.756us
                                      -  PrepareTime:  3.344us
                                      -  SinkTime:  5.930us
                                  -  GetBlockCounter:  6
                                  -  NumBlockedBySinkTimes:  0
                                  -  NumBlockedBySrcTimes:  6
                                  -  NumBlockedTimes:  8
                                  -  NumScheduleTimes:  8
                                  -  NumYieldTimes:  0
                                  -  Task1BeginExecuteTime:  2.57ms
                                  -  Task2EosTime:  16.386ms
                                  -  Task3SrcPendingFinishOverTime:  16.388ms
                                  -  Task4DstPendingFinishOverTime:  16.388ms
                                  -  Task5TotalTime:  16.393ms
                                  -  Task6ClosePipelineTime:  16.394ms
                                  -  TaskCpuTime:  109.165us
                                  -  WaitBfTime:  0ns
                                  -  WaitSinkTime:  0ns
                                  -  WaitSourceTime:  14.124ms
                                  -  WaitWorkerTime:  176.466us

... 太长,没有都贴上来

1 Answers

问题定位:
原查询两表内连接的条件是:
on case when p.p_value = '100001' then '100001' else a.kqmj_code end = case when p.p_value = '100001' then '100001' else p.gen6code end

a表量级260万,p表几千条

修改为:
on a.kqmj_code = p.gen6code

修改后,查询耗时降低到秒级。主要是通过query-profile,不知道怎么定位出性能瓶颈的点