为什么Profile中的RowsKeyRangeFiltered远大于表的实际行数。

Viewed 23
2.1

2.1.5 表行数：1620000，没有做过更新和删除。
通过SortKey做点查，但是，Profile中出现【- RowsKeyRangeFiltered: 17.814555M (17814555)】，17814555远大于1620000。
详细的Profile如下：

Summary:
- Profile ID: f83b42d9f05142f4-96ed95ee4959670c
- Task Type: QUERY
- Start Time: 2024-09-26 15:38:17
- End Time: 2024-09-26 15:38:17
- Total: 32ms
- Task State: EOF
- User: root
- Default Db: test
- Sql Statement: select * from adi_register_info_MOR03 where SERIALNUM_ID = '0011d756711bfead0ff8fe8f712ab94c'
Execution Summary:
- Parse SQL Time: 0ms
- Nereids Analysis Time: 2ms
- Nereids Rewrite Time: 3ms
- Nereids Optimize Time: 1ms
- Nereids Translate Time: 0ms
- Workload Group: normal
- Analysis Time: 2ms
- Plan Time: 5ms
- JoinReorder Time: N/A
- CreateSingleNode Time: N/A
- QueryDistributed Time: N/A
- Init Scan Node Time: N/A
- Finalize Scan Node Time: N/A
- Get Splits Time: N/A
- Get Partitions Time: N/A
- Get Partition Files Time: N/A
- Create Scan Range Time: N/A
- Schedule Time: 8ms
- Fragment Assign Time: 0ms
- Fragment Serialize Time: 2ms
- Fragment RPC Phase1 Time: 5ms
- Fragment RPC Phase2 Time: 1ms
- Fragment Compressed Size: 8.27 KB
- Fragment RPC Count: 6
- Wait and Fetch Result Time: 17ms
- Fetch Result Time: 15ms
- Write Result Time: 0ms
- Doris Version: doris-2.1.5-rc02-d5a02e095d
- Is Nereids: Yes
- Is Pipeline: Yes
- Is Cached: No
- Total Instances Num: 4
- Instances Num Per BE: 10.100.31.167:8060:1,10.100.31.237:8060:2,10.100.31.71:8060:1
- Parallel Fragment Exec Instance Num: 1
- Trace ID:
- Transaction Commit Time: N/A

MergedProfile
Fragments:
Fragment 0:
Pipeline : 0(instance_num=1):
RESULT_SINK_OPERATOR (id=0):
- PlanInfo
- TABLE: test.adi_register_info_mor03(adi_register_info_mor03), PREAGGREGATION: ON
- PREDICATES: (SERIALNUM_ID = '0011d756711bfead0ff8fe8f712ab94c') AND (DORIS_DELETE_SIGN = 0)
- partitions=1/1 (adi_register_info_mor03)
- tablets=3/3, tabletList=402864,402866,402868
- cardinality=1620000, avgRowSize=0.0, numNodes=1
- pushAggOp=NONE
- projections: SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM
- project output tuple id: 1
- BlocksProduced: sum 2, avg 2, max 2, min 2
- CloseTime: avg 4.890us, max 4.890us, min 4.890us
- ExecTime: avg 378.705us, max 378.705us, min 378.705us
- InitTime: avg 28.740us, max 28.740us, min 28.740us
- InputRows: sum 0, avg 0, max 0, min 0
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 123.672us, max 123.672us, min 123.672us
- RowsProduced: sum 1, avg 1, max 1, min 1
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
EXCHANGE_OPERATOR (id=1):
- PlanInfo
- offset: 0
- BlocksProduced: sum 2, avg 2, max 2, min 2
- CloseTime: avg 3.930us, max 3.930us, min 3.930us
- ExecTime: avg 120.461us, max 120.461us, min 120.461us
- InitTime: avg 104.381us, max 104.381us, min 104.381us
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 2.110us, max 2.110us, min 2.110us
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 1, avg 1, max 1, min 1
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForData0: avg 13.383ms, max 13.383ms, min 13.383ms
Fragment 1:
Pipeline : 0(instance_num=3):
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: sum 4, avg 1, max 2, min 0
- CloseTime: avg 9.694us, max 10.211us, min 9.70us
- ExecTime: avg 382.206us, max 567.10us, min 142.552us
- InitTime: avg 95.381us, max 113.272us, min 62.421us
- InputRows: sum 1, avg 0, max 1, min 0
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 768.00 B, avg 256.00 B, max 768.00 B, min 0.00
- OpenTime: avg 98.698us, max 173.973us, min 55.981us
- RowsProduced: sum 1, avg 0, max 1, min 0
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- BlocksProduced: sum 1, avg 0, max 1, min 0
- CloseTime: avg 662.403us, max 706.980us, min 579.99us
- ExecTime: avg 9.652ms, max 13.39ms, min 7.901ms
- InitTime: avg 302.161us, max 321.886us, min 268.343us
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 6.441ms, max 6.999ms, min 6.64ms
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 1, avg 0, max 1, min 0
- RuntimeFilterInfo: sum , avg , max , min
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: avg 1.469ms, max 4.409ms, min 0ns
VScanner:
- MemoryUsage: sum , avg , max , min
- FreeBlocks: sum 12.52 MB, avg 4.17 MB, max 4.22 MB, min 4.08 MB

Execution Profile f83b42d9f05142f4-96ed95ee4959670c:(Active: 32ms, % non-child: 0.00%)
Fragments:
Fragment 0:
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.237, port:9050)):
PipelineXTask (index=0):(Active: 831.31us, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 454.777us
- CloseTime: 10.440us
- GetBlockTime: 12.180us
- OpenTime: 168.522us
- PrepareTime: 189.22us
- SinkTime: 221.713us
- GetBlockCounter: 2
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 1
- NumBlockedTimes: 3
- NumScheduleTimes: 3
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 801.290us
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 93.701us
RESULT_SINK_OPERATOR (id=0):
- AppendBatchTime: 219.423us
- CopyBufferTime: 0ns
- ResultSendTime: 108.62us
- TupleConvertTime: 60.121us
- BlocksProduced: 2
- BytesSent: 121.00 B
- CloseTime: 4.890us
- ExecTime: 378.705us
- InitTime: 28.740us
- InputRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumSentRows: 1
- OpenTime: 123.672us
- PendingFinishDependency: 0ns
- RowsProduced: 1
- WaitForDependencyTime: 0ns
- WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: 0ns
EXCHANGE_OPERATOR (id=1):
- BlocksProduced: 2
- BytesReceived: 325.00 B
- CloseTime: 3.930us
- DataArrivalWaitTime: 0ns
- DecompressBytes: 0.00
- DecompressTime: 0ns
- DeserializeRowBatchTimer: 42.771us
- ExecTime: 120.461us
- FirstBatchArrivalWaitTime: 0ns
- InitTime: 104.381us
- LocalBytesReceived: 0.00
- MemoryUsage:
- Blocks: 768.00 B
- PeakMemoryUsage: 0.00
- OpenTime: 2.110us
- ProjectionTime: 0ns
- RowsProduced: 1
- SendersBlockedTotalTimer(*): 0ns
- WaitForDependencyTime: 0ns
- WaitForData0: 13.383ms
Fragment 1:
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.237, port:9050)):
PipelineXTask (index=0):(Active: 14.614ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 7.81ms
- CloseTime: 718.350us
- GetBlockTime: 669.750us
- OpenTime: 6.334ms
- PrepareTime: 473.727us
- SinkTime: 4.870us
- GetBlockCounter: 33
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 0
- NumBlockedTimes: 2
- NumScheduleTimes: 2
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 3.949ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 67.800us
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 0
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 9.70us
- CompressTime: 0ns
- ExecTime: 142.552us
- InitTime: 62.421us
- InputRows: 0
- LocalBytesSent: 0.00
- LocalSendTime: 0ns
- LocalSentRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 66.141us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 0ns
- RowsProduced: 0
- RpcAvgTime: 0ns
- RpcCount: 0
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[0011d756711bfead0ff8fe8f712ab94c,0000-01-01 00:00:00 : 0011d756711bfead0ff8fe8f712ab94c,9999-12-31 23:59:59.999999]
- TabletIds: [402864]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 610ns
- BlocksProduced: 0
- CloseTime: 706.980us
- ExecTime: 7.901ms
- InitTime: 268.343us
- KeyRangesNum: 0
- MaxScannerThreadNum: 33
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 33
- OpenTime: 6.261ms
- ProcessConjunctTime: 288.255us
- ProjectionTime: 0ns
- RowsProduced: 0
- RowsRead: 0
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 14.381ms
- TabletNum: 1
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 0ns
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM, DORIS_DELETE_SIGN]
- PerScannerRunningTime: [20.610us, 7.920us, 8.470us, 7.950us, 6.480us, 7.050us, 6.380us, 9.830us, 9.090us, 8.570us, 8.100us, 6.620us, 6.580us, 7.210us, 7.260us, 6.450us, 7.100us, 6.480us, 6.500us, 6.480us, 7.350us, 6.960us, 6.201us, 6.510us, 6.220us, 6.450us, 7.150us, 6.730us, 6.990us, 6.191us, 7.900us, 7.840us, 7.831us, ]
- PerScannerRowsRead: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ]
- PerScannerWaitTime: [65.731us, 25.401us, 79.451us, 66.981us, 190.213us, 459.506us, 488.977us, 529.448us, 1.268ms, 1.301ms, 1.143ms, 1.802ms, 1.805ms, 1.900ms, 19.360us, 25.800us, 102.721us, 69.241us, 251.514us, 321.254us, 410.106us, 114.941us, 147.092us, 219.663us, 264.174us, 336.424us, 354.505us, 423.946us, 15.040us, 66.321us, 20.161us, 36.641us, 54.671us, ]
- PerScannerProjectionTime: [70.000ns, 150.000ns, 150.000ns, 160.000ns, 90.000ns, 100.000ns, 120.000ns, 250.000ns, 140.000ns, 160.000ns, 120.000ns, 70.000ns, 70.000ns, 90.000ns, 100.000ns, 80.000ns, 110.000ns, 120.000ns, 100.000ns, 90.000ns, 60.000ns, 120.000ns, 90.000ns, 110.000ns, 100.000ns, 80.000ns, 90.000ns, 120.000ns, 110.000ns, 90.000ns, 90.000ns, 120.000ns, 80.000ns, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 0ns
- DeleteBitmapGetAggTime: 3.232ms
- MemoryUsage:
- FreeBlocks: 4.22 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 34.532ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 900ns
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 19.864ms
- ScannerCtxSchedTime: 14.248ms
- ScannerFilterTime: 0ns
- ScannerGetBlockTime: 28.840us
- ScannerInitTime: 418.275us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 33
SegmentIterator:
- BitmapIndexFilterTimer: 0ns
- BlockConditionsFilteredBloomFilterTime: 0ns
- BlockConditionsFilteredDictTime: 0ns
- BlockConditionsFilteredTime: 1.950us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 0ns
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 8.977ms
- BlockLoadTime: 15.956ms
- BlocksLoad: 33
- CachedPagesNum: 0
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 0.00
- DecompressorTimer: 0ns
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 0
- FirstReadSeekTime: 0ns
- FirstReadTime: 16.430us
- IOTimer: 0ns
- InvertedIndexFilterTime: 0ns
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 0ns
- NumSegmentFiltered: 0
- NumSegmentTotal: 33
- OutputColumnTime: 0ns
- OutputIndexResultColumnTimer: 0ns
- RawRowsRead: 0
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 17.814555M (17814555)
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 0
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 0ns
- TotalPagesNum: 0
- UncompressedBytesRead: 0.00
- VectorPredEvalTime: 0ns
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.167, port:9050)):
PipelineXTask (index=0):(Active: 15.101ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 7.531ms
- CloseTime: 713.382us
- GetBlockTime: 932.477us
- OpenTime: 6.261ms
- PrepareTime: 586.640us
- SinkTime: 269.614us
- GetBlockCounter: 33
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 0
- NumBlockedTimes: 2
- NumScheduleTimes: 3
- NumYieldTimes: 0
- PendingFinishTimes: 1
- TaskCpuTime: 4.866ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 84.41us
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 2
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 10.211us
- CompressTime: 0ns
- ExecTime: 567.10us
- InitTime: 113.272us
- InputRows: 0
- LocalBytesSent: 0.00
- LocalSendTime: 0ns
- LocalSentRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 173.973us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 1.521ms
- RowsProduced: 0
- RpcAvgTime: 0ns
- RpcCount: 1
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[0011d756711bfead0ff8fe8f712ab94c,0000-01-01 00:00:00 : 0011d756711bfead0ff8fe8f712ab94c,9999-12-31 23:59:59.999999]
- TabletIds: [402868]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 440ns
- BlocksProduced: 0
- CloseTime: 701.131us
- ExecTime: 8.15ms
- InitTime: 321.886us
- KeyRangesNum: 0
- MaxScannerThreadNum: 33
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 33
- OpenTime: 6.64ms
- ProcessConjunctTime: 290.165us
- ProjectionTime: 0ns
- RowsProduced: 0
- RowsRead: 0
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 14.776ms
- TabletNum: 1
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 0ns
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM, DORIS_DELETE_SIGN]
- PerScannerRunningTime: [6.060us, 6.200us, 5.540us, 6.280us, 6.840us, 7.060us, 7.190us, 7.810us, 18.510us, 6.080us, 5.680us, 6.860us, 5.800us, 7.020us, 6.460us, 6.721us, 5.840us, 6.081us, 6.240us, 6.960us, 5.520us, 7.320us, 7.810us, 30.741us, 7.290us, 7.680us, 6.191us, 5.890us, 6.020us, 6.340us, 6.411us, 6.590us, 7.481us, ]
- PerScannerRowsRead: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ]
- PerScannerWaitTime: [31.821us, 57.770us, 71.491us, 72.051us, 700.012us, 1.099ms, 173.033us, 52.661us, 289.585us, 969.957us, 1.065ms, 1.314ms, 1.334ms, 1.334ms, 1.423ms, 66.511us, 674.641us, 691.542us, 32.801us, 28.811us, 148.973us, 23.640us, 13.200us, 111.712us, 96.172us, 97.271us, 92.092us, 87.582us, 395.986us, 483.058us, 508.969us, 513.698us, 718.972us, ]
- PerScannerProjectionTime: [50.000ns, 150.000ns, 70.000ns, 110.000ns, 110.000ns, 190.000ns, 150.000ns, 220.000ns, 140.000ns, 80.000ns, 60.000ns, 150.000ns, 140.000ns, 120.000ns, 140.000ns, 101.000ns, 110.000ns, 120.000ns, 90.000ns, 80.000ns, 100.000ns, 110.000ns, 120.000ns, 160.000ns, 120.000ns, 150.000ns, 140.000ns, 110.000ns, 90.000ns, 120.000ns, 170.000ns, 110.000ns, 120.000ns, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 0ns
- DeleteBitmapGetAggTime: 1.327ms
- MemoryUsage:
- FreeBlocks: 4.08 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 37.221ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 890ns
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 19.963ms
- ScannerCtxSchedTime: 14.425ms
- ScannerFilterTime: 0ns
- ScannerGetBlockTime: 27.210us
- ScannerInitTime: 493.629us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 33
SegmentIterator:
- BitmapIndexFilterTimer: 0ns
- BlockConditionsFilteredBloomFilterTime: 0ns
- BlockConditionsFilteredDictTime: 0ns
- BlockConditionsFilteredTime: 2.340us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 0ns
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 14.693ms
- BlockLoadTime: 22.189ms
- BlocksLoad: 37
- CachedPagesNum: 0
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 0.00
- DecompressorTimer: 0ns
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 0
- FirstReadSeekTime: 0ns
- FirstReadTime: 18.950us
- IOTimer: 0ns
- InvertedIndexFilterTime: 0ns
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 0ns
- NumSegmentFiltered: 0
- NumSegmentTotal: 37
- OutputColumnTime: 0ns
- OutputIndexResultColumnTimer: 0ns
- RawRowsRead: 0
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 4.804142M (4804142)
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 0
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 0ns
- TotalPagesNum: 0
- UncompressedBytesRead: 0.00
- VectorPredEvalTime: 0ns
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.71, port:9050)):
PipelineXTask (index=0):(Active: 16.464ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 8.148ms
- CloseTime: 591.390us
- GetBlockTime: 739.812us
- OpenTime: 7.61ms
- PrepareTime: 654.641us
- SinkTime: 260.464us
- GetBlockCounter: 33
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 1
- NumBlockedTimes: 3
- NumScheduleTimes: 4
- NumYieldTimes: 0
- PendingFinishTimes: 1
- TaskCpuTime: 4.952ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 75.51us
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 2
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 214.00 B
- CloseTime: 9.801us
- CompressTime: 0ns
- ExecTime: 437.58us
- InitTime: 110.452us
- InputRows: 1
- LocalBytesSent: 0.00
- LocalSendTime: 0ns
- LocalSentRows: 0
- MemoryUsage:
- PeakMemoryUsage: 768.00 B
- MergeBlockTime: 5.900us
- OpenTime: 55.981us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 1.769ms
- RowsProduced: 1
- RpcAvgTime: 1.215ms
- RpcCount: 1
- RpcMaxTime: 1.215ms
- RpcMinTime: 1.215ms
- RpcSumTime: 1.215ms
- SerializeBatchTime: 9.311us
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 198.00 B
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[0011d756711bfead0ff8fe8f712ab94c,0000-01-01 00:00:00 : 0011d756711bfead0ff8fe8f712ab94c,9999-12-31 23:59:59.999999]
- TabletIds: [402866]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 860ns
- BlocksProduced: 1
- CloseTime: 579.99us
- ExecTime: 13.39ms
- InitTime: 316.255us
- KeyRangesNum: 0
- MaxScannerThreadNum: 33
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 33
- OpenTime: 6.999ms
- ProcessConjunctTime: 400.506us
- ProjectionTime: 0ns
- RowsProduced: 1
- RowsRead: 1
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 10.574ms
- TabletNum: 1
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 4.409ms
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM, DORIS_DELETE_SIGN]
- PreEvaluatePredicates:
ComparisonPredicateBase(TINYINT, EQ), column_id=6, opposite=false
- PerScannerRunningTime: [150.093us, 6.620us, 13.631us, 5.960us, 10.940us, 7.080us, 7.550us, 6.300us, 6.210us, 6.110us, 6.290us, 6.630us, 6.090us, 6.290us, 5.710us, 6.021us, 6.880us, 5.730us, 5.711us, 5.770us, 6.110us, 5.820us, 6.610us, 6.670us, 7.030us, 5.530us, 7.960us, 6.681us, 6.490us, 5.640us, 5.810us, 5.510us, 6.560us, ]
- PerScannerRowsRead: [1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ]
- PerScannerWaitTime: [125.222us, 117.372us, 95.262us, 322.646us, 1.260ms, 13.780us, 14.760us, 63.201us, 28.771us, 18.341us, 42.231us, 240.144us, 331.095us, 469.878us, 956.556us, 18.351us, 78.961us, 240.004us, 448.977us, 485.218us, 638.661us, 676.261us, 912.605us, 225.713us, 675.352us, 30.090us, 533.709us, 43.411us, 74.271us, 213.194us, 320.086us, 387.177us, 472.557us, ]
- PerScannerProjectionTime: [58.131us, 110.000ns, 230.000ns, 80.000ns, 60.000ns, 140.000ns, 70.000ns, 180.000ns, 120.000ns, 130.000ns, 70.000ns, 170.000ns, 90.000ns, 80.000ns, 90.000ns, 100.000ns, 180.000ns, 60.000ns, 110.000ns, 100.000ns, 70.000ns, 60.000ns, 140.000ns, 60.000ns, 90.000ns, 90.000ns, 100.000ns, 180.000ns, 50.000ns, 110.000ns, 70.000ns, 40.000ns, 120.000ns, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 9.460us
- DeleteBitmapGetAggTime: 1.422ms
- MemoryUsage:
- FreeBlocks: 4.22 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 22.758ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 960ns
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 19.433ms
- ScannerCtxSchedTime: 9.818ms
- ScannerFilterTime: 17.80us
- ScannerGetBlockTime: 85.573us
- ScannerInitTime: 588.990us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 33
SegmentIterator:
- BitmapIndexFilterTimer: 9.570us
- BlockConditionsFilteredBloomFilterTime: 34.340us
- BlockConditionsFilteredDictTime: 13.950us
- BlockConditionsFilteredTime: 575.568us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 324.135us
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 4.643ms
- BlockLoadTime: 15.672ms
- BlocksLoad: 34
- CachedPagesNum: 0
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 2.07 MB
- DecompressorTimer: 741.893us
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 0
- FirstReadSeekTime: 0ns
- FirstReadTime: 2.753ms
- IOTimer: 1.358ms
- InvertedIndexFilterTime: 33.760us
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 5.768ms
- NumSegmentFiltered: 0
- NumSegmentTotal: 33
- OutputColumnTime: 2.720us
- OutputIndexResultColumnTimer: 550ns
- RawRowsRead: 1
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 17.834982M (17834982)
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 1
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 120ns
- TotalPagesNum: 11
- UncompressedBytesRead: 2.11 MB
- VectorPredEvalTime: 890ns
LoadChannels:

polarbearmx4
2 Answers

看看数据size的情况：
show data from adi_register_info_MOR03

张彬华5475

全表数据量：112880000，sortkey扫描了424395221，这个表1副本，3分桶，无分区，没有删除和upsert，都是无重复的插入。。
RowsKeyRangeFiltered: 424.395221M (424395221)
image.png

Summary:
- Profile ID: 67767b9975dd4a6a-a68fc9662632f89d
- Task Type: QUERY
- Start Time: 2024-09-27 10:52:40
- End Time: 2024-09-27 10:52:40
- Total: 99ms
- Task State: EOF
- User: root
- Default Db: test
- Sql Statement: select * from adi_register_info_MOR03 where SERIALNUM_ID = '0011d756711bfead0ff8fe8f712ab94c'
Execution Summary:
- Parse SQL Time: 1ms
- Nereids Analysis Time: 1ms
- Nereids Rewrite Time: 6ms
- Nereids Optimize Time: 2ms
- Nereids Translate Time: 0ms
- Workload Group: normal
- Analysis Time: 1ms
- Plan Time: 9ms
- JoinReorder Time: N/A
- CreateSingleNode Time: N/A
- QueryDistributed Time: N/A
- Init Scan Node Time: N/A
- Finalize Scan Node Time: N/A
- Get Splits Time: N/A
- Get Partitions Time: N/A
- Get Partition Files Time: N/A
- Create Scan Range Time: N/A
- Schedule Time: 17ms
- Fragment Assign Time: 1ms
- Fragment Serialize Time: 2ms
- Fragment RPC Phase1 Time: 12ms
- Fragment RPC Phase2 Time: 2ms
- Fragment Compressed Size: 8.29 KB
- Fragment RPC Count: 6
- Wait and Fetch Result Time: 72ms
- Fetch Result Time: 71ms
- Write Result Time: 1ms
- Doris Version: doris-2.1.5-rc02-d5a02e095d
- Is Nereids: Yes
- Is Pipeline: Yes
- Is Cached: No
- Total Instances Num: 4
- Instances Num Per BE: 10.100.31.167:8060:1,10.100.31.237:8060:2,10.100.31.71:8060:1
- Parallel Fragment Exec Instance Num: 1
- Trace ID:
- Transaction Commit Time: N/A

MergedProfile
Fragments:
Fragment 0:
Pipeline : 0(instance_num=1):
RESULT_SINK_OPERATOR (id=0):
- PlanInfo
- TABLE: test.adi_register_info_mor03(adi_register_info_mor03), PREAGGREGATION: ON
- PREDICATES: (SERIALNUM_ID = '0011d756711bfead0ff8fe8f712ab94c') AND (DORIS_DELETE_SIGN = 0)
- partitions=1/1 (adi_register_info_mor03)
- tablets=3/3, tabletList=402864,402866,402868
- cardinality=112880000, avgRowSize=0.0, numNodes=1
- pushAggOp=NONE
- projections: SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM
- project output tuple id: 1
- BlocksProduced: sum 2, avg 2, max 2, min 2
- CloseTime: avg 7.600us, max 7.600us, min 7.600us
- ExecTime: avg 4.10ms, max 4.10ms, min 4.10ms
- InitTime: avg 48.361us, max 48.361us, min 48.361us
- InputRows: sum 0, avg 0, max 0, min 0
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 138.191us, max 138.191us, min 138.191us
- RowsProduced: sum 1, avg 1, max 1, min 1
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
EXCHANGE_OPERATOR (id=1):
- PlanInfo
- offset: 0
- BlocksProduced: sum 2, avg 2, max 2, min 2
- CloseTime: avg 7.900us, max 7.900us, min 7.900us
- ExecTime: avg 130.42us, max 130.42us, min 130.42us
- InitTime: avg 85.21us, max 85.21us, min 85.21us
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 18.431us, max 18.431us, min 18.431us
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 1, avg 1, max 1, min 1
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForData0: avg 65.738ms, max 65.738ms, min 65.738ms
Fragment 1:
Pipeline : 0(instance_num=3):
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: sum 4, avg 1, max 2, min 0
- CloseTime: avg 13.33us, max 14.20us, min 12.440us
- ExecTime: avg 417.706us, max 597.980us, min 167.352us
- InitTime: avg 100.818us, max 139.322us, min 80.281us
- InputRows: sum 1, avg 0, max 1, min 0
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 768.00 B, avg 256.00 B, max 768.00 B, min 0.00
- OpenTime: avg 77.568us, max 101.452us, min 64.831us
- RowsProduced: sum 1, avg 0, max 1, min 0
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- BlocksProduced: sum 1, avg 0, max 1, min 0
- CloseTime: avg 1.25ms, max 1.267ms, min 818.604us
- ExecTime: avg 46.374ms, max 65.826ms, min 30.907ms
- InitTime: avg 221.324us, max 240.264us, min 198.764us
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 33.110ms, max 40.92ms, min 24.559ms
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 1, avg 0, max 1, min 0
- RuntimeFilterInfo: sum , avg , max , min
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: avg 11.110ms, max 23.568ms, min 4.576ms
VScanner:
- MemoryUsage: sum , avg , max , min
- FreeBlocks: sum 11.81 MB, avg 3.94 MB, max 4.50 MB, min 3.09 MB

Execution Profile 67767b9975dd4a6a-a68fc9662632f89d:(Active: 100ms, % non-child: 0.00%)
Fragments:
Fragment 0:
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.237, port:9050)):
PipelineXTask (index=0):(Active: 4.572ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 4.96ms
- CloseTime: 18.550us
- GetBlockTime: 22.880us
- OpenTime: 183.503us
- PrepareTime: 259.343us
- SinkTime: 3.816ms
- GetBlockCounter: 2
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 1
- NumBlockedTimes: 3
- NumScheduleTimes: 3
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 1.306ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 92.190us
RESULT_SINK_OPERATOR (id=0):
- AppendBatchTime: 3.812ms
- CopyBufferTime: 0ns
- ResultSendTime: 215.562us
- TupleConvertTime: 3.523ms
- BlocksProduced: 2
- BytesSent: 121.00 B
- CloseTime: 7.600us
- ExecTime: 4.10ms
- InitTime: 48.361us
- InputRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumSentRows: 1
- OpenTime: 138.191us
- PendingFinishDependency: 0ns
- RowsProduced: 1
- WaitForDependencyTime: 0ns
- WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: 0ns
EXCHANGE_OPERATOR (id=1):
- BlocksProduced: 2
- BytesReceived: 325.00 B
- CloseTime: 7.900us
- DataArrivalWaitTime: 0ns
- DecompressBytes: 0.00
- DecompressTime: 0ns
- DeserializeRowBatchTimer: 51.201us
- ExecTime: 130.42us
- FirstBatchArrivalWaitTime: 0ns
- InitTime: 85.21us
- LocalBytesReceived: 0.00
- MemoryUsage:
- Blocks: 768.00 B
- PeakMemoryUsage: 0.00
- OpenTime: 18.431us
- ProjectionTime: 0ns
- RowsProduced: 1
- SendersBlockedTotalTimer(*): 0ns
- WaitForDependencyTime: 0ns
- WaitForData0: 65.738ms
Fragment 1:
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.167, port:9050)):
PipelineXTask (index=0):(Active: 51.946ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 25.986ms
- CloseTime: 834.54us
- GetBlockTime: 763.781us
- OpenTime: 24.632ms
- PrepareTime: 485.138us
- SinkTime: 379.927us
- GetBlockCounter: 48
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 16
- NumBlockedTimes: 18
- NumScheduleTimes: 19
- NumYieldTimes: 0
- PendingFinishTimes: 1
- TaskCpuTime: 11.198ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 985.411us
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 2
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 12.640us
- CompressTime: 0ns
- ExecTime: 597.980us
- InitTime: 139.322us
- InputRows: 0
- LocalBytesSent: 0.00
- LocalSendTime: 0ns
- LocalSentRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 66.421us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 3.504ms
- RowsProduced: 0
- RpcAvgTime: 0ns
- RpcCount: 1
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[0011d756711bfead0ff8fe8f712ab94c,0000-01-01 00:00:00 : 0011d756711bfead0ff8fe8f712ab94c,9999-12-31 23:59:59.999999]
- TabletIds: [402868]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 800ns
- BlocksProduced: 0
- CloseTime: 818.604us
- ExecTime: 30.907ms
- InitTime: 198.764us
- KeyRangesNum: 0
- MaxScannerThreadNum: 48
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 48
- OpenTime: 24.559ms
- ProcessConjunctTime: 516.19us
- ProjectionTime: 0ns
- RowsProduced: 0
- RowsRead: 0
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 72.253ms
- TabletNum: 1
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 4.576ms
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM, DORIS_DELETE_SIGN]
- PerScannerRunningTime: [10.900us, 8.510us, 24.071us, 10.390us, 9.291us, 11.260us, 7.770us, 24.830us, 9.241us, 7.080us, 8.039us, 9.680us, 10.880us, 23.290us, 9.520us, 8.230us, 8.230us, 9.880us, 10.460us, 6.750us, 7.840us, 8.581us, 8.260us, 7.360us, 7.370us, 7.490us, 7.440us, 7.280us, 7.030us, 7.470us, 7.360us, 7.400us, 7.530us, 7.230us, 8.130us, 20.091us, 6.861us, 9.050us, 8.460us, 9.260us, 10.240us, 8.660us, 8.680us, 9.671us, 8.710us, 9.350us, 8.600us, 11.380us, ]
- PerScannerRowsRead: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ]
- PerScannerWaitTime: [81.432us, 35.581us, 111.552us, 62.761us, 1.627ms, 1.745ms, 3.339ms, 223.043us, 1.373ms, 1.400ms, 1.282ms, 1.311ms, 3.201ms, 39.941us, 61.491us, 111.292us, 629.381us, 3.564ms, 3.661ms, 57.171us, 32.590us, 1.048ms, 1.188ms, 1.251ms, 1.490ms, 53.291us, 52.621us, 45.901us, 83.322us, 1.324ms, 1.773ms, 3.492ms, 74.542us, 77.761us, 126.692us, 1.427ms, 1.422ms, 1.598ms, 2.089ms, 2.699ms, 2.811ms, 2.922ms, 3.176ms, 3.247ms, 3.419ms, 4.515ms, 4.691ms, 2.192ms, ]
- PerScannerProjectionTime: [100.000ns, 150.000ns, 160.000ns, 160.000ns, 130.000ns, 140.000ns, 80.000ns, 160.000ns, 140.000ns, 50.000ns, 220.000ns, 170.000ns, 150.000ns, 130.000ns, 160.000ns, 120.000ns, 100.000ns, 60.000ns, 130.000ns, 100.000ns, 130.000ns, 140.000ns, 100.000ns, 160.000ns, 140.000ns, 150.000ns, 140.000ns, 130.000ns, 100.000ns, 120.000ns, 120.000ns, 90.000ns, 150.000ns, 110.000ns, 130.000ns, 280.000ns, 100.000ns, 160.000ns, 120.000ns, 290.000ns, 130.000ns, 110.000ns, 100.000ns, 120.000ns, 120.000ns, 100.000ns, 110.000ns, 150.000ns, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 0ns
- DeleteBitmapGetAggTime: 950.704us
- MemoryUsage:
- FreeBlocks: 4.22 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 279.351ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 1.880us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 99.846ms
- ScannerCtxSchedTime: 71.676ms
- ScannerFilterTime: 0ns
- ScannerGetBlockTime: 53.611us
- ScannerInitTime: 3.515ms
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 48
SegmentIterator:
- BitmapIndexFilterTimer: 0ns
- BlockConditionsFilteredBloomFilterTime: 0ns
- BlockConditionsFilteredDictTime: 0ns
- BlockConditionsFilteredTime: 11.220us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 0ns
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 39.687ms
- BlockLoadTime: 53.585ms
- BlocksLoad: 173
- CachedPagesNum: 0
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 0.00
- DecompressorTimer: 0ns
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 0
- FirstReadSeekTime: 0ns
- FirstReadTime: 86.837us
- IOTimer: 0ns
- InvertedIndexFilterTime: 0ns
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 0ns
- NumSegmentFiltered: 0
- NumSegmentTotal: 173
- OutputColumnTime: 0ns
- OutputIndexResultColumnTimer: 0ns
- RawRowsRead: 0
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 311.858358M (311858358)
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 0
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 0ns
- TotalPagesNum: 0
- UncompressedBytesRead: 0.00
- VectorPredEvalTime: 0ns
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.237, port:9050)):
PipelineXTask (index=0):(Active: 72.546ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 36.5ms
- CloseTime: 1.281ms
- GetBlockTime: 1.28ms
- OpenTime: 34.753ms
- PrepareTime: 496.117us
- SinkTime: 7.910us
- GetBlockCounter: 48
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 12
- NumBlockedTimes: 14
- NumScheduleTimes: 14
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 11.346ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 5.508ms
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 0
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 12.440us
- CompressTime: 0ns
- ExecTime: 167.352us
- InitTime: 82.851us
- InputRows: 0
- LocalBytesSent: 0.00
- LocalSendTime: 0ns
- LocalSentRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 64.831us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 0ns
- RowsProduced: 0
- RpcAvgTime: 0ns
- RpcCount: 0
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[0011d756711bfead0ff8fe8f712ab94c,0000-01-01 00:00:00 : 0011d756711bfead0ff8fe8f712ab94c,9999-12-31 23:59:59.999999]
- TabletIds: [402864]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 1.160us
- BlocksProduced: 0
- CloseTime: 1.267ms
- ExecTime: 42.390ms
- InitTime: 240.264us
- KeyRangesNum: 0
- MaxScannerThreadNum: 48
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 48
- OpenTime: 34.678ms
- ProcessConjunctTime: 7.333ms
- ProjectionTime: 0ns
- RowsProduced: 0
- RowsRead: 0
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 80.120ms
- TabletNum: 1
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 5.188ms
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM, DORIS_DELETE_SIGN]
- PerScannerRunningTime: [8.340us, 12.180us, 9.950us, 9.230us, 11.190us, 35.570us, 8.681us, 14.560us, 10.050us, 12.610us, 8.060us, 9.451us, 10.251us, 10.241us, 12.770us, 9.280us, 10.480us, 7.740us, 14.030us, 9.000us, 15.270us, 8.970us, 9.600us, 8.650us, 9.540us, 23.490us, 16.920us, 10.250us, 14.021us, 10.380us, 12.730us, 11.851us, 15.360us, 12.630us, 14.670us, 11.190us, 12.540us, 9.460us, 17.360us, 11.400us, 11.230us, 8.860us, 12.940us, 9.470us, 11.160us, 10.200us, 11.081us, 10.610us, ]
- PerScannerRowsRead: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ]
- PerScannerWaitTime: [98.962us, 32.081us, 112.362us, 134.622us, 233.023us, 462.777us, 490.846us, 1.007ms, 1.037ms, 1.046ms, 1.833ms, 1.723ms, 1.742ms, 2.329ms, 2.434ms, 2.741ms, 3.765ms, 7.038ms, 7.848ms, 29.980us, 39.751us, 14.020us, 73.711us, 61.181us, 73.621us, 431.026us, 1.701ms, 1.742ms, 2.165ms, 21.650us, 23.541us, 845.552us, 1.274ms, 1.274ms, 1.280ms, 1.295ms, 3.518ms, 4.893ms, 55.621us, 54.351us, 1.884ms, 1.920ms, 2.531ms, 2.530ms, 2.911ms, 2.949ms, 3.782ms, 4.628ms, ]
- PerScannerProjectionTime: [90.000ns, 290.000ns, 160.000ns, 100.000ns, 220.000ns, 180.000ns, 100.000ns, 380.000ns, 140.000ns, 110.000ns, 240.000ns, 290.000ns, 160.000ns, 140.000ns, 100.000ns, 130.000ns, 230.000ns, 130.000ns, 60.000ns, 140.000ns, 110.000ns, 130.000ns, 90.000ns, 140.000ns, 150.000ns, 270.000ns, 150.000ns, 60.000ns, 100.000ns, 80.000ns, 150.000ns, 110.000ns, 70.000ns, 140.000ns, 110.000ns, 70.000ns, 130.000ns, 120.000ns, 150.000ns, 310.000ns, 190.000ns, 130.000ns, 110.000ns, 130.000ns, 140.000ns, 140.000ns, 110.000ns, 130.000ns, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 0ns
- DeleteBitmapGetAggTime: 670.719us
- MemoryUsage:
- FreeBlocks: 3.09 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 477.757ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 1.360us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 125.339ms
- ScannerCtxSchedTime: 80.7ms
- ScannerFilterTime: 0ns
- ScannerGetBlockTime: 77.992us
- ScannerInitTime: 2.869ms
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 48
SegmentIterator:
- BitmapIndexFilterTimer: 0ns
- BlockConditionsFilteredBloomFilterTime: 0ns
- BlockConditionsFilteredDictTime: 0ns
- BlockConditionsFilteredTime: 3.70us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 0ns
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 24.924ms
- BlockLoadTime: 29.454ms
- BlocksLoad: 49
- CachedPagesNum: 0
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 0.00
- DecompressorTimer: 0ns
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 0
- FirstReadSeekTime: 0ns
- FirstReadTime: 39.240us
- IOTimer: 0ns
- InvertedIndexFilterTime: 0ns
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 0ns
- NumSegmentFiltered: 0
- NumSegmentTotal: 49
- OutputColumnTime: 0ns
- OutputIndexResultColumnTimer: 0ns
- RawRowsRead: 0
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 434.472616M (434472616)
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 0
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 0ns
- TotalPagesNum: 0
- UncompressedBytesRead: 0.00
- VectorPredEvalTime: 0ns
Pipeline :0 (host=TNetworkAddress(hostname:10.100.31.71, port:9050)):
PipelineXTask (index=0):(Active: 83.332ms, % non-child: 0.00%)
- CoreChangeTimes: 0
- ExecuteTime: 41.626ms
- CloseTime: 1.6ms
- GetBlockTime: 961.55us
- OpenTime: 40.200ms
- PrepareTime: 489.88us
- SinkTime: 292.345us
- GetBlockCounter: 48
- NumBlockedBySinkTimes: 0
- NumBlockedBySrcTimes: 13
- NumBlockedTimes: 15
- NumScheduleTimes: 16
- NumYieldTimes: 0
- PendingFinishTimes: 1
- TaskCpuTime: 10.381ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 285.206us
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 2
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 214.00 B
- CloseTime: 14.20us
- CompressTime: 0ns
- ExecTime: 487.788us
- InitTime: 80.281us
- InputRows: 1
- LocalBytesSent: 0.00
- LocalSendTime: 0ns
- LocalSentRows: 0
- MemoryUsage:
- PeakMemoryUsage: 768.00 B
- MergeBlockTime: 7.490us
- OpenTime: 101.452us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 1.567ms
- RowsProduced: 1
- RpcAvgTime: 1.301ms
- RpcCount: 1
- RpcMaxTime: 1.301ms
- RpcMinTime: 1.301ms
- RpcSumTime: 1.301ms
- SerializeBatchTime: 18.870us
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 198.00 B
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = adi_register_info_mor03(adi_register_info_mor03)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[0011d756711bfead0ff8fe8f712ab94c,0000-01-01 00:00:00 : 0011d756711bfead0ff8fe8f712ab94c,9999-12-31 23:59:59.999999]
- TabletIds: [402866]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 670ns
- BlocksProduced: 1
- CloseTime: 990.57us
- ExecTime: 65.826ms
- InitTime: 224.944us
- KeyRangesNum: 0
- MaxScannerThreadNum: 48
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 48
- OpenTime: 40.92ms
- ProcessConjunctTime: 6.691ms
- ProjectionTime: 0ns
- RowsProduced: 1
- RowsRead: 1
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 62.568ms
- TabletNum: 1
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 23.568ms
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [SERIALNUM_ID, DATAGENERATE_DATE, ROW_ID, TASK_ID, BATCH_NUM, INT_NUM, DORIS_DELETE_SIGN]
- PreEvaluatePredicates:
ComparisonPredicateBase(TINYINT, EQ), column_id=6, opposite=false
- PerScannerRunningTime: [227.374us, 9.700us, 8.870us, 11.890us, 10.740us, 9.720us, 10.070us, 12.140us, 8.600us, 8.280us, 10.320us, 7.980us, 8.830us, 7.370us, 9.010us, 8.540us, 8.340us, 7.330us, 7.620us, 7.610us, 6.420us, 6.540us, 6.940us, 9.200us, 9.090us, 34.090us, 7.670us, 9.810us, 12.540us, 6.960us, 8.000us, 9.620us, 8.370us, 9.910us, 7.191us, 6.800us, 9.840us, 6.590us, 7.730us, 6.591us, 8.931us, 9.230us, 7.840us, 9.801us, 8.600us, 7.770us, 9.330us, 8.189us, ]
- PerScannerRowsRead: [1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ]
- PerScannerWaitTime: [95.651us, 54.241us, 60.511us, 118.182us, 477.028us, 457.358us, 2.141ms, 2.177ms, 2.190ms, 2.471ms, 2.857ms, 4.407ms, 2.325ms, 2.385ms, 2.361ms, 44.001us, 38.111us, 2.839ms, 4.170ms, 94.142us, 915.326us, 1.907ms, 1.962ms, 2.055ms, 2.583ms, 2.570ms, 56.911us, 589.450us, 1.178ms, 407.426us, 610.750us, 5.288ms, 56.511us, 37.350us, 115.512us, 452.287us, 1.322ms, 1.510ms, 48.951us, 398.536us, 783.323us, 31.581us, 35.351us, 975.206us, 2.320ms, 416.897us, 1.067ms, 1.101ms, ]
- PerScannerProjectionTime: [73.161us, 320.000ns, 120.000ns, 60.000ns, 230.000ns, 210.000ns, 220.000ns, 100.000ns, 60.000ns, 80.000ns, 230.000ns, 90.000ns, 130.000ns, 90.000ns, 50.000ns, 200.000ns, 110.000ns, 50.000ns, 80.000ns, 100.000ns, 120.000ns, 100.000ns, 180.000ns, 60.000ns, 120.000ns, 100.000ns, 140.000ns, 40.000ns, 120.000ns, 110.000ns, 90.000ns, 70.000ns, 120.000ns, 100.000ns, 140.000ns, 100.000ns, 140.000ns, 100.000ns, 110.000ns, 100.000ns, 120.000ns, 210.000ns, 170.000ns, 120.000ns, 120.000ns, 130.000ns, 190.000ns, 90.000ns, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 10.410us
- DeleteBitmapGetAggTime: 1.571ms
- MemoryUsage:
- FreeBlocks: 4.50 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 522.691ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 1.410us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 139.444ms
- ScannerCtxSchedTime: 62.134ms
- ScannerFilterTime: 15.310us
- ScannerGetBlockTime: 170.453us
- ScannerInitTime: 2.788ms
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 48
SegmentIterator:
- BitmapIndexFilterTimer: 5.90us
- BlockConditionsFilteredBloomFilterTime: 20.200us
- BlockConditionsFilteredDictTime: 7.110us
- BlockConditionsFilteredTime: 2.972ms
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 2.759ms
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 29.768ms
- BlockLoadTime: 88.734ms
- BlocksLoad: 99
- CachedPagesNum: 0
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 2.36 MB
- DecompressorTimer: 757.103us
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 0
- FirstReadSeekTime: 0ns
- FirstReadTime: 359.656us
- IOTimer: 13.202ms
- InvertedIndexFilterTime: 21.800us
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 32.115ms
- NumSegmentFiltered: 0
- NumSegmentTotal: 98
- OutputColumnTime: 2.830us
- OutputIndexResultColumnTimer: 700ns
- RawRowsRead: 1
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 424.395221M (424395221)
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 1
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 340ns
- TotalPagesNum: 11
- UncompressedBytesRead: 3.07 MB
- VectorPredEvalTime: 1.40us
LoadChannels:

polarbearmx4