Doris2.1.6中使用Arrow Flight SQL协议

Question

Hi各位，我已经安装了Doris2.1.6，想使用Arrow Flight SQL协议，按照官网的示例我编写了一段python代码，python代码中主要写了一个select语句从数据库获取290万数据，执行程序消耗了90秒左右，与使用pymysql库消耗的时间差的不多。然而我看网络上一些人获取100万数据只用了3秒，是我的使用方式有问题吗，或者有什么配置需要开启吗，希望有人能够解答，谢谢。

建表语句：
CREATE TABLE load_data (
region_code varchar(50) NOT NULL COMMENT '区域编码',
region_id varchar(50) NOT NULL COMMENT '区域ID',
data_time datetime NOT NULL COMMENT '数据时间',
item varchar(50) NOT NULL COMMENT '所属项',
value double NULL COMMENT '功率'
) ENGINE=OLAP
UNIQUE KEY(region_id, data_time, item)
COMMENT 'OLAP'
DISTRIBUTED BY HASH(region_id) BUCKETS 10
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"min_load_replica_num" = "-1",
"is_being_synced" = "false",
"storage_medium" = "hdd",
"storage_format" = "V2",
"inverted_index_storage_format" = "V1",
"enable_unique_key_merge_on_write" = "true",
"light_schema_change" = "true",
"disable_auto_compaction" = "false",
"enable_single_replica_compaction" = "false",
"group_commit_interval_ms" = "10000",
"group_commit_data_bytes" = "134217728",
"enable_mow_light_delete" = "false"
);

python代码：
from datetime import datetime
import adbc_driver_manager
import adbc_driver_flightsql.dbapi as flight_sql

def read_and_write_to_new_table():

startTime = datetime.now()
conn = flight_sql.connect(uri="grpc://192.168.xxx.xxx:9999", db_kwargs={
    adbc_driver_manager.DatabaseOptions.USERNAME.value: "user",
    adbc_driver_manager.DatabaseOptions.PASSWORD.value: "password",
})
cursor = conn.cursor()

cursor.execute("SELECT *  FROM test_db.load_data;")
print(cursor.fetchallarrow().to_pandas())
endTime = datetime.now()
print("连接->获取数据耗时：",endTime-startTime)
cursor.close()
conn.close()

if name == 'main':
read_and_write_to_new_table()

更新：按照您的方法我生成了该profile，内容如下：
Summary:
- Profile ID: 80d6ea76deba47e0-aa573ffbc17e686e
- Task Type: QUERY
- Start Time: 2024-11-08 18:03:02
- End Time: 2024-11-08 18:04:52
- Total: 1m49s
- Task State: EOF
- User: root
- Default Catalog: internal
- Default Db: mdm_db
- Sql Statement: select regionCode,regionId,dataTime,item,value from mdm_load_forecast_data
Execution Summary:
- Parse SQL Time: 1ms
- Nereids Analysis Time: 1ms
- Nereids Rewrite Time: 0ms
- Nereids Optimize Time: 1ms
- Nereids Translate Time: 0ms
- Workload Group: normal
- Analysis Time: 1ms
- Plan Time: 1ms
- JoinReorder Time: N/A
- CreateSingleNode Time: N/A
- QueryDistributed Time: N/A
- Init Scan Node Time: N/A
- Finalize Scan Node Time: N/A
- Get Splits Time: N/A
- Get Partitions Time: N/A
- Get Partition Files Time: N/A
- Create Scan Range Time: N/A
- Schedule Time: 2ms
- Fragment Assign Time: 0ms
- Fragment Serialize Time: 0ms
- Fragment RPC Phase1 Time: 2ms
- Fragment RPC Phase2 Time: 0ms
- Fragment Compressed Size: 3.17 KB
- Fragment RPC Count: 2
- Schedule Time Of BE: {"phase1":{"cdrd-dev-07: 8060":{"RPC Work Time":"1ms","RPC Latency From FE To BE":"1ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"0ms"}},"phase2":{"cdrd-dev-07: 8060":{"RPC Work Time":"0ms","RPC Latency From FE To BE":"0ms","RPC Work Queue Time":"0ms","RPC Latency From BE To FE":"0ms"}}}
- Wait and Fetch Result Time: 1m49s
- Fetch Result Time: 998ms
- Write Result Time: 1m48s
- Doris Version: doris-2.1.6-rc04-653e315ba5
- Is Nereids: Yes
- Is Pipeline: Yes
- Is Cached: No
- Total Instances Num: 5
- Instances Num Per BE: cdrd-dev-07:8060:5
- Parallel Fragment Exec Instance Num: 4
- Trace ID:
- Transaction Commit Time: N/A
- Executed By Frontend: N/A

MergedProfile
Fragments:
Fragment 0:
Pipeline : 0(instance_num=1):
RESULT_SINK_OPERATOR (id=0):
- PlanInfo
- TABLE: mdm_db.mdm_load_forecast_data(mdm_load_forecast_data), PREAGGREGATION: ON
- PREDICATES: (DORIS_DELETE_SIGN = 0)
- partitions=1/1 (mdm_load_forecast_data)
- tablets=10/10, tabletList=1107053,1107055,1107057 ...
- cardinality=2839719, avgRowSize=0.0, numNodes=1
- pushAggOp=NONE
- projections: regionCode, regionId, dataTime, item, value
- project output tuple id: 1
- BlocksProduced: sum 866, avg 866, max 866, min 866
- CloseTime: avg 77.507us, max 77.507us, min 77.507us
- ExecTime: avg 876.2ms, max 876.2ms, min 876.2ms
- InitTime: avg 8.767us, max 8.767us, min 8.767us
- InputRows: sum 0, avg 0, max 0, min 0
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 19.437us, max 19.437us, min 19.437us
- RowsProduced: sum 2.839719M (2839719), avg 2.839719M (2839719), max 2.839719M (2839719), min 2.839719M (2839719)
- WaitForDependencyTime: avg 1m48s, max 1m48s, min 1m48s
- WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
EXCHANGE_OPERATOR (id=1):
- PlanInfo
- offset: 0
- BlocksProduced: sum 865, avg 865, max 865, min 865
- CloseTime: avg 3.226us, max 3.226us, min 3.226us
- ExecTime: avg 16.284ms, max 16.284ms, min 16.284ms
- InitTime: avg 26.600us, max 26.600us, min 26.600us
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 21.47 MB, avg 21.47 MB, max 21.47 MB, min 21.47 MB
- OpenTime: avg 2.445us, max 2.445us, min 2.445us
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 2.839719M (2839719), avg 2.839719M (2839719), max 2.839719M (2839719), min 2.839719M (2839719)
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForData0: avg 5.790ms, max 5.790ms, min 5.790ms
Fragment 1:
Pipeline : 0(instance_num=4):
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: sum 865, avg 216, max 237, min 199
- CloseTime: avg 12.360us, max 12.784us, min 11.862us
- ExecTime: avg 24.721ms, max 31.333ms, min 20.656ms
- InitTime: avg 18.69us, max 35.16us, min 11.872us
- InputRows: sum 2.839719M (2839719), avg 709.929K (709929), max 777.207K (777207), min 652.701K (652701)
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 18.427us, max 25.7us, min 15.870us
- RowsProduced: sum 2.839719M (2839719), avg 709.929K (709929), max 777.207K (777207), min 652.701K (652701)
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForLocalExchangeBuffer0: avg 54s752ms, max 1m45s, min 319.154us
- WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
OLAP_SCAN_OPERATOR (id=0. table name = mdm_load_forecast_data(mdm_load_forecast_data)):
- BlocksProduced: sum 865, avg 216, max 237, min 199
- CloseTime: avg 1.190ms, max 1.680ms, min 964.142us
- ExecTime: avg 13.387ms, max 18.632ms, min 8.995ms
- InitTime: avg 76.870us, max 101.813us, min 60.584us
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 7.798ms, max 13.968ms, min 406.549us
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 2.839719M (2839719), avg 709.929K (709929), max 777.207K (777207), min 652.701K (652701)
- RuntimeFilterInfo: sum , avg , max , min
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: avg 1.627ms, max 4.403ms, min 0ns
VScanner:
- MemoryUsage: sum , avg , max , min
- FreeBlocks: sum 87.45 MB, avg 21.86 MB, max 22.99 MB, min 21.46 MB

Execution Profile 80d6ea76deba47e0-aa573ffbc17e686e:(Active: 1m49s, % non-child: 0.00%)
Fragments:
Fragment 0:
Pipeline :0 (host=TNetworkAddress(hostname:cdrd-dev-07, port:9050)):
PipelineXTask (index=0):(Active: 898.358ms, % non-child: 0.00%)
- CoreChangeTimes: 2
- ExecuteTime: 898.126ms
- CloseTime: 82.135us
- GetBlockTime: 16.920ms
- OpenTime: 26.771us
- PrepareTime: 67.96us
- SinkTime: 876.212ms
- GetBlockCounter: 866
- NumBlockedBySinkTimes: 242
- NumBlockedBySrcTimes: 1
- NumBlockedTimes: 245
- NumScheduleTimes: 245
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 841.704ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 11.261ms
RESULT_SINK_OPERATOR (id=0):
- AppendBatchTime: 875.481ms
- CopyBufferTime: 0ns
- ResultSendTime: 130.675ms
- TupleConvertTime: 708.948ms
- BlocksProduced: 866
- BytesSent: 214.75 MB
- CloseTime: 77.507us
- ExecTime: 876.2ms
- InitTime: 8.767us
- InputRows: 0
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumSentRows: 2.839719M (2839719)
- OpenTime: 19.437us
- PendingFinishDependency: 0ns
- RowsProduced: 2.839719M (2839719)
- WaitForDependencyTime: 1m48s
- WaitForDependency[RESULT_SINK_OPERATOR_DEPENDENCY]Time: 0ns
EXCHANGE_OPERATOR (id=1):
- InstanceID: 80d6ea76deba47e0-aa573ffbc17e6873
- BlocksProduced: 865
- CloseTime: 3.226us
- DataArrivalWaitTime: 0ns
- DecompressBytes: 0.00
- DecompressTime: 0ns
- DeserializeRowBatchTimer: 0ns
- ExecTime: 16.284ms
- FirstBatchArrivalWaitTime: 0ns
- InitTime: 26.600us
- LocalBytesReceived: 462.38 MB
- MemoryUsage:
- PeakMemoryUsage: 21.47 MB
- OpenTime: 2.445us
- ProjectionTime: 0ns
- RemoteBytesReceived: 0.00
- RowsProduced: 2.839719M (2839719)
- SendersBlockedTotalTimer(*): 0ns
- WaitForDependencyTime: 0ns
- WaitForData0: 5.790ms
Fragment 1:
Pipeline :0 (host=TNetworkAddress(hostname:cdrd-dev-07, port:9050)):
PipelineXTask (index=0):(Active: 59.874ms, % non-child: 0.00%)
- CoreChangeTimes: 5
- ExecuteTime: 43.960ms
- CloseTime: 1.694ms
- GetBlockTime: 3.41ms
- OpenTime: 13.991ms
- PrepareTime: 176.454us
- SinkTime: 24.311ms
- GetBlockCounter: 225
- NumBlockedBySinkTimes: 347
- NumBlockedBySrcTimes: 0
- NumBlockedTimes: 349
- NumScheduleTimes: 349
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 30.215ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 37.971ms
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 225
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 11.862us
- CompressTime: 0ns
- ExecTime: 24.194ms
- InitTime: 35.16us
- InputRows: 738.612K (738612)
- LocalBytesSent: 55.38 MB
- LocalSendTime: 23.921ms
- LocalSentRows: 738.612K (738612)
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 15.960us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 0ns
- RowsProduced: 738.612K (738612)
- RpcAvgTime: 0ns
- RpcCount: 0
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForLocalExchangeBuffer0: 1m23s
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = mdm_load_forecast_data(mdm_load_forecast_data)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[ : �]
- TabletIds: [1107053, 1107061, 1107069]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 310ns
- BlocksProduced: 225
- CloseTime: 1.680ms
- ExecTime: 18.632ms
- InitTime: 101.813us
- KeyRangesNum: 0
- MaxScannerThreadNum: 12
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 46
- OpenTime: 13.968ms
- ProcessConjunctTime: 55.84us
- ProjectionTime: 0ns
- RowsProduced: 738.612K (738612)
- RowsRead: 738.612K (738612)
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 22.686ms
- TabletNum: 3
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 0ns
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [regionCode, regionId, dataTime, item, value, DORIS_DELETE_SIGN]
- PreEvaluatePredicates:
ComparisonPredicateBase(TINYINT, EQ), column_id=5, opposite=false
- PerScannerRunningTime: [2.310ms, 1.265ms, 851.879us, 2.067ms, 964.174us, 1.284ms, 2.357ms, 1.223ms, 2.493ms, 1.525ms, 1.393ms, 1.190ms, 735.360us, 612.870us, 762.873us, 695.878us, 644.889us, 809.003us, 680.836us, 933.666us, 781.538us, 686.228us, 787.449us, 536.755us, 1.346ms, 678.643us, 996.486us, 696.868us, 654.128us, 844.365us, 601.407us, 541.705us, 528.659us, 580.586us, 688.911us, 803.948us, 916.712us, 735.268us, 1.232ms, 687.488us, 1.745ms, 679.045us, 774.855us, 681.619us, 743.355us, 579.576us, ]
- PerScannerRowsRead: [16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 10.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 13.48K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 10.23K, ]
- PerScannerWaitTime: [35.187us, 90.642us, 363.718us, 1.755ms, 13.633ms, 248.610us, 557.594us, 597.580us, 781.608us, 780.155us, 995.392us, 1.759ms, 30.046us, 28.053us, 34.445us, 30.628us, 39.134us, 54.463us, 27.462us, 40.677us, 21.350us, 26.310us, 36.459us, 30.367us, 34.796us, 40.306us, 41.459us, 27.261us, 22.182us, 38.382us, 29.957us, 49.394us, 18.024us, 27.723us, 51.898us, 27.642us, 23.474us, 27.893us, 29.455us, 24.536us, 23.665us, 31.560us, 31.680us, 29.676us, 27.071us, 30.617us, ]
- PerScannerProjectionTime: [1.635ms, 638.805us, 297.681us, 1.311ms, 488.654us, 654.537us, 919.958us, 665.408us, 1.132ms, 754.737us, 791.426us, 628.048us, 151.677us, 164.372us, 191.442us, 148.021us, 144.553us, 152.508us, 207.092us, 329.654us, 161.445us, 193.175us, 236.777us, 221.558us, 412.810us, 173.848us, 264.241us, 154.694us, 168.238us, 215.437us, 150.746us, 142.949us, 134.805us, 153.380us, 162.958us, 180.940us, 165.123us, 160.804us, 202.081us, 131.019us, 140.766us, 195.430us, 153.410us, 129.585us, 175.372us, 175.691us, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 26.616ms
- DeleteBitmapGetAggTime: 164.355us
- MemoryUsage:
- FreeBlocks: 22.99 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 39.98ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 9.629us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 86.992ms
- ScannerCtxSchedTime: 22.601ms
- ScannerFilterTime: 177.791us
- ScannerGetBlockTime: 28.565ms
- ScannerInitTime: 244.332us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 46
SegmentIterator:
- BitmapIndexFilterTimer: 17.129us
- BlockConditionsFilteredBloomFilterTime: 54.323us
- BlockConditionsFilteredDictTime: 16.578us
- BlockConditionsFilteredTime: 699.161us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 244.616us
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 1.440ms
- BlockLoadTime: 59.974ms
- BlocksLoad: 271
- CachedPagesNum: 170
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 4.76 MB
- DecompressorTimer: 815.361us
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 225
- FirstReadSeekTime: 2.34ms
- FirstReadTime: 2.454ms
- IOTimer: 5.88ms
- InvertedIndexFilterTime: 100.330us
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryNullBitmapTime: 0ns
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherCacheHit: 0
- InvertedIndexSearcherCacheMiss: 0
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 52.740ms
- NumSegmentFiltered: 0
- NumSegmentTotal: 46
- OutputColumnTime: 824.213us
- OutputIndexResultColumnTimer: 23.539us
- RawRowsRead: 738.612K (738612)
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 0
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 738.612K (738612)
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 8.141us
- TotalPagesNum: 506
- UncompressedBytesRead: 4.88 MB
- VectorPredEvalTime: 479.842us
PipelineXTask (index=1):(Active: 37.953ms, % non-child: 0.00%)
- CoreChangeTimes: 74
- ExecuteTime: 31.161ms
- CloseTime: 978.850us
- GetBlockTime: 2.369ms
- OpenTime: 5.654ms
- PrepareTime: 109.547us
- SinkTime: 20.689ms
- GetBlockCounter: 199
- NumBlockedBySinkTimes: 511
- NumBlockedBySrcTimes: 1
- NumBlockedTimes: 514
- NumScheduleTimes: 514
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 25.780ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 70.498ms
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 199
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 12.424us
- CompressTime: 0ns
- ExecTime: 20.656ms
- InitTime: 12.724us
- InputRows: 652.701K (652701)
- LocalBytesSent: 49.08 MB
- LocalSendTime: 20.446ms
- LocalSentRows: 652.701K (652701)
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 25.7us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 0ns
- RowsProduced: 652.701K (652701)
- RpcAvgTime: 0ns
- RpcCount: 0
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForLocalExchangeBuffer0: 1m45s
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = mdm_load_forecast_data(mdm_load_forecast_data)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[ : �]
- TabletIds: [1107055, 1107063, 1107071]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 310ns
- BlocksProduced: 199
- CloseTime: 964.142us
- ExecTime: 11.28ms
- InitTime: 64.932us
- KeyRangesNum: 0
- MaxScannerThreadNum: 12
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 41
- OpenTime: 5.622ms
- ProcessConjunctTime: 78.108us
- ProjectionTime: 0ns
- RowsProduced: 652.701K (652701)
- RowsRead: 652.701K (652701)
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 23.596ms
- TabletNum: 3
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 2.105ms
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [regionCode, regionId, dataTime, item, value, DORIS_DELETE_SIGN]
- PreEvaluatePredicates:
ComparisonPredicateBase(TINYINT, EQ), column_id=5, opposite=false
- PerScannerRunningTime: [2.233ms, 2.177ms, 924.457us, 1.513ms, 195.650us, 1.824ms, 1.133ms, 1.124ms, 1.010ms, 1.498ms, 819.169us, 7.444ms, 882.617us, 585.656us, 729.889us, 1.416ms, 937.370us, 789.152us, 1.139ms, 1.255ms, 881.887us, 895.725us, 692.269us, 632.757us, 783.112us, 760.213us, 717.466us, 680.468us, 872.018us, 777.198us, 640.701us, 782.388us, 713.860us, 668.312us, 739.890us, 667.270us, 656.349us, 708.728us, 934.746us, 843.354us, 214.515us, ]
- PerScannerRowsRead: [16.38K, 16.38K, 16.38K, 16.38K, 5.99K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.27K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 7.86K, ]
- PerScannerWaitTime: [5.478ms, 591.798us, 586.308us, 656.581us, 726.844us, 799.471us, 1.355ms, 1.422ms, 1.744ms, 2.172ms, 3.511ms, 3.669ms, 33.914us, 36.880us, 29.215us, 32.290us, 35.327us, 29.596us, 22.623us, 26.400us, 30.538us, 29.596us, 26.910us, 20.819us, 26.280us, 32.271us, 26.129us, 31.460us, 114.125us, 19.958us, 26.620us, 24.847us, 20.418us, 18.164us, 27.271us, 24.967us, 23.514us, 30.357us, 23.594us, 34.755us, 23.645us, ]
- PerScannerProjectionTime: [1.759ms, 1.681ms, 233.451us, 686.630us, 80.451us, 681.509us, 582.311us, 540.803us, 541.325us, 876.104us, 304.186us, 6.978ms, 322.971us, 166.695us, 143.631us, 231.370us, 222.250us, 258.918us, 316.970us, 290.942us, 289.366us, 260.914us, 215.787us, 151.567us, 196.862us, 236.926us, 201.021us, 209.074us, 173.057us, 236.858us, 137.048us, 157.928us, 159.110us, 114.415us, 193.626us, 202.591us, 186.251us, 254.140us, 225.355us, 263.676us, 80.832us, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 22.193ms
- DeleteBitmapGetAggTime: 141.938us
- MemoryUsage:
- FreeBlocks: 21.53 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 49.898ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 8.200us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 78.672ms
- ScannerCtxSchedTime: 23.516ms
- ScannerFilterTime: 159.569us
- ScannerGetBlockTime: 23.268ms
- ScannerInitTime: 226.749us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 41
SegmentIterator:
- BitmapIndexFilterTimer: 15.403us
- BlockConditionsFilteredBloomFilterTime: 45.212us
- BlockConditionsFilteredDictTime: 13.719us
- BlockConditionsFilteredTime: 614.415us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 243.565us
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 1.282ms
- BlockLoadTime: 56.554ms
- BlocksLoad: 240
- CachedPagesNum: 153
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 4.08 MB
- DecompressorTimer: 642.276us
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 199
- FirstReadSeekTime: 6.177ms
- FirstReadTime: 6.604ms
- IOTimer: 4.496ms
- InvertedIndexFilterTime: 86.183us
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryNullBitmapTime: 0ns
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherCacheHit: 0
- InvertedIndexSearcherCacheMiss: 0
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 45.841ms
- NumSegmentFiltered: 0
- NumSegmentTotal: 41
- OutputColumnTime: 693.207us
- OutputIndexResultColumnTimer: 20.752us
- RawRowsRead: 652.701K (652701)
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 0
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 652.701K (652701)
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 7.254us
- TotalPagesNum: 447
- UncompressedBytesRead: 4.18 MB
- VectorPredEvalTime: 398.920us
PipelineXTask (index=2):(Active: 51.497ms, % non-child: 0.00%)
- CoreChangeTimes: 8
- ExecuteTime: 39.142ms
- CloseTime: 989.40us
- GetBlockTime: 2.816ms
- OpenTime: 11.219ms
- PrepareTime: 94.970us
- SinkTime: 22.811ms
- GetBlockCounter: 204
- NumBlockedBySinkTimes: 324
- NumBlockedBySrcTimes: 0
- NumBlockedTimes: 326
- NumScheduleTimes: 326
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 27.892ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 37.737ms
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 204
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 12.784us
- CompressTime: 0ns
- ExecTime: 22.700ms
- InitTime: 11.872us
- InputRows: 671.199K (671199)
- LocalBytesSent: 50.19 MB
- LocalSendTime: 22.454ms
- LocalSentRows: 671.199K (671199)
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 16.872us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 0ns
- RowsProduced: 671.199K (671199)
- RpcAvgTime: 0ns
- RpcCount: 0
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForLocalExchangeBuffer0: 319.154us
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = mdm_load_forecast_data(mdm_load_forecast_data)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[ : �]
- TabletIds: [1107057, 1107065]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 230ns
- BlocksProduced: 204
- CloseTime: 974.332us
- ExecTime: 14.891ms
- InitTime: 60.584us
- KeyRangesNum: 0
- MaxScannerThreadNum: 12
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 41
- OpenTime: 11.195ms
- ProcessConjunctTime: 36.258us
- ProjectionTime: 0ns
- RowsProduced: 671.199K (671199)
- RowsRead: 671.199K (671199)
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 18.458ms
- TabletNum: 2
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 0ns
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [regionCode, regionId, dataTime, item, value, DORIS_DELETE_SIGN]
- PreEvaluatePredicates:
ComparisonPredicateBase(TINYINT, EQ), column_id=5, opposite=false
- PerScannerRunningTime: [1.057ms, 814.120us, 1.200ms, 821.514us, 1.264ms, 548.377us, 923.236us, 1.277ms, 1.250ms, 1.205ms, 896.576us, 1.256ms, 1.088ms, 817.807us, 923.066us, 807.747us, 637.776us, 750.560us, 663.555us, 690.965us, 629.337us, 1.210ms, 683.883us, 657.343us, 734.399us, 745.090us, 751.350us, 1.053ms, 758.896us, 771.137us, 770.838us, 751.381us, 686.589us, 848.102us, 610.716us, 783.452us, 752.925us, 616.165us, 880.765us, 800.502us, 844.896us, ]
- PerScannerRowsRead: [16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 14.50K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 17.72K, ]
- PerScannerWaitTime: [29.466us, 53.411us, 52.108us, 29.516us, 39.805us, 10.947ms, 222.902us, 228.552us, 990.052us, 1.133ms, 1.183ms, 1.443ms, 1.057ms, 30.919us, 35.317us, 27.793us, 28.444us, 28.925us, 25.969us, 49.424us, 41.549us, 30.478us, 37.802us, 34.235us, 30.988us, 20.639us, 24.095us, 52.930us, 30.057us, 31.881us, 23.244us, 155.594us, 33.523us, 28.484us, 31.059us, 38.082us, 60.253us, 24.887us, 32.211us, 33.053us, 24.687us, ]
- PerScannerProjectionTime: [485.988us, 284.447us, 310.055us, 233.711us, 325.534us, 115.659us, 449.600us, 653.387us, 666.481us, 618.819us, 466.533us, 585.728us, 614.653us, 191.863us, 148.793us, 145.367us, 161.417us, 196.632us, 150.545us, 161.225us, 146.826us, 234.993us, 183.728us, 168.649us, 159.712us, 164.150us, 170.522us, 148.640us, 194.058us, 201.291us, 213.073us, 205.208us, 206.612us, 155.345us, 156.736us, 173.319us, 154.853us, 162.316us, 153.219us, 220.174us, 165.873us, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 22.969ms
- DeleteBitmapGetAggTime: 194.559us
- MemoryUsage:
- FreeBlocks: 21.46 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 35.125ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 8.273us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 74.422ms
- ScannerCtxSchedTime: 18.379ms
- ScannerFilterTime: 170.974us
- ScannerGetBlockTime: 23.986ms
- ScannerInitTime: 174.219us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 41
SegmentIterator:
- BitmapIndexFilterTimer: 25.124us
- BlockConditionsFilteredBloomFilterTime: 48.399us
- BlockConditionsFilteredDictTime: 15.949us
- BlockConditionsFilteredTime: 646.290us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 238.228us
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 1.325ms
- BlockLoadTime: 53.231ms
- BlocksLoad: 245
- CachedPagesNum: 150
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 3.95 MB
- DecompressorTimer: 645.750us
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 204
- FirstReadSeekTime: 1.689ms
- FirstReadTime: 2.69ms
- IOTimer: 3.88ms
- InvertedIndexFilterTime: 90.217us
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryNullBitmapTime: 0ns
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherCacheHit: 0
- InvertedIndexSearcherCacheMiss: 0
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 46.943ms
- NumSegmentFiltered: 0
- NumSegmentTotal: 41
- OutputColumnTime: 817.435us
- OutputIndexResultColumnTimer: 19.217us
- RawRowsRead: 671.199K (671199)
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 0
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 671.199K (671199)
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 7.306us
- TotalPagesNum: 456
- UncompressedBytesRead: 4.06 MB
- VectorPredEvalTime: 421.154us
PipelineXTask (index=3):(Active: 38.258ms, % non-child: 0.00%)
- CoreChangeTimes: 3
- ExecuteTime: 36.540ms
- CloseTime: 1.158ms
- GetBlockTime: 3.138ms
- OpenTime: 425.394us
- PrepareTime: 113.304us
- SinkTime: 31.390ms
- GetBlockCounter: 237
- NumBlockedBySinkTimes: 166
- NumBlockedBySrcTimes: 1
- NumBlockedTimes: 169
- NumScheduleTimes: 169
- NumYieldTimes: 0
- PendingFinishTimes: 0
- TaskCpuTime: 36.586ms
- WaitBfTime: 0ns
- WaitBfTimes: 0
- WaitDenpendencyTimes: 1
- WaitWorkerTime: 6.306ms
DATA_STREAM_SINK_OPERATOR (id=1,dst_id=1):
- BlocksProduced: 237
- BrpcSendTime: 0ns
- BrpcSendTime.Wait: 0ns
- BytesSent: 0.00
- CloseTime: 12.373us
- CompressTime: 0ns
- ExecTime: 31.333ms
- InitTime: 12.664us
- InputRows: 777.207K (777207)
- LocalBytesSent: 58.60 MB
- LocalSendTime: 31.123ms
- LocalSentRows: 777.207K (777207)
- MemoryUsage:
- PeakMemoryUsage: 0.00
- MergeBlockTime: 0ns
- OpenTime: 15.870us
- OverallThroughput: 0.0 /sec
- PendingFinishDependency: 0ns
- RowsProduced: 777.207K (777207)
- RpcAvgTime: 0ns
- RpcCount: 0
- RpcMaxTime: 0ns
- RpcMinTime: 0ns
- RpcSumTime: 0ns
- SerializeBatchTime: 0ns
- SplitBlockDistributeByChannelTime: 0ns
- SplitBlockHashComputeTime: 0ns
- UncompressedRowBatchSize: 0.00
- WaitForDependencyTime: 0ns
- WaitForBroadcastBuffer: 0ns
- WaitForLocalExchangeBuffer0: 29s734ms
- WaitForRpcBufferQueue: 0ns
OLAP_SCAN_OPERATOR (id=0. table name = mdm_load_forecast_data(mdm_load_forecast_data)):
- RuntimeFilters: :
- PushDownPredicates: [{DORIS_DELETE_SIGN IN [0]}]
- KeyRanges: ScanKeys:ScanKey=[ : �]
- TabletIds: [1107059, 1107067]
- UseSpecificThreadToken: False
- AcquireRuntimeFilterTime: 260ns
- BlocksProduced: 237
- CloseTime: 1.144ms
- ExecTime: 8.995ms
- InitTime: 80.151us
- KeyRangesNum: 0
- MaxScannerThreadNum: 12
- MemoryUsage:
- PeakMemoryUsage: 0.00
- NumScanners: 48
- OpenTime: 406.549us
- ProcessConjunctTime: 51.317us
- ProjectionTime: 0ns
- RowsProduced: 777.207K (777207)
- RowsRead: 777.207K (777207)
- RuntimeFilterInfo:
- ScannerWorkerWaitTime: 52.324ms
- TabletNum: 2
- TotalReadThroughput: 0
- WaitForDependency[OLAP_SCAN_OPERATOR_DEPENDENCY]Time: 4.403ms
- WaitForRuntimeFilter: 0ns
VScanner:
- ReadColumns: [regionCode, regionId, dataTime, item, value, DORIS_DELETE_SIGN]
- PreEvaluatePredicates:
ComparisonPredicateBase(TINYINT, EQ), column_id=5, opposite=false
- PerScannerRunningTime: [1.655ms, 1.586ms, 812.666us, 962.761us, 1.406ms, 13.039ms, 679.573us, 425.122us, 773.771us, 1.329ms, 12.131ms, 1.014ms, 6.929ms, 3.370ms, 670.667us, 843.034us, 1.057ms, 935.970us, 936.039us, 756.029us, 761.409us, 616.643us, 714.201us, 739.116us, 908.587us, 649.339us, 754.896us, 627.105us, 676.739us, 895.705us, 677.499us, 643.676us, 949.575us, 599.814us, 986.855us, 736.272us, 641.071us, 711.495us, 662.071us, 726.794us, 926.832us, 795.943us, 662.133us, 599.002us, 701.486us, 645.019us, 590.195us, 573.685us, ]
- PerScannerRowsRead: [16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 10.12K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 16.38K, 13.42K, ]
- PerScannerWaitTime: [1.971ms, 2.067ms, 2.174ms, 2.453ms, 2.508ms, 3.634ms, 3.735ms, 4.451ms, 4.453ms, 4.452ms, 4.677ms, 5.011ms, 3.206ms, 2.581ms, 1.665ms, 668.724us, 51.167us, 1.720ms, 20.930us, 25.778us, 41.088us, 23.124us, 30.397us, 28.805us, 19.908us, 32.250us, 23.304us, 25.909us, 33.262us, 33.363us, 27.142us, 29.576us, 16.802us, 25.639us, 21.400us, 23.564us, 31.249us, 29.095us, 31.109us, 27.923us, 30.768us, 26.340us, 36.058us, 35.317us, 27.622us, 28.795us, 27.322us, 25.037us, ]
- PerScannerProjectionTime: [1.151ms, 333.541us, 286.640us, 338.471us, 682.599us, 308.264us, 242.016us, 213.062us, 218.752us, 820.152us, 367.695us, 387.121us, 398.072us, 203.665us, 183.878us, 355.792us, 489.616us, 398.505us, 347.488us, 228.193us, 152.279us, 147.518us, 151.726us, 220.026us, 169.401us, 144.014us, 265.942us, 132.731us, 153.902us, 236.096us, 176.062us, 151.626us, 135.788us, 192.715us, 258.637us, 221.549us, 153.179us, 158.829us, 208.402us, 184.839us, 195.300us, 272.947us, 166.196us, 139.483us, 196.080us, 175.252us, 136.958us, 161.794us, ]
- BlockConvertTime: 0ns
- BlockFetchTime: 56.668ms
- DeleteBitmapGetAggTime: 163.670us
- MemoryUsage:
- FreeBlocks: 21.46 MB
- NewlyCreateFreeBlocksNum: 0
- NumScaleUpScanners: 0
- ReaderInitTime: 39.259ms
- RowsDelFiltered: 0
- ScannerBatchWaitTime: 8.884us
- ScannerConvertBlockTime: 0ns
- ScannerCpuTime: 82.737ms
- ScannerCtxSchedTime: 52.239ms
- ScannerFilterTime: 182.318us
- ScannerGetBlockTime: 57.823ms
- ScannerInitTime: 264.360us
- ScannerPrefilterTime: 0ns
- ScannerSchedCount: 48
SegmentIterator:
- BitmapIndexFilterTimer: 21.67us
- BlockConditionsFilteredBloomFilterTime: 50.776us
- BlockConditionsFilteredDictTime: 16.126us
- BlockConditionsFilteredTime: 808.561us
- BlockConditionsFilteredZonemapRuntimePredicateTime: 0ns
- BlockConditionsFilteredZonemapTime: 355.300us
- BlockInitSeekCount: 0
- BlockInitSeekTime: 0ns
- BlockInitTime: 1.603ms
- BlockLoadTime: 90.991ms
- BlocksLoad: 285
- CachedPagesNum: 179
- CollectIteratorMergeTime: 0ns
- CollectIteratorNormalTime: 0ns
- CompressedBytesRead: 4.68 MB
- DecompressorTimer: 983.691us
- ExprFilterEvalTime: 0ns
- FirstReadSeekCount: 237
- FirstReadSeekTime: 1.957ms
- FirstReadTime: 2.394ms
- IOTimer: 2.708ms
- InvertedIndexFilterTime: 101.433us
- InvertedIndexQueryBitmapCopyTime: 0ns
- InvertedIndexQueryBitmapOpTime: 0ns
- InvertedIndexQueryCacheHit: 0
- InvertedIndexQueryCacheMiss: 0
- InvertedIndexQueryNullBitmapTime: 0ns
- InvertedIndexQueryTime: 0ns
- InvertedIndexSearcherCacheHit: 0
- InvertedIndexSearcherCacheMiss: 0
- InvertedIndexSearcherOpenTime: 0ns
- InvertedIndexSearcherSearchTime: 0ns
- LazyReadSeekCount: 0
- LazyReadSeekTime: 0ns
- LazyReadTime: 83.701ms
- NumSegmentFiltered: 0
- NumSegmentTotal: 48
- OutputColumnTime: 851.661us
- OutputIndexResultColumnTimer: 22.409us
- RawRowsRead: 777.207K (777207)
- RowsBitmapIndexFiltered: 0
- RowsBloomFilterFiltered: 0
- RowsConditionsFiltered: 0
- RowsDictFiltered: 0
- RowsInvertedIndexFiltered: 0
- RowsKeyRangeFiltered: 0
- RowsShortCircuitPredFiltered: 0
- RowsShortCircuitPredInput: 0
- RowsStatsFiltered: 0
- RowsVectorPredFiltered: 0
- RowsVectorPredInput: 777.207K (777207)
- RowsZonemapRuntimePredicateFiltered: 0
- SecondReadTime: 0ns
- ShortPredEvalTime: 7.995us
- TotalPagesNum: 528
- UncompressedBytesRead: 4.86 MB
- VectorPredEvalTime: 409.824us
LoadChannels:

xinyiZzz · Answer

执行 set global enable_profile=true; 打开 query profile
然后用 pymysql 查询一次

参考文档查看profile，然后在问题中帖下 profile
https://doris.apache.org/zh-CN/docs/dev/query-acceleration/tuning/query-profile/#profile-分析查询性能

我们确认下耗时在哪里

黄海军@SelectDB · Answer

方便提供一下表结构、python代码、doris集群配置以及查询数据耗时截图吗？更新在提问内容中即可

Doris2.1.6中使用Arrow Flight SQL协议

2 Answers