doris 版本 2.1.3
fe 一台 8核 32G
be 7台 8核 64G
请问如下问题该如何定位与解决呢
W20240805 09:48:55.210906 3729 single_replica_compaction.cpp:142] 11388762 tablet don't need to fetch, no matched version
W20240805 09:48:55.210947 3729 status.h:380] meet error status: [ABORTED]no matched version to fetch
0# doris::SingleReplicaCompaction::_do_single_replica_compaction_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:335
1# doris::SingleReplicaCompaction::execute_compact_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
2# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
3# doris::Tablet::execute_single_replica_compaction(doris::SingleReplicaCompaction&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
4# std::_Function_handler<void (), doris::StorageEngine::_submit_single_replica_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::$_1>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/olap_server.cpp:781
5# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
6# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
7# start_thread
8# __clone
W20240805 09:48:55.210958 3729 tablet.cpp:1907] failed to do single replica compaction. res=[ABORTED]no matched version to fetch
0# doris::SingleReplicaCompaction::_do_single_replica_compaction_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:335
1# doris::SingleReplicaCompaction::execute_compact_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
2# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
3# doris::Tablet::execute_single_replica_compaction(doris::SingleReplicaCompaction&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
4# std::_Function_handler<void (), doris::StorageEngine::_submit_single_replica_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::$_1>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/olap_server.cpp:781
5# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
6# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
7# start_thread
8# __clone
, tablet=11388762
W20240805 09:48:55.256110 3729 single_replica_compaction.cpp:142] 10982721 tablet don't need to fetch, no matched version
W20240805 09:48:55.256160 3729 status.h:380] meet error status: [ABORTED]no matched version to fetch
0# doris::SingleReplicaCompaction::_do_single_replica_compaction_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:335
1# doris::SingleReplicaCompaction::execute_compact_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
2# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
3# doris::Tablet::execute_single_replica_compaction(doris::SingleReplicaCompaction&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
4# std::_Function_handler<void (), doris::StorageEngine::_submit_single_replica_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::$_1>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/olap_server.cpp:781
5# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
6# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
7# start_thread
8# __clone
W20240805 09:48:55.256177 3729 tablet.cpp:1907] failed to do single replica compaction. res=[ABORTED]no matched version to fetch
0# doris::SingleReplicaCompaction::_do_single_replica_compaction_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:335
1# doris::SingleReplicaCompaction::execute_compact_impl() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291
2# doris::Compaction::execute_compact() at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
3# doris::Tablet::execute_single_replica_compaction(doris::SingleReplicaCompaction&) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:449
4# std::_Function_handler<void (), doris::StorageEngine::_submit_single_replica_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType)::$_1>::_M_invoke(std::_Any_data const&) at /home/zcp/repo_center/doris_release/doris/be/src/olap/olap_server.cpp:781
5# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0
6# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562
7# start_thread
8# __clone
, tablet=10982721
20.07更新
按照 https://mp.weixin.qq.com/s/KzK0Gx1m8Z-1qZbyY1ZtlQ 提供的思路进行分析。
show tablet 10982713;
结果为:
+-----------+------------------+---------------+------------------+-------+---------+-------------+---------+--------+-------+-----------+--------------------------------------------------------------------+
| DbName | TableName | PartitionName | IndexName | DbId | TableId | PartitionId | IndexId | IsSync | Order | QueryHits | DetailCmd |
+-----------+------------------+---------------+------------------+-------+---------+-------------+---------+--------+-------+-----------+--------------------------------------------------------------------+
| xxxxxxxxx | adx_daily_device | p20240731 | adx_daily_device | 10358 | 863432 | 10982712 | 863433 | true | 0 | 0 | SHOW PROC '/dbs/10358/863432/partitions/10982712/863433/10982713'; |
+-----------+------------------+---------------+------------------+-------+---------+-------------+---------+--------+-------+-----------+--------------------------------------------------------------------+
SHOW PROC '/dbs/10358/863432/partitions/10982712/863433/10982713';
结果为:
+-----------+-----------+---------+-------------------+------------------+---------------+------------+---------------+----------------+-----------+--------+-------+------------+--------------+----------------------+---------------------+----------------------------------------------------+------------------------------------------------------------------+-------------------+------------------------------------------------------------+-----------+
| ReplicaId | BackendId | Version | LstSuccessVersion | LstFailedVersion | LstFailedTime | SchemaHash | LocalDataSize | RemoteDataSize | RowCount | State | IsBad | IsUserDrop | VersionCount | PathHash | Path | MetaUrl | CompactionStatus | CooldownReplicaId | CooldownMetaId | QueryHits |
+-----------+-----------+---------+-------------------+------------------+---------------+------------+---------------+----------------+-----------+--------+-------+------------+--------------+----------------------+---------------------+----------------------------------------------------+------------------------------------------------------------------+-------------------+------------------------------------------------------------+-----------+
| 10982714 | 67726 | 6731 | 6731 | -1 | NULL | 1141744743 | 24527306010 | 20309668917 | 618336679 | NORMAL | false | false | 27 | -8723605996059250119 | /data2/ssd1/be_data | http://172.31.24.252:8040/api/meta/header/10982713 | http://172.31.24.252:8040/api/compaction/show?tablet_id=10982713 | 10982716 | TUniqueId(hi:5929651324942457548, lo:-6757274624355318341) | 0 |
| 10982715 | 93095 | 6731 | 6731 | -1 | NULL | 1141744743 | 24527306010 | 20309668917 | 618336679 | NORMAL | false | false | 27 | 568453340506426267 | /data/ssd1/be_data | http://172.31.20.199:8040/api/meta/header/10982713 | http://172.31.20.199:8040/api/compaction/show?tablet_id=10982713 | 10982716 | TUniqueId(hi:5929651324942457548, lo:-6757274624355318341) | 0 |
| 10982716 | 276075 | 6731 | 6731 | -1 | NULL | 1141744743 | 24527306010 | 20309668917 | 618336679 | NORMAL | false | false | 27 | 245446347514547678 | /data/ssd1/be_data | http://172.31.19.176:8040/api/meta/header/10982713 | http://172.31.19.176:8040/api/compaction/show?tablet_id=10982713 | 10982716 | TUniqueId(hi:5929651324942457548, lo:-6757274624355318341) | 0 |
+-----------+-----------+---------+-------------------+------------------+---------------+------------+---------------+----------------+-----------+--------+-------+------------+--------------+----------------------+---------------------+----------------------------------------------------+------------------------------------------------------------------+-------------------+------------------------------------------------------------+-----------+
执行count输出为:
elect count(1) from adx_daily_device where last_date='2024-07-31';
+------------+
| count(1) |
+------------+
| 3706976839 |
+------------+
感觉这个报错并没有影响数据
分别查看 compaction相关信息输出为:
curl "http://172.31.24.252:8040/api/compaction/show?tablet_id=10982713"
{
"cumulative policy type": "time_series",
"cumulative point": -1,
"last cumulative failure time": "2024-08-05 11:52:00.687",
"last base failure time": "1970-01-01 00:00:00.000",
"last full failure time": null,
"last cumulative success time": "1970-01-01 00:00:00.000",
"last base success time": "1970-01-01 00:00:00.000",
"last full success time": "1970-01-01 00:00:00.000",
"last base schedule time": "1970-01-01 00:00:00.000",
"last base status": "",
"fetch from peer": "172.31.20.199:8060",
"rowsets": [
"[0-1] 0 DATA OVERLAP_UNKNOWN 02000000002178b32b4025067860863187f374ba931ce18d 0",
"[2-373] 1 DATA NONOVERLAPPING 020000000021951d2b4025067860863187f374ba931ce18d 1.95 GB",
"[374-764] 1 DATA NONOVERLAPPING 02000000002dedf52b4025067860863187f374ba931ce18d 1.95 GB",
"[765-1178] 1 DATA NONOVERLAPPING 02000000003217962b4025067860863187f374ba931ce18d 1.90 GB",
"[1179-1534] 1 DATA NONOVERLAPPING 0200000000364c452b4025067860863187f374ba931ce18d 1.66 GB",
"[1535-1887] 1 DATA NONOVERLAPPING 02000000003bb5d22b4025067860863187f374ba931ce18d 1.68 GB",
"[1888-2187] 1 DATA NONOVERLAPPING 020000000001e514404dd6abb30a4b1153bd3a6907cc9791 1.70 GB",
"[2188-2497] 1 DATA NONOVERLAPPING 020000000004ef8d404dd6abb30a4b1153bd3a6907cc9791 1.67 GB",
"[2498-2660] 1 DATA NONOVERLAPPING 020000000009d6c6404dd6abb30a4b1153bd3a6907cc9791 1.39 GB",
"[2661-2837] 1 DATA NONOVERLAPPING 02000000000c68e7404dd6abb30a4b1153bd3a6907cc9791 1.55 GB",
"[2838-3175] 1 DATA NONOVERLAPPING 0200000000111e30404dd6abb30a4b1153bd3a6907cc9791 1.76 GB",
"[3176-3479] 1 DATA NONOVERLAPPING 02000000001433a5404dd6abb30a4b1153bd3a6907cc9791 1.69 GB",
"[3480-3649] 1 DATA NONOVERLAPPING 02000000000c5bbc1c48f010a659098bc80c6567529ea4a2 1.44 GB",
"[3650-3802] 1 DATA NONOVERLAPPING 02000000000c5bbd1c48f010a659098bc80c6567529ea4a2 1.41 GB",
"[3803-4115] 1 DATA NONOVERLAPPING 02000000000c5bbe1c48f010a659098bc80c6567529ea4a2 1.74 GB",
"[4116-4262] 1 DATA NONOVERLAPPING 02000000000c5bbf1c48f010a659098bc80c6567529ea4a2 1.44 GB",
"[4263-4404] 1 DATA NONOVERLAPPING 02000000000c5bc01c48f010a659098bc80c6567529ea4a2 1.45 GB",
"[4405-4586] 1 DATA NONOVERLAPPING 02000000000c5bc11c48f010a659098bc80c6567529ea4a2 1.49 GB",
"[4587-4804] 1 DATA NONOVERLAPPING 02000000000c5bc21c48f010a659098bc80c6567529ea4a2 1.58 GB",
"[4805-4946] 1 DATA NONOVERLAPPING 02000000000c5bc31c48f010a659098bc80c6567529ea4a2 1.47 GB",
"[4947-5184] 1 DATA NONOVERLAPPING 02000000000c5bc41c48f010a659098bc80c6567529ea4a2 1.61 GB",
"[5185-5475] 1 DATA NONOVERLAPPING 02000000000c5bc51c48f010a659098bc80c6567529ea4a2 1.72 GB",
"[5476-5710] 1 DATA NONOVERLAPPING 02000000000c5bc61c48f010a659098bc80c6567529ea4a2 1.61 GB",
"[5711-5862] 1 DATA NONOVERLAPPING 02000000000c5bc71c48f010a659098bc80c6567529ea4a2 1.47 GB",
"[5863-6170] 1 DATA NONOVERLAPPING 02000000000c5bc81c48f010a659098bc80c6567529ea4a2 1.79 GB",
"[6171-6531] 1 DATA NONOVERLAPPING 02000000000c5bc91c48f010a659098bc80c6567529ea4a2 1.72 GB",
"[6532-6731] 1 DATA NONOVERLAPPING 02000000000c5bca1c48f010a659098bc80c6567529ea4a2 941.68 MB"
],
"missing_rowsets": [],
"stale_rowsets": [],
"stale version path": []
}
[ec2-user@doris_sg4 ~]$ curl "http://172.31.20.199:8040/api/compaction/show?tablet_id=10982713"
{
"cumulative policy type": "time_series",
"cumulative point": 6732,
"last cumulative failure time": "2024-08-02 20:05:56.194",
"last base failure time": "1970-01-01 00:00:00.000",
"last full failure time": null,
"last cumulative success time": "2024-08-02 18:27:31.213",
"last base success time": "1970-01-01 00:00:00.000",
"last full success time": "1970-01-01 00:00:00.000",
"last base schedule time": "1970-01-01 00:00:00.000",
"last base status": "",
"fetch from peer": "-1",
"rowsets": [
"[0-1] 0 DATA OVERLAP_UNKNOWN 02000000002178b32b4025067860863187f374ba931ce18d 0",
"[2-373] 1 DATA NONOVERLAPPING 020000000021951d2b4025067860863187f374ba931ce18d 1.95 GB",
"[374-764] 1 DATA NONOVERLAPPING 02000000002dedf52b4025067860863187f374ba931ce18d 1.95 GB",
"[765-1178] 1 DATA NONOVERLAPPING 02000000003217962b4025067860863187f374ba931ce18d 1.90 GB",
"[1179-1534] 1 DATA NONOVERLAPPING 0200000000364c452b4025067860863187f374ba931ce18d 1.66 GB",
"[1535-1887] 1 DATA NONOVERLAPPING 02000000003bb5d22b4025067860863187f374ba931ce18d 1.68 GB",
"[1888-2187] 1 DATA NONOVERLAPPING 020000000001e514404dd6abb30a4b1153bd3a6907cc9791 1.70 GB",
"[2188-2497] 1 DATA NONOVERLAPPING 020000000004ef8d404dd6abb30a4b1153bd3a6907cc9791 1.67 GB",
"[2498-2660] 1 DATA NONOVERLAPPING 020000000009d6c6404dd6abb30a4b1153bd3a6907cc9791 1.39 GB",
"[2661-2837] 1 DATA NONOVERLAPPING 02000000000c68e7404dd6abb30a4b1153bd3a6907cc9791 1.55 GB",
"[2838-3175] 1 DATA NONOVERLAPPING 0200000000111e30404dd6abb30a4b1153bd3a6907cc9791 1.76 GB",
"[3176-3479] 1 DATA NONOVERLAPPING 02000000001433a5404dd6abb30a4b1153bd3a6907cc9791 1.69 GB",
"[3480-3649] 1 DATA NONOVERLAPPING 0200000006071897364d901ceb01ab76c649f86a9b155495 1.44 GB",
"[3650-3802] 1 DATA NONOVERLAPPING 02000000060c49a7364d901ceb01ab76c649f86a9b155495 1.41 GB",
"[3803-4115] 1 DATA NONOVERLAPPING 02000000061d32ad364d901ceb01ab76c649f86a9b155495 1.74 GB",
"[4116-4262] 1 DATA NONOVERLAPPING 020000000621a0e0364d901ceb01ab76c649f86a9b155495 1.44 GB",
"[4263-4404] 1 DATA NONOVERLAPPING 0200000006257c76364d901ceb01ab76c649f86a9b155495 1.45 GB",
"[4405-4586] 1 DATA NONOVERLAPPING 02000000062db6b2364d901ceb01ab76c649f86a9b155495 1.49 GB",
"[4587-4804] 1 DATA NONOVERLAPPING 020000000636f695364d901ceb01ab76c649f86a9b155495 1.58 GB",
"[4805-4946] 1 DATA NONOVERLAPPING 02000000063a748b364d901ceb01ab76c649f86a9b155495 1.47 GB",
"[4947-5184] 1 DATA NONOVERLAPPING 020000000642e10d364d901ceb01ab76c649f86a9b155495 1.61 GB",
"[5185-5475] 1 DATA NONOVERLAPPING 020000000656d690364d901ceb01ab76c649f86a9b155495 1.72 GB",
"[5476-5710] 1 DATA NONOVERLAPPING 02000000065c00c7364d901ceb01ab76c649f86a9b155495 1.61 GB",
"[5711-5862] 1 DATA NONOVERLAPPING 020000000660479c364d901ceb01ab76c649f86a9b155495 1.47 GB",
"[5863-6170] 1 DATA NONOVERLAPPING 02000000066c5309364d901ceb01ab76c649f86a9b155495 1.79 GB",
"[6171-6531] 1 DATA NONOVERLAPPING 0200000006865968364d901ceb01ab76c649f86a9b155495 1.72 GB",
"[6532-6731] 1 DATA NONOVERLAPPING 02000000069ba00c364d901ceb01ab76c649f86a9b155495 941.68 MB"
],
"missing_rowsets": [],
"stale_rowsets": [],
"stale version path": []
}[ec2-user@doris_sg4 ~]$ curl "http://172.31.19.176:8040/api/compaction/show?tablet_id=10982713"
{
"cumulative policy type": "time_series",
"cumulative point": -1,
"last cumulative failure time": "2024-08-05 11:55:21.087",
"last base failure time": "1970-01-01 00:00:00.000",
"last full failure time": null,
"last cumulative success time": "1970-01-01 00:00:00.000",
"last base success time": "1970-01-01 00:00:00.000",
"last full success time": "1970-01-01 00:00:00.000",
"last base schedule time": "1970-01-01 00:00:00.000",
"last base status": "",
"fetch from peer": "172.31.20.199:8060",
"rowsets": [
"[0-1] 0 DATA OVERLAP_UNKNOWN 02000000002178b32b4025067860863187f374ba931ce18d 0",
"[2-373] 1 DATA NONOVERLAPPING 020000000021951d2b4025067860863187f374ba931ce18d 1.95 GB",
"[374-764] 1 DATA NONOVERLAPPING 02000000002dedf52b4025067860863187f374ba931ce18d 1.95 GB",
"[765-1178] 1 DATA NONOVERLAPPING 02000000003217962b4025067860863187f374ba931ce18d 1.90 GB",
"[1179-1534] 1 DATA NONOVERLAPPING 0200000000364c452b4025067860863187f374ba931ce18d 1.66 GB",
"[1535-1887] 1 DATA NONOVERLAPPING 02000000003bb5d22b4025067860863187f374ba931ce18d 1.68 GB",
"[1888-2187] 1 DATA NONOVERLAPPING 020000000001e514404dd6abb30a4b1153bd3a6907cc9791 1.70 GB",
"[2188-2497] 1 DATA NONOVERLAPPING 020000000004ef8d404dd6abb30a4b1153bd3a6907cc9791 1.67 GB",
"[2498-2660] 1 DATA NONOVERLAPPING 020000000009d6c6404dd6abb30a4b1153bd3a6907cc9791 1.39 GB",
"[2661-2837] 1 DATA NONOVERLAPPING 02000000000c68e7404dd6abb30a4b1153bd3a6907cc9791 1.55 GB",
"[2838-3175] 1 DATA NONOVERLAPPING 0200000000111e30404dd6abb30a4b1153bd3a6907cc9791 1.76 GB",
"[3176-3479] 1 DATA NONOVERLAPPING 02000000001433a5404dd6abb30a4b1153bd3a6907cc9791 1.69 GB",
"[3480-3649] 1 DATA NONOVERLAPPING 02000000011fc331624745c4839e784701ab81c25ed9b8a5 1.44 GB",
"[3650-3802] 1 DATA NONOVERLAPPING 02000000011fc332624745c4839e784701ab81c25ed9b8a5 1.41 GB",
"[3803-4115] 1 DATA NONOVERLAPPING 02000000011fc333624745c4839e784701ab81c25ed9b8a5 1.74 GB",
"[4116-4262] 1 DATA NONOVERLAPPING 02000000011fc334624745c4839e784701ab81c25ed9b8a5 1.44 GB",
"[4263-4404] 1 DATA NONOVERLAPPING 02000000011fc335624745c4839e784701ab81c25ed9b8a5 1.45 GB",
"[4405-4586] 1 DATA NONOVERLAPPING 02000000011fc336624745c4839e784701ab81c25ed9b8a5 1.49 GB",
"[4587-4804] 1 DATA NONOVERLAPPING 02000000011fc337624745c4839e784701ab81c25ed9b8a5 1.58 GB",
"[4805-4946] 1 DATA NONOVERLAPPING 02000000011fc338624745c4839e784701ab81c25ed9b8a5 1.47 GB",
"[4947-5184] 1 DATA NONOVERLAPPING 02000000011fc339624745c4839e784701ab81c25ed9b8a5 1.61 GB",
"[5185-5475] 1 DATA NONOVERLAPPING 02000000011fc33a624745c4839e784701ab81c25ed9b8a5 1.72 GB",
"[5476-5710] 1 DATA NONOVERLAPPING 02000000011fc33b624745c4839e784701ab81c25ed9b8a5 1.61 GB",
"[5711-5862] 1 DATA NONOVERLAPPING 02000000011fc33c624745c4839e784701ab81c25ed9b8a5 1.47 GB",
"[5863-6170] 1 DATA NONOVERLAPPING 02000000011fc33d624745c4839e784701ab81c25ed9b8a5 1.79 GB",
"[6171-6531] 1 DATA NONOVERLAPPING 02000000011fc33e624745c4839e784701ab81c25ed9b8a5 1.72 GB",
"[6532-6731] 1 DATA NONOVERLAPPING 02000000011fc33f624745c4839e784701ab81c25ed9b8a5 941.68 MB"
],
"missing_rowsets": [],
"stale_rowsets": [],
"stale version path": []
}
这些信息里面版本是一致的 6731,也没有空洞版本呢。为什么会一致报错呢?
ALTER TABLE xxxx SET("enable_single_replica_compaction" = "false")
通过执行这个命令取消了 enable_single_replica_compaction 功能后错误消失,是开启这个功能需要什么先决条件么?