【已记录】Routine load任务数据实时写入,多资源组下同一tablet存在写入不及时情况,如何规避?

Viewed 76

Doris版本: 2.1.3

Doris集群现在有两个Resource Group,一个是default,一个ad_group;
有一张表两个副本,一个副本在default分组中,一个副本在ad_group;
现在routine load任务实时写入这张表,有副本写得快,有副本写的慢,导致查询这张表时会报以下错误,有没有办法规避掉以下问题?

Cause: java.sql.SQLException: errCode = 2, detailMessage = tablet 8215840 has no queryable replicas. err: Replica on backend 8225074 with tag {"location" : "ad_group"}, which is not in user's resource tags: [{"location" : "default"}]

补充1:建表语句

PROPERTIES (
"replication_allocation" = "tag.location.default: 1, tag.location.ad_group: 1",
"min_load_replica_num" = "-1",
"dynamic_partition.enable" = "true",
"dynamic_partition.time_unit" = "DAY",
"dynamic_partition.start" = "-90",
"dynamic_partition.end" = "3",
"dynamic_partition.prefix" = "p",
"dynamic_partition.replication_allocation" = "tag.location.default: 1, tag.location.ad_group: 1",
"dynamic_partition.buckets" = "8",
"dynamic_partition.create_history_partition" = "true",
"dynamic_partition.history_partition_num" = "-1",
"storage_policy" = "oss_policy"
);

补充2:

副本没问题,现在发现是跟存储策略有关,两个Resource Group,创建表(两副本,且每个资源组中有一个副本)时,不管设置dynamic_partition.storage_policy还是默认storage_policy,写入数据后,仅有单个资源组权限的用户都不能查询

1 Answers

这种是有一个节点visible成功了,另一个节点没visible成功,那个节点可能有问题,比如负载很高,或者队列满了,执行一下 show tablet 8215840 看下这个tablet的副本状态


建表语句能看一下吗?