【已解决】[INTERNAL_ERROR]Failed to allocate s3 writer buffer for 60 seconds -- doris-2.0.5

Viewed 69

使用EXPORT对表中数据导出至s3,sql如下:

EXPORT TABLE
  doris_db.xxx
TO  "s3://export/xxx/"
PROPERTIES
(
    "label"="test_export_parallelism_2",
    "column_separator"=",",
    "delete_existing_files" = "true",
    "parallelism" = "2"
)
WITH s3
(
    "s3.endpoint" = "http://xxxxx",
    "s3.access_key" = "xxxxx",
    "s3.secret_key" = "xxxxx",
    "s3.region" = "xxxxx",
    "use_path_style" = "true"
);

测试环境3fe、3be。
show EXPORT WHERE LABEL like "%test_export_parallelism_2%";
查看导出结果报错为:

type:RUN_FAIL; msg:errCode = 2, detailMessage = (10.124.152.176)[INTERNAL_ERROR]Failed to allocate s3 writer buffer for 60 seconds

请问该如何解决这个问题?

1 Answers

be.conf 中调整这个参数,后重启BE节点:s3_write_buffer_whole_size ,默认是52428800字节,可以调大一些试试