Doris 2.1.0 版本 load 数据找不到文件问题

Viewed 39

从HDFS LOAD 数据,执行的LOAD 语句 :
LOAD LABEL test.test(
DATA INFILE("hdfs://host:port/doris_export/tmp/test/*")
INTO TABLE test
COLUMNS TERMINATED BY "," (key1,key2,key3)
)
with HDFS (
"fs.defaultFS"="hdfs://host:port/",
"hadoop.username" = "user_test",
"dfs.namenode.kerberos.principal" = "hdfs/_HOST@test.COM",
"hadoop.security.authentication" = "kerberos",
"hadoop.kerberos.principal" = "scapp@test.COM",
"hadoop.kerberos.keytab" = "/data1/doris-2.0.4/test.keytab"
)
PROPERTIES(
"timeout"="1200",
"max_filter_ratio"="0.1"

);
DATA INFILE("hdfs://host:port/doris_export/tmp/test/") 配置的路径,但是通过BE日志查看,找不到文件,BE报错: 14:30:14.403462 126405 file_system.cpp:35] NOT_FOUND, No such file or directory), reason: RemoteException: File does not exist: /user/user_test/doris_export/tmp/test/。查找文件的路径和DATA INFILE 配置路径有差异。

2 Answers

【问题状态】已处理
【问题处理】fs.defaultFS 的 hdfs://host:port/ 改成 hdfs://host:port,去掉尾部的/

指定了具体文件,还是有问题。问题点 DATA INFILE 配置的路径 和 BE 查找数据的路径不一致。