自制doris2.0.4镜像docker部署一Fe和一Be集群,Be启动不会自动注册到Fe

Viewed 323

1.环境使用的是window10专业版安装的 Docker Desktop在wsl2子系统用的是CentOs7.x

2.doris2.0.4的fe和be镜像构建

下载https://doris.apache.org/download/最新的二进制包解压

2.2 fe2.0.4镜像构建脚本

...
# 选择基础镜像
FROM openjdk:8u342-jdk

# 设置环境变量
ENV JAVA_HOME="/usr/local/openjdk-8/"
PATH="/opt/apache-doris/fe/bin:$PATH"

# 下载软件至镜像内,可根据需要替换
COPY ./resource/fe /opt/fe

RUN apt-get update &&
apt-get install -y default-mysql-client &&
apt-get clean &&
mkdir /opt/apache-doris &&
cd /opt &&
mv ./fe/ /opt/apache-doris/

RUN chmod 755 /opt/apache-doris/fe/bin/init_fe.sh

ENTRYPOINT ["/bin/bash","/opt/apache-doris/fe/bin/init_fe.sh"]
...
resource下放的是2.0.4源码包中的fe文件夹

image.png
且在fe的bin目录中放入了:
image.png

2.3 be2.0.4镜像构建

'''
# 选择基础镜像
FROM openjdk:8u342-jdk

# 设置环境变量
ENV JAVA_HOME="/usr/local/openjdk-8/"
PATH="/opt/apache-doris/be/bin:$PATH"

# 下载软件至镜像内,可根据需要替换
COPY ./resource/be /opt/be

RUN apt-get update &&
apt-get install -y default-mysql-client &&
apt-get clean &&
mkdir /opt/apache-doris &&
cd /opt &&
mv ./be/ /opt/apache-doris/

RUN chmod 755 /opt/apache-doris/be/bin/init_be.sh

ENTRYPOINT ["/bin/bash","/opt/apache-doris/be/bin/init_be.sh"]
'''

同fe一样在reource里放入:
image.png
be的bin下放入:
image.png

fe和be中的init脚本是从2.0.4的源码包中:
https://github.com/apache/doris/releases
image.png
image.png
拷贝到上面的构建文件中的
如果是在windows下直接打开复制过去的,会有让shell文件的格式有问题,镜像运行的时候报初始化脚本\r问题,所以需要在wsl进入centOs子系统中执行如下:
sed -i 's/\r$//' filename
将init_fe.sh/init_be.sh格式转为linux下的格式

3.启动脚本如下

...
docker network create --subnet=172.10.70.0/24 doris-network

docker network rm doris-network

docker run --privileged -itd --name=fe --env FE_SERVERS="fe1:172.10.70.2:9010" --env FE_ID=1 -p 8030:8030 -p 9030:9030 -v D:\doris\fe\doris-meta:/opt/apache-doris/fe/doris-meta -v D:\doris\fe\log:/opt/apache-doris/fe/log -v D:\doris\fe\conf\fe.conf:/opt/apache-doris/fe/conf/fe.conf --network=doris-network --ip=172.10.70.2 apache-doris:2.0.4-fe

docker run --privileged -itd --name=be --env FE_SERVERS="fe1:172.10.70.2:9010" --env BE_ADDR="172.10.70.3:9050" -p 8040:8040 -v D:\doris\be\storage:/opt/apache-doris/be/storage -v D:\doris\be\log:/opt/apache-doris/be/log -v D:\doris\be\conf\be.conf:/opt/apache-doris/be/conf/be.conf --network=doris-network --ip=172.10.70.3 apache-doris:2.0.4-be

...

3.1 fe挂载文件如下

image.png
image.png

3.2 be挂载文件如下

image.png
image.png

fe.conf和be.conf都是从容器中没有挂载启动起来,然后下载下来放到上面的挂载路径中的

3.3 fe启动日志

image.png

3.4 be启动日志

image.png

be日志一直是打印的是be自动注册fe失败

3.5 进入be容器启动be

进入be命令行也执行了:
sysctl -w vm.max_map_count=2000000
启动bex需要先将swapoff关闭
swapoff -a
/opt/apache-doris/be/bin/start_be.sh --daemon

3.6 进入fe容器手动注册be

进入fe命令行执行了:
sysctl -w vm.max_map_count=2000000

进入fe命令行手动注册be如下:
# 进入一台有mysql的服务器,端口9093,账号root,默认密码是空
mysql -h 172.10.70.2 -P9030 -uroot

# 注册be
ALTER SYSTEM ADD BACKEND "172.10.70.3:9050";

# 查看be Alive属性如果是true就ok了
show PROC '/backends';

+-----------+-------------+---------------+--------+----------+----------+---------------------+---------------------+-------+----------------------+-----------+------------------+--------------------+---------------+---------------+---------+----------------+--------------------+--------------------------+--------+-----------------------------+-------------------------------------------------------------------------------------------------------------------------------+-------------------------+----------+
| BackendId | Host | HeartbeatPort | BePort | HttpPort | BrpcPort | LastStartTime | LastHeartbeat | Alive | SystemDecommissioned | TabletNum | DataUsedCapacity | TrashUsedCapcacity | AvailCapacity | TotalCapacity | UsedPct | MaxDiskUsedPct | RemoteUsedCapacity | Tag | ErrMsg | Version | Status | HeartbeatFailureCounter | NodeRole |
+-----------+-------------+---------------+--------+----------+----------+---------------------+---------------------+-------+----------------------+-----------+------------------+--------------------+---------------+---------------+---------+----------------+--------------------+--------------------------+--------+-----------------------------+-------------------------------------------------------------------------------------------------------------------------------+-------------------------+----------+
| 10114 | 172.10.70.3 | 9050 | 9060 | 8040 | 8060 | 2024-02-28 01:10:51 | 2024-02-28 01:13:39 | true | false | 14 | 0.000 | 0.000 | 8.397 GB | 57.028 GB | 85.28 % | 85.28 % | 0.000 | {"location" : "default"} | | doris-2.0.4-rc06-003a815b63 | {"lastSuccessReportTabletsTime":"2024-02-28 01:13:03","lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false} | 0 | mix |
+-----------+-------------+---------------+--------+----------+----------+---------------------+---------------------+-------+----------------------+-----------+------------------+--------------------+---------------+---------------+---------+----------------+--------------------+--------------------------+--------+-----------------------------+-------------------------------------------------------------------------------------------------------------------------------+-------------------------+----------+

4.doris后台

image.png

5.使用navicat客户端连接如下

使用的地址是127.0.0.1/localhost/wifi地址是可以连上的,但是使用docker的桥接内网地址172.10.70.2是连不上的,端口是9030
image.png
image.png
到此我这种方式是不是就已经将doris镜像构建和部署1fe和1be集群搞好了?

6.本地构建的镜像推送到阿里云镜像仓库如下
registry.cn-hangzhou.aliyuncs.com/bigfei/zlf:apache-doris-2.0.4-fe
registry.cn-hangzhou.aliyuncs.com/bigfei/zlf:apache-doris-2.0.4-be

我只是在构建doris2.0.4的fe和be镜像部署1fe和1be的集群遇到这个be注册不上的问题,之前根据官网的部署1fe和1be的docker命令使用的是 --net=host 网络模式 ip一开始是使用本机wifi地址192.168.40.60,fe启动报wifi那个ip:80有问题,后面将wifi地址换成127.0.0.1只有fe可以启动,be也是注册不上,然后又搞了一个桥接网络192.168.40.0/24,然后也是只有fe可以启动,be也是注册不上,最后,搞了一个172.10.70.0/24 桥接网路,也是只有fe可以启动,be还是注册不上,上面是我构建好的镜像,大佬,在看这个问题的时候可以直接使用,或者根据上面的步骤一步一步的搞,还有我感觉这个ip需要是一个固定的公网ip,所以在一台主机上使用docker方式部署集群由于本机网络环境复制就会有这种奇葩的问题,多台部署应该就没有这种问题吧,这个问题在线等大佬回复,非常感谢!

2 Answers

需要几个步骤来解决

  1. 所有启动命令里的 conf 目录的映射关系请删除
    -v D:\doris\be\conf\be.conf:/opt/apache-doris/be/conf/be.conf
  2. 麻烦在BE启动以后,查看BE的be.INFO日志,观察报错信息

我把之前的那个be容器删除之后重启启动了一个
docker run --privileged -itd --name=be --env FE_SERVERS="fe1:172.10.70.2:9010" --env BE_ADDR="172.10.70.3:9050" -p 8040:8040 -v D:\doris\be\storage:/opt/apache-doris/be/storage -v D:\doris\be\log:/opt/apache-doris/be/log --network=doris-network --ip=172.10.70.3 apache-doris:2.0.4-be

storage/log全部删除之后,新启动的容器这两个storage/log是空的
image.png

重启新手动启动后:
image.png

I0228 03:47:27.023309  1835 daemon.cpp:432]  version doris-2.0.4-rc06(AVX2) RELEASE (build git://VM-0-45-ubuntu@003a815b6329f7dc795dc890e32e2d37ed58a1e3)
Built on Sun, 21 Jan 2024 19:01:40 CST by VM-0-45-ubuntu
W0228 03:47:27.047876  1835 cpu_info.cpp:206] /sys/devices/system/node is not present - no NUMA support
I0228 03:47:27.081018  1835 mem_info.cpp:463] Physical Memory: 7.70 GB, Mem Limit: 6.16 GB, origin config value: 80%, System Mem Available Min Reserve: 788.04 MB, Vm Min Free KBytes: 66.00 MB, Vm Overcommit Memory: 0
I0228 03:47:27.097692  1835 daemon.cpp:440] Cpu Info:
  Model: Intel(R) Core(TM) i5-9400 CPU @ 2.90GHz
  Cores: 6
  Max Possible Cores: 6
  L1 Cache: 32.00 KB (Line: 64.00 B)
  L2 Cache: 256.00 KB (Line: 64.00 B)
  L3 Cache: 9.00 MB (Line: 64.00 B)
  Hardware Supports:
    ssse3
    sse4_1
    sse4_2
    popcnt
    avx
    avx2
  Numa Nodes: 1
  Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 |
I0228 03:47:27.103811  1835 daemon.cpp:441] Disk Info: 
  Num disks 7: ram, loop, sda, sdb, sdc, sdd, sde
I0228 03:47:27.103827  1835 daemon.cpp:442] Physical Memory: 7.70 GB
Memory Limt: 6.16 GB
CGroup Info: Process CGroup Info: memory.limit_in_bytes=9223372036854771712, cpu cfs limits: unlimited
I0228 03:47:27.108847  1835 backend_options.cpp:62] local host ip=172.10.70.3
I0228 03:47:27.146015  1835 timezone_utils.cpp:269] Read 187 timezones.
I0228 03:47:27.168900  1835 task_scheduler.cpp:51] BlockedTaskScheduler start
I0228 03:47:27.174058  1835 task_scheduler.cpp:58] BlockedTaskScheduler started
I0228 03:47:27.174309  1835 task_scheduler.cpp:51] BlockedTaskScheduler start
I0228 03:47:27.185168  1835 task_scheduler.cpp:58] BlockedTaskScheduler started
I0228 03:47:27.185781  2110 fragment_mgr.cpp:1071] FragmentMgr cancel worker start working.
E0228 03:47:27.415477  1835 variable.cpp:179] Already exposed `doris_cache_obj_lrucache' whose value is `0'
E0228 03:47:27.416833  1835 variable.cpp:179] Already exposed `doris_cache_obj_lrucache_persecond' whose value is `0'
I0228 03:47:27.418768  1835 load_path_mgr.cpp:71] Load path configured to [/opt/apache-doris/be/storage/mini_download]
I0228 03:47:27.418816  2187 result_buffer_mgr.cpp:147] result buffer manager cancel thread begin.
E0228 03:47:27.542943  1835 variable.cpp:179] Already exposed `doris_cache_data_page_cache' whose value is `0'
E0228 03:47:27.547261  1835 variable.cpp:179] Already exposed `doris_cache_data_page_cache_persecond' whose value is `0'
E0228 03:47:27.549423  1835 variable.cpp:179] Already exposed `doris_cache_index_page_cache' whose value is `0'
E0228 03:47:27.554360  1835 variable.cpp:179] Already exposed `doris_cache_index_page_cache_persecond' whose value is `0'
E0228 03:47:27.557586  1835 variable.cpp:179] Already exposed `doris_cache_pkindex_page_cache' whose value is `0'
E0228 03:47:27.561249  1835 variable.cpp:179] Already exposed `doris_cache_pkindex_page_cache_persecond' whose value is `0'
I0228 03:47:27.563237  1835 exec_env_init.cpp:258] Storage page cache memory limit: 1.23 GB, origin config value: 20%
E0228 03:47:27.563388  1835 variable.cpp:179] Already exposed `doris_cache_row_cache' whose value is `0'
E0228 03:47:27.564658  1835 variable.cpp:179] Already exposed `doris_cache_row_cache_persecond' whose value is `0'
I0228 03:47:27.568385  1835 exec_env_init.cpp:271] Row cache memory limit: 1.23 GB, origin config value: 20%
I0228 03:47:27.568454  1835 exec_env_init.cpp:290] segment_cache_capacity <= fd_number * 2 / 5, fd_number: 1048576 segment_cache_capacity: 419430
E0228 03:47:27.568572  1835 variable.cpp:179] Already exposed `doris_cache_segment_cache' whose value is `0'
E0228 03:47:27.587329  1835 variable.cpp:179] Already exposed `doris_cache_segment_cache_persecond' whose value is `0'
E0228 03:47:27.600383  1835 variable.cpp:179] Already exposed `doris_cache_schema_cache' whose value is `0'
E0228 03:47:27.618526  1835 variable.cpp:179] Already exposed `doris_cache_schema_cache_persecond' whose value is `0'
E0228 03:47:27.625051  1835 variable.cpp:179] Already exposed `doris_cache_lookup_connection_cache' whose value is `0'
E0228 03:47:27.629484  1835 variable.cpp:179] Already exposed `doris_cache_lookup_connection_cache_persecond' whose value is `0'
I0228 03:47:27.632139  1835 inverted_index_cache.cpp:80] fd_number: 1048576, inverted index open searcher limit: 419430
E0228 03:47:27.636649  1835 variable.cpp:179] Already exposed `doris_cache_inverted_index_searcher_cache' whose value is `0'
E0228 03:47:27.639393  1835 variable.cpp:179] Already exposed `doris_cache_inverted_index_searcher_cache_persecond' whose value is `0'
I0228 03:47:27.641844  1835 exec_env_init.cpp:307] Inverted index searcher cache memory limit: 630.43 MB, origin config value: 10%
E0228 03:47:27.641932  1835 variable.cpp:179] Already exposed `doris_cache_inverted_index_query_cache' whose value is `0'
E0228 03:47:27.646136  1835 variable.cpp:179] Already exposed `doris_cache_inverted_index_query_cache_persecond' whose value is `0'
I0228 03:47:27.648694  1835 exec_env_init.cpp:320] Inverted index query match cache memory limit: 630.43 MB, origin config value: 10%
E0228 03:47:27.686553  1835 variable.cpp:179] Already exposed `doris_cache_lastest_success_channel_cache' whose value is `0'
E0228 03:47:27.688921  1835 variable.cpp:179] Already exposed `doris_cache_lastest_success_channel_cache_persecond' whose value is `0'
I0228 03:47:27.694733  1835 s3_file_write_bufferpool.cpp:78] S3 file buffer pool with 100 buffers
I0228 03:47:27.714146  1876 daemon.cpp:218] os physical memory 7.70 GB. process memory used 868.64 MB, limit 6.16 GB, soft limit 5.54 GB. sys available memory 4.84 GB, low water mark 788.04 MB, warning water mark 1.54 GB. Refresh interval memory growth 0 B
I0228 03:47:27.916697  1876 daemon.cpp:218] os physical memory 7.70 GB. process memory used 1.13 GB, limit 6.16 GB, soft limit 5.54 GB. sys available memory 4.56 GB, low water mark 788.04 MB, warning water mark 1.54 GB. Refresh interval memory growth 0 B
I0228 03:47:28.012404  1835 storage_engine.cpp:108] starting backend using uid:074bb427ee3193c3-2235815533da4782
E0228 03:47:28.012630  1835 variable.cpp:179] Already exposed `doris_cache_tablet_version_cache' whose value is `0'
E0228 03:47:28.014283  1835 variable.cpp:179] Already exposed `doris_cache_tablet_version_cache_persecond' whose value is `0'
I0228 03:47:28.020931  2851 data_dir.cpp:853] path: /opt/apache-doris/be/storage total capacity: 61233729536, available capacity: 9015390208
I0228 03:48:02.574944  2851 data_dir.cpp:191] path: /opt/apache-doris/be/storage, hash: 17886382994037300539
I0228 03:48:02.603941  2851 olap_meta.cpp:68] [Rocksdb] RocksDB version: 5.14.2
I0228 03:48:02.603960  2851 olap_meta.cpp:68] [Rocksdb] Git sha rocksdb_build_git_sha:8586594e0073a653c11d1d0aafc4aa0f4db64b84
I0228 03:48:02.603962  2851 olap_meta.cpp:68] [Rocksdb] Compile date Jan 13 2024
I0228 03:48:02.603965  2851 olap_meta.cpp:68] [Rocksdb] DB SUMMARY
I0228 03:48:02.605289  2851 olap_meta.cpp:68] [Rocksdb] [ERROR] Error when reading /opt/apache-doris/be/storage/meta dir
I0228 03:48:02.605342  2851 olap_meta.cpp:68] [Rocksdb] SST files in /opt/apache-doris/be/storage/meta dir, Total Num: 0, files: 
I0228 03:48:02.606925  2851 olap_meta.cpp:68] [Rocksdb] Write Ahead Log file in /opt/apache-doris/be/storage/meta: 
I0228 03:48:02.606940  2851 olap_meta.cpp:68] [Rocksdb]                         Options.error_if_exists: 0
I0228 03:48:02.606942  2851 olap_meta.cpp:68] [Rocksdb]                       Options.create_if_missing: 1
I0228 03:48:02.606945  2851 olap_meta.cpp:68] [Rocksdb]                         Options.paranoid_checks: 1
I0228 03:48:02.608247  2851 olap_meta.cpp:68] [Rocksdb]                                     Options.env: 0x55fe59e60760
I0228 03:48:02.608258  2851 olap_meta.cpp:68] [Rocksdb]                                Options.info_log: 0x7f945d790a00
I0228 03:48:02.608259  2851 olap_meta.cpp:68] [Rocksdb]                Options.max_file_opening_threads: 16
I0228 03:48:02.608263  2851 olap_meta.cpp:68] [Rocksdb]                              Options.statistics: (nil)
I0228 03:48:02.608263  2851 olap_meta.cpp:68] [Rocksdb]                               Options.use_fsync: 0
I0228 03:48:02.609515  2851 olap_meta.cpp:68] [Rocksdb]                       Options.max_log_file_size: 0
I0228 03:48:02.609524  2851 olap_meta.cpp:68] [Rocksdb]                  Options.max_manifest_file_size: 18446744073709551615
I0228 03:48:02.609525  2851 olap_meta.cpp:68] [Rocksdb]                   Options.log_file_time_to_roll: 0
I0228 03:48:02.609527  2851 olap_meta.cpp:68] [Rocksdb]                       Options.keep_log_file_num: 1000
I0228 03:48:02.613839  2851 olap_meta.cpp:68] [Rocksdb]                    Options.recycle_log_file_num: 0
I0228 03:48:02.613878  2851 olap_meta.cpp:68] [Rocksdb]                         Options.allow_fallocate: 1
I0228 03:48:02.613880  2851 olap_meta.cpp:68] [Rocksdb]                        Options.allow_mmap_reads: 0
I0228 03:48:02.613883  2851 olap_meta.cpp:68] [Rocksdb]                       Options.allow_mmap_writes: 0
I0228 03:48:02.613884  2851 olap_meta.cpp:68] [Rocksdb]                        Options.use_direct_reads: 0
I0228 03:48:02.617416  2851 olap_meta.cpp:68] [Rocksdb]                        Options.use_direct_io_for_flush_and_compaction: 0
I0228 03:48:02.617431  2851 olap_meta.cpp:68] [Rocksdb]          Options.create_missing_column_families: 1
I0228 03:48:02.617434  2851 olap_meta.cpp:68] [Rocksdb]                              Options.db_log_dir: 
I0228 03:48:02.617439  2851 olap_meta.cpp:68] [Rocksdb]                                 Options.wal_dir: /opt/apache-doris/be/storage/meta
I0228 03:48:02.618888  2851 olap_meta.cpp:68] [Rocksdb]                Options.table_cache_numshardbits: 6
I0228 03:48:02.618897  2851 olap_meta.cpp:68] [Rocksdb]                      Options.max_subcompactions: 1
I0228 03:48:02.618899  2851 olap_meta.cpp:68] [Rocksdb]                  Options.max_background_flushes: -1
I0228 03:48:02.618904  2851 olap_meta.cpp:68] [Rocksdb]                         Options.WAL_ttl_seconds: 0
I0228 03:48:02.618906  2851 olap_meta.cpp:68] [Rocksdb]                       Options.WAL_size_limit_MB: 0
I0228 03:48:02.620162  2851 olap_meta.cpp:68] [Rocksdb]             Options.manifest_preallocation_size: 4194304
I0228 03:48:02.620174  2851 olap_meta.cpp:68] [Rocksdb]                     Options.is_fd_close_on_exec: 1
I0228 03:48:02.620177  2851 olap_meta.cpp:68] [Rocksdb]                   Options.advise_random_on_open: 1
I0228 03:48:02.620179  2851 olap_meta.cpp:68] [Rocksdb]                    Options.db_write_buffer_size: 0
I0228 03:48:02.620182  2851 olap_meta.cpp:68] [Rocksdb]                    Options.write_buffer_manager: 0x7f945d790a80
I0228 03:48:02.622143  2851 olap_meta.cpp:68] [Rocksdb]         Options.access_hint_on_compaction_start: 1
I0228 03:48:02.622159  2851 olap_meta.cpp:68] [Rocksdb]  Options.new_table_reader_for_compaction_inputs: 0
I0228 03:48:02.622161  2851 olap_meta.cpp:68] [Rocksdb]           Options.random_access_max_buffer_size: 1048576
I0228 03:48:02.622164  2851 olap_meta.cpp:68] [Rocksdb]                      Options.use_adaptive_mutex: 0
I0228 03:48:02.622166  2851 olap_meta.cpp:68] [Rocksdb]                            Options.rate_limiter: (nil)
I0228 03:48:02.623303  2851 olap_meta.cpp:68] [Rocksdb]     Options.sst_file_manager.rate_bytes_per_sec: 0
I0228 03:48:02.623313  2851 olap_meta.cpp:68] [Rocksdb]                       Options.wal_recovery_mode: 2
I0228 03:48:02.623317  2851 olap_meta.cpp:68] [Rocksdb]                  Options.enable_thread_tracking: 0
I0228 03:48:02.623318  2851 olap_meta.cpp:68] [Rocksdb]                  Options.enable_pipelined_write: 0
I0228 03:48:02.624413  2851 olap_meta.cpp:68] [Rocksdb]         Options.allow_concurrent_memtable_write: 1
I0228 03:48:02.624421  2851 olap_meta.cpp:68] [Rocksdb]      Options.enable_write_thread_adaptive_yield: 1
I0228 03:48:02.624424  2851 olap_meta.cpp:68] [Rocksdb]             Options.write_thread_max_yield_usec: 100
I0228 03:48:02.624426  2851 olap_meta.cpp:68] [Rocksdb]            Options.write_thread_slow_yield_usec: 3
I0228 03:48:02.624428  2851 olap_meta.cpp:68] [Rocksdb]                               Options.row_cache: None
I0228 03:48:02.625669  2851 olap_meta.cpp:68] [Rocksdb]                              Options.wal_filter: None
I0228 03:48:02.625725  2851 olap_meta.cpp:68] [Rocksdb]             Options.avoid_flush_during_recovery: 0
I0228 03:48:02.625733  2851 olap_meta.cpp:68] [Rocksdb]             Options.allow_ingest_behind: 0
I0228 03:48:02.625735  2851 olap_meta.cpp:68] [Rocksdb]             Options.preserve_deletes: 0
I0228 03:48:02.625737  2851 olap_meta.cpp:68] [Rocksdb]             Options.two_write_queues: 0
I0228 03:48:02.629719  2851 olap_meta.cpp:68] [Rocksdb]             Options.manual_wal_flush: 0
I0228 03:48:02.629765  2851 olap_meta.cpp:68] [Rocksdb]             Options.max_background_jobs: 16
I0228 03:48:02.629766  2851 olap_meta.cpp:68] [Rocksdb]             Options.max_background_compactions: -1
I0228 03:48:02.629770  2851 olap_meta.cpp:68] [Rocksdb]             Options.avoid_flush_during_shutdown: 0
I0228 03:48:02.629772  2851 olap_meta.cpp:68] [Rocksdb]           Options.writable_file_max_buffer_size: 1048576
I0228 03:48:02.633750  2851 olap_meta.cpp:68] [Rocksdb]             Options.delayed_write_rate : 16777216
I0228 03:48:02.633781  2851 olap_meta.cpp:68] [Rocksdb]             Options.max_total_wal_size: 0
I0228 03:48:02.633785  2851 olap_meta.cpp:68] [Rocksdb]             Options.delete_obsolete_files_period_micros: 21600000000
I0228 03:48:02.633787  2851 olap_meta.cpp:68] [Rocksdb]                   Options.stats_dump_period_sec: 600
I0228 03:48:02.633790  2851 olap_meta.cpp:68] [Rocksdb]                          Options.max_open_files: -1
I0228 03:48:02.636144  2851 olap_meta.cpp:68] [Rocksdb]                          Options.bytes_per_sync: 0
I0228 03:48:02.636162  2851 olap_meta.cpp:68] [Rocksdb]                      Options.wal_bytes_per_sync: 0
I0228 03:48:02.636164  2851 olap_meta.cpp:68] [Rocksdb]       Options.compaction_readahead_size: 0
I0228 03:48:02.636168  2851 olap_meta.cpp:68] [Rocksdb] Compression algorithms supported:
I0228 03:48:02.636173  2851 olap_meta.cpp:68] [Rocksdb] 	kZSTD supported: 1
I0228 03:48:02.637771  2851 olap_meta.cpp:68] [Rocksdb] 	kXpressCompression supported: 0
I0228 03:48:02.637797  2851 olap_meta.cpp:68] [Rocksdb] 	kBZip2Compression supported: 1
I0228 03:48:02.637799  2851 olap_meta.cpp:68] [Rocksdb] 	kZSTDNotFinalCompression supported: 1
I0228 03:48:02.637801  2851 olap_meta.cpp:68] [Rocksdb] 	kLZ4Compression supported: 1
I0228 03:48:02.637804  2851 olap_meta.cpp:68] [Rocksdb] 	kZlibCompression supported: 1
I0228 03:48:02.637804  2851 olap_meta.cpp:68] [Rocksdb] 	kLZ4HCCompression supported: 1
I0228 03:48:02.639714  2851 olap_meta.cpp:68] [Rocksdb] 	kSnappyCompression supported: 1
I0228 03:48:02.639731  2851 olap_meta.cpp:68] [Rocksdb] Fast CRC32 supported: Not supported on x86
I0228 03:48:02.710209  2851 olap_meta.cpp:68] [Rocksdb] [db/db_impl_open.cc:222] Creating manifest 1 
I0228 03:48:02.899861  2851 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3084] Recovering from manifest file: MANIFEST-000001
I0228 03:48:02.908754  2851 olap_meta.cpp:68] [Rocksdb] [db/column_family.cc:473] --------------- Options for column family [default]:
I0228 03:48:02.910828  2851 olap_meta.cpp:68] [Rocksdb]               Options.comparator: leveldb.BytewiseComparator
I0228 03:48:02.910841  2851 olap_meta.cpp:68] [Rocksdb]           Options.merge_operator: None
I0228 03:48:02.910843  2851 olap_meta.cpp:68] [Rocksdb]        Options.compaction_filter: None
I0228 03:48:02.910845  2851 olap_meta.cpp:68] [Rocksdb]        Options.compaction_filter_factory: None
I0228 03:48:02.913533  2851 olap_meta.cpp:68] [Rocksdb]         Options.memtable_factory: SkipListFactory
I0228 03:48:02.913548  2851 olap_meta.cpp:68] [Rocksdb]            Options.table_factory: BlockBasedTable
I0228 03:48:02.913609  2851 olap_meta.cpp:68] [Rocksdb]            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f965bc29058)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 0
  pin_l0_filter_and_index_blocks_in_cache: 0
  index_type: 0
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7f945d700c60
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
I0228 03:48:02.917191  2851 olap_meta.cpp:68] [Rocksdb]        Options.write_buffer_size: 67108864
I0228 03:48:02.917209  2851 olap_meta.cpp:68] [Rocksdb]  Options.max_write_buffer_number: 2
I0228 03:48:02.918308  2851 olap_meta.cpp:68] [Rocksdb]          Options.compression: Snappy
I0228 03:48:02.918315  2851 olap_meta.cpp:68] [Rocksdb]                  Options.bottommost_compression: Disabled
I0228 03:48:02.920461  2851 olap_meta.cpp:68] [Rocksdb]       Options.prefix_extractor: nullptr
I0228 03:48:02.920473  2851 olap_meta.cpp:68] [Rocksdb]   Options.memtable_insert_with_hint_prefix_extractor: nullptr
I0228 03:48:02.920480  2851 olap_meta.cpp:68] [Rocksdb]             Options.num_levels: 7
I0228 03:48:02.920481  2851 olap_meta.cpp:68] [Rocksdb]        Options.min_write_buffer_number_to_merge: 1
I0228 03:48:02.920487  2851 olap_meta.cpp:68] [Rocksdb]     Options.max_write_buffer_number_to_maintain: 0
I0228 03:48:02.922479  2851 olap_meta.cpp:68] [Rocksdb]            Options.compression_opts.window_bits: -14
I0228 03:48:02.922495  2851 olap_meta.cpp:68] [Rocksdb]                  Options.compression_opts.level: -1
I0228 03:48:02.922497  2851 olap_meta.cpp:68] [Rocksdb]               Options.compression_opts.strategy: 0
I0228 03:48:02.922530  2851 olap_meta.cpp:68] [Rocksdb]         Options.compression_opts.max_dict_bytes: 0
I0228 03:48:02.922534  2851 olap_meta.cpp:68] [Rocksdb]         Options.compression_opts.zstd_max_train_bytes: 0
I0228 03:48:02.922874  2851 olap_meta.cpp:68] [Rocksdb]      Options.level0_file_num_compaction_trigger: 4
I0228 03:48:02.922879  2851 olap_meta.cpp:68] [Rocksdb]          Options.level0_slowdown_writes_trigger: 20
I0228 03:48:02.922884  2851 olap_meta.cpp:68] [Rocksdb]              Options.level0_stop_writes_trigger: 36
I0228 03:48:02.922886  2851 olap_meta.cpp:68] [Rocksdb]                   Options.target_file_size_base: 67108864
I0228 03:48:02.928467  2851 olap_meta.cpp:68] [Rocksdb]             Options.target_file_size_multiplier: 1
I0228 03:48:02.928488  2851 olap_meta.cpp:68] [Rocksdb]                Options.max_bytes_for_level_base: 268435456
I0228 03:48:02.928493  2851 olap_meta.cpp:68] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0
I0228 03:48:02.928500  2851 olap_meta.cpp:68] [Rocksdb]          Options.max_bytes_for_level_multiplier: 10.000000
I0228 03:48:02.928503  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1
I0228 03:48:02.930480  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1
I0228 03:48:02.930532  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1
I0228 03:48:02.930537  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1
I0228 03:48:02.930539  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1
I0228 03:48:02.930541  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1
I0228 03:48:02.932379  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1
I0228 03:48:02.932396  2851 olap_meta.cpp:68] [Rocksdb]       Options.max_sequential_skip_in_iterations: 8
I0228 03:48:02.932399  2851 olap_meta.cpp:68] [Rocksdb]                    Options.max_compaction_bytes: 1677721600
I0228 03:48:02.932401  2851 olap_meta.cpp:68] [Rocksdb]                        Options.arena_block_size: 8388608
I0228 03:48:02.934804  2851 olap_meta.cpp:68] [Rocksdb]   Options.soft_pending_compaction_bytes_limit: 68719476736
I0228 03:48:02.934831  2851 olap_meta.cpp:68] [Rocksdb]   Options.hard_pending_compaction_bytes_limit: 274877906944
I0228 03:48:02.934835  2851 olap_meta.cpp:68] [Rocksdb]       Options.rate_limit_delay_max_milliseconds: 100
I0228 03:48:02.934837  2851 olap_meta.cpp:68] [Rocksdb]                Options.disable_auto_compactions: 0
I0228 03:48:02.934844  2851 olap_meta.cpp:68] [Rocksdb]                        Options.compaction_style: kCompactionStyleLevel
I0228 03:48:02.936765  2851 olap_meta.cpp:68] [Rocksdb]                          Options.compaction_pri: kByCompensatedSize
I0228 03:48:02.936781  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.size_ratio: 1
I0228 03:48:02.936784  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2
I0228 03:48:02.936785  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295
I0228 03:48:02.938768  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200
I0228 03:48:02.938786  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1
I0228 03:48:02.938791  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
I0228 03:48:02.938793  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824
I0228 03:48:02.941162  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0
I0228 03:48:02.941183  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.ttl: 0
I0228 03:48:02.941186  2851 olap_meta.cpp:68] [Rocksdb]                   Options.table_properties_collectors: 
I0228 03:48:02.941188  2851 olap_meta.cpp:68] [Rocksdb]                   Options.inplace_update_support: 0
I0228 03:48:02.941190  2851 olap_meta.cpp:68] [Rocksdb]                 Options.inplace_update_num_locks: 10000
I0228 03:48:02.943835  2851 olap_meta.cpp:68] [Rocksdb]               Options.memtable_prefix_bloom_size_ratio: 0.000000
I0228 03:48:02.943852  2851 olap_meta.cpp:68] [Rocksdb]   Options.memtable_huge_page_size: 0
I0228 03:48:02.943861  2851 olap_meta.cpp:68] [Rocksdb]                           Options.bloom_locality: 0
I0228 03:48:02.943863  2851 olap_meta.cpp:68] [Rocksdb]                    Options.max_successive_merges: 0
I0228 03:48:02.943866  2851 olap_meta.cpp:68] [Rocksdb]                Options.optimize_filters_for_hits: 0
I0228 03:48:02.946028  2851 olap_meta.cpp:68] [Rocksdb]                Options.paranoid_file_checks: 0
I0228 03:48:02.946050  2851 olap_meta.cpp:68] [Rocksdb]                Options.force_consistency_checks: 0
I0228 03:48:02.946053  2851 olap_meta.cpp:68] [Rocksdb]                Options.report_bg_io_stats: 0
I0228 03:48:02.946055  2851 olap_meta.cpp:68] [Rocksdb]                               Options.ttl: 0
I0228 03:48:02.992836  2851 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3350] Recovered from manifest file:/opt/apache-doris/be/storage/meta/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
I0228 03:48:02.994410  2851 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3367] Column family [default] (ID 0), log number is 0
I0228 03:48:03.021826  2851 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:2846] Creating manifest 4
I0228 03:48:03.069901  2851 olap_meta.cpp:68] [Rocksdb] [db/column_family.cc:473] --------------- Options for column family [doris]:
I0228 03:48:03.069931  2851 olap_meta.cpp:68] [Rocksdb]               Options.comparator: leveldb.BytewiseComparator
I0228 03:48:03.069933  2851 olap_meta.cpp:68] [Rocksdb]           Options.merge_operator: None
I0228 03:48:03.069938  2851 olap_meta.cpp:68] [Rocksdb]        Options.compaction_filter: None
I0228 03:48:03.069947  2851 olap_meta.cpp:68] [Rocksdb]        Options.compaction_filter_factory: None
I0228 03:48:03.071884  2851 olap_meta.cpp:68] [Rocksdb]         Options.memtable_factory: SkipListFactory
I0228 03:48:03.071903  2851 olap_meta.cpp:68] [Rocksdb]            Options.table_factory: BlockBasedTable
I0228 03:48:03.071933  2851 olap_meta.cpp:68] [Rocksdb]            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f965bc29060)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 0
  pin_l0_filter_and_index_blocks_in_cache: 0
  index_type: 0
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7f945d700cd0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
I0228 03:48:03.074947  2851 olap_meta.cpp:68] [Rocksdb]        Options.write_buffer_size: 67108864
I0228 03:48:03.074962  2851 olap_meta.cpp:68] [Rocksdb]  Options.max_write_buffer_number: 2
I0228 03:48:03.074966  2851 olap_meta.cpp:68] [Rocksdb]          Options.compression: Snappy
I0228 03:48:03.076452  2851 olap_meta.cpp:68] [Rocksdb]                  Options.bottommost_compression: Disabled
I0228 03:48:03.076467  2851 olap_meta.cpp:68] [Rocksdb]       Options.prefix_extractor: nullptr
I0228 03:48:03.076469  2851 olap_meta.cpp:68] [Rocksdb]   Options.memtable_insert_with_hint_prefix_extractor: nullptr
I0228 03:48:03.076478  2851 olap_meta.cpp:68] [Rocksdb]             Options.num_levels: 7
I0228 03:48:03.076479  2851 olap_meta.cpp:68] [Rocksdb]        Options.min_write_buffer_number_to_merge: 1
I0228 03:48:03.079463  2851 olap_meta.cpp:68] [Rocksdb]     Options.max_write_buffer_number_to_maintain: 0
I0228 03:48:03.079504  2851 olap_meta.cpp:68] [Rocksdb]            Options.compression_opts.window_bits: -14
I0228 03:48:03.079511  2851 olap_meta.cpp:68] [Rocksdb]                  Options.compression_opts.level: -1
I0228 03:48:03.079514  2851 olap_meta.cpp:68] [Rocksdb]               Options.compression_opts.strategy: 0
I0228 03:48:03.079515  2851 olap_meta.cpp:68] [Rocksdb]         Options.compression_opts.max_dict_bytes: 0
I0228 03:48:03.083143  2851 olap_meta.cpp:68] [Rocksdb]         Options.compression_opts.zstd_max_train_bytes: 0
I0228 03:48:03.083161  2851 olap_meta.cpp:68] [Rocksdb]      Options.level0_file_num_compaction_trigger: 4
I0228 03:48:03.083163  2851 olap_meta.cpp:68] [Rocksdb]          Options.level0_slowdown_writes_trigger: 20
I0228 03:48:03.083165  2851 olap_meta.cpp:68] [Rocksdb]              Options.level0_stop_writes_trigger: 36
I0228 03:48:03.083168  2851 olap_meta.cpp:68] [Rocksdb]                   Options.target_file_size_base: 67108864
I0228 03:48:03.085650  2851 olap_meta.cpp:68] [Rocksdb]             Options.target_file_size_multiplier: 1
I0228 03:48:03.085662  2851 olap_meta.cpp:68] [Rocksdb]                Options.max_bytes_for_level_base: 268435456
I0228 03:48:03.085664  2851 olap_meta.cpp:68] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0
I0228 03:48:03.085673  2851 olap_meta.cpp:68] [Rocksdb]          Options.max_bytes_for_level_multiplier: 10.000000
I0228 03:48:03.090734  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1
I0228 03:48:03.090745  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1
I0228 03:48:03.090747  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1
I0228 03:48:03.090749  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1
I0228 03:48:03.090750  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1
I0228 03:48:03.092592  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1
I0228 03:48:03.092607  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1
I0228 03:48:03.092608  2851 olap_meta.cpp:68] [Rocksdb]       Options.max_sequential_skip_in_iterations: 8
I0228 03:48:03.092610  2851 olap_meta.cpp:68] [Rocksdb]                    Options.max_compaction_bytes: 1677721600
I0228 03:48:03.092612  2851 olap_meta.cpp:68] [Rocksdb]                        Options.arena_block_size: 8388608
I0228 03:48:03.097050  2851 olap_meta.cpp:68] [Rocksdb]   Options.soft_pending_compaction_bytes_limit: 68719476736
I0228 03:48:03.097115  2851 olap_meta.cpp:68] [Rocksdb]   Options.hard_pending_compaction_bytes_limit: 274877906944
I0228 03:48:03.097118  2851 olap_meta.cpp:68] [Rocksdb]       Options.rate_limit_delay_max_milliseconds: 100
I0228 03:48:03.097124  2851 olap_meta.cpp:68] [Rocksdb]                Options.disable_auto_compactions: 0
I0228 03:48:03.099370  2851 olap_meta.cpp:68] [Rocksdb]                        Options.compaction_style: kCompactionStyleLevel
I0228 03:48:03.099380  2851 olap_meta.cpp:68] [Rocksdb]                          Options.compaction_pri: kByCompensatedSize
I0228 03:48:03.099383  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.size_ratio: 1
I0228 03:48:03.099385  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2
I0228 03:48:03.099390  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295
I0228 03:48:03.101086  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200
I0228 03:48:03.101102  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1
I0228 03:48:03.101106  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
I0228 03:48:03.101115  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824
I0228 03:48:03.103785  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0
I0228 03:48:03.103811  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.ttl: 0
I0228 03:48:03.103813  2851 olap_meta.cpp:68] [Rocksdb]                   Options.table_properties_collectors: 
I0228 03:48:03.103826  2851 olap_meta.cpp:68] [Rocksdb]                   Options.inplace_update_support: 0
I0228 03:48:03.103827  2851 olap_meta.cpp:68] [Rocksdb]                 Options.inplace_update_num_locks: 10000
I0228 03:48:03.106724  2851 olap_meta.cpp:68] [Rocksdb]               Options.memtable_prefix_bloom_size_ratio: 0.000000
I0228 03:48:03.106742  2851 olap_meta.cpp:68] [Rocksdb]   Options.memtable_huge_page_size: 0
I0228 03:48:03.106747  2851 olap_meta.cpp:68] [Rocksdb]                           Options.bloom_locality: 0
I0228 03:48:03.106750  2851 olap_meta.cpp:68] [Rocksdb]                    Options.max_successive_merges: 0
I0228 03:48:03.107291  2851 olap_meta.cpp:68] [Rocksdb]                Options.optimize_filters_for_hits: 0
I0228 03:48:03.107298  2851 olap_meta.cpp:68] [Rocksdb]                Options.paranoid_file_checks: 0
I0228 03:48:03.107302  2851 olap_meta.cpp:68] [Rocksdb]                Options.force_consistency_checks: 0
I0228 03:48:03.107304  2851 olap_meta.cpp:68] [Rocksdb]                Options.report_bg_io_stats: 0
I0228 03:48:03.107312  2851 olap_meta.cpp:68] [Rocksdb]                               Options.ttl: 0
I0228 03:48:03.116847  2851 olap_meta.cpp:68] [Rocksdb] [db/db_impl.cc:1394] Created column family [doris] (ID 1)
I0228 03:48:03.272768  2851 olap_meta.cpp:68] [Rocksdb] [db/column_family.cc:473] --------------- Options for column family [meta]:
I0228 03:48:03.272821  2851 olap_meta.cpp:68] [Rocksdb]               Options.comparator: leveldb.BytewiseComparator
I0228 03:48:03.272832  2851 olap_meta.cpp:68] [Rocksdb]           Options.merge_operator: None
I0228 03:48:03.272840  2851 olap_meta.cpp:68] [Rocksdb]        Options.compaction_filter: None
I0228 03:48:03.274520  2851 olap_meta.cpp:68] [Rocksdb]        Options.compaction_filter_factory: None
I0228 03:48:03.274533  2851 olap_meta.cpp:68] [Rocksdb]         Options.memtable_factory: SkipListFactory
I0228 03:48:03.274721  2851 olap_meta.cpp:68] [Rocksdb]            Options.table_factory: BlockBasedTable
I0228 03:48:03.274789  2851 olap_meta.cpp:68] [Rocksdb]            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f965bc29068)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 0
  pin_l0_filter_and_index_blocks_in_cache: 0
  index_type: 0
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7f945d700d40
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 4
    strict_capacity_limit : 0
    high_pri_pool_ratio: 0.000
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 4096
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
I0228 03:48:03.281126  2851 olap_meta.cpp:68] [Rocksdb]        Options.write_buffer_size: 67108864
I0228 03:48:03.281144  2851 olap_meta.cpp:68] [Rocksdb]  Options.max_write_buffer_number: 5
I0228 03:48:03.282905  2851 olap_meta.cpp:68] [Rocksdb]          Options.compression: Snappy
I0228 03:48:03.282920  2851 olap_meta.cpp:68] [Rocksdb]                  Options.bottommost_compression: Disabled
I0228 03:48:03.282925  2851 olap_meta.cpp:68] [Rocksdb]       Options.prefix_extractor: rocksdb.FixedPrefix.4
I0228 03:48:03.282927  2851 olap_meta.cpp:68] [Rocksdb]   Options.memtable_insert_with_hint_prefix_extractor: nullptr
I0228 03:48:03.282931  2851 olap_meta.cpp:68] [Rocksdb]             Options.num_levels: 7
I0228 03:48:03.285020  2851 olap_meta.cpp:68] [Rocksdb]        Options.min_write_buffer_number_to_merge: 1
I0228 03:48:03.285038  2851 olap_meta.cpp:68] [Rocksdb]     Options.max_write_buffer_number_to_maintain: 0
I0228 03:48:03.285041  2851 olap_meta.cpp:68] [Rocksdb]            Options.compression_opts.window_bits: -14
I0228 03:48:03.285050  2851 olap_meta.cpp:68] [Rocksdb]                  Options.compression_opts.level: -1
I0228 03:48:03.285053  2851 olap_meta.cpp:68] [Rocksdb]               Options.compression_opts.strategy: 0
I0228 03:48:03.286479  2851 olap_meta.cpp:68] [Rocksdb]         Options.compression_opts.max_dict_bytes: 0
I0228 03:48:03.286494  2851 olap_meta.cpp:68] [Rocksdb]         Options.compression_opts.zstd_max_train_bytes: 0
I0228 03:48:03.286496  2851 olap_meta.cpp:68] [Rocksdb]      Options.level0_file_num_compaction_trigger: 4
I0228 03:48:03.286499  2851 olap_meta.cpp:68] [Rocksdb]          Options.level0_slowdown_writes_trigger: 20
I0228 03:48:03.286500  2851 olap_meta.cpp:68] [Rocksdb]              Options.level0_stop_writes_trigger: 36
I0228 03:48:03.288031  2851 olap_meta.cpp:68] [Rocksdb]                   Options.target_file_size_base: 67108864
I0228 03:48:03.288045  2851 olap_meta.cpp:68] [Rocksdb]             Options.target_file_size_multiplier: 1
I0228 03:48:03.288048  2851 olap_meta.cpp:68] [Rocksdb]                Options.max_bytes_for_level_base: 268435456
I0228 03:48:03.288050  2851 olap_meta.cpp:68] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0
I0228 03:48:03.290599  2851 olap_meta.cpp:68] [Rocksdb]          Options.max_bytes_for_level_multiplier: 10.000000
I0228 03:48:03.290619  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1
I0228 03:48:03.290621  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1
I0228 03:48:03.290622  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1
I0228 03:48:03.290624  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1
I0228 03:48:03.292178  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1
I0228 03:48:03.292192  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1
I0228 03:48:03.292194  2851 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1
I0228 03:48:03.292197  2851 olap_meta.cpp:68] [Rocksdb]       Options.max_sequential_skip_in_iterations: 8
I0228 03:48:03.292199  2851 olap_meta.cpp:68] [Rocksdb]                    Options.max_compaction_bytes: 1677721600
I0228 03:48:03.294494  2851 olap_meta.cpp:68] [Rocksdb]                        Options.arena_block_size: 8388608
I0228 03:48:03.294507  2851 olap_meta.cpp:68] [Rocksdb]   Options.soft_pending_compaction_bytes_limit: 68719476736
I0228 03:48:03.294508  2851 olap_meta.cpp:68] [Rocksdb]   Options.hard_pending_compaction_bytes_limit: 274877906944
I0228 03:48:03.294510  2851 olap_meta.cpp:68] [Rocksdb]       Options.rate_limit_delay_max_milliseconds: 100
I0228 03:48:03.296402  2851 olap_meta.cpp:68] [Rocksdb]                Options.disable_auto_compactions: 0
I0228 03:48:03.296419  2851 olap_meta.cpp:68] [Rocksdb]                        Options.compaction_style: kCompactionStyleLevel
I0228 03:48:03.296422  2851 olap_meta.cpp:68] [Rocksdb]                          Options.compaction_pri: kByCompensatedSize
I0228 03:48:03.296424  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.size_ratio: 1
I0228 03:48:03.296425  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2
I0228 03:48:03.299706  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295
I0228 03:48:03.299717  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200
I0228 03:48:03.299719  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1
I0228 03:48:03.299722  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
I0228 03:48:03.301291  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824
I0228 03:48:03.301308  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0
I0228 03:48:03.301313  2851 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.ttl: 0
I0228 03:48:03.301316  2851 olap_meta.cpp:68] [Rocksdb]                   Options.table_properties_collectors: 
I0228 03:48:03.303339  2851 olap_meta.cpp:68] [Rocksdb]                   Options.inplace_update_support: 0
I0228 03:48:03.303357  2851 olap_meta.cpp:68] [Rocksdb]                 Options.inplace_update_num_locks: 10000
I0228 03:48:03.303376  2851 olap_meta.cpp:68] [Rocksdb]               Options.memtable_prefix_bloom_size_ratio: 0.000000
I0228 03:48:03.303378  2851 olap_meta.cpp:68] [Rocksdb]   Options.memtable_huge_page_size: 0
I0228 03:48:03.303418  2851 olap_meta.cpp:68] [Rocksdb]                           Options.bloom_locality: 0
I0228 03:48:03.305856  2851 olap_meta.cpp:68] [Rocksdb]                    Options.max_successive_merges: 0
I0228 03:48:03.305886  2851 olap_meta.cpp:68] [Rocksdb]                Options.optimize_filters_for_hits: 0
I0228 03:48:03.305887  2851 olap_meta.cpp:68] [Rocksdb]                Options.paranoid_file_checks: 0
I0228 03:48:03.305891  2851 olap_meta.cpp:68] [Rocksdb]                Options.force_consistency_checks: 0
I0228 03:48:03.305892  2851 olap_meta.cpp:68] [Rocksdb]                Options.report_bg_io_stats: 0
I0228 03:48:03.307487  2851 olap_meta.cpp:68] [Rocksdb]                               Options.ttl: 0
I0228 03:48:03.313621  2851 olap_meta.cpp:68] [Rocksdb] [db/db_impl.cc:1394] Created column family [meta] (ID 2)
I0228 03:48:03.599167  2851 olap_meta.cpp:68] [Rocksdb] [db/db_impl_open.cc:1219] DB pointer 0x7f945d84c000
I0228 03:48:03.599658  1835 storage_engine.cpp:266] stream load record path: /opt/apache-doris/be/storage
I0228 03:48:04.052141  3091 data_dir.cpp:361] start to load tablets from /opt/apache-doris/be/storage
I0228 03:48:04.053462  3091 data_dir.cpp:354] successfully check incompatible old format meta /opt/apache-doris/be/storage
I0228 03:48:04.053471  3091 data_dir.cpp:372] begin loading rowset from meta
I0228 03:48:04.053475  3091 data_dir.cpp:400] load rowset from meta finished, data dir: /opt/apache-doris/be/storage
I0228 03:48:04.053478  3091 data_dir.cpp:405] begin loading tablet from meta
I0228 03:48:04.053503  3091 data_dir.cpp:451] load tablet from meta finished, loaded tablet: 0, error tablet: 0, path: /opt/apache-doris/be/storage
I0228 03:48:04.054778  3091 data_dir.cpp:623] finish to load tablets from /opt/apache-doris/be/storage, total rowset meta: 0, invalid rowset num: 0
I0228 03:48:04.056953  1835 storage_engine.cpp:112] success to init storage engine.
I0228 03:48:04.057130  1835 olap_server.cpp:103] unused rowset monitor thread started
I0228 03:48:04.057189  1835 olap_server.cpp:109] garbage sweeper thread started
I0228 03:48:04.057230  1835 olap_server.cpp:115] disk stat monitor thread started
I0228 03:48:04.057242  3106 storage_engine.cpp:720] start trash and snapshot sweep. is_clean=0
I0228 03:48:04.059000  3106 storage_engine.cpp:383] get root path info cost: 0 ms. tablet counter: 0
I0228 03:48:04.059042  3106 storage_engine.cpp:744] Start to sweep path /opt/apache-doris/be/storage
I0228 03:48:04.060118  1835 olap_server.cpp:152] compaction tasks producer thread started
I0228 03:48:04.060161  1835 olap_server.cpp:157] tablet replicas info update thread started
I0228 03:48:04.062871  1835 olap_server.cpp:175] tablet checkpoint tasks producer thread started
I0228 03:48:04.062911  1835 olap_server.cpp:180] tablet path check thread started
I0228 03:48:04.062943  1835 olap_server.cpp:186] fd cache clean thread started
I0228 03:48:04.063017  1835 olap_server.cpp:205] path scan/gc threads started. number:1
I0228 03:48:04.063140  1835 olap_server.cpp:212] cooldown thread pool started
I0228 03:48:04.063167  1835 olap_server.cpp:218] cooldown tasks producer thread started
I0228 03:48:04.064445  1835 olap_server.cpp:224] remove unused remote files thread started
I0228 03:48:04.064487  1835 olap_server.cpp:230] cold data compaction producer thread started
I0228 03:48:04.061194  3140 olap_server.cpp:650] start to update replica infos!
W0228 03:48:04.064544  3140 olap_server.cpp:667] Have not get FE Master heartbeat yet
I0228 03:48:04.063433  3154 olap_server.cpp:380] try to perform path scan!
I0228 03:48:04.065877  3154 data_dir.cpp:750] start to scan data dir path:/opt/apache-doris/be/storage
I0228 03:48:04.063697  3151 olap_server.cpp:399] begin to produce tablet meta checkpoint tasks.
I0228 03:48:04.064519  1835 olap_server.cpp:236] cache file cleaner tasks producer thread started
I0228 03:48:04.062247  3106 storage_engine.cpp:862] remove 0 invalid rowset meta from dir: /opt/apache-doris/be/storage
I0228 03:48:04.067734  3106 storage_engine.cpp:895] remove 0 invalid binlog meta from dir: /opt/apache-doris/be/storage
I0228 03:48:04.067741  3106 storage_engine.cpp:920] removed invalid delete bitmap from dir: /opt/apache-doris/be/storage, deleted tablets size: 0
I0228 03:48:04.071161  3106 storage_engine.cpp:944] removed invalid pending publish info from dir: /opt/apache-doris/be/storage, deleted pending publish info size: 0
I0228 03:48:04.067422  3161 olap_server.cpp:1065] cooldown producer get tablet num: 0
I0228 03:48:04.068217  3155 olap_server.cpp:360] try to start path gc thread!
I0228 03:48:04.060899  3139 olap_server.cpp:555] try to start compaction producer process!
I0228 03:48:04.071873  3155 olap_server.cpp:363] try to perform path gc!
I0228 03:48:04.077243  1835 olap_server.cpp:247] async publish thread started
I0228 03:48:04.077257  1835 olap_server.cpp:249] all storage engine's background threads are started.
I0228 03:48:04.079721  3188 tablet_manager.cpp:1300] finish to do meta checkpoint on dir: /opt/apache-doris/be/storage, number: 0, cost(ms): 0
I0228 03:48:04.084867  3106 data_dir.cpp:868] path: /opt/apache-doris/be/storage trash capacity: 0
I0228 03:48:04.091979  1835 agent_server.cpp:138] Register user resource listener
I0228 03:48:04.092072  1835 backend_service.cpp:381] Doris BackendService listening on 9060
I0228 03:48:04.092075  1835 backend_service.cpp:385] ingest binlog thread pool size is -1, so we will in sync mode
I0228 03:48:04.094849  1835 thrift_server.cpp:381] ThriftServer 'backend' started on port: 9060
I0228 03:48:04.120632  1835 brpc_service.cpp:75] BRPC server bind to host: 0.0.0.0, port: 8060
I0228 03:48:04.160012  1835 server.cpp:1107] Server[doris::PInternalServiceImpl] is serving on port=8060.
I0228 03:48:04.168794  1835 server.cpp:1110] Check out http://cd30c813ddeb:8060 in web browser.
I0228 03:48:04.225402  1835 thrift_server.cpp:381] ThriftServer 'heartbeat' started on port: 9050
I0228 03:48:07.983667  3839 heartbeat_server.cpp:61] get heartbeat from FE.host:172.10.70.2, port:9020, cluster id:965620436, counter:1, BE start time: 1709092084224
I0228 03:48:07.983711  3839 heartbeat_server.cpp:93] get first heartbeat. update cluster id
I0228 03:48:08.021441  3839 heartbeat_server.cpp:98] record cluster id. host: 172.10.70.2. port: 9020. cluster id: 965620436
I0228 03:48:08.021492  3839 heartbeat_server.cpp:170] master change. new master host: 172.10.70.2. port: 9020. epoch: 3
I0228 03:48:08.021497  3839 heartbeat_server.cpp:193] get token. token: 2fd34e0a-dd51-4db1-b270-9cc97eef966e
I0228 03:48:08.021499  3839 heartbeat_server.cpp:214] Master FE is changed or restarted. report tablet and disk info immediately
I0228 03:48:11.023308  3251 tablet_manager.cpp:1020] find expired transactions for 0 tablets
I0228 03:48:11.024979  3251 tablet_manager.cpp:1052] success to build all report tablets info. tablet_count=0
I0228 03:48:11.024124  3250 data_dir.cpp:853] path: /opt/apache-doris/be/storage total capacity: 61233729536, available capacity: 9015078912
I0228 03:48:11.025314  3250 storage_engine.cpp:383] get root path info cost: 2 ms. tablet counter: 0
I0228 03:48:11.030010  3249 task_worker_pool.cpp:1078] successfully report TASK|host=172.10.70.2|port=9020
I0228 03:48:11.050069  3251 task_worker_pool.cpp:1078] successfully report TABLET|host=172.10.70.2|port=9020
I0228 03:48:11.051862  3250 task_worker_pool.cpp:1078] successfully report DISK|host=172.10.70.2|port=9020
I0228 03:48:24.034852  3249 task_worker_pool.cpp:1078] successfully report TASK|host=172.10.70.2|port=9020
I0228 03:48:24.072129  3161 olap_server.cpp:1065] cooldown producer get tablet num: 0
I0228 03:48:27.695252  2849 load_channel_mgr.cpp:250] cleaning timed out load channels
I0228 03:48:27.697043  2849 load_channel_mgr.cpp:282] load mem consumption(bytes). limit: 3305277030, current: 0, peak: 0, total running load channels: 0
I0228 03:48:35.040506  3249 task_worker_pool.cpp:1078] successfully report TASK|host=172.10.70.2|port=9020
I0228 03:48:40.588450  3154 data_dir.cpp:821] scan data dir path: /opt/apache-doris/be/storage finished. path size: 0
I0228 03:48:44.072679  3161 olap_server.cpp:1065] cooldown producer get tablet num: 0
I0228 03:48:48.045622  3249 task_worker_pool.cpp:1078] successfully report TASK|host=172.10.70.2|port=9020
I0228 03:48:52.596549  4056 backend_service.cpp:657] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1
I0228 03:48:59.051580  3249 task_worker_pool.cpp: