Apache Doris 4.0.0 存算分离手动部署指南

Apache Doris 4.0.0 存算分离手动部署指南一、准备工作环境要求3 台以上服务器奇数台根据业务规模调整 CPU 和内存除修改机器名外其他命令需在所有服务器上执行1. 修改机器名# node1sudohostnamectl set-hostname doris-node1# node2sudohostnamectl set-hostname doris-node2# node3sudohostnamectl set-hostname doris-node32. 基础配置# 检查时钟同步sudosystemctl status chronyd# 安装 lsofsudoyuminstall-ylsof# 关闭防火墙sudosystemctl disable firewalld.service# 禁用透明大页THPechoecho madvise /sys/kernel/mm/transparent_hugepage/enabled|sudotee-a/etc/rc.local# 禁用大页sudosysctlvm.nr_hugepages03. 修改/etc/sysctl.confvm.max_map_count 2000000 net.ipv4.tcp_abort_on_overflow 1 fs.file-max 1000000立即生效sudosysctl-p4. 修改/etc/security/limits.conf* soft nofile 1000000 * hard nofile 1000000 root soft nofile 1000000 root hard nofile 10000005. 安装 Java 17sudoyuminstall-yjava-17-openjdk java-17-openjdk-develsudotee/etc/profile.d/doris_java.shEOF export JAVA_HOME/usr/lib/jvm/java-17-openjdk export PATH\$JAVA_HOME/bin:\$PATHEOFsource/etc/profile.d/doris_java.shsudosh-cecho JAVA_HOME/usr/lib/jvm/java-17-openjdk /etc/environmentjava-version6. 数据盘挂载FE 节点所有节点sudomkfs.xfs /dev/nvme1n1sudomkdir-p/data/doris-fesudomount/dev/nvme1n1 /data/doris-feecho/dev/nvme1n1 /data/doris-fe xfs defaults 0 0|sudotee-a/etc/fstabBE 节点所有节点sudomkfs.xfs /dev/nvme2n1sudomkdir-p/data/doris-besudomount/dev/nvme2n1 /data/doris-beecho/dev/nvme2n1 /data/doris-be xfs defaults 0 0|sudotee-a/etc/fstabsudosystemctl daemon-reload7. 创建 doris 用户sudogroupadddorissudouseradd-gdoris-M-s/sbin/nologin doris8. 设置目录权限sudochown-Rdoris:doris /data/doris-fe /data/doris-besudochmod755/data/doris-fe /data/doris-be二、安装 Doris1. 下载与解压cd/optwgethttps://apache-doris-releases.oss-accelerate.aliyuncs.com/apache-doris-4.0.0-bin-x64.tar.gztar-zxvfapache-doris-4.0.0-bin-x64.tar.gzmvapache-doris-4.0.0-bin-x64 doris-4.0.0wgethttp://apache-doris-releases.oss-accelerate.aliyuncs.com/apache-doris-3.0.2-tools.tar.gztar-zxvfapache-doris-3.0.2-tools.tar.gzmvtools/fdb/pkgs doris-4.0.0/tools/fdb2. 安装 FoundationDBmkdir/opt/foundationdb编辑/opt/doris-4.0.0/tools/fdb/fdb_vars.shDATA_DIRS/data/doris-fe/foundationdbFDB_CLUSTER_IPS172.16.10.110,172.16.10.111,172.16.10.112FDB_HOME/opt/foundationdbFDB_CLUSTER_IDfdbserverFDB_CLUSTER_DESCdorisfdbMEMORY_LIMIT_GB6CPU_CORES_LIMIT2USERdorisSTORAGE_STATELESS_LOG_RATIO1:1:1STORAGE_PROCESSES_NUM_PER_SSD2LOG_PROCESSES_NUM_PER_SSD2MEMORY_STORAGE_GB4MEMORY_STATELESS_GB1MEMORY_LOG_GB1部署 FDB 集群/opt/doris-4.0.0/tools/fdb/fdb_ctl.sh deploy设置权限sudochown-Rdoris:doris /opt/foundationdbsudochown-Rdoris:doris /data/doris-fe/foundationdbsudochmod-R750/opt/foundationdb创建 systemd 服务/etc/systemd/system/doris-fdb.service[Unit] DescriptionDoris FoundationDB Controller Afternetwork.target [Service] Userdoris Groupdoris Typeforking WorkingDirectory/opt/doris-4.0.0/tools/fdb ExecStart/opt/doris-4.0.0/tools/fdb/fdb_ctl.sh start ExecStop/opt/doris-4.0.0/tools/fdb/fdb_ctl.sh stop Restarton-failure RestartSec30s StartLimitInterval60s StartLimitBurst5 LimitNOFILE1000000 [Install] WantedBymulti-user.target启动sudosystemctl daemon-reloadsudosystemctlenable--nowdoris-fdb3. 部署 Meta Service编辑/opt/doris-4.0.0/ms/conf/doris_cloud.conffdb_cluster dorisfdb:fdbserver172.16.10.110:4500,172.16.10.111:4500,172.16.10.112:4500创建服务/etc/systemd/system/doris-ms.service[Unit] DescriptionDoris Meta Service Afterdoris-fdb.service [Service] Userdoris Groupdoris Typeforking EnvironmentJAVA_HOME/usr/lib/jvm/java-17-openjdk EnvironmentPATH/usr/lib/jvm/java-17-openjdk/bin:/usr/bin:/usr/sbin WorkingDirectory/opt/doris-4.0.0/ms/ ExecStart/opt/doris-4.0.0/ms/bin/start.sh --daemon ExecStop/opt/doris-4.0.0/ms/bin/stop.sh Restarton-failure RestartSec30s StartLimitInterval60s StartLimitBurst5 LimitNOFILE1000000 [Install] WantedBymulti-user.target启动并验证sudosystemctl daemon-reloadsudosystemctlenable--nowdoris-msps-p$(cat/opt/doris-4.0.0/ms/bin/doris_cloud.pid)ss-tulnp|grep50004. 部署 FE编辑/opt/doris-4.0.0/fe/conf/fe.confpriority_networks 172.16.10.0/24 deploy_mode cloud cluster_id 388628430 meta_service_endpoint 172.16.10.110:5000,172.16.10.111:5000,172.16.10.112:5000 meta_dir /data/doris-fe/doris-meta sys_log_dir /data/doris-fe/log audit_log_dir /data/doris-fe/log LOG_DIR /data/doris-fe/log创建目录sudo-udorismkdir/data/doris-fe/doris-metasudo-udorismkdir/data/doris-fe/log创建服务/etc/systemd/system/doris-fe.service[Unit] DescriptionDoris FE Afterdoris-ms.service [Service] Userdoris Groupdoris Typeforking EnvironmentJAVA_HOME/usr/lib/jvm/java-17-openjdk EnvironmentPATH/usr/lib/jvm/java-17-openjdk/bin:/usr/bin:/usr/sbin WorkingDirectory/opt/doris-4.0.0/fe/ ExecStart/opt/doris-4.0.0/fe/bin/start_fe.sh --daemon ExecStop/opt/doris-4.0.0/fe/bin/stop_fe.sh Restarton-failure RestartSec30s StartLimitInterval60s StartLimitBurst5 LimitNOFILE1000000 [Install] WantedBymulti-user.target启动 FEsudosystemctl daemon-reloadsudosystemctlenable--nowdoris-fe配置 FEmysql-h172.16.10.110-P9030-urootSETPASSWORDFORrootPASSWORD(your_password);ALTERSYSTEMADDFOLLOWER172.16.10.111:9010;ALTERSYSTEMADDFOLLOWER172.16.10.112:9010;SHOWFRONTENDS;5. 部署 BE编辑/opt/doris-4.0.0/be/conf/be.confpriority_networks 172.16.10.0/24 deploy_mode cloud meta_service_endpoint 172.16.10.110:5000,172.16.10.111:5000,172.16.10.112:5000 sys_log_dir /data/doris-be/log storage_root_path /data/doris-be/storage,medium:SSD file_cache_path [{path:/data/doris-be/file_cache,total_size:858993459200}] mem_limit 48G storage_page_cache_limit 25% row_cache_mem_limit 16% inverted_index_searcher_cache_limit 12% enable_storage_policy true cloud_unique_id doris-node1 # 每个节点不同doris-node1/2/3 disable_storage_medium_check true创建目录sudo-udorismkdir/data/doris-be/logsudo-udorismkdir/data/doris-be/storagesudo-udorismkdir/data/doris-be/file_cache创建服务/etc/systemd/system/doris-be.service[Unit] DescriptionDoris BE Afternetwork.target [Service] Userdoris Groupdoris Typeforking EnvironmentJAVA_HOME/usr/lib/jvm/java-17-openjdk EnvironmentPATH/usr/lib/jvm/java-17-openjdk/bin:/usr/bin:/usr/sbin WorkingDirectory/opt/doris-4.0.0/be/ ExecStart/opt/doris-4.0.0/be/bin/start_be.sh --daemon ExecStop/opt/doris-4.0.0/be/bin/stop_be.sh Restarton-failure RestartSec30s StartLimitInterval60s StartLimitBurst5 LimitNOFILE1000000 [Install] WantedBymulti-user.target启动 BEsudosystemctl daemon-reloadsudosystemctlenable--nowdoris-be注册 BE 节点ALTERSYSTEMADDBACKEND172.16.10.110:9050;ALTERSYSTEMADDBACKEND172.16.10.111:9050;ALTERSYSTEMADDBACKEND172.16.10.112:9050;SHOWBACKENDS;三、运维调试检查 FoundationDB/opt/doris-4.0.0/tools/fdb/fdb_ctl.sh fdbcli--execstatus details查看 Meta Service 日志journalctl-udoris-ms-n50--no-pager清理 FDB元数据冲突时重建sudo-udoris /opt/doris-4.0.0/tools/fdb/fdb_ctl.sh cleanBE 优雅下线ALTERSYSTEM DECOMMISSION BACKEND172.16.10.112:9050;-- 等待 SystemDecommissioned true, TabletNum 0ALTERSYSTEMDROPBACKEND172.16.10.112:9050;增加 BE 节点ALTERSYSTEMADDBACKEND172.16.10.112:9050;四、注意事项与建议版本稳定性4.0.0 版本存在视图关联查询报错、元数据差异等问题建议使用更新的稳定版本。高可用建议部署 Nginx 代理 FE 的 9030 端口避免主 FE 节点宕机后客户端无法访问。程序连接可配置三个 FE 地址。以上为完整的 Apache Doris 4.0.0 存算分离手动部署指南。