otter数据同步搭建
1.下载所需包
otter : https://github.com/alibaba/otter/releases
下载manager.deployer-4.2.18.tar.gz,node.deployer-4.2.18.tar.gz
aria2c :https://github.com/aria2/aria2/releases
docker 搭建zookeeper (非docker 需要下载)
2.数据库配置修改my.cnf
secure-file-priv= NULL
#log_bin
#开启binlog
log-bin = mysql-bin
#选择row模式
binlog-format = ROW
#服务Id 不能重复
server_id = 1 3数据库初始化 执行以下脚本 创建otter库
4.jdk确认安装 目前支持jdk8
5安装zookeeper
docker pull zookeeper:3.4.14
docker run -d --restart=always --log-driver json-file --log-opt max-size=100m --log-opt max-file=2 --name zookeeper -p 2181:2181 -v /etc/localtime:/etc/localtime zookeeper6.安装otter manager
mkdir /opt/otter-manager –p
tar -zxf manager.deployer-4.2.18.tar.gz -C /opt/otter-manager
cd /opt/otter-manager/conf7.修改manager配置文件
## otter manager domain name 修改ip
otter.domainName = 10.6.116.199
## otter manager http port 修改管理端口
otter.port = 8080
## jetty web config xml
otter.jetty = jetty.xml
## otter manager database config 修改数据库地址
otter.database.driver.class.name = com.mysql.jdbc.Driver
otter.database.driver.url = jdbc:mysql://10.6.116.199:3390/otter?useSSL=false
otter.database.driver.username = root
otter.database.driver.password = password
## otter communication port 修改node链接管理端端口
otter.communication.manager.port = 1099
## otter communication payload size (default = 8388608)
otter.communication.payload = 8388608
## otter communication pool size
otter.communication.pool.size = 10
## default zookeeper address 修改zk地址
otter.zookeeper.cluster.default = 127.0.0.1:2181
## default zookeeper sesstion timeout = 60s
otter.zookeeper.sessionTimeout = 60000
## otter arbitrate connect manager config
otter.manager.address = ${otter.domainName}:${otter.communication.manager.port}
## should run in product mode , true/false
otter.manager.productionMode = true
## self-monitor enable or disable
otter.manager.monitor.self.enable = true
## self-montir interval , default 120s
otter.manager.monitor.self.interval = 120
## auto-recovery paused enable or disable
otter.manager.monitor.recovery.paused = true
# manager email user config
otter.manager.monitor.email.host = smtp.gmail.com
otter.manager.monitor.email.username =
otter.manager.monitor.email.password =
otter.manager.monitor.email.stmp.port = 4658.启动manager
/opt/otter-manager/bin/startup.sh查看日志
tail -f /opt/otter-manager/logs/manager.log访问管理端 用户名/密码:admin/admin
9.安装node
mkdir /opt/otter-node –p
tar -zxf node.deployer-4.2.18.tar.gz -C /opt/otter-node 10.安装aria2
xz -d aria2-1.36.0.tar.xz
tar -xf aria2-1.36.0.tar
cd aria2-1.36.0/
./configure
make check
make
make install
aria2c -v11. 在manager 配置node
http://10.6.116.199:8080/node_list.htm

获得inode id

写入nodeid
echo 1 > /opt/otter-node/conf/nid12.修改node 配置
# otter node root dir
otter.nodeHome = ${user.dir}/../
## otter node dir
otter.htdocs.dir = ${otter.nodeHome}/htdocs
otter.download.dir = ${otter.nodeHome}/download
otter.extend.dir= ${otter.nodeHome}/extend
## default zookeeper sesstion timeout = 60s
otter.zookeeper.sessionTimeout = 60000
## otter communication payload size (default = 8388608)
otter.communication.payload = 8388608
## otter communication pool size
otter.communication.pool.size = 10
## otter arbitrate & node connect manager config 修改这里改为配置的manager地址
otter.manager.address = 10.6.116.199:109913.启动node
/opt/otter-node/bin/startup.sh看到控制台 节点状态是已启动则启动成功
14.同理配置node2
15.配置数据源


17.配置canal


18. 添加数据表


19.添加channel

20.添加pipeline

21.配置映射关系

22.启动channel

23.检验效果
在A,B
两个数据库分别插入数据 对方会进行同步

参考:https://blog.csdn.net/fiendbaal/article/details/122132537
本文是原创文章,完整转载请注明来自 John Yan
评论
匿名评论
隐私政策
你无需删除空行,直接评论以获取最佳展示效果