https://github.com/alibaba/canal/wiki/QuickStart

1、准备

• 对于自建 MySQL , 需要先开启 Binlog 写入功能，配置 binlog-format 为 ROW 模式，my.cnf 中配置如下

  [mysqld]
  log-bin=mysql-bin # 开启 binlog
  binlog-format=ROW # 选择 ROW 模式
  server_id=1 # 配置 MySQL replaction 需要定义，不要和 canal 的 slaveId 重复

• 注意：针对阿里云 RDS for MySQL , 默认打开了 binlog , 并且账号默认具有 binlog dump 权限 , 不需要任何权限或者 binlog 设置,可以直接跳过这一步

• 授权 canal 链接 MySQL 账号具有作为 MySQL slave 的权限, 如果已有账户可直接 grant

  CREATE USER canal IDENTIFIED BY 'canal';  
  GRANT SELECT, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'canal'@'%';
  -- GRANT ALL PRIVILEGES ON *.* TO 'canal'@'%' ;
  FLUSH PRIVILEGES;

  2、启动

  下载 canal, 访问 release 页面 , 选择需要的包下载, 如以 1.0.17 版本为例

  wget https://github.com/alibaba/canal/releases/download/canal-1.0.17/canal.deployer-1.0.17.tar.gz

  解压缩

  mkdir /tmp/canal
  tar zxvf canal.deployer-$version.tar.gz  -C /tmp/canal

  • 解压完成后，进入 /tmp/canal 目录，可以看到如下结构

    drwxr-xr-x 2 jianghang jianghang  136 2013-02-05 21:51 bin
    drwxr-xr-x 4 jianghang jianghang  160 2013-02-05 21:51 conf
    drwxr-xr-x 2 jianghang jianghang 1.3K 2013-02-05 21:51 lib
    drwxr-xr-x 2 jianghang jianghang   48 2013-02-05 21:29 logs

    配置修改

    vi conf/example/instance.properties

    mysql serverId
    canal.instance.mysql.slaveId = 1234
    #position info，需要改成自己的数据库信息
    canal.instance.master.address = 127.0.0.1:3306
    canal.instance.master.journal.name =
    canal.instance.master.position =
    canal.instance.master.timestamp =
    #canal.instance.standby.address =
    #canal.instance.standby.journal.name =
    #canal.instance.standby.position =
    #canal.instance.standby.timestamp =
    #username/password，需要改成自己的数据库信息
    canal.instance.dbUsername = canal
    canal.instance.dbPassword = canal
    canal.instance.defaultDatabaseName =
    canal.instance.connectionCharset = UTF-8
    #table regex
    canal.instance.filter.regex = .*\\..*

  • canal.instance.connectionCharset 代表数据库的编码方式对应到 java 中的编码类型，比如 UTF-8，GBK , ISO-8859-1

  • 如果系统是1个 cpu，需要将 canal.instance.parser.parallel 设置为 false

    指定读取位置

    进入虚拟机中Mysql中执行下面语句查看binlog所在位置
    

    show master status

    显示如下
    
    (1)、如果file中binlog文件不为mysql-bin.000001可以重置mysql
    　
    ```plsql mysql > reset master;

(2)、查看canal配置文件
```plsql
vim /usr/local/canal/conf/example/meta.da

找到对应的binlog信息更改和mysql查询结果一致即可

"journalName": "mysql-bin.000001","postition":"120"

注意:如果不一致，肯能会导致未知错误

启动

sh bin/startup.sh

查看 server 日志

vi logs/canal/canal.log</pre>

2013-02-05 22:45:27.967 [main] INFO  com.alibaba.otter.canal.deployer.CanalLauncher - ## start the canal server.
2013-02-05 22:45:28.113 [main] INFO  com.alibaba.otter.canal.deployer.CanalController - ## start the canal server[10.1.29.120:11111]
2013-02-05 22:45:28.210 [main] INFO  com.alibaba.otter.canal.deployer.CanalLauncher - ## the canal server is running now ......

查看 instance 的日志

vi logs/example/example.log

2013-02-05 22:50:45.636 [main] INFO  c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [canal.properties]
2013-02-05 22:50:45.641 [main] INFO  c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [example/instance.properties]
2013-02-05 22:50:45.803 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start CannalInstance for 1-example 
2013-02-05 22:50:45.810 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start successful....

关闭

sh bin/stop.sh

3、其他方式

• canal 的 docker 模式快速启动，参考：Docker QuickStart
• canal 链接 Aliyun RDS for MySQL，参考：Aliyun RDS QuickStart
• canal 消息投递给 kafka/RocketMQ，参考：Canal-Kafka-RocketMQ-QuickStart

4、配置实践

(1)、下载文件
wget https://github.com/alibaba/canal/releases/download/canal-1.1.5/canal.deployer-1.1.5.tar.gz
(2)、解压
mkdir canal_txy
tar -zxvf canal.deployer-1.1.5.tar.gz -C canal_txy
(3)、修改canal.properties

......
#修改zk
canal.zkServers = xxx:2001,xxx:2001,xxx:2001
......
#修改destinations
canal.destinations = yicheForumCanal
......

(4)、修改具体destinations instance的配置文件

• 创建destinations 对应的文件夹
  • mkdir yicheForumCanal
  • cp exapmpl/instance.properties yicheForumCanal
• 修改instance.properties配置 ```xml ……

  position info

  canal.instance.master.address=xxx:3306 ……

  username/password

  canal.instance.dbUsername=canal canal.instance.dbPassword=canal.1111 ….

table regex

canal.instance.filter.regex=YiCheForum.dnt_topic,YiCheForum.dnt_post,YiCheForum.dnt_logtopic,YiCheForum.dnt_infoflow

table black regex

canal.instance.filter.black.regex= ….

``` (5)、启动

• cd /data/canal_txy/bin
• sh startup.sh

(6)、查看日志目录及日志文件

五、Canal Client消费

https://callmejacky.blog.csdn.net/article/details/107971333?utm_medium=distribute.pc_relevant.none-task-blog-2%7Edefault%7EBlogCommendFromBaidu%7Edefault-5.control&dist_request_id=&depth_1-utm_source=distribute.pc_relevant.none-task-blog-2%7Edefault%7EBlogCommendFromBaidu%7Edefault-5.control