21.1 proto协议定义

  1.     获取Route信息，根据之前的架构图，可以看出来应该是Agent来获取，这里我们并没有实现Agent，所以用一个其他简单的客户端来完成单元测试。但是无论用什么，总需要一个传递数据，需要一定的消息协议，lars-dns也需要设置不同纤细的分发消息路由机制，所以我们需要先定义一些proto协议。
  3.     在`Lars/base`下创建`proto/`文件夹.

Lars/base/proto/lars.proto

  1. syntax = "proto3";
  3. package lars;
  5. /* Lars系统的消息ID */
  6. enum MessageId {
  7.     ID_UNKNOW                = 0;  //proto3 enum第一个属性必须是0，用来占位
  8.     ID_GetRouteRequest       = 1;  //向DNS请求Route对应的关系的消息ID
  9.     ID_GetRouteResponse      = 2;  //DNS回复的Route信息的消息ID
  10. }
  12. //一个管理的主机的信息
  13. message HostInfo {
  14.     int32 ip = 1;
  15.     int32 port = 2;
  16. }
  18. //请求lars-dns route信息的消息内容
  19. message GetRouteRequest {
  20.     int32 modid = 1; 
  21.     int32 cmdid = 2;
  22. }
  24. //lars-dns 回复的route信息消息内容
  25. message GetRouteResponse {
  26.     int32 modid = 1;    
  27.     int32 cmdid = 2;
  28.     repeated HostInfo host = 3;
  29. }
  1.     然后我们将proto文件编译成对应的C++文件, 我们还是提供一个脚本

Lars/base/proto/build.sh

  1. #!/bin/bash
  3. # proto编译
  4. protoc --cpp_out=. ./*.proto
  7. # 将全部的cc 文件 变成 cpp文件
  8. oldsuffix="cc"
  9. newsuffix="cpp"
  10. dir=$(eval pwd)
  11. for file in $(ls $dir | grep .${oldsuffix})
  12. do
  13.     name=$(ls ${file} | cut -d. -f1,2)
  14.     mv $file ${name}.${newsuffix}
  15. done
  16. echo "build proto file successd!"
  1.     因为protoc会自动生成cc后缀的文件，为了方便我们Makefile的编译，所以将cc文件改成cpp的。

21.2 proto编译环境集成

  1.     现在我们将`lars-dns`的Makefile加入针对proto文件的编译

Lars/lars_dns/Makefile

  1. TARGET= bin/lars_dns
  2. CXX=g++
  3. CFLAGS=-g -O2 -Wall -Wno-deprecated
  5. BASE=../base
  6. BASE_H=$(BASE)/include
  8. PROTO = $(BASE)/proto
  9. PROTO_H = $(BASE)/proto
  11. LARS_REACTOR=../lars_reactor
  12. LARS_REACTOR_H =$(LARS_REACTOR)/include
  13. LARS_REACTOR_LIB=$(LARS_REACTOR)/lib  -llreactor
  15. MYSQL=$(BASE)/mysql-connector-c
  16. MYSQL_H=$(MYSQL)/include
  17. MYSQL_LIB=$(MYSQL)/lib/libmysqlclient.a
  19. OTHER_LIB = -lpthread -ldl -lprotobuf
  20. SRC= ./src
  21. INC= -I./include -I$(BASE_H) -I$(LARS_REACTOR_H) -I$(MYSQL_H) -I$(PROTO_H)
  23. LIB= $(MYSQL_LIB) -L$(LARS_REACTOR_LIB) $(OTHER_LIB) 
  26. OBJS = $(addsuffix .o, $(basename $(wildcard $(SRC)/*.cpp)))
  27. OBJS += $(PROTO)/lars.pb.o
  29. $(TARGET): $(OBJS)
  30.         mkdir -p bin
  31.         $(CXX) $(CFLAGS) -o $(TARGET) $(OBJS) $(INC) $(LIB)
  33. %.o: %.cpp
  34.         $(CXX) $(CFLAGS) -c -o $@ $< $(INC) 
  36. .PHONY: clean
  38. clean:
  39.         -rm -f src/*.o $(TARGET)
  1.     添加了两个部分一个`OBJS`增添一个`lars.pb.o`的依赖，然后再`OTHER_LIB`增加`-lprotobuf`动态库的连接。

21.3 实现Route获取

  1.     接下来我们来实现针对`ID_GetRouteRequest`消息指令的业务处理.

lars_dns/src/dns_service.cpp

  1. #include "lars_reactor.h"
  2. #include "dns_route.h"
  3. #include "lars.pb.h"
  5. void get_route(const char *data, uint32_t len, int msgid, net_connection *net_conn, void *user_data)
  6. {
  7.     //1. 解析proto文件
  8.     lars::GetRouteRequest req;
  10.     req.ParseFromArray(data, len);
  13.     //2. 得到modid 和 cmdid
  14.     int modid, cmdid;
  16.     modid = req.modid();
  17.     cmdid = req.cmdid();
  19.     //3. 根据modid/cmdid 获取 host信息
  20.     host_set hosts = Route::instance()->get_hosts(modid, cmdid);
  22.     //4. 将数据打包成protobuf
  23.     lars::GetRouteResponse rsp;
  25.     rsp.set_modid(modid);
  26.     rsp.set_cmdid(cmdid);
  28.     for (host_set_it it = hosts.begin(); it != hosts.end(); it ++) {
  29.         uint64_t ip_port = *it;
  30.         lars::HostInfo host;
  31.         host.set_ip((uint32_t)(ip_port >> 32));
  32.         host.set_port((int)(ip_port));
  33.         rsp.add_host()->CopyFrom(host);
  34.     }
  36.     //5. 发送给客户端
  37.     std::string responseString;
  38.     rsp.SerializeToString(&responseString);
  39.     net_conn->send_message(responseString.c_str(), responseString.size(), lars::ID_GetRouteResponse)    ;
  40. }
  42. int main(int argc, char **argv)
  43. {
  44.     event_loop loop;
  46.     //加载配置文件
  47.     config_file::setPath("conf/lars_dns.conf");
  48.     std::string ip = config_file::instance()->GetString("reactor", "ip", "0.0.0.0");
  49.     short port = config_file::instance()->GetNumber("reactor", "port", 7778);
  52.     //创建tcp服务器
  53.     tcp_server *server = new tcp_server(&loop, ip.c_str(), port);
  55.     //注册路由业务
  56.     server->add_msg_router(lars::ID_GetRouteRequest, get_route);
  58.     //开始事件监听    
  59.     printf("lars dns service ....\n");
  60.     loop.event_process();
  62.     return 0;
  63. }
  1.     需要给`Route`类，实现一个get_host()方法，来针对modid/cmdid取出对应的value

lars_dns/src/dns_route.cpp

  1. //获取modid/cmdid对应的host信息
  2. host_set Route::get_hosts(int modid, int cmdid)
  3. {
  4.     host_set hosts;     
  6.     //组装key
  7.     uint64_t key = ((uint64_t)modid << 32) + cmdid;
  9.     pthread_rwlock_rdlock(&_map_lock);
  10.     route_map_it it = _data_pointer->find(key);
  11.     if (it != _data_pointer->end()) {
  12.         //找到对应的ip + port对
  13.         hosts = it->second;
  14.     }
  15.     pthread_rwlock_unlock(&_map_lock);
  17.     return hosts;
  18. }

21.3 lars_dns获取Route信息测试-V0.2

  1.     下面我们写一个客户端检查测试一下该功能.

lars_dns/test/lars_dns_test1.cpp

  1. #include <string.h>
  2. #include <unistd.h>
  3. #include <string>
  4. #include "lars_reactor.h"
  5. #include "lars.pb.h"
  7. //命令行参数
  8. struct Option
  9. {
  10.     Option():ip(NULL),port(0) {}
  12.     char *ip;
  13.     short port;
  14. };
  17. Option option;
  19. void Usage() {
  20.     printf("Usage: ./lars_dns_test -h ip -p port\n");
  21. }
  23. //解析命令行
  24. void parse_option(int argc, char **argv)
  25. {
  26.     for (int i = 0; i < argc; i++) {
  27.         if (strcmp(argv[i], "-h") == 0) {
  28.             option.ip = argv[i + 1];
  29.         }
  30.         else if (strcmp(argv[i], "-p") == 0) {
  31.             option.port = atoi(argv[i + 1]);
  32.         }
  33.     }
  35.     if ( !option.ip || !option.port ) {
  36.         Usage();
  37.         exit(1);
  38.     }
  40. }
  42. //typedef void (*conn_callback)(net_connection *conn, void *args);
  43. void on_connection(net_connection *conn, void *args) 
  44. {
  45.     //发送Route信息请求
  46.     lars::GetRouteRequest req;
  48.     req.set_modid(1);
  49.     req.set_cmdid(2);
  51.     std::string requestString;
  53.     req.SerializeToString(&requestString);
  54.     conn->send_message(requestString.c_str(), requestString.size(), lars::ID_GetRouteRequest);
  55. }
  59. void deal_get_route(const char *data, uint32_t len, int msgid, net_connection *net_conn, void *user_data)
  60. {
  61.     //解包得到数据
  62.     lars::GetRouteResponse rsp;
  63.     rsp.ParseFromArray(data, len);
  65.     //打印数据
  66.     printf("modid = %d\n", rsp.modid());
  67.     printf("cmdid = %d\n", rsp.cmdid());
  68.     printf("host_size = %d\n", rsp.host_size());
  70.     for (int i = 0; i < rsp.host_size(); i++) {
  71.         printf("-->ip = %u\n", rsp.host(i).ip());
  72.         printf("-->port = %d\n", rsp.host(i).port());
  73.     }
  75.     //再请求
  76.     lars::GetRouteRequest req;
  77.     req.set_modid(rsp.modid());
  78.     req.set_cmdid(rsp.cmdid());
  79.     std::string requestString;
  80.     req.SerializeToString(&requestString);
  81.     net_conn->send_message(requestString.c_str(), requestString.size(), lars::ID_GetRouteRequest);
  82. }
  85. int main(int argc, char **argv)
  86. {
  87.     parse_option(argc, argv);
  89.     event_loop loop;
  90.     tcp_client *client;
  92.     //创建客户端
  93.     client = new tcp_client(&loop, option.ip, option.port, "lars_dns_test");
  94.     if (client == NULL) {
  95.         fprintf(stderr, "client == NULL\n");
  96.         exit(1);
  97.     }
  99.     //客户端成功建立连接，首先发送请求包
  100.     client->set_conn_start(on_connection);
  102.     //设置服务端回应包处理业务
  103.     client->add_msg_router(lars::ID_GetRouteResponse, deal_get_route);
  106.     loop.event_process(); 
  108.     return 0;
  109. }
  1.     同时提供一个`Makefile`对客户端进行编译。

lars_dns/test/Makefile

  1. TARGET= lars_dns_test1
  2. CXX=g++
  3. CFLAGS=-g -O2 -Wall -Wno-deprecated
  5. BASE=../../base
  6. BASE_H=$(BASE)/include
  8. PROTO = $(BASE)/proto
  9. PROTO_H = $(BASE)/proto
  11. LARS_REACTOR=../../lars_reactor
  12. LARS_REACTOR_H =$(LARS_REACTOR)/include
  13. LARS_REACTOR_LIB=$(LARS_REACTOR)/lib  -llreactor
  15. OTHER_LIB = -lpthread -ldl -lprotobuf
  16. SRC= ./src
  17. INC= -I./include -I$(BASE_H) -I$(LARS_REACTOR_H) -I$(PROTO_H)
  19. LIB= $(MYSQL_LIB) -L$(LARS_REACTOR_LIB) $(OTHER_LIB) 
  22. OBJS = lars_dns_test1.o
  23. OBJS += $(PROTO)/lars.pb.o
  25. $(TARGET): $(OBJS)
  26.         $(CXX) $(CFLAGS) -o $(TARGET) $(OBJS) $(INC) $(LIB)
  28. %.o: %.cpp
  29.         $(CXX) $(CFLAGS) -c -o $@ $< $(INC) 
  31. .PHONY: clean
  33. clean:
  34.         -rm -f ./*.o $(TARGET)

我们分别启动bin/lars_dns进程，和test/lars_dns_test1进程

服务端

  1. $ ./bin/lars_dns 
  2. msg_router init...
  3. create 0 thread
  4. create 1 thread
  5. create 2 thread
  6. create 3 thread
  7. create 4 thread
  8. add msg cb msgid = 1
  9. lars dns service ....
  10. begin accept
  11. begin accept
  12. [thread]: get new connection succ!
  13. modID = 1, cmdID = 1, ip = 3232235953, port = 7777
  14. modID = 1, cmdID = 2, ip = 3232235954, port = 7776
  15. modID = 2, cmdID = 1, ip = 3232235955, port = 7778
  16. modID = 2, cmdID = 2, ip = 3232235956, port = 7779
  17. modID = 1, cmdID = 1, ip = 3232235953, port = 7777
  18. modID = 1, cmdID = 2, ip = 3232235954, port = 7776
  19. modID = 2, cmdID = 1, ip = 3232235955, port = 7778
  20. modID = 2, cmdID = 2, ip = 3232235956, port = 7779
  21. read data from socket

客户端

  1. $ ./lars_dns_test1 -h 127.0.0.1 -p 7778
  2. msg_router init...
  3. do_connect EINPROGRESS
  4. add msg cb msgid = 2
  5. connect 127.0.0.1:7778 succ!
  6. modid = 1
  7. cmdid = 2
  8. host_size = 1
  9. -->ip = 3232235954
  10. -->port = 7776