
利用logstash手机kafka日志
首先在已安装kafka的虚拟机上面安装logstash(安装见ELK部署中logstash部署,及kafka集群部署
编写conf文件
vim kafka.conf
input{
kafka{
topics => “topic1”
codec => “json”
decorate_events =>true
bootstrap_servers => “192.168.188.138:9092,192.168.188.139:9092,192.168.188.140:9092”
}
}
output{
elasticsearch{
hosts => [“192.168.188.128:9200”]
index => “kafka-topic1-%{+YYYY.MM.DD}”
}
}
首先启动kafka,然后启动logstash
nohup /usr/local/kafka/bin/kafka-server-start.sh config/server.properlies &
nohup logstash -f kafka.conf
在leader终端输入信息,打开浏览器,利用浏览器扩展插件elasticsearch观察产生日志,打开浏览器打开kibana,用来展示日志
