Azue Event Hubs 集成

针对 Microsoft Azure Eventhubs 的 Storm spout 和 bolt 实现

build

  1. mvn clean package

运行 topology 示例

要运行 topology 示例, 您需要去修改 config.properties 文件与 eventhubs 配置. 以下是一个例子:

  1. eventhubspout.username = [username: policy name in EventHubs Portal]
  2. eventhubspout.password = [password: shared access key in EventHubs Portal]
  3. eventhubspout.namespace = [namespace]
  4. eventhubspout.entitypath = [entitypath]
  5. eventhubspout.partitions.count = [partitioncount]
  7. # if not provided, will use storm's zookeeper settings
  8. # zookeeper.connectionstring=zookeeper0:2181,zookeeper1:2181,zookeeper2:2181
  10. eventhubspout.checkpoint.interval = 10
  11. eventhub.receiver.credits = 1024

然后您可以使用 storm.cmd 来提交 topology 示例:

  1. storm jar {jarfile} com.microsoft.eventhubs.samples.EventCount {topologyname} {spoutconffile}
  2. where the {jarfile} should be: eventhubs-storm-spout-{version}-jar-with-dependencies.jar

运行 EventHubSendClient

我们包括一个简单的 EventHubs send client 用于测试. 您可以像下面这样来运行 client:

  1. java -cp .\target\eventhubs-storm-spout-{version}-jar-with-dependencies.jar com.microsoft.eventhubs.client.EventHubSendClient
  2. [username] [password] [entityPath] [partitionId] [messageSize] [messageCount]

如果想要发送消息到所有的 partition（分区）, 使用 “-1” 作为 partitionId.

Windows Azure Eventhubs

  1. http://azure.microsoft.com/en-us/services/event-hubs/