net windows Kafka 安装与使用入门

.netwindowsKafka安装与使用入门完整解决方案请参考：SettingUpandRunningApacheKafkaonWindowsOS在环境搭建过程中遇到两个问题，在这里先列出来，以方便查询：1.\Java\jre7\lib\ext\QTJava.zipwasunexpectedatthistime.Processexited解决方案：1.1右键点击“我的电脑”->"高级系统设置"->"环境变量"1.2查看CLASSPATH的值里有没有包含QTJava.zip的路径，如果有的话，把对应的路径删除，问题就解决了。2.Missing`server'JVM(Java\jre7\bin\server\jvm­­.dll.)解决方案：2.1.拷贝C:\ProgramFiles\Java\jdk1.6.0\jre\bin\server2.2粘贴到C:\ProgramFiles\Java\jre1.6.0\bin搭建环境1.安装JDK1.1安装文件：/technetwork/java/javase/downloads/jre8-downloads-2133155.html下载ServerJRE.1.2安装完成后需要添加以下的环境变量（右键点击“我的电脑”->"高级系统设置"->"环境变量"）：JAVA_HOME:C:\ProgramFiles(x86)\Java\jre1.8.0_60（这个是默认安装路径，如果安装过程中更改了安装目录，把更改后的路径填上就行了）PATH:在现有的值后面添加";%JAVA_HOME%\bin"1.3打开cmd运行"java-version"查看当前系统Java的版本：java-version2.安装ZookeeperKafka的运行依赖于Zookeeper，所以在运行Kafka之前我们需要安装并运行Zookeeper2.1下载安装文件：/releases.html2.2解压文件（本文解压到G:\zookeeper-3.4.8）2.3打开G:\zookeeper-3.4.8\conf，把zoo_sample.cfg重命名成zoo.cfg2.4从文本编辑器里打开zoo.cfg2.5把dataDir的值改成“:\zookeeper-3.4.8\data”2.6添加如下系统变量：ZOOKEEPER_HOME:G:\zookeeper-3.4.8Path:在现有的值后面添加";%ZOOKEEPER_HOME%\bin;"2.7运行Zookeeper:打开cmd然后执行zkserver3.安装并运行Kafka3.1下载安装文件：/downloads.html3.2解压文件（本文解压到G:\kafka_2.11-）3.3打开G:\kafka_2.11-\config3.4从文本编辑器里打开perties3.5把log.dirs的值改成“G:\kafka_2.11-\kafka-logs”3.6打开cmd3.7进入kafka文件目录:cd/dG:\kafka_2.11-\3.8输入并执行以打开kafka:.\bin\windows\kafka-server-start.bat.\config\perties4.创建topics4.1打开cmd并进入G:\kafka_2.11-\bin\windows4.2创建一个topic：kafka-topics.bat--create--zookeeperlocalhost:2181--replication-factor1--partitions1--topictest5.打开一个Producer：cd/dG:\kafka_2.11-\bin\windowskafka-console-producer.bat--broker-listlocalhost:9092--topictest6.打开一个Consumer:cd/dG:\kafka_2.11-\bin\windowskafka-console-consumer.bat--zookeeperlocalhost:2181--topictest然后就可以在Producer控制台窗口输入消息了。在消息输入过后，很快Consumer窗口就会显示出Producer发送的消息：至此，Kafka运行环境的搭建就完成了:-)web管理方面（正式运维部署）：网上有人说kafkasdk方面：有人建议:/Microsoft/CSharpClient-for-Kafka（微软提供的sdk，看了源码个人感觉有些复杂）还有kafka-net这个感觉会简单很多（看了源码感觉一些Task写法并不喜欢）推荐:kafka-net简单易用些。地址:/Jroland/kafka-net以上sdk可以搜索nuget查看开源地址和最新release包,当然.netsdk还有很多其他选择。个人开发工具（windows支持），windows开发环境使用kafkaTool下载地址:/download.htmlkafka-netsdk使用demo参考来源:/Wulex/p/5619425.html详细请查看官方开源地址的demo:/Jroland/kafka-netKafkaProducer程序:复制代码复制代码classProgram{staticvoidMain(string[]args){do{Produce(GetKafkaBroker(),getTopicName());System.Threading.Thread.Sleep(3000);}while(true);}privatestaticvoidProduce(stringbroker,stringtopic){varoptions=newKafkaOptions(newUri(broker));varrouter=newBrokerRouter(options);varclient=newProducer(router);varcurrentDatetime=DateTime.Now;varkey=currentDatetime.Second.ToString();varevents=new[]{newMessage("HelloWorld"+currentDatetime,key)};client.SendMessageAsync(topic,events).Wait(1500);Console.WriteLine("Produced:Key:{0}.Message:{1}",key,events[0].Value.ToUtf8String());using(client){}}privatestaticstringGetKafkaBroker(){stringKafkaBroker=string.Empty;conststringkafkaBrokerKeyName="KafkaBroker";if(!ConfigurationManager.AppSettings.AllKeys.Contains(kafkaBrokerKeyName)){KafkaBroker="http://localhost:9092";}else{KafkaBroker=ConfigurationManager.AppSettings[kafkaBrokerKeyName];}returnKafkaBroker;}privatestaticstringgetTopicName(){stringTopicName=string.Empty;conststringtopicNameKeyName="Topic";if(!ConfigurationManager.AppSettings.AllKeys.Contains(topicNameKeyName)){thrownewException("Key\""+topicNameKeyName+"\"notfoundinConfigfile->configuration/AppSettings");}else{TopicName=ConfigurationManager.AppSettings[topicNameKeyName];}returnTopicName;}}复制代码复制代码4.KafkaConsumer程序:复制代码复制代码classProgram{staticvoidMain(string[]args){Consume(getKafkaBroker(),getTopicName());}privatestaticvoidConsume(stringbroker,stringtopic){varoptions=newKafkaOptions(newUri(broker));varrouter=newBRouter(options);varconsumer=newConsumer(newConsumerOptions(topic,router));//ConsumereturnsablockingIEnumerable(ie:neverendingstream)foreach(varmessageinconsumer.Consume()){Console.WriteLine("Response:Partition{0},Offset{1}:{2}",message.Meta.PartitionId,message.Meta.Offset,message.Value.ToUtf8String());}}privatestaticstringgetKafkaBroker(){stringKafkaBroker=string.Empty;varKafkaBrokerKeyName="KafkaBroker";if(!ConfigurationManager.AppSettings.AllKeys.Contains(KafkaBrokerKeyName)){KafkaBroker="http://localhost:9092";}else{KafkaBroker=ConfigurationManager.AppSettings[KafkaBrokerKe