2015-01-19 13 views
5

मैं काफ्का 0.8.2 बीटा का उपयोग कर रहा है और 2 उबंटू 14 आभासी मशीनों:काफ्का Zookeeper कनेक्शन जारी करता

  1. 172.30.141.127 Zookeeper
  2. 172.30.141.184 चल रहा है एक काफ्का दलाल
चल रहा है

मैं जुकीपर उदाहरण शुरू कर रहा हूं और सब ठीक है। फिर मैं ब्रोकर शुरू करने की कोशिश करता हूं और इसे 172.30.141.127 मार्च 181 से कनेक्ट करता हूं। ऐसा लगता है कि एक विशिष्ट बंदरगाह पर एक सत्र को जोड़ने और स्थापित करने में सक्षम है, लेकिन फिर यह कुछ अपवाद के कारण कनेक्शन को नुकसान पहुंचाता है जो लॉग प्रतीत नहीं होता है।

दलाल उत्पादन:

[2015-01-19 11:03:55,029] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,030] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,031] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,031] INFO Client environment:os.arch=i386 (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,032] INFO Client environment:os.version=3.16.0-23-generic (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,033] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,033] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,037] INFO Client environment:user.dir=/home/osboxes/Desktop/kafka_2.11-0.8.2-beta (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,039] INFO Initiating client connection, connectString=172.30.141.127:2181 sessionTimeout=6000 [email protected] (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:55,129] INFO Opening socket connection to server 172.30.141.127/172.30.141.127:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:55,186] INFO Socket connection established to 172.30.141.127/172.30.141.127:2181, initiating session (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:55,203] WARN Session 0x0 for server 172.30.141.127/172.30.141.127:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) 
java.io.IOException: Connection reset by peer 
    at sun.nio.ch.FileDispatcherImpl.read0(Native Method) 
    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) 
    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) 
    at sun.nio.ch.IOUtil.read(IOUtil.java:192) 
    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366) 
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 
[2015-01-19 11:03:56,552] INFO Opening socket connection to server 172.30.141.127/172.30.141.127:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:56,555] INFO Socket connection established to 172.30.141.127/172.30.141.127:2181, initiating session (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:56,567] WARN Session 0x0 for server 172.30.141.127/172.30.141.127:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) 
java.io.IOException: Connection reset by peer 
    at sun.nio.ch.FileDispatcherImpl.read0(Native Method) 
    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) 
    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) 
    at sun.nio.ch.IOUtil.read(IOUtil.java:192) 
    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68) 
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366) 
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 
[2015-01-19 11:03:57,131] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread) 
[2015-01-19 11:03:58,075] INFO Opening socket connection to server 172.30.141.127/172.30.141.127:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:58,077] INFO Socket connection established to 172.30.141.127/172.30.141.127:2181, initiating session (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:58,195] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper) 
[2015-01-19 11:03:58,196] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn) 
[2015-01-19 11:03:58,251] FATAL [Kafka Server 1], Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) 
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 2000 
    at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84) 
    at kafka.server.KafkaServer.initZk(KafkaServer.scala:157) 
    at kafka.server.KafkaServer.startup(KafkaServer.scala:83) 
    at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:28) 
    at kafka.Kafka$.main(Kafka.scala:46) 
    at kafka.Kafka.main(Kafka.scala) 
[2015-01-19 11:03:58,279] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer) 
[2015-01-19 11:03:58,295] INFO [Kafka Server 1], shut down completed (kafka.server.KafkaServer) 
[2015-01-19 11:03:58,308] FATAL Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable) 
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 2000 
    at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98) 
    at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84) 
    at kafka.server.KafkaServer.initZk(KafkaServer.scala:157) 
    at kafka.server.KafkaServer.startup(KafkaServer.scala:83) 
    at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:28) 
    at kafka.Kafka$.main(Kafka.scala:46) 
    at kafka.Kafka.main(Kafka.scala) 
[2015-01-19 11:03:58,335] INFO [Kafka Server 1], shutting down (kafka.server.KafkaServer) 

Zookeper आउटपुट:

[2015-01-19 11:03:55,245] INFO Accepted socket connection from /172.30.141.184:54089 (org.apache.zookeeper.server.NIOServerCnxnFactory) 
[2015-01-19 11:03:55,315] WARN Exception causing close of session 0x0 due to java.io.IOException: Connection reset by peer (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:55,329] INFO Closed socket connection for client /172.30.141.184:54089 (no session established for client) (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:56,613] INFO Accepted socket connection from /172.30.141.184:54090 (org.apache.zookeeper.server.NIOServerCnxnFactory) 
[2015-01-19 11:03:56,615] WARN Exception causing close of session 0x0 due to java.io.IOException: Connection reset by peer (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:56,617] INFO Closed socket connection for client /172.30.141.184:54090 (no session established for client) (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:58,133] INFO Accepted socket connection from /172.30.141.184:54091 (org.apache.zookeeper.server.NIOServerCnxnFactory) 
[2015-01-19 11:03:58,134] WARN Exception causing close of session 0x0 due to java.io.IOException: Connection reset by peer (org.apache.zookeeper.server.NIOServerCnxn) 
[2015-01-19 11:03:58,135] INFO Closed socket connection for client /172.30.141.184:54091 (no session established for client) (org.apache.zookeeper.server.NIOServerCnxn) 

पिंग 2 मशीनों के बीच काम करता है। टेलनेट 2181 प्रकार के काम करता है, जिसमें यह कनेक्ट होता है, लेकिन समय-समय पर डिस्कनेक्ट हो जाता है। इससे मुझे लगता है कि समस्या जुकीपर उदाहरण के साथ है। दोनों प्रक्रियाओं को रूट के रूप में शुरू किया गया है।

कोई विचार यह क्यों हो रहा है? धन्यवाद

उत्तर

0

चेतावनी के बारे में कोई विचार है, लेकिन मैं एक ही त्रुटि समस्या

org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 2000 
    at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:880) 
    .... 

मेरे मामले में, जब मैं उत्पादक और उपभोक्ता की स्थापना किया गया था मैं गलत आईपी/पोर्ट प्रदान की है। जब मैंने इसे एक के साथ सही करने के लिए बदल दिया:

bin/kafka-console-producer.sh --broker-list kafka_ip:kafka_port --topic test 
bin/kafka-console-consumer.sh --zookeeper zookeeper_id:zookeper_port --topic test --from-beginning 

मेरी समस्या हल हो गई थी।

3

आप शायद प्रति मेजबान कनेक्शन की अधिकतम संख्या को मार रहे हैं।

ऐसा होता है यदि आपके पास आपके ज़ूकीपर लॉग में [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:[email protected]] - Too many connections from /127.0.0.1 - max is 10 है।

अपने conf/zoo.cfg में maxClientCnxns=[something more than 10; 0 for unlimited] सेट करके इसे ठीक करें।

Docs (maxClientCnxns के लिए खोजें)

संबंधित मुद्दे