Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)

人生苦短,务必性感.

问题描述:集群中有一台kafka启起来一会就自动退出

netstat -anp|grep 9092,发现端口不在监听状态

用Kafka Tool工具也连不上(10.45.157.64这台)

Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)

查看server.log,报错如下:

[2020-11-07 10:09:39,932] INFO Opening socket connection to server 10.45.154.85/10.45.154.85:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-11-07 10:09:39,944] WARN Client session timed out, have not heard from server in 20056ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-11-07 10:09:40,051] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper)
[2020-11-07 10:09:40,054] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-11-07 10:09:40,055] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient)
[2020-11-07 10:09:40,062] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING
        at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply$mcV$sp(ZooKeeperClient.scala:258)
        at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:254)
        at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:254)
        at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:253)
        at kafka.zookeeper.ZooKeeperClient.kafka$zookeeper$ZooKeeperClient$$waitUntilConnected(ZooKeeperClient.scala:254)
        at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:112)
        at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1825)
        at kafka.server.KafkaServer.kafka$server$KafkaServer$$createZkClient$1(KafkaServer.scala:363)
        at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:387)
        at kafka.server.KafkaServer.startup(KafkaServer.scala:207)
        at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
        at kafka.Kafka$.main(Kafka.scala:84)
        at kafka.Kafka.main(Kafka.scala)

[2020-11-07 10:09:40,069] INFO shutting down (kafka.server.KafkaServer)
[2020-11-07 10:09:40,075] INFO shut down completed (kafka.server.KafkaServer)
[2020-11-07 10:09:40,076] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2020-11-07 10:09:40,080] INFO shutting down (kafka.server.KafkaServer)

Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)

嘴强王者,还是排查下吧:

1、netstat -anp|grep 9092,发端口不在监听状态,就感觉防火墙问题,看了下防火墙是关的   这步没毛病,排除

2、sh zkServer.sh status 查看Mode,一台是leader ,另外两台均是follower       这步没毛病,排除

3、查看server.properties配置中的broker.id,是否有重复     这步没毛病  ,排除

4、查看server.properties配置中的broker.id,是否与myid和zoo.cfg中配置的server.id一致  这步没毛病 ,排除

 

那是哪出问题了呢?

Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)

5、那可能是连接zookeeper的超时问题? 在server.properties 中查看 zookeeper.connection.timeout.ms=6000,把6000改大,我这里改为60000(如果没有这个参数就自己添加上) 问题真在这!!!

再次启动kafka,nohup /usr/local/kafka_2.11-2.3.0/bin/kafka-server-start.sh /usr/local/kafka_2.11-2.3.0/config/server.properties 1>/dev/null 2>&1 &
,终端窗口输入命令jps查看进程,发现此时kafka已经启起来了。

Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)

再用Kafka Tool工具连一下试试,也正常了

Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)

Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)