Hadoop com/fasterxml/jackson/databind/ObjectMapper Error starting NodeManager

2019-11-11 11:20:20,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/dat
a/appcom/hadoop-2.7.4/tmp/nm-local-dir/usercache_DEL_1573442420242
2019-11-11 11:20:20,299 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.l
ocalizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTra
cker
2019-11-11 11:20:20,303 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing YARN shuffle service for Spark
2019-11-11 11:20:20,303 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service spark_shuffle, "spark_shuff
le"
2019-11-11 11:20:20,308 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
java.lang.NoClassDefFoundError: com/fasterxml/jackson/databind/ObjectMapper
    at org.apache.spark.network.shuffle.ExternalShuffleBlockResolver.<clinit>(ExternalShuffleBlockResolver.java:57)
    at org.apache.spark.network.shuffle.ExternalShuffleBlockHandler.<init>(ExternalShuffleBlockHandler.java:58)
    at org.apache.spark.network.yarn.YarnShuffleService.serviceInit(YarnShuffleService.java:129)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:143)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:245)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:261)
    at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:495)
    at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:543)
Caused by: java.lang.ClassNotFoundException: com.fasterxml.jackson.databind.ObjectMapper
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 14 more
2019-11-11 11:20:20,311 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system...
2019-11-11 11:20:20,312 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped.
2019-11-11 11:20:20,312 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete.
2019-11-11 11:20:20,312 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NodeManager at Slave14/10.178.150.14
************************************************************/

 

hadoop启动nodemanager报错如上。

通过日志可以看出缺少相关的jar包,最重要的jar包为jackson-databind-2.2.3.jar

cd $HADOOP_HOME/share/hadoop/tools/lib中。暴力的将jackson相关的jar包全部cp到

cd $HADOOP_HOME/share/hadoop/common/lib中后

启动正常无报错

cd $HADOOP_HOME/sbin

./yarn-daemon.sh start nodemanager

jps

如下:

Hadoop com/fasterxml/jackson/databind/ObjectMapper Error starting NodeManager

日志输出如下下:

Hadoop com/fasterxml/jackson/databind/ObjectMapper Error starting NodeManager