mysql数据导入hive出现错误ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf.
ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is set correctly.
mysql导入数据到hive
在sqoop根目录输入命令:
./bin/sqoop import --connect jdbc:mysql://xxx.xxx.xxx.xxx:3306/mqtt --username xxxx --password xxxxx --table mqtt_user --hive-import --create-hive-table -m1 --target-dir /user/hive/warehouse/test1 --hive-table dblab.test1
运行后报错:
ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is set correctly.
多次参考多个大佬的回答后发现是自己路径设置有问题
1.HADOOP_CLASSPATH路径
vim ~/.bashrc
export HADOOP_CLASSPATH=/usr/local/hadoop/lib
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/local/hive/lib/*
检查HIVE_CONF_DIR是否有设置:
echo $HIVE_CONF_DIR
如果输出为空,则是没有设置HIVE_CONF_DIR
vim ~/.bashrc
export HIVE_CONF_DIR=$HIVE_HOME/conf
重新输入命令:
./bin/sqoop import --connect jdbc:mysql://xxx.xxx.xxx.xxx:3306/mqtt --username xxxx --password xxxxx --table mqtt_user --hive-import --create-hive-table -m1 --target-dir /user/hive/warehouse/test1 --hive-table dblab.test1
执行成功