IDEA 打jar,提交spark集群运行
1、idea打开file,选择projectstructure,点击Artifacts,如下图 选择add JAREmpty
然后点击OK
2、选择bulid Artifacts
点击bulid 就会打成jar
3、通过winSCP把jar上传到服务器/var/lib/hadoop-hdfs/application/bash/jar/testjjp.jar
4、编写spark submit脚本
#!/bin/bash
spark-submit \
--class com.jjp.test_Bayes \
--master yarn-client \
--jars/var/lib/hadoop-hdfs/application/bash/jar/ojdbc7.jar \
/var/lib/hadoop-hdfs/application/bash/jar/testjjp.jar\
5、直接运行脚本就是把testjjp类提交到spark集群上运行了。