错误的解决方案是什么，“JBlas不是包或apache的成员”？

Question

我试图从这两个线程（ this和this）线程中解决它，它在我自己的虚拟机上为我工作，但在云计算机数据表中无效。我为他们做了同样的过程。但云中的错误与之前在虚拟机中的错误相同。在云上应该做些什么来解决它？

Answer 1

你在这些链接的线程中做了完整的“git clone”步骤吗？你是否需要实际修改jblas？如果不是的话，你应该把它们从maven中心使用--packages org.jblas:jblas:1.2.4，而不用git clone或mvn install;以下的罚款对我来说是新的Dataproc集群：

$ spark-shell --packages org.jblas:jblas:1.2.4 
Ivy Default Cache set to: /home/dhuo/.ivy2/cache 
The jars for the packages stored in: /home/dhuo/.ivy2/jars 
:: loading settings :: url = jar:file:/usr/lib/spark/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml 
org.jblas#jblas added as a dependency 
:: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0 
    confs: [default] 
    found org.jblas#jblas;1.2.4 in central 
downloading https://repo1.maven.org/maven2/org/jblas/jblas/1.2.4/jblas-1.2.4.jar ... 
    [SUCCESSFUL ] org.jblas#jblas;1.2.4!jblas.jar (605ms) 
:: resolution report :: resolve 713ms :: artifacts dl 608ms 
    :: modules in use: 
    org.jblas#jblas;1.2.4 from central in [default] 
    --------------------------------------------------------------------- 
    |     |   modules   || artifacts | 
    |  conf  | number| search|dwnlded|evicted|| number|dwnlded| 
    --------------------------------------------------------------------- 
    |  default  | 1 | 1 | 1 | 0 || 1 | 1 | 
    --------------------------------------------------------------------- 
:: retrieving :: org.apache.spark#spark-submit-parent 
    confs: [default] 
    1 artifacts copied, 0 already retrieved (10360kB/29ms) 
Setting default log level to "WARN". 
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 
ivysettings.xml file not found in HIVE_HOME or HIVE_CONF_DIR,/etc/hive/conf.dist/ivysettings.xml will be used 
Spark context Web UI available at http://10.240.2.221:4040 
Spark context available as 'sc' (master = yarn, app id = application_1501548510890_0005). 
Spark session available as 'spark'. 
Welcome to 
     ____    __ 
    /__/__ ___ _____/ /__ 
    _\ \/ _ \/ _ `/ __/ '_/ 
    /___/ .__/\_,_/_/ /_/\_\ version 2.2.0 
     /_/ 

Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_131) 
Type in expressions to have them evaluated. 
Type :help for more information. 

scala> import org.jblas.DoubleMatrix 
import org.jblas.DoubleMatrix 

scala> :quit 

此外，如果您需要通过Dataproc的作业提交API提交要求“套餐”的工作，然后因为--packages是在不同的火花发射实际上是语法糖脚本而不是Spark作业的属性，则需要使用等效的spark.jars.packages，而不是在这种情况下，如explained in this * answer。