Graphframe错误/星火
问题描述:
我写在斯卡拉2.11这行代码到Databricks:Graphframe错误/星火
import org.graphframes._
val user_ridotto = sqlContext.sql("SELECT * FROM userRidotto")
var users_1 = user_ridotto.select("user_id", "name", "city", "num_fr",
"fans", "review_count", "importance").withColumnRenamed("user_id", "id")
val users = users_1.withColumn("ridotto", lit("ridotto"))
var edges_1 = user_ridotto.select($"user_id" as "src", explode($"friends")
as
"dst", lit(1))
val graph_1 = GraphFrame(users, edges_1)
println("users: " + users.count + ", archi_1: " + edges_1.count)
val paths = graph_1.find("(a)-[e]->(b)")
.filter("a.ridotto='ridotto'")
.filter("b.ridotto='ridotto'")
val edges = paths.select("e.src", "e.dst")
val graph = GraphFrame(graph_1.vertices, edges)
println("users: " + users.count + ", archi: " + edges.count)
但它返回我这些错误:
笔记本:1:错误:对象graphframes是不是成员包有机的 进口org.graphframes._ ^ 笔记本:8:错误:未找到:值GraphFrame VAL graph_1 = GraphFrame(用户,edges_1) ^ 笔记本:15:错误:未找到:值GraphFrame val graph = GraphFrame(graph_1.vertices,edges)
任何人都可以帮助我吗?
在此先感谢 真诚 安东尼
答
库不是naitively loded,所以你需要导入库下的jar文件。您可以在工作区下导入文件(应该有一个消息框,允许您专门导入jar文件),然后附加它。附加后需要重新启动集群
您可以在以下位置获得jar文件:graphframes