阅读背景:

希望使用SparklyR按索引对Spark数据框进行排序

来源:互联网 
library(sparklyr)
library(dplyr)
library(Lahman)

spark_install(version = "2.0.0")
sc <- spark_connect(master = "local")

batting_tbl <- copy_to(sc, Lahman::Batting, "batting"); batting_tbl

batting_tbl %>% arrange(-index())
# Error: org.apache.spark.sql.AnalysisException: Undefined function: 'INDEX'. 
# This function is neither a registered temporary 
# function nor a permanent function registered in the database 'default'.; line 3 pos 10
library(sparklyr)
library(dplyr)
library(Lahman



你的当前访问异常,请进行认证后继续阅读剩余内容。

分享到: