Spark 简单的wordcount
2017-07-21 本文已影响0人
RoronoaZoro丶
sc.textFile("/input/words.txt")
.flatMap(line => line.split(" "))
.map(word => (word, 1))
.reduceByKey((x, y) => x + y)
.collect
sc.textFile("/input/words.txt")
.flatMap(_.split(" "))
.map((_, 1))
.reduceByKey(_ + _)
.collect
