Spark 运行警告:spark.debug.maxToStri
2020-05-01 本文已影响0人
晨冉1688
spark运行报错
Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.debug.maxToStringFields' in SparkEnv.conf.
可以设置一个参数.config("spark.debug.maxToStringFields", "100")
SparkSession
.builder()
.master("local[*]")
.appName("report")
.config("spark.debug.maxToStringFields", "100")
.getOrCreate();