大数据开发

Spark 运行警告:spark.debug.maxToStri

2020-05-01  本文已影响0人  晨冉1688

spark运行报错

Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.debug.maxToStringFields' in SparkEnv.conf.

可以设置一个参数.config("spark.debug.maxToStringFields", "100")

SparkSession
        .builder()
        .master("local[*]")
        .appName("report")
        .config("spark.debug.maxToStringFields", "100")
        .getOrCreate();
上一篇下一篇

猜你喜欢

热点阅读