014 Spark自带的jar如何代入到Yarn集群中

2021-02-15  本文已影响0人  逸章

方法一:

To make Spark runtime jars accessible from YARN side, you can specify spark.yarn.archive or spark.yarn.jars. For details please refer to Spark Properties. If neither spark.yarn.archive nor spark.yarn.jars is specified, Spark will create a zip file with all jars under $SPARK_HOME/jars and upload it to the distributed cache

image.png

方法二:

image.png
上一篇下一篇

猜你喜欢

热点阅读