Spark Streaming

2019-10-16  本文已影响0人  clive0x

spark.streaming.receiver.writeAheadLog.enable   config to enable receiver's write ahead long,then data received from streaming will writed to block manager && write ahead log,must first config checkpoint 

spark.streaming.blockInterval:200ms  Every 200ms spark will generator block,see BlockGenerator.scala.

上一篇下一篇

猜你喜欢

热点阅读