kafka usecase in real world

2019-06-13  本文已影响0人  赐我理由在披甲上阵

movieflix

image.png
video play position:
  a topic that can have multiple producers;
  should be highly distributed if high volume > 30 partitions;
  choose "user_id" as a key, to make sure all my user's data in order;

recommendations
  low volume topic
  kafka streams recommendation source data from analytical training

GetTaxi

requirement

image.png

social media architecture of kafka

basically decoupled different components, we can call the model CQRS(command query responsibility segregated)

image.png

User_234 liked post_123 at 3 am

image.png
image.png

real time: like spark/storm
batch: hadoop/RBMS


monitoring

image.png

important metrics


two types of index:

image.png
image.png

advertised hostname and listeners:

image.png
上一篇下一篇

猜你喜欢

热点阅读