MapReduce

Map-Reduce

• MapReduce is a framework to develop distrubuted applications using Java,Scala, and other programming languages.

• MapReduces's distributed filesystem is not a replacement for a relational database management systen.

Hadoop and Spark

Hadoop and Spark are two different distributed software frameworks.

• A spark job can be an arbitrary DAG(Directed Acyclic Graph) of map and/or reduce/shuffle phase. Spark may run with/without Hadoop.

Benefits for big data processing

• reliability

• scalability
• distributed processing
• parallelism

Chapter 10: Content-Based Recommendation:Movies