Distributed computing and data processing frameworks

The big data challenge

The major hardware restrictions
• Processor time
• Memory
• Hard drive space
• Network bandwidth

Memory (RAM)

Hard drive space

Hadoop

MapReduce

Resilient Distributed Datasets (RDDs)

Storm framework

Discussion