Open main menu

CDOT Wiki β

Changes

GPU621/Apache Spark

18 bytes added, 15:57, 20 November 2020
m
no edit summary
= [[File:Hadooplogo.png||300px]] vs [[File:Apache Spark logo.svg.png||200px]] =
'''MapReduce ''' was famously used by Google to process massive data sets in parallel on a distributed cluster in order to index the web for accurate and efficient search results. '''Apache Hadoop''', the open-source platform inspired by Google’s early proprietary technology has been one of the most popular big data processing frameworks. However, in recent years its usage has been declining in favor of other increasingly popular technologies, namely '''Apache sparkSpark'''.
This project will focus on demonstrating how a particular use case performs in Apache Hadoop versus Apache spark, and how this relates to the rising and waning adoption of Spark and Hadoop respectively. It will compare the advantages of Apache Hadoop versus Apache Spark for certain big data applications.
76
edits