Changes

Jump to: navigation, search

GPU621/ApacheSpark

954 bytes added, 13:36, 26 November 2018
→‎Finance and Stock trading Use Case
Spark is advanced data processing/analysis model which is replacing MapReduce <br />
Spark does not have its own file system so it run on the top of HDFS <br />
 
[[File:10a.PNG]]
=== Spark vs MapReduce ===
[[File:3.PNG]]
== Features ==
<b> Transformations </b> <br />
Create a new data set from existing one <br />
[[File:5bc.PNG ]]
 
<b> Actions </b> <br />
Return a value to the driver program after running computation on data set <br />
[[File:6.PNG]]  These examples and more are found at https://spark.apache.org/docs/latest/rdd-programming-guide.html == Examples & == === Word Count ===  [[File:4.PNG]] Using transformations ( flatmap, map, reduceByKey ) to build a data set of string and int pairs. It is then saved into a file === Finance and Stock trading Use Case ===
It Imagine that you are working for a financial company and your job is used to buy in healthcareand buy out stocks to make money. The decision you make highly depends on the prediction which is calculated by your financial model. In this kind of situation, mediahow long it takes for your financial model to make a prediction is very critical. We know that the price of stocks change very fast. In a couple seconds a stock can change prices drastically. Thus, financeif your model cannot provide you a near real time response, retail, travelyou might lose your opportunity to trade your stocks with the best price. Apache Spark can be utilized to create financial models to make predictions in real time.
=== Finance and Fraud Detection ===[[File:7ab.png]]
Sathia
33
edits
Retrieved from "https://wiki.cdot.senecapolytechnic.ca/wiki/Special:MobileDiff/136250...136349"

Navigation menu