Difference between revisions of "GPU621/DPS921 Could 4U"
(→Map and Reduce Library on GAE) |
(→Map and Reduce Library on GAE) |
||
Line 14: | Line 14: | ||
The original source code is [https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/java/example/src/com/google/appengine/demos/mapreduce/randomcollisions/CollisionFindingServlet.java here]. | The original source code is [https://github.com/GoogleCloudPlatform/appengine-mapreduce/blob/master/java/example/src/com/google/appengine/demos/mapreduce/randomcollisions/CollisionFindingServlet.java here]. | ||
− | [[File:MPL.png| | + | [[File:MPL.png|600px]] |
== Start a new project == | == Start a new project == |
Revision as of 12:08, 8 December 2016
Contents
Cloud 4U
Group Members
- Hualiang Xu, Everything.
Progress
What is Google App Engine
Google App Engine is a platform for building scalable web applications and mobile backends. It has a efficient Map Reduce Library that processes large set of data in map and reduce pattern in parallelism. This project will use this library to process a serious of searching history and produce a recommendation list for user.
Map and Reduce Library on GAE
In Map and Reduce Library, user code is only required for mapping and reduce function. The platform will shuffle and rearrange data order to make the upcoming reduce process extremely fast. This also reduces a lot of development work. For further boosting, the shuffle part can be rewritten to boost up the speed.
The original source code is here.
Start a new project
This link is a completed setup guide by Google. In this project, one more step is to import Map and Reduce Library in java files.
Map: com.google.appengine.tools.mapreduce.Mapper;
Reduce: com.google.appengine.tools.mapreduce.Reducer; com.google.appengine.tools.mapreduce.ReducerInput;