Difference between revisions of "Alpha Centauri"

From CDOT Wiki
Jump to: navigation, search
Line 36: Line 36:
 
[[File:Daal-flow.png]]
 
[[File:Daal-flow.png]]
  
 
+
[[File:DAALDataflow.png]]
  
 
== Sources ==
 
== Sources ==

Revision as of 16:31, 16 December 2017

"The world is one big data problem." -cit. Andrew McAfee

Intel Data Analytics Acceleration Library

Team Members

  1. Rosario A. Cali
  2. Joseph Pildush
  3. eMail All

Introduction

Intel Data Analytics Acceleration Library, also known as Intel DAAL, is a library created by Intel in 2015 to solve problems associated with Big Data. Intel DAAL is available for Linux, OS X and Windows platforms and it is available for the C++, Python, and Java programming platforms. Intel DAAL is optimized to run on a wide range of devices ranging from home computers to data centers and it uses Vectorization to deliver best performances.

Intel DAAL helps speed big data analytics by providing highly optimized algorithmic building blocks for all data analysis stages and by supporting different processing modes.

The data analysis stages covered are:

  • Pre-processing
  • Transformation
  • Analysis
  • Modeling
  • Validation
  • Decision Making

The different processing modes are:

  • Batch processing - Data is stored in memory and processed all at once.
  • Online processing - Data is processed in chunks and then the partial results are combined during the finalizing stage. This is also called Streaming.
  • Distributed processing - Similarly to MapReduce Consumers in a cluster process local data (map stage), and then the Producer process collects and combines partial results from Consumers (reduce stage). Developers can choose to use the data movement in a framework such as Hadoop or Spark, or explicitly coding communications using MPI.

How Intel DAAL Works

Intel DAAL is a simple and efficient approach towards Big Data, Machine Learning, and Deep Learning because it takes away all the hustle of creating complex and efficient algorithms. For the most part, developers only have to worry about feeding the Data and follow the Data Analytics Ecosystem Flow. Intel DAAL provides many functions for Data Management, Algorithms, and Services.
Here there are some pictures describing the Intel DAAL Model and how it works:

DaalModel.png

Daal-flow.png

File:DAALDataflow.png

Sources