Open main menu

CDOT Wiki β

Changes

GPU621/Apache Spark Fall 2022

78 bytes added, 03:45, 7 December 2022
no edit summary
==Spark cluster mode==
 
===1. Local mode===
For local development and testing, it is usually divided into local single-thread and local-cluster multi-thread.
===5. Kubernetes cluster mode===
Running on the Kubernetes cluster manager, Kubernetes is responsible for resource management, and Spark is responsible for task scheduling and computing
 
==Spark Implementation==
===Work Flow Chart===
[[File:Cluster-Overview.jpg]]
 
10
edits