Changes

Jump to: navigation, search

GPU621/Apache Spark Fall 2022

453 bytes added, 22:25, 29 November 2022
Apache Spark Core API
</dependency>
</dependencies>
 
===Create And Set Up Spark===
Spark needs to be set up in a cluster. But you can also run it locally and act as a cluster. We will talk about how to set up a spark in a cluster later. Now let's try to create a spark locally. To do that, we will need the following code:
 
//create and set up spark
SparkConf conf = new SparkConf().setAppName("HelloSpark").setMaster("local[*]");
JavaSparkContext sc = new JavaSparkContext(conf);
sc.setLogLevel("WARN");
==Deploy Apache Spark Application On AWS==
92
edits

Navigation menu