Changes

Jump to: navigation, search

GPU621/Apache Spark Fall 2022

13 bytes added, 23:25, 29 November 2022
Create And Set Up Spark
Spark needs to be set up in a cluster. But you can also run it locally and act as a cluster. We will talk about how to set up a spark in a cluster later. Now let's try to create a spark locally. To do that, we will need the following code:
//create and set up spark  SparkConf conf = new SparkConf().setAppName("HelloSpark").setMaster("local[*]"); JavaSparkContext sc = new JavaSparkContext(conf); sc.setLogLevel("WARN");
==Deploy Apache Spark Application On AWS==
92
edits

Navigation menu