Spark JAR Package

A Spark JAR Package is a JAR package that ...

• Example(s):
  • s3://elasticmapreduce/libs/script-runner/script-runner.jar
• See: Spark Platform, AWS EMR.

---

---

References

2016

• http://spark.apache.org/docs/latest/submitting-applications.html
  • QUOTE: The spark-submit script in Spark’s bin directory is used to launch applications on a cluster. It can use all of Spark’s supported cluster managers through a uniform interface so you don’t have to configure your application specially for each one. ...

    ... Once a user application is bundled, it can be launched using the bin/spark-submit script. This script takes care of setting up the classpath with Spark and its dependencies, and can support different cluster managers and deploy modes that Spark supports:

./bin/spark-submit \
 --class <main-class> \
 --master <master-url> \
 --deploy-mode <deploy-mode> \
 --conf <key>=<value> \
 ... # other options
 <application-jar> \
 [application-arguments]

---