In this post, we will discuss how to create an assembled JAR for a standalone Spark application using the sbt-assembly plugin. One of my previous posts, we discussed how to build a stand alone Spark Application using SBT eclipse plugin. Now, we will take it one step further and show you how to create a fat JAR for your Spark project using the sbt-assembly plugin.

Adding the sbt-assembly Plugin

The first step in creating an assembled JAR for your Spark application is to add the sbt-assembly plugin. To do this, you will need to add the following line to the project/plugin.sbt file:

addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.9.1")

Configuring Assembly Settings

Next, you will need to specify sbt-assembly.git as a dependency in the project/project/build.scala file:

import sbt._

object Plugins extends Build {
  lazy val root = Project("root", file(".")) dependsOn(
    uri("git://github.com/sbt/sbt-assembly.git#0.9.1")
  )
}

In the build.sbt file, add the following contents: