This is One of the Solutions

Pyspark Notebook With Docker

| Comments

Install Docker

Using the following command one can install docker. I have done the same using Ubuntu-14-04 instance. For richer options refer the docker official site

 wget -qO- | sh

Now run the following command from any machine on which docker is installed.

docker run -d -t -p 8888:8888 prabeeshk/pyspark-notebook

After successfully running the pyspark-notebook docker container, access pyspark ipython notebook by directing the web browser to or http://localhost:8888. Enjoy the Spark with ipython notebook.

For docker image details refer dockerhub repository

Find the source code in github repository

Related posts