Spark with Python in Jupyter Notebook on a single Amazon EC2 instance
In an earlier post I have explained how to run Python+Spark program with Jupyter on local machine and in a subsequent post , I will explain how the same can be done an AWS EMR cluster of multiple machines. In this post, I explain how this can be done on a single EC2 machine instance running Ubuntu on Amazon AWS. The strategy described in this blog post is based on strategies described in posts written by Jose Marcial Portilla and Chris Albon . We assume that you have a basic familiarity with AWS services like EC2 machines, S3 data storage and concept of keypairs and an account with Amazon AWS. You may use your Amazon eCommerce account but you may also create one on the AWS login page . This tutorial is based on Ubuntu and assumes that you have a basic familiarity with the SSH command and other general Linux file operation commands. 1. Login to AWS Go to the AWS console ,login with userID and password, then go to the page with EC2 services. Unless you have used AWS ...