Spark Streaming Playground Environment Setup

Most of the materials are presented as a reference materials based on local machine setup environment, based on your machine some steps may vary.

• Linux Machine Setup
• SSH
• Python - Conda Environment
• PostgreSQL
• Apache Hadoop
• Apache Hive
• Setup
• References
• Test with our code
• Apache Spark
• Docker
• Kubernetes
• Twitter
• MISC

These steps will help you to turn your machine into a single node cluster (both the master and client services will be running on your machine).

This is pretty heavy stuff to hold on average single machine, so it would be ideal to have RAM 16GB and 8 Cores minimum. A machine with 32GB and 8+ Cores would be ideal!