Learning Apache Spark Course

Hi and welcome to the repository of the Learning Spark course. You can find all the source codes of the Jupyter notebooks here.

The full course is available in our Data Engineering Academy at

Course Contents

• Why Spark
• How Spark Works
• Set up your dev environment 
with Docker & Jupyter
• Work with DataFrames (JSON & CSV)
• Introduction into SparkSQL
• Coding with RDDs
• Conclusion

Source codes

• 01_JSON_Transformations
• 02_CSV_Schemas
• 03_Working_with_DataFrames
• 04_SparkSQL
• 05_Working_With_RDDs

Interesting Links

• How to activate Hyper-V on Win 10
• Used Docker Container
• How to share local windows paths with container