Formula 1 Data Engineering Project

Real World Project on Formula1 Racing. The technology used: Azure Databricks, Delta Lake, Unity Catalog, Azure Data Factory The project includes:

• application of design patterns: full data load, incremental load;
• working with delta and parquet files;
• working with Azure storage blob containers;
• Data vacuuming, deletion, time travel and restoration;