GitHub - AyoubMaimmadi/ETL-and-ELT-integration-pipelines: ETL and ELT are data processing pipelines. ETL extracts data, transforms it, and then loads it into a database, ensuring it's clean before storage. ELT, however, loads raw data first and transforms it later within the database, offering more flexibility. This process is automated with Airflow.

Name		Name	Last commit message	Last commit date
Latest commit History 52 Commits
airflow		airflow
assets		assets
sales_csv		sales_csv
sales_xlsx		sales_xlsx
ELT_automated.py		ELT_automated.py
ELT_automated_airflow.py		ELT_automated_airflow.py
ETL_automated_airflow.py		ETL_automated_airflow.py
ETL_pipeline.py		ETL_pipeline.py
ETL_pipeline_version2.py		ETL_pipeline_version2.py
README.md		README.md
create_db_schema.py		create_db_schema.py
docker-compose.yml		docker-compose.yml
dockerfile		dockerfile
hdfs_upload.py		hdfs_upload.py
mapper.py		mapper.py
mapper.py.txt		mapper.py.txt
mapper_test.py		mapper_test.py
progress_elt.json		progress_elt.json
progress_etl.json		progress_etl.json
reducer.py		reducer.py
remote_ETL_pipeline.py		remote_ETL_pipeline.py
sample_data.csv		sample_data.csv
tempCodeRunnerFile.py		tempCodeRunnerFile.py

Provide feedback