Code

Add raw data filter regex and task#294

Code

Merged

amarouane-ABDELHAK merged 8 commits intofeature/automate-to-cog-transformationNASA-IMPACT/veda-data-airflow:feature/automate-to-cog-transformationfrom automated-transformation/add-raw-data-filterNASA-IMPACT/veda-data-airflow:automated-transformation/add-raw-data-filterCopy head branch name to clipboardFeb 17, 2025

+103-38

Commits

Commits on Feb 5, 2025

• add raw data filter regex and task

  paridhi-parajuli

  committed
  7035d49

  Copy full SHA for 7035d49

• add config param as str

  paridhi-parajuli

  committed
  8864481

  Copy full SHA for 8864481

• increase runs per dag

  paridhi-parajuli

  committed
  155dba8

  Copy full SHA for 155dba8

Commits on Feb 11, 2025

• 1. Combine filter task to discover files task

  Show description for 98d31aa
  paridhi-parajuli

  committed
  98d31aa

  Copy full SHA for 98d31aa

Commits on Feb 13, 2025

• resolve comment

  paridhi-parajuli

  committed
  9aa1431

  Copy full SHA for 9aa1431

Commits on Feb 17, 2025

• add new line

  paridhi-parajuli

  committed
  a6a57df

  Copy full SHA for a6a57df

• make the max instances per dag configurable

  paridhi-parajuli

  committed
  3840a2e

  Copy full SHA for 3840a2e

• add changes to temp file handling

  paridhi-parajuli

  committed
  f8855e2

  Copy full SHA for f8855e2