Tools/Airflow
Airflow
Python-based workflow orchestrator — DAGs of tasks with scheduling, retries, and dependency management. The default choice for batch data pipelines (ETL into a warehouse, scheduled ML retraining) where Argo_Workflows is the Kubernetes-native equivalent for container-first pipelines. Commonly paired with dbt (Airflow schedules, dbt transforms) as the open-source alternative to AWS_Glue; Temporal is the alternative instead of Airflow when workflows are long-running application logic rather than batch pipelines.