Scheduler
Orchestrators define and monitor complex multi-step DAG workflows with dependency management, retries, and observability. Cron-style schedulers simply trigger jobs at fixed time intervals. The tools below are full orchestrators.
- Apache Airflow - Platform for programmatically authoring, scheduling, and monitoring data pipelines as DAGs.
- Dagster - Data orchestration platform with an asset-centric approach, lineage tracking, and built-in observability.