Workflow engines
Workflow engines tools and applications
airflow Installation Guide
airflow is a free and open-source workflow platform. Airflow provides platform to programmatically author and monitor workflows
azkaban Installation Guide
azkaban is a free and open-source workflow manager. LinkedIn Azkaban provides batch workflow job scheduler
cadence Installation Guide
cadence is a free and open-source workflow orchestration. Uber Cadence provides fault-tolerant stateful code platform
dagster Installation Guide
dagster is a free and open-source data orchestrator. Dagster provides data orchestrator for machine learning and ETL
digdag Installation Guide
digdag is a free and open-source workflow engine. Digdag provides simple workflow engine for multi-cloud
kedro Installation Guide
kedro is a free and open-source data pipeline framework. Kedro provides framework for creating reproducible data pipelines
luigi Installation Guide
luigi is a free and open-source pipeline framework. Luigi helps build complex pipelines of batch jobs
metaflow Installation Guide
metaflow is a free and open-source ML infrastructure. Netflix Metaflow provides framework for real-life ML projects
oozie Installation Guide
oozie is a free and open-source workflow scheduler. Oozie provides workflow scheduler for Hadoop jobs
prefect Installation Guide
prefect is a free and open-source workflow orchestration. Prefect provides modern workflow orchestration framework
temporal Installation Guide
temporal is a free and open-source workflow orchestration. Temporal provides workflow orchestration platform for mission-critical applications