Azkaban documentation!¶
What is Azkaban¶
Azkaban is a distributed Workflow Manager, implemented at LinkedIn to solve the problem of Hadoop job dependencies. We had jobs that needed to run in order, from ETL jobs to data analytics products.
See the Getting Started for more details.
Features¶
- Distributed Multiple Executor
- MySQL Retry
- Friendly UI
- Conditional Workflow
- Data Triggers
- High Security
- Support plug-in extensions, from Web UI to job Execution
- Full Authorship management system
Contents:
- Getting Started
- Configurations
- UserManager
- Creating Flows
- Using Azkaban
- Conditional Workflow
- Flow Trigger Dependency Plugin
- API Documentation
- Authenticate
- Fetch user Projects
- Create a Project
- Delete a Project
- Upload a Project Zip
- Fetch Flows of a Project
- Fetch Jobs of a Flow
- Fetch Executions of a Flow
- Fetch Running Executions of a Flow
- Execute a Flow
- Cancel a Flow Execution
- Schedule a period-based Flow (Deprecated)
- Flexible scheduling using Cron
- Fetch a Schedule
- Unschedule a Flow
- Set a SLA
- Fetch a SLA
- Pause a Flow Execution
- Resume a Flow Execution
- Fetch a Flow Execution
- Fetch Execution Job Logs
- Fetch Flow Execution Updates
- Fetch Logs of a Project
- Image Management APIs
- How Tos
- Plugins
- Jobtypes
Community¶
Users and development team are in the Gitter.
Developers interested in getting more involved with Azkaban may join the mailing lists mailing lists, report bugs, and make contributions.