airflow▌

This skill covers deploying Airflow DAGs and projects to production, whether using Astro (Astronomer's managed platform) or open-source Airflow on Docker Compose or Kubernetes.

Human approval gates, form inputs, and branching in Airflow DAGs using deferrable operators. \n \n Four operator types: ApprovalOperator for approve/reject decisions, HITLOperator for multi-option selection with forms, HITLBranchOperator for human-driven task routing, and HITLEntryOperator for form data collection \n All operators are deferrable, releasing worker slots while awaiting human response via Airflow UI's Required Actions tab or REST API \n Supports optional features including custom n

Automated detection and code migration for upgrading Apache Airflow 2.x DAGs to Airflow 3.x. \n \n Provides Ruff-based auto-fix rules (AIR30/AIR301/AIR302/AIR31/AIR311/AIR312) to detect and resolve breaking changes in imports, operators, hooks, and context variables \n Covers critical architecture shifts: workers no longer access metadata DB directly; use the Airflow Python client or REST API instead of ORM session queries \n Includes manual migration checklist for issues Ruff cannot auto-fix: c

Query, manage, and troubleshoot Apache Airflow DAGs, runs, tasks, and system configuration. \n \n Supports 30+ commands across DAG inspection, run management, task logging, configuration queries, and direct REST API access \n Manage multiple Airflow instances with persistent configuration; auto-discover local and Astro deployments \n Trigger DAG runs synchronously (wait for completion) or asynchronously, diagnose failures, clear runs for retry, and access task logs with retry/map-index filtering

Production-ready patterns for Apache Airflow including DAG design, operators, sensors, testing, and deployment strategies.

Production-ready patterns for Apache Airflow DAGs, operators, sensors, testing, and deployment. \n \n Covers DAG design principles (idempotent, atomic, incremental, observable) with task dependency patterns for linear, fan-out, fan-in, and complex workflows \n Includes TaskFlow API decorators for cleaner code with automatic XCom passing, dynamic DAG generation from configs, and branching with conditional logic \n Provides sensor patterns for S3 files, external task dependencies, and custom senso