astronomer▌

Human approval gates, form inputs, and branching in Airflow DAGs using deferrable operators. \n \n Four operator types: ApprovalOperator for approve/reject decisions, HITLOperator…

Convert dbt Core projects into Airflow DAGs or TaskGroups using Astronomer Cosmos. \n \n Supports three assembly patterns: standalone DbtDag, DbtTaskGroup within existing DAGs, an…

Custom OpenLineage extractors for unsupported Airflow operators and complex lineage scenarios. \n \n Two approaches: add OpenLineage methods directly to operators you own (recomme…

Initialize and configure Astro/Airflow projects with dependencies, connections, and environment setup. \n \n Scaffolds complete project structure with astro dev init , including d…

Verify data freshness by checking table timestamps and update patterns against a staleness scale. \n \n Identifies timestamp columns using common ETL naming patterns ( _loaded_at…

Comprehensive statistical and quality analysis of database tables with structured profiling output. \n \n Generates column-level statistics tailored to data type: min/max/percenti…

Trace upstream data lineage to identify sources, DAGs, and dependencies feeding a table or column. \n \n Supports tracing three target types: tables, columns, and DAGs; uses Airfl…

Iterative test-debug-fix cycles for Airflow DAGs with comprehensive failure diagnosis. \n \n Start with af runs trigger-wait <dag_id> to run a DAG and wait for completion; no…

Automated detection and code migration for upgrading Apache Airflow 2.x DAGs to Airflow 3.x. \n \n Provides Ruff-based auto-fix rules (AIR30/AIR301/AIR302/AIR31/AIR311/AIR312) to…

Guided workflow for creating Apache Airflow DAGs with validation and testing integration. \n \n Structured six-phase approach: discover environment and existing patterns, plan DAG…