tag

lineage

3 indexed skills · max 10 per page

skills (3)

annotating-task-lineage

astronomer/agents · Productivity

0

Annotate Airflow tasks with data lineage using inlets and outlets. \n \n Supports OpenLineage Dataset objects, Airflow Assets, and Airflow Datasets for defining inputs and outputs across databases, data warehouses, and cloud storage \n Use as a fallback when operators lack built-in OpenLineage extractors; follows a four-tier precedence system where custom extractors and OpenLineage methods take priority \n Includes dataset naming helpers for Snowflake, BigQuery, S3, and PostgreSQL to ensure cons

tracing-downstream-lineage

astronomer/agents · Productivity

0

Trace downstream data lineage to assess change impact before modifying tables or DAGs. \n \n Identifies direct consumers of a target table or DAG through source code search, view dependencies, and BI tool connections \n Builds a full dependency tree mapping all downstream impacts, from tables to dashboards to ML models \n Categorizes dependencies by criticality (critical, high, medium, low) to prioritize stakeholder communication and testing \n Generates an impact report with risk assessment, af

tracing-upstream-lineage

astronomer/agents · Productivity

0

Trace upstream data lineage to identify sources, DAGs, and dependencies feeding a table or column. \n \n Supports tracing three target types: tables, columns, and DAGs; uses Airflow DAG source code and task inspection to find producing pipelines \n Handles SQL sources (FROM clauses), external systems (S3, Postgres, Salesforce, HTTP APIs), and file-based sources; recursively traces upstream chains \n Includes column-level tracing through direct mappings, transformations, and aggregations in DAG c