Cloud Composer · Apache Airflow — vgsales ETL pipeline PUBLIC DATASET · ILLUSTRATIVE MOCKUP

Automated ETL Pipeline — scheduled DAG run

GCS (raw) → clean → BigQuery (typed load) → curated summary table · runs daily, no manual steps

0records
0/7tasks
0.0selapsed

DAGS (5)

data_ingestion_dagqueued
data_cleaning_dagqueued
env_dependencies_dagqueued
bigquery_dagqueued
bigquery_vgsales_
aggregation_dagqueued
One responsibility per DAG, so a transient failure in one stage never forces a full re-run. Every task carries retries + retry_delay.
Graph view
BigQuery result
Task instances — waiting to start
Scheduler log
Idle — press “Trigger DAG run” to start.
Illustrative UI mockup · public video-game sales dataset · GCP project IDs and bucket names redacted