
JuWon
Data Engineer, ETL Pipelines, Python, Airflow and dbt
Compétences

Voir mes services

Expérience professionnelle
Data Engineer
esports.com • Temps plein
Feb 2025 - Feb 2026 • 1 yr
Built a production-grade Enterprise Medallion Lakehouse on Microsoft Fabric processing the full Online Retail II dataset across Bronze, Silver, and Gold layers, reducing data transformation time by 60% through reusable PySpark utility notebooks. Engineered an Apache Airflow-orchestrated ELT pipeline integrating 5 data sources into a Snowflake Star Schema warehouse, cutting manual data preparation effort by 80% through automated scheduling, retry logic, and incremental load patterns. Developed a dbt transformation layer with 15 modular SQL models, 30 built-in data quality tests, and full auto-generated documentation, reducing data errors caught in production to zero across all tested pipelines. Delivered 3 end-to-end Power BI solutions connected to live warehouse models, covering sales analytics, operational KPIs, and workforce reporting, each with advanced DAX measures, optimized relationships, and automated refresh.