Shahid T

Senior Data Engineer

Not Found • Temps plein

Jun 2022 - Mar 2026 • 3 yrs 9 mos

• Built 70+ of the 110 Airflow DAGs maintained on GCP Composer for a digital advertising company. • Built Apache Beam / Dataflow pipelines for terabyte-scale workloads and streaming Pub/Sub data. • Evaluated and prototyped multiple BI platforms before driving adoption of Holistics as a cost-effective semantic-layer alternative to Looker for scalable enterprise reporting. • Designed and developed a new star-schema data model in BigQuery, replacing a legacy architecture of hundreds of report-specific tables with about 40 tables and simplifying maintenance. • Redesigned and optimised legacy ETL queries to reduce processing overhead, pipeline failures, and backfill requirements, and implemented built-in error checks and alerts to improve pipeline reliability. • Migrated 30+ legacy Looker Studio reports to Holistics, consolidating standalone reports into a centralised, drill-through reporting experience that improved navigation and usability. • Designed analytical solutions on my own initiative that enabled richer user analysis, expanded segment targeting and predictive modelling population by 6x, and supported adaptation to new PII regulations.

Power BI Consultant

Boston Consulting Group

Sep 2021 - Jun 2022 • 9 mos

• Built Power BI reports that were embedded in a broader UI to compare predicted vs actual pricing strategy for a retailer with 9,000+ stores. Data sourced from Azure Data Lake and PostgreSQL. • Benchmarked and optimised a DirectQuery Power BI model and the SQL views powering it, improving load times through reduced query count, caching, and tuning of underlying queries. • Integrated and aggregated data from CSVs, Spark outputs, application data, and modelling outputs.