Parcourir les catégories
Explorer
Fiverr Pro
Français
$
USD
Archit M
@ayushmani3
Lead Data Engineer
Inde
Anglais, Hindi
À propos de moi
Senior Tech Executive & Cloud Data Architect with ~6 years of experience managing global deliveries for MNCs across Europe, UK, and EMEA. Consider me your trusted friend and partner in this data journey, bringing the exact elite expertise you need. Expert in building scalable ETL/ELT pipelines, processing billions of records, and cutting cloud costs by 4x using GCP and Azure. Specializes in Python, SQL, Airflow, BigQuery, Snowflake, and Terraform. Let’s handle your data engineering and make tech seamless for your business.
Compétences
Archit M
hors ligne •
Temps de réponse moyen de 1 heure
Voir mes services
Conseil en ingénierie des données
I will design enterprise cloud data architecture and cross cloud migrations
Portfolio
Expérience professionnelle
Technical lead
Media and Marketing • Temps plein
Jan 2022 - Present • 4 yrs 4 mos
Technical Lead with extensive experience designing and scaling cloud‑native data platforms across GCP, AWS, and Azure. Strong expertise in building secure, high‑performance data pipelines using Airflow, BigQuery, Snowflake, Dataproc, Spark, DBT, Dataform, and modern CI/CD automation practices. Currently at Dentsu, delivering large‑scale data solutions for media, automobile, and fintech clients. Built 75+ Airflow DAGs and 15+ Kubernetes workloads, improving distributed processing scalability by 50%. Processed 20B+ data points using BigQuery and Dataform with modular, testable Python code and robust CI/CD pipelines. Led secure cross‑cloud data migrations between AWS S3 and GCP using GCP KMS, encryption, and automated key rotation. Re‑engineered legacy Hadoop/Oozie workflows into cloud‑native Airflow pipelines on GCP Dataproc, processing 210M+ records daily. Implemented high‑volume PySpark batch jobs transforming 550M+ raw records into production datasets with strong reliability, retries, and real‑time alerting. Architected a secure distributed data platform for a payment gateway client, ingesting data from 22+ APIs via Cloud Run into GCS. Managed infrastructure with Terraform (IaC), automated 25+ GitHub Actions workflows, and processed 10M+ transactional records in Snowflake. Implemented envelope encryption and compliance‑ready key management using GCP KMS. Previously at Merkle Inc, optimized large‑scale data pipelines on Azure Databricks and Azure Data Factory, reducing runtimes from 3 days to 8 hours, and delivered containerized AWS microservices processing 50M+ data points, aligned with cloud well‑architected principles. Skilled in Python, SQL, Scala, containerization (Docker, Kubernetes), data governance, performance optimization, and building resilient, production‑grade data systems.
