s
satish_sp

Satish P

@satish_sp

Data Engineer

Inde
Anglais
Certaines informations sont présentées en anglais.
À propos de moi
I am a Data Engineer with 5+ years of experience designing and developing scalable data pipelines, ETL frameworks, and data lake architectures across AWS and Azure cloud platforms. I have strong expertise in Python, PySpark, SQL, Apache Spark, Databricks, Snowflake, and Apache Airflow.... Plus d’infos

Compétences

s
satish_sp
Satish P
hors ligne • 

Voir mes services

Programmation et Tech
I will build and automate etl pipelines using airflow pyspark and AWS

Portfolio

Expérience professionnelle

Qualcomm

Data Engineer

Qualcomm • Temps plein

Aug 2025 - Present9 mos

Designed scalable data pipelines ingesting semiconductor wafer probe test data from Automated Test Equipment (ATE) into AWS S3 data lake. Built PySpark and Databricks based ETL pipelines processing millions of wafer test records daily. Implemented S3 data lake architecture managing raw, processed, and curated manufacturing datasets. Developed ingestion frameworks for high volume CSV and Parquet wafer test files from manufacturing systems. Built and managed Apache Airflow DAGs orchestrating ingestion, transformation, and loading workflows. Implemented PySpark transformations generating wafer level and die level yield analytics datasets.

United_Airlines

Data Engineer

United Airlines • Temps plein

Oct 2023 - Jul 20251 yr 9 mos

Designed ETL pipelines migrating pilot records from SQL Server to AWS Redshift for FAA PRD compliance. Automated ingestion and transformation using Python, AWS Glue, Lambda, and PySpark. Developed Apache Airflow DAGs with proactive monitoring using AWS SNS. Deployed data pipelines across development, staging, and production environments. Implemented data validation frameworks ensuring regulatory data accuracy and collaborating with DevOps teams to automate infrastructure.