d
divya_patel15

Divya Patel

@divya_patel15

Software Engineer Data Engineer

Inde
Anglais, Hindi
Certaines informations sont présentées en anglais.
À propos de moi
I am a Software Engineer/ data engineer with experience in building multithreaded data pipelines and modern ELT stacks. I specialize in Java, Python, and Spark, with a focus on creating scalable, fault-tolerant systems using AWS and BigQuery to improve data throughput and processing efficiency.... Plus d’infos

Compétences

d
divya_patel15
Divya Patel
hors ligne • 
Temps de réponse moyen de 1 heure

Voir mes services

ETL de données
I will make data engineering pipelines
De100 $US / projetPlus de détails

Expérience professionnelle

Microsoft

Software Development Engineer

Microsoft • Temps plein

Oct 2025 - Present • 10 mos

• Configured and deployed a modern ELT stack (Airbyte, Prefect, dbt) to orchestrate data ingestion, transformation, and loading into Google BigQuery. • Developed an organization-wide finance and business data upload platform using Python and Angular that validates, formats, and standardizes reports before storing them in Amazon S3 and Google BigQuery.

Amazon

Software Engineer

Amazon • Temps plein

Dec 2024 - Oct 2025 • 10 mos

• Built a multithreaded data pipeline using Java and Apache Spark to enable parallel data flow, reducing latency by 70% and significantly improving throughput and efficiency while ensuring consistency, reliability, and fault tolerance across large-scale data processing. • Developed Git-integrated Databricks jobs using Python to stream data from Kafka into Delta tables, designing a transactional, fault-tolerant, and scalable data pipeline that ensured reliability, consistency, and error-free ingestion. • Worked on a payment processing project using SFTP, S3, and Databricks to reconcile all transactions by coordinating with banks, payment gateways, and internal databases, ensuring fault-free and reliable payment methods.