m
manish7lucky

Manish D.

@manish7lucky

Data Enginner and Python Developer

Inde
Anglais, Hindi, Bengali
Certaines informations sont présentées en anglais.
À propos de moi
Data Engineer building automated, production-grade pipelines from ingestion to analytics-ready warehouses. Built: a 1B+ row batch pipeline (Airflow, S3, Snowpipe, dbt) and a real-time streaming pipeline (Kafka, PySpark, Databricks, Delta Lake) with anomaly detection. Stack: Python, SQL, Airflow, dbt, PostgreSQL, Snowflake, AWS, Docker, Kafka. I can build ETL pipelines, automate reporting/spreadsheet syncs, set up Airflow orchestration, design dbt models, or fix a broken pipeline. Currently pursuing BS Data Science at IIT Madras. Clean code, clear scope, no surprises.... Plus d’infos

Compétences

m
manish7lucky
Manish D.
hors ligne • 

Voir mes services

ETL de données
I will build a python etl pipeline for your data

Portfolio

Expérience professionnelle

Personal_portfolio project

Nyc Taxi Data Pipeline

Personal portfolio project • Indépendant

Jul 2026 - Present • 3 mos

end to end production style data pipeline that reduces ingestion speed by 40%