I will create, update airflow dags, end to end project support in docker setup, dags

Certaines informations sont présentées en anglais.

Pakistan

Je parle Anglais

26 commandes terminées

Data Engineer: dbt, BigQuery, PySpark, Python, SQL, GCP, AWS

From setting up ETL/ELT pipelines and real-time streaming to creating dashboards and optimizing databases for faster insights, I can help you with any data related stuff. I am well skilled in BigQuery...

Niveau 1

Répond à certains critères de performance et présente un fort potentiel sur la place de marché.

À propos de ce service

I will create, update, and optimize Apache Airflow DAGs and provide end-to-end project support. Whether you need new pipelines, existing DAG enhancements, or a complete Airflow setup in Docker, I will help you build scalable, efficient, and production-ready workflows tailored to your needs.


I can help you with ETL/ELT pipelines, data orchestration, workflow automation, Docker-based Airflow setup, API/database integrations, and performance optimization to ensure your pipelines run faster, smoother, and with fewer failures.


Whats included:

  • Creating new Airflow DAGs from scratch
  • Updating and refactoring existing DAGs
  • Setting up Airflow in Docker with configurations
  • Designing end-to-end ETL/ELT pipelines
  • Integrating APIs, databases, and external data sources
  • Debugging, bug fixing, and resolving task failures
  • Optimizing DAG performance for faster execution
  • Setting up scheduling, dependencies, and orchestration
  • Implementing monitoring, logging, and error handling
  • Providing ongoing support for scaling and maintaining pipelines


Just shoot me a DM, and Ill get back to you right away to discuss your project needs.

Destination Platform:

Snowflake

Google BigQuery

Amazon Redshift

Outils et plateformes:

Fivetran

Airbyte

Matillion

Mon portfolio

Autres services de Data engineering I Offre