I will help to build pyspark notebooks and optimize jobs

Certaines informations sont présentées en anglais.
Soham Das

Inde

Je parle Anglais

4 commandes terminées

Databricks, Unity Catalog, ADF, DLT

Tools I work with - Databricks, Unity Catalog, DLT, Azure, SQL What I help with: - Design and build ETL pipelines using Azure Data Factory and Databricks - Optimize slow or failing Spark and PySpark ...
Plus d’infos
À propos de ce service

Is your PySpark job taking hours? Is your SQL query timing out?

I will find exactly what's slowing it down and fix it.

I have optimized PySpark jobs processing billions of records in production environments. I know exactly where to look.


What I fix:

  • Slow PySpark transformations and actions
  • Partition skew and memory issues
  • Inefficient SQL queries on large datasets
  • Spark configuration tuning
  • DataFrame optimization and caching strategy


You share your code. I analyse, fix and explain exactly what was wrong and why.

Message me first with your problem. I will tell you honestly if I can help.

Plus d’infos
help to build pyspark notebooks and optimize jobs
Plein écran
help to build pyspark notebooks and optimize jobs
Plein écran
help to build pyspark notebooks and optimize jobshelp to build pyspark notebooks and optimize jobs

Langue:

Anglais

Expertise technique:

Apache Spark

•

Databricks

•

Autres

Expertise:

Pipelines de data

•

Développement ETL

+2

Secteur:

Analyse de données

Balises associées