Parcourir les catégories
Explorer
Fiverr Pro
Français
$
USD
Shivanesan S
@hardshiva
GCP Data Engineer
Inde
Anglais
À propos de moi
I am a Google Certified Data Engineer with 3+ years of experience designing and implementing scalable data engineering solutions on Google Cloud Platform. I have expertise in building end-to-end ETL pipelines and optimizing data processing workflows.
Compétences
Shivanesan S
hors ligne •
Temps de réponse moyen de 1 heure
Voir mes services
Conseil en ingénierie des données
I will do data engineering, etl pipeline orchestration, and data architecture
Expérience professionnelle
Data Engineer
Randstad Singapore • Temps plein
Feb 2023 - Present • 3 yrs 3 mos
Scalable ML Pipelines: Designed and optimized scalable ETL/ELT pipelines using Apache Airflow and BigQuery, integrating Vertex AI to automate the training and deployment of predictive models on operational data. Developed automated data ingestion workflows using Google Cloud Storage, Bigquery, and Dataproc, reducing manual intervention and increasing pipeline reliability by 40% Predictive Insights: Built responsive web applications (POC) using Next.js and Python, integrating LLM-powered search and Generative AI features to provide stakeholders with natural language queries for real-time operational insights. Optimized PySpark jobs and SQL queries in BigQuery, improving data processing performance and reducing computational costs by 70% Implemented data quality monitoring dashboards and automated testing procedures, ensuring data accuracy and pipeline stability Cross-Functional Collaboration: Collaborated with Data Science teams to translate complex business requirements into scalable technical solutions, leveraging Google Cloud Vertex AI for model versioning and lifecycle management.
