Sourav D

Senior DevOps & Data Platform Architect

Confidentials • Temps plein

May 2017 - Present • 9 yrs 3 mos

Infrastructure as Code & Automation: Designed 30+ production-ready, modular Terraform patterns and automated policy-as-code deployments across multi-tier environments (Dev/Non-Prod/Prod), cutting manual setup by ~70% and configuration drift/duplication by ~40%. Integrated automated testing with PowerShell Pester and built Python-based IaC drift detection visualized via OpenSearch. CI/CD & DevSecOps Delivery: Transitioned and built multi-stage pipelines using GitHub Actions, Azure DevOps, and Terraform Enterprise, reducing deployment cycles from ~120 minutes to under 20 minutes. Enforced automated security governance, secrets management, and static scanning using tfsec, Checkov, and TFLint within pull-request workflows. Modern Lakehouse & Kubernetes Architecture: Deployed containerized microservices and modern data platforms on Kubernetes (AKS) using Docker, NGINX Ingress with token authentication, and ArgoCD. Engineered Lakehouse solutions hosting Apache Iceberg, Trino query engines, and Apache Polaris for centralized catalog management and RBAC governance. Enterprise Networking & Landing Zones: Architected enterprise Azure Landing Zones, management group hierarchies, hybrid connectivity (ExpressRoute/VPN), load balancing, and private networking. Designed high-availability architectures, including load-balanced Azure OpenAI services behind API Gateways with strict cost optimization Data Platforms & Full-Stack Observability: Streamlined customer onboarding, bucket permissions, and cross-tenant replication across Azure Data Factory, Databricks, and Google Cloud Storage. Built end-to-end monitoring using Datadog across Kubernetes clusters and pipelines, alongside Apache Superset dashboards to analyze petabyte-scale metadata.