
Tharanga
Python Developer, FastAPI , Web Scraping , AI Automation, Data Engineering
Compétences

Voir mes services


Portfolio
Expérience professionnelle
Data Engineer
Not Found • Temps plein
Jul 2023 - Present • 2 yrs 10 mos
Designing and building production-ready data engineering systems using Apache Kafka, PySpark, and Delta Lake to support large-scale data processing and real-time streaming pipelines. Developing and deploying AI-powered applications integrated with leading LLMs including OpenAI GPT, Gemini, and Qwen to automate intelligent data workflows. Building agentic scrapers and web scraping systems for structured data extraction at scale. Creating RESTful APIs using FastAPI to expose data services and support downstream applications. Developing interactive Streamlit dashboards for data visualization and business reporting. Leveraging LangGraph to design and manage multi-step agentic workflows, enabling autonomous decision-making within data pipelines.
python developer
iLevel Lab • Temps plein
Feb 2022 - Jul 2023 • 1 yr 5 mos
Developed and maintained scalable RESTful APIs using FastAPI, supporting internal and client-facing data workflows. Built automated web scraping pipelines to extract, clean, and structure large datasets for downstream analytics. Collaborated on AI-integrated applications leveraging OpenAI GPT and other LLMs to automate repetitive data processing tasks. Contributed to the development of Streamlit dashboards for real-time data visualization and reporting. Worked within an agile team environment to deliver production-ready Python solutions, improving data pipeline reliability and reducing manual intervention across key business processes.