
Heshan S
Data Pipeline Developer
Compétences

Voir mes services

Portfolio
Expérience professionnelle
Founder & Scraping Engineer
Pulse Aggregator • Indépendant
Feb 2026 - Present • 5 mos
Production news aggregator monitoring 250+ sources (BBC, Reuters, TechCrunch) 24/7 with Python/Playwright scraping, SHA-256 deduplication, and PostgreSQL full-text search. Features hourly automated crawls, keyword alerts, weekly digest emails via APScheduler. 4-tier scraping pipeline handles anti-bot measures with proxy rotation. Live since March 2026—powers PR monitoring, journalism research.
Founder & Web Scraping Engineer
Social Intel (Social Media Dataset Marketplace) • Indépendant
Dec 2025 - Present • 7 mos
Building production-grade scraping pipelines that extract/enrich 124k+ social media records (Reddit, GitHub, YouTube) with sentiment analysis and topic tags. Tech: Python/Scrapy/Playwright + JWT API delivery. Powers AI training, brand monitoring, market intelligence. Live since March 2026.