WebScrapingEngineer

## Accountabilities Design, build, refactor, and maintain robust web scraping systems to ensure high reliability, scalability, and performance of data pipelines. Implement advanced scraping strategies including browser automation, fingerprint management, proxy rotation, and session handling to bypass detection mechanisms. Work with dynamic and JavaScript-heavy websites, handling complex DOM structures and evolving page behaviors effectively. Collaborate with analysts and cross-functional stakeholders to define data requirements and ensure accuracy and completeness of extracted datasets. Develop monitoring, logging, and alerting systems to proactively detect scraper failures and performance issues. Optimize existing scraping infrastructure for speed, efficiency, and maintainability using clean, modular engineering practices. Research and adopt new tools, techniques, and anti-detection strategies to continuously improve data extraction capabilities. Requirements: 3+ years of hands-on experience in web scraping and automation engineering roles. Strong expertise with scraping frameworks such as Selenium, Playwright, or Puppeteer. Deep understanding of HTTP protocols, REST APIs, HTML parsing, browser rendering, and TLS/SSL fundamentals. Proven experience working with anti-bot systems, including fingerprinting, request signature manipulation, and evasion techniques. Strong knowledge of cookies, headers, session management, and proxy infrastructure (residential and datacenter proxies). Experience building monitoring, logging, and alerting systems for production-grade scraping pipelines. Strong debugging and troubleshooting skills for large-scale distributed systems. Excellent communication skills for working with both technical and non-technical stakeholders in English. Benefits: Competitive compensation aligned with skills and experience Fully remote work opportunity based in India with flexible working hours (11am–8pm IST standard, flexible arrangement) Strong focus on o