smart-working-solutions - Smart Working Solutions - Python Scraping Engineer (Remote, Full-Time) [HR160]
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• Strong professional experience with Python development • Proven experience building production-grade web scraping systems • Hands-on experience scraping Google or similarly protected platforms • Strong understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour • Experience using browser automation frameworks such as Playwright, Selenium, Puppeteer, or similar • Strong knowledge of HTML parsing, DOM traversal, and structured data extraction • Experience handling rate limiting, CAPTCHA systems, IP rotation, and bot detection mechanisms • Experience building asynchronous or concurrent scraping architectures • Experience operating scraping systems at scale in cloud environments • Strong debugging and troubleshooting skills for complex distributed systems • Experience working with headless browser fingerprinting and anti-bot evasion techniques • Experience working with distributed task systems or job queues • Experience implementing data quality monitoring or anomaly detection systems • Experience working with search, advertising, or competitive intelligence datasets
Responsibilities
• Design, develop, and maintain large-scale Python-based web scraping systems • Build scrapers capable of extracting data from Google and other highly protected websites • Develop scraping pipelines for dynamic, JavaScript-heavy websites using browser automation • Continuously adapt scraping systems to changes in page structure, request flows, and anti-bot defences • Engineer robust data extraction and processing pipelines to ensure high data quality and reliability • Implement advanced scraping strategies including proxy rotation, fingerprinting, and request routing • Monitor scraping systems and quickly identify and debug failures in production • Optimise scraping infrastructure for performance, reliability, cost efficiency, and low latency • Collaborate with data engineers, data scientists, and product teams to ensure data is usable and trusted • Maintain clear technical documentation and operational runbooks for scraping systems • Contribute to the adoption of AI-assisted development tools and agentic coding workflows
Benefits
• Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter) • No Weekend Work: Real work-life balance, not just words • Day 1 Benefits: Laptop and full medical insurance provided • Support That Matters:Mentorship, community, and forums where ideas are shared • True Belonging: A long-term career where your contributions are valued
No credit card. Takes 10 seconds.