Senior Python Scraping Engineer
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Strong professional experience with Python, including production-grade scraping systems • Deep hands-on experience scraping Google or similarly protected platforms • Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour • Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks • Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques • Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems • Comfortable working with asynchronous and concurrent scraping architectures • Experience running scrapers at scale in cloud environments • Strong debugging skills and ability to reason about complex failure modes • Experience with headless browser fingerprinting and anti-bot evasion techniques • Familiarity with containerisation and orchestration, such as Docker and Kubernetes • Experience with distributed task systems and job queues • Background in data quality monitoring and anomaly detection • Experience working with search, advertising, or competitive intelligence data • Pragmatic problem-solving in hostile and fast-changing technical environments • High ownership of systems that run continuously and at scale • A strong bias toward reliability, correctness, and observability • Ability to explain complex technical behaviour clearly to non-specialists • Curiosity about how large platforms evolve their defences and infrastructure • Our Core Values • All Adthenians are expected to align closely with our ‘Core Values’. • What it means... • Get Shit Done: We're big on taking action, owning our challenges, and finding solutions. • Freedom with Responsibility: We take charge of results to recognition. We know that our hustle not only moves the needle for the company but also sets us up for personal success. • Deliver Remarkable Quality: We care about exceeding expectations in the work we do and aim to always do our best work as individuals and as a team. • Smart & Always Improving: We strive daily to expand our knowledge and become better at what we do. • Meet your teammates • You’ll work closely with: • Title: Chief Product & Tech Officer • LinkedIn: https://www.linkedin.com/in/paul-felby-1a475a18a/ • Title: Lead Technical Architect • LinkedIn: https://www.linkedin.com/in/ivan-nikolov-475b2040/
Responsibilities
• As a Senior Python Scraping Engineer, you will design, build, and operate large-scale, resilient web scraping systems, with a strong focus on Google and Google-like search environments. • This role sits at the intersection of data engineering, reverse engineering, and systems reliability, and is critical to delivering accurate, timely, and trustworthy data at scale. • You will work on complex scraping problems where naïve approaches do not work, including dynamic rendering, anti-bot defences, frequent markup changes, and high-volume data collection. • We are leaders in adopting coding with AI tools. The role is ideal for someone who believes in agentic coding and would like to improve their skills. • Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites • Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches • Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms • Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability • Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput • Monitor scrape health, detect failures early, and rapidly debug production issues • Optimise performance, cost, and latency across scraping infrastructure • Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted • Document scraping logic and operational runbooks for long-term maintainability • Who we look for • Research shows men apply if they meet ~60% of the criteria, while women and underrepresented groups apply only if they meet all requirements. If you have the skills but don't meet every requirement, reach out – we'd love to explore how you could be a great fit!
Benefits
• We offer the best of both worlds: the maturity and stability of a well-established company combined with the energy, agility, and impact of a scaling tech organisation. • If you’ve been hesitant about joining a typical tech company due to concerns about chaos, fragility, or volatility, Adthena is your answer. • We’re smaller than large-scale enterprises, offering more autonomy, less red tape, and accelerated growth. • Startup Engineering culture • Strong Culture: Our quarterly surveys show a 93% average approval rating for company culture, with an overall eNPS of 27. • Award-Winning Product: US 2025 Search Awards for Best AI Search Software Innovation • Stock Options: Our employees do incredible work, so as we grow, everyone shares the rewards. • Trust-Based Vacation: Take as much time off as you need, when you need it. • Remote-First: 52% of Adthenian’s work fully remote, with others choosing Hybrid Work at our 3 Geohubs (London, Austin, Sydney). • Flexible Work: Work how and where you do your best, with full autonomy over your day. • Career Growth: Bespoke training and career development via "Sherpa plans” to guide your growth. • Monthly Hackdays & Training Days • Family Care Package: Up to 6 months fully paid maternity leave, and 2 months paternity leave. • Swag Welcome Gift: $70 credit to grab some merch. • Birthday Day Off: Celebrate your special day. • Regular Socials: Summer & Christmas parties, annual and quarterly offsites, monthly meet-ups. See here for more info. • Volunteer Days: Make a difference with paid volunteer time each quarter. See here for more info.