Pro members applied to this job 36 hours before you saw itGet Pro ›

source.ai - Experienced Web Scraping Engineer (Remote)

Remote - Warsaw2d ago

Remote EMEA Artificial Intelligence Developer Tools Web Developer Redis Docker Front-end MySQL Kubernetes Elasticsearch Prometheus Grafana Back-end FastAPI

Requirements

• Understanding of computer science, including data structures, algorithms, computability and complexity. • Knowledge on how to unblock websites for scraping. • Is able to use different scraping techniques & open-source tools to build scrapers. • Is comfortable with using Dev Tools. • Network (TLS/SSL) knowledge. • Worked with browser automations. • Knows their way around asynchronous programming. • Web development knowledge. • Knows how to use CSS Selectors / XPaths for parsing. • Worked on browser source code. • Knowledge of any front-end framework. • Experience working with Pydantic, FastAPI, SQLAlchemy. • Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus. • Experience with machine learning that is scraping domain-specific. • Has experience in building scalable systems.

Responsibilities

• Develop scalable scrapers. • Define resilient scraping strategies, unblock websites for scrapingImprove observability in the system. • Develop back-end solutions for scraping & parsing problems of various magnitudes. • Maintain the current system and develop new features related to scraping & parsing.

Benefits

• Gross salary: from 4500 EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competencies. • Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing. • Celebration & Community: Team events, an overseas workation and plenty of ways to mark milestones together. • Plus bonus vacation days, paid life-moment days off, and all the tools you need. See the full list of benefits here: https://source.ai/career/blog/benefits • Oxylabs is part of Source, a data ecosystem for a world built on intelligence. One of five independent technology companies connected by shared standards, expertise, and a belief in responsible access to web data. • Up for the challenge? Let’s talk!