Software Engineer – Web Crawling
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• solving complex web scraping challenges • data is the product • 3+ years of experience in software engineering with a focus on web crawling and data extraction. • web crawling and data extraction • Strong expertise in Node.js (preferred) for web crawling applications. • Strong expertise in Node.js • Deep understanding of HTML, JavaScript, and reverse engineering techniques. • HTML, JavaScript, and reverse engineering techniques • Hands-on experience with Playwright, Puppeteer, and Cheerio for automation and scraping. • Playwright, Puppeteer, and Cheerio • Knowledge of security and performance best practices related to web crawling. • security and performance best practices • Experience with Apify or Crawlee for large-scale crawling solutions. • Apify or Crawlee • Proficiency in TypeScript. • TypeScript
Responsibilities
• Develop, enhance, and maintain web crawlers and scraping infrastructure. • Optimize scraping techniques to handle anti-bot mechanisms, performance, and security challenges. • Collaborate with a geographically distributed team to identify and resolve issues. • geographically distributed team • Ensure high availability, efficiency, and reliability of crawling operations. • Integrate AI solutions to enhance automation and data extraction accuracy. • AI solutions
Benefits
• Unlimited PTO (we mean it!) • Comprehensive medical, dental, and vision insurance plans • STD, LTD, AD&D, and life insurance coverage • Free membership to TalkSpace, Teladoc and Health Advocate • Free annual membership to One Medical in participating regions • 401(k) retirement plan with company matching • Free equipment: laptop and home office stipend • Please note: the only valid application forms are via woflow.com and jobs.ashbyhq.com/woflow