Python Scraping Engineer

Job not on LinkedIn

🕒 March 16

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Smart Working

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤝 B2B

☁️ SaaS

🎯 Recruiter

B2B • SaaS • Recruitment

Smart Working is a recruitment service specializing in sourcing and providing top-tier software developers from around the world to meet the needs of businesses. With a robust vetting process that includes technical assessments and background checks, Smart Working ensures that clients receive highly skilled developers adept in various programming languages and frameworks. The company focuses on flexible and remote hiring solutions, allowing businesses to efficiently scale their development teams while benefiting from significant cost savings.

📋 Description

• Design, develop, and maintain large-scale Python-based web scraping systems • Build scrapers capable of extracting data from Google and other highly protected websites • Develop scraping pipelines for dynamic, JavaScript-heavy websites using browser automation • Continuously adapt scraping systems to changes in page structure, request flows, and anti-bot defences • Engineer robust data extraction and processing pipelines to ensure high data quality and reliability • Implement advanced scraping strategies including proxy rotation, fingerprinting, and request routing • Monitor scraping systems and quickly identify and debug failures in production • Optimise scraping infrastructure for performance, reliability, cost efficiency, and low latency • Collaborate with data engineers, data scientists, and product teams to ensure data is usable and trusted • Maintain clear technical documentation and operational runbooks for scraping systems • Contribute to the adoption of AI-assisted development tools and agentic coding workflows

🎯 Requirements

• Strong professional experience with Python development • Proven experience building production-grade web scraping systems • Hands-on experience scraping Google or similarly protected platforms • Strong understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour • Experience using browser automation frameworks such as Playwright, Selenium, Puppeteer, or similar • Strong knowledge of HTML parsing, DOM traversal, and structured data extraction • Experience handling rate limiting, CAPTCHA systems, IP rotation, and bot detection mechanisms • Experience building asynchronous or concurrent scraping architectures • Experience operating scraping systems at scale in cloud environments • Strong debugging and troubleshooting skills for complex distributed systems • Experience working with headless browser fingerprinting and anti-bot evasion techniques

🏖️ Benefits

• Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter) • No Weekend Work: Real work-life balance, not just words • Day 1 Benefits: Laptop and full medical insurance provided • Support That Matters:Mentorship, community, and forums where ideas are shared • True Belonging: A long-term career where your contributions are valued