Anti-Bot Engineer

🕒 il y a 11 jours

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Recevoir des emails pour des emplois à distance

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

Smart Working

Site WebLinkedInTous les Emplois

51 - 200 employés

🤝 B2B

☁️ SaaS

🎯 Recrutement

B2B • SaaS • Recruitment

Smart Working est un service de recrutement spécialisé dans la recherche et la fourniture de développeurs logiciels de premier plan venus du monde entier pour répondre aux besoins des entreprises. Grâce à un processus de sélection rigoureux incluant des évaluations techniques et des vérifications de l'historique, Smart Working garantit que ses clients reçoivent des développeurs hautement qualifiés maîtrisant divers langages de programmation et frameworks. L'entreprise se concentre sur des solutions d'embauche flexibles et à distance, permettant aux entreprises de développer efficacement leurs équipes de développement tout en bénéficiant d'économies significatives.

Description

• Design, build, and maintain large-scale Python-based scraping systems targeting highly protected websites (including Google-like environments). • Architect resilient extraction systems capable of handling dynamic, JavaScript-heavy pages using browser automation and hybrid approaches. • Continuously adapt systems to frequent changes in page structures, request flows, and anti-bot mechanisms. • Build robust, production-grade data extraction pipelines with strong emphasis on accuracy, observability, and fault tolerance. • Implement advanced strategies such as proxy rotation, fingerprinting, session management, and request routing to ensure stability at scale. • Monitor system health, proactively detect anomalies, and debug complex production failures across distributed systems. • Optimise scraping infrastructure for performance, cost efficiency, and reliability at scale. • Collaborate with data engineering and product teams to ensure scraped data is structured, validated, and trusted. • Operate and improve systems running continuously in cloud environments. • Document system architecture, scraping logic, and operational procedures for long-term maintainability. • Contribute to improving resilience, automation, and adaptability in adversarial environments.

🎯 Exigences

• 7+ years of professional software engineering experience, with a strong focus on backend systems, data engineering, or distributed systems. • Proven experience building and operating large-scale production web scraping systems. • Deep hands-on experience scraping Google or similarly complex, heavily protected / anti-bot environments. • Strong expertise in Python (or comparable production languages such as Go, Rust, or JavaScript). • Strong understanding of HTTP internals: headers, cookies, TLS, redirects, sessions, and browser networking behaviour. • Experience with browser automation frameworks such as Playwright, Selenium, Puppeteer, or equivalent. • Strong knowledge of HTML parsing, DOM traversal, and high-performance data extraction techniques. • Proven experience handling anti-bot systems, including rate limiting, CAPTCHAs, IP rotation, and fingerprinting. • Experience designing asynchronous and concurrent systems for high-throughput workloads. • Strong debugging skills across distributed, failure-prone production systems. • Experience running cloud-based systems at scale with strong operational ownership. • Comfortable working in highly adversarial and fast-changing technical environments.

🏖️ Avantages

• Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter) • No Weekend Work: Real work-life balance, not just words • Day 1 Benefits: Laptop and full medical insurance provided • Support That Matters: Mentorship, community, and forums where ideas are shared • True Belonging: A long-term career where your contributions are valued