Web Scraping Lead – Global Team

🔥 0 minutes ago

🌐 India, United States – Remote

🇮🇳 India – Remote 🇺🇸 United States – Remote

💵 $73k - $90k / year

⏰ Full Time

🟠 Senior

✨ Team Lead

👻 Ghost score 5%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

YipitData

WebsiteLinkedInAll Job Openings

201 - 500 employees

💸 Finance

🏢 Enterprise

Finance • Enterprise • Data Analysis

YipitData is a company that specializes in providing accurate, timely insights on over 1,000 companies by analyzing billions of data points every day. They offer detailed research to help investors make smarter decisions and assist companies in increasing market share, sales, and customer base. YipitData delivers alternative data through a range of datasets, including receipt data, card data, web data, and publicly reported earnings. This data is used to track market trends, consumer behavior, and product categories, enabling businesses to gain transparency into performance metrics. Their services cater to investors, companies, and data partners, with a strong focus on accuracy and near real-time data delivery.

📋 Description

• Lead, mentor, and grow a team of web scraping engineers • Own the architecture, roadmap, scalability, and reliability of scraping systems • Guide development and maintenance of scrapers using Playwright, Puppeteer, Selenium, and similar tools • Solve complex challenges involving dynamic websites, browser automation, fingerprinting, sessions, cookies, headers, and proxies • Establish monitoring, logging, alerting, and data-quality practices • Drive performance, reliability, and infrastructure improvements • Partner with Engineering, Data, Analytics, and Product teams to prioritize requirements and deliver high-quality data • Participate in hiring, technical reviews, and engineering planning • Lead the design, scalability, reliability, and performance of scraping infrastructure

🎯 Requirements

• 7+ years of software engineering experience, with strong web scraping experience • Previous engineering management/team leadership experience preferred • Strong hands-on experience with Playwright, Puppeteer, or Selenium • Deep understanding of HTTP, REST APIs, HTML/DOM, browser rendering, and TLS/SSL • Strong experience with fingerprinting, anti-bot challenges, cookies, headers, sessions, and proxy rotation • Experience building scalable, reliable scraping infrastructure • Strong knowledge of monitoring, logging, metrics, and production troubleshooting • Excellent communication and stakeholder-management skills • Strong ownership, leadership, and mentoring abilities • Must not currently or in the future require visa sponsorship

🏖️ Benefits

• Competitive salary and comprehensive benefit offerings • Career ladder with manager or individual-contributor paths • Regular career conversations and internal mobility opportunities • Flexible work hours • Hybrid work environment • Unlimited vacation • Generous 401K match • Parental leave • Team events • Wellness budget • Learning reimbursement • Monthly WFH budget for remote workers • Health plans starting at no monthly out-of-pocket premium • Dental and vision benefits • Commuter benefits • Learning, self-improvement, and skill-mastery opportunities