Wynd Labs
11 - 50 employees
Founded 2018
🤖 Artificial Intelligence
Artificial Intelligence • Data
Wynd Labs is focused on making public web data accessible for artificial intelligence applications. The company provides enterprise customers with robust web scraping networks for accessing diverse data, such as financial insights for small to medium cap equities. Additionally, Wynd Labs contributes to AI development by offering AI-oriented datasets and designing native AI models to assist in data scraping and structuring. Their platform supports a wide range of business solutions, including AI training data, price scraping, ad verification, and financial data services.
Research Crawling Engineer
🕒 April 20
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
Wynd Labs
11 - 50 employees
Founded 2018
🤖 Artificial Intelligence
Artificial Intelligence • Data
Wynd Labs is focused on making public web data accessible for artificial intelligence applications. The company provides enterprise customers with robust web scraping networks for accessing diverse data, such as financial insights for small to medium cap equities. Additionally, Wynd Labs contributes to AI development by offering AI-oriented datasets and designing native AI models to assist in data scraping and structuring. Their platform supports a wide range of business solutions, including AI training data, price scraping, ad verification, and financial data services.
📋 Description
• Build and maintain large-scale web crawlers across diverse domains • Design high-throughput, fault-tolerant systems for data collection (millions to billions of URLs/day) • Handle anti-bot systems, rate limits, and dynamic/JS-heavy sites • Develop pipelines for cleaning, deduplication, filtering, and normalization • Construct and maintain datasets for research and model training • Monitor crawl performance, coverage, and data quality; iterate quickly • Collaborate with research teams to align data collection with modeling needs • Optimize infrastructure for cost, latency, and reliability
🎯 Requirements
• Strong programming experience in one or more of: Go, Rust, Python, Java, or C++ • Experience building web crawlers or large-scale data pipelines • Solid understanding of HTTP, networking, and browser behavior • Familiarity with distributed systems and parallel processing • Experience working with large datasets (TB–PB scale preferred) • Ability to debug unstable or adversarial environments
🏖️ Benefits
• Competitive salary • Benefits and equity package
Apply NowSimilar Jobs
🕒 April 20
Senior HPC Cluster Engineer focusing on GPU computing and InfiniBand networks for AI cloud infrastructure. Responsibilities include optimizing performance and integrating new hardware within a dynamic environment.
🕒 April 20
Open Core Ventures
1 - 10
Founding Engineer role at Hermes Web to develop a polished hosted personal AI agent. Responsibilities include owning product and engineering end-to-end with a focus on consumer-grade polish.
🕒 April 18
Controls Engineer providing technical advice and analyzing system controls for rotating equipment, including programming. Coordinating with customers and ensuring operation per design standards throughout North America.
🕒 April 17
Microgrid Design Engineer developing DER solutions at Honeywell for C&I projects. Collaborating with engineers to enhance energy efficiency and sustainability goals.
🇺🇸 United States – Remote
💵 $120k - $140k / year
⏰ Full Time
🟢 Junior
🟡 Mid-level
👷🏻♀️ Engineer
🦅 H1B Visa Sponsor
🕒 April 17
Capacity and Performance Engineer ensuring optimized systems and operational excellence for Luminare Health's infrastructure. Main responsibilities include driving proactive monitoring and managing capacity roadmaps.
