Data Engineer

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

👻 Ghost score 17%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Wynd Labs

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2018

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

Wynd Labs is focused on making public web data accessible for artificial intelligence applications. The company provides enterprise customers with robust web scraping networks for accessing diverse data, such as financial insights for small to medium cap equities. Additionally, Wynd Labs contributes to AI development by offering AI-oriented datasets and designing native AI models to assist in data scraping and structuring. Their platform supports a wide range of business solutions, including AI training data, price scraping, ad verification, and financial data services.

📋 Description

• Maintain, optimize, and troubleshoot database queries and related data systems • Create, maintain, and improve pipelines for collecting, processing, transforming, validating, and delivering large-scale datasets • Support web scraping and data collection initiatives by developing, testing, and maintaining data-gathering scripts and tools • Monitor and troubleshoot data pipeline issues • Identify data quality concerns and implement timely fixes • Document database queries, pipeline processes, scraping workflows, technical decisions, issues, and resolutions • Participate in research and development projects to improve the company’s data products and workflows

🎯 Requirements

• Bachelor’s degree or equivalent work experience • Advanced Python, including async programming, multiprocessing, and production-grade code for long-running data jobs • Hands-on experience with high-volume web scraping, including proxies, rate limiting, and anti-bot evasion • Experience with platform APIs and large media/metadata datasets • Experience designing and operating distributed data pipelines across many workers/servers • Experience with task queues such as Celery, Kafka, RabbitMQ, or similar • Practical experience with columnar/analytical data warehouses • Databend, ClickHouse, or BigQuery experience strongly preferred • Comfortable with complex analytical queries, partitioning strategies, and cost-aware querying on cloud warehouses • Experience with Docker and Kubernetes, including containerizing workloads, writing Helm charts/manifests, managing deployments, and autoscaling workloads • Comfortable managing services on Linux servers and debugging disk I/O, network, and memory performance issues • CI/CD experience for data workflows using GitHub Actions or ArgoCD • Experience writing scalable APIs

🏖️ Benefits

• Competitive salary, benefits and equity package • Fully remote team • Opportunity to work on a web-scale crawler and knowledge graph • Lean, technical culture with low red tape and fast decision-making • Opportunity to improve access to public web data and extend the value of AI