Senior Software Engineer, Data Acquisition

🔥 14 hours ago

🇺🇸 United States – Remote

💵 $160k - $200k / year

⏰ Full Time

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

People Data Labs

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2015

💼 Consulting

📣 Marketing

🔌 API

Consulting • Marketing • API

People Data Labs is a data infrastructure company that provides large-scale person and company datasets via developer-friendly APIs and data enrichment services. Their platform offers identity resolution, contact and firmographic enrichment, and data delivery tools used by sales, marketing, recruiting, and risk teams. They sell primarily to businesses through a SaaS/API model and emphasize data quality, coverage, and privacy/compliance capabilities.

📋 Description

• Contribute to the architecture and improvement of the data acquisition and processing platform, increasing reliability, throughput, and observability • Use and develop web crawling technologies to capture and catalog data on the internet • Build, operate, and evolve large-scale distributed systems that collect, process, and deliver data from across the web • Design and develop backend services for distributed job orchestration, data pipelines, and large-scale asynchronous workloads • Structure and model captured data, ensuring high quality and consistency across datasets • Improve the speed, scalability, and fault tolerance of ingestion systems • Partner with data product and engineering teams to design and implement new data products and improve existing products • Learn and apply domain-specific knowledge in web crawling and data acquisition with mentorship from experienced teammates

🎯 Requirements

• 7+ years of professional experience building or operating backend or infrastructure systems at scale • Solid programming experience in Python, Go, Rust, or similar, including async / await, coroutines, or concurrency frameworks • Strong grasp of software architecture and backend fundamentals, including concurrency, scalability, and fault tolerance • Solid understanding of browser rendering pipeline and web application architecture, including authentication, cookies, and HTTP request/response • Familiarity with network architecture and debugging, including HTTP, DNS, proxies, and packet capture and analysis • Solid understanding of distributed systems concepts: parallelism, asynchronous programming, backpressure, and message-driven design • Experience designing or maintaining resilient data ingestion, API integration, or ETL systems • Proficiency with Linux / Unix command-line tools and system resource management • Familiarity with message queues, orchestration, and distributed task systems such as Kafka, SQS, and Airflow • Experience evaluating and monitoring data quality, ensuring consistency, completeness, and reliability across releases • Ability to work independently in a fast-paced, remote-first environment and collaborate asynchronously • Ability to communicate clearly and thoughtfully in writing • Ability to write and maintain technical design documents, including pipeline design, schema design, and data flow diagrams • Ability to scope and break down complex projects into deliverable milestones and communicate progress, risks, and blockers • Degree in a quantitative field such as computer science, mathematics, or engineering (nice to have) • Experience as a Red Teamer (nice to have) • Experience with large-scale data ingestion, crawling, or indexing systems (nice to have) • Experience with Apache Spark, Databricks, or other distributed data platforms (nice to have) • Experience with streaming data systems such as Kafka, Pub/Sub, and Spark Streaming (nice to have) • Proficiency with SQL and data warehousing such as Snowflake, Redshift, or BigQuery (nice to have) • Experience with cloud platforms, preferably AWS (nice to have) • Understanding of modern data storage and design patterns such as Parquet, Delta Lake, partitioning, and incremental updates (nice to have) • Experience building and maintaining data pipelines on modern big-data or cloud platforms (nice to have)

🏖️ Benefits

• Stock • Competitive Salaries • Unlimited paid time off • Medical, dental, & vision insurance • Health, fitness, and office stipends • The permanent ability to work wherever and however you want