Principal Engineer – Data Retrieval

🕒 October 31

⛰️ Colorado, New York, +2 more states – Remote

⛰️ Colorado – Remote 🗽 New York – Remote 🍂 Massachusetts – Remote ☕ Washington – Remote

💵 $272k - $431.3k / year

⏰ Full Time

🔴 Lead

🚰 Data Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 11%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Open for 15 days.
• Jobs at this company usually fill in 36 days.
• Reposted once.

Apply Now

Check your resume score

Customize resume + cover letter

Find Similar Remote Jobs

☆ Save☑️ Mark as applied❌ Hide

Report problem

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Architect and scale data acquisition infrastructure powering NVIDIA’s foundation models • Build systems that discover valuable sources, crawl the open web at scale, and deliver reliable, high-quality data to training pipelines • Own architecture for source discovery, URL indexing, crawl frontiers, predictive ranking, scheduling, distributed fetching, and ingestion • Design scalable frontier storage and queueing systems with high-throughput writes, efficient lookups, deduplication, and quality-, diversity-, and freshness-based scheduling • Build continuous discovery loops that extract links and feed candidates into crawl frontiers • Develop a shared crawl execution layer for reliable, polite, large-scale fetching of dynamic websites • Build extensible pipelines for open-web, licensed, and partner content, including text, PDFs, code repositories, and multimodal assets • Define stable source-connector interfaces • Partner with parsing and curation teams to preserve valuable code, math, and structured content and improve accepted data yield • Implement provenance and policy enforcement with legal, privacy, security, and data governance partners • Own production readiness, capacity planning, observability, fault tolerance, recovery, and cost efficiency • Instrument pipelines end to end and set service objectives for throughput, freshness, reliability, and training cutoffs • Evaluate internal crawls and external datasets through comparable pilots with research and product teams • Deliver reproducible data releases tied to source coverage and processing quality • Coordinate cross-team dependencies and tradeoffs • Lead architecture reviews, critical implementation work, engineer mentoring, and team building

🎯 Requirements

• BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field, or equivalent experience • 15+ years of relevant software engineering experience • Experience designing and operating large-scale distributed systems • Experience setting technical direction and delivering complex infrastructure across multiple teams • Deep experience with web crawling or related discovery, indexing, or ingestion infrastructure • Experience with distributed scheduling, stateful services, storage, and high-throughput data processing • Strong hands-on engineering and system design skills • Experience with architecture, implementation, performance analysis, and production debugging • Experience building batch or streaming pipelines • Knowledge of consistency, retries, duplicate processing, backpressure, and recovery • Track record of improving throughput, latency, resource efficiency, or operational reliability • Experience delivering data platforms for research, ML, search, or other demanding technical users • Strong technical communication and leadership through influence across engineering, product, research, and governance teams

🏖️ Benefits

• Equity • Benefits

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume