Principal Engineer – Data Retrieval

🕒 October 31

🇺🇸 United States – Remote

💵 $272k - $431.3k / year

⏰ Full Time

🔴 Lead

🚰 Data Engineer

Where this job comes from

Posted on NVIDIA's careers page ↗NVIDIA's careers page, not through a job board

First seen by Remote Rocketship October 31

Still open on NVIDIA's site. Checked 58 minutes ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Architect and scale data acquisition infrastructure powering NVIDIA’s foundation models • Build systems that discover valuable sources, crawl the open web at scale, and deliver reliable, high-quality data to training pipelines • Own architecture for source discovery, URL indexing, crawl frontiers, predictive ranking, scheduling, distributed fetching, and ingestion • Design scalable frontier storage and queueing systems with high-throughput writes, efficient lookups, deduplication, and quality-, diversity-, and freshness-based scheduling • Build continuous discovery loops that extract links and feed candidates into crawl frontiers • Develop a shared crawl execution layer for reliable, polite, large-scale fetching of dynamic websites • Build extensible pipelines for open-web, licensed, and partner content, including text, PDFs, code repositories, and multimodal assets • Define stable source-connector interfaces • Partner with parsing and curation teams to preserve valuable code, math, and structured content and improve accepted data yield • Implement provenance and policy enforcement with legal, privacy, security, and data governance partners • Own production readiness, capacity planning, observability, fault tolerance, recovery, and cost efficiency • Instrument pipelines end to end and set service objectives for throughput, freshness, reliability, and training cutoffs • Evaluate internal crawls and external datasets through comparable pilots with research and product teams • Deliver reproducible data releases tied to source coverage and processing quality • Coordinate cross-team dependencies and tradeoffs • Lead architecture reviews, critical implementation work, engineer mentoring, and team building

🎯 Requirements

• BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field, or equivalent experience • 15+ years of relevant software engineering experience • Experience designing and operating large-scale distributed systems • Experience setting technical direction and delivering complex infrastructure across multiple teams • Deep experience with web crawling or related discovery, indexing, or ingestion infrastructure • Experience with distributed scheduling, stateful services, storage, and high-throughput data processing • Strong hands-on engineering and system design skills • Experience with architecture, implementation, performance analysis, and production debugging • Experience building batch or streaming pipelines • Knowledge of consistency, retries, duplicate processing, backpressure, and recovery • Track record of improving throughput, latency, resource efficiency, or operational reliability • Experience delivering data platforms for research, ML, search, or other demanding technical users • Strong technical communication and leadership through influence across engineering, product, research, and governance teams

🏖️ Benefits

• Equity • Benefits

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 31

TriEdge Investments

11 - 50

💸 Finance

🤝 B2B

Director leading Databricks enterprise data warehousing and BI for Salud Healthcare, a value-based-care MSO. Owning healthcare analytics, semantic modeling, and a hands-on data engineering team.

🕒 October 30

3Cloud

501 - 1000

💼 Consulting

🏥 Healthcare

🏭 Manufacturing

Senior Architect leading Azure data platform modernization and transformation programs for 3Cloud clients. Shaping scalable architectures, guiding multi-team delivery, and mentoring technical leaders.

🕒 October 30

AlphaSense

1001 - 5000

💼 Consulting

🏥 Healthcare

📣 Marketing

Principal Engineer building scalable data platforms for AlphaSense’s AI-powered market-intelligence platform. Leading migrations, storage self-service, and cell-based architecture at Fortune 500 scale.

🇺🇸 United States – Remote

💵 $246k - $339k / year

💰 Debt Financing on 2022-06

⏰ Full Time

🔴 Lead

🚰 Data Engineer

🕒 October 30

Datavail

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

Senior Data Architect leading Microsoft Fabric and Azure data platform architecture for Datavail’s consulting clients. Owning modeling, DevOps, governance, AI enablement and technical delivery.

🕒 October 30

Fetch Rewards

501 - 1000

💼 Consulting

🍽️ Food & Beverage

📦 Logistics

Principal Software Engineer building Fetch’s advertising data products, audience workflows, and measurement platforms. Leading architecture and production systems that help brands reach shoppers and measure incremental purchases.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok