Senior AI Infrastructure Engineer – Hardware Infrastructure Engineering

🕒 August 31

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

Where this job comes from

Posted on NVIDIA's careers page ↗NVIDIA's careers page, not through a job board

First seen by Remote Rocketship August 31

Still open on NVIDIA's site. Checked 11 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Build and operate scalable telemetry pipelines for metrics, logs, traces, and events across on-premise, CSP, and NCP clusters • Establish common instrumentation, collection, storage, and access patterns for consistent telemetry generation and consumption • Deliver dashboards, alerting, and analysis capabilities that improve service visibility, detection, and troubleshooting • Standardize and automate incident, maintenance, service on-call, and support on-call workflows across HWInf • Integrate operational data and lifecycle signals to improve ownership, escalation, communication, and post-incident learning • Build reporting and AI-assisted tooling to reduce manual toil and improve operational responsiveness • Build and maintain physical hardware and software catalogs as trusted sources of truth for infrastructure inventory, service ownership, dependencies, and documentation • Create consistent data models and integration pipelines connecting clusters, hardware, services, teams, and operational workflows • Provide self-service discovery capabilities so engineers can identify what they operate, who owns it, and how to support it

🎯 Requirements

• BS degree in Computer Science, Computer Engineering, or a related technical field, or equivalent experience • 8+ years of experience in infrastructure security, platform engineering, or security tooling • Proficiency in one or more programming languages such as Python, Go, Typescript, or Java • Strong understanding of software and infrastructure principles, with experience applying them in production environments • Ability to lead cross-functional initiatives spanning internal teams and external partners across engineering, product, finance, and security • Experience building and operating incident-management processes with internally built and/or externally vended SaaS tools • Experience building, deploying, and maintaining ML models in production systems • Familiarity with AI agent frameworks or orchestration tools • Experience building and operating modern observability platforms for scalable metrics, logs, traces, and profiling • Experience working with service catalog and configuration management databases (CMDB)

🏖️ Benefits

• Equity • Benefits

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 August 28

Mirantis

501 - 1000

💼 Consulting

🏥 Healthcare

📦 Logistics

Software Engineer building Go and Kubernetes infrastructure for Mirantis’ GPU-as-a-Service platform. Designing APIs, provisioning workflows, and reconciliation systems for bare-metal GPU clusters.

🕒 August 27

Kindred

1 - 10

🏨 Hospitality

🏪 Marketplace

✈️ Travel

Senior infrastructure engineer building scalable AWS platforms for Kindred’s members-only home-swapping service. Leading DevOps, automation, architecture, and developer productivity initiatives.

🕒 August 21

Zazz

501 - 1000

💼 Consulting

📣 Marketing

🔌 API

Senior Security & Infrastructure Engineer managing AWS infrastructure, Terraform, security, and DevSecOps for a services company. Supporting SOC 2 compliance, production operations, and secure client onboarding.

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

🕒 August 20

Tailscale

51 - 200

☁️ SaaS

🔐 Security

📡 Telecommunications

Security Infrastructure Engineer securing Tailscale’s private networking software across cloud, Kubernetes, operating systems, and networks. Building controls, auditing infrastructure, and supporting incident response.

🇺🇸 United States – Remote

💵 $163k - $204k / year

💰 $100M Series B on 2022-05

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

🕒 August 19

Bitdeer Group

201 - 500

💼 Consulting

📦 Logistics

🏗️ Construction

Senior engineer architecting distributed storage, NVMe caching, and GPU-direct data delivery. Building AI computational infrastructure for Bitdeer’s NeoCloud and large-scale training workloads.

🇺🇸 United States – Remote

💰 Post-IPO Equity on 2023-05

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok