Senior Compiler Engineer – AI

🔥 1 minute ago

🏄 California, Washington – Remote

🏄 California – Remote ☕ Washington – Remote

💵 $184k - $287.5k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 1%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Design and implement program transformations on JAX programs (jaxpr) for large-scale training, including pipeline schedules, task placement, sharding, and communication/computation overlap • Develop optimizing compiler and runtime technologies for accelerating deep learning training on large-scale distributed systems • Compile graph intermediate representations to target-specific code • Build distributed runtimes that dispatch per-stage programs to many GPUs and move data between stages using communication libraries such as NCCL • Advance compiler technology for high-performance large-scale training workloads, including mixture-of-experts models • Collaborate with JAX, XLA, and hardware architecture teams • Integrate JaxPP into JAX training frameworks, including MaxText • Contribute to the open-source JaxPP project through maintenance, testing, performance tracking, and adoption support

🎯 Requirements

• Master's or PhD in Computer Science, Computer Engineering, or related field, or equivalent experience • 6+ years of relevant work or research experience in compilers, distributed systems, or deep learning training • Compiler design and implementation • Distributed system design, development, and deployment • Experience with deep learning frameworks (JAX, PyTorch) • GPU training and inference of deep learning models • C/C++ and Python programming • Excellent software design skills, including debugging, performance analysis, and test design • Experience with parallel computing libraries (MPI) • Ability to work independently, define project goals and scope, and lead development efforts • Strong communication skills • Experience with JAX internals, XLA, StableHLO, or MLIR is advantageous • Experience building or tuning large training jobs with pipeline, tensor, expert, and data parallelism is advantageous • Knowledge of GPU communication libraries such as NCCL, NVSHMEM, or RDMA, and CPU and/or GPU architecture is advantageous • CUDA programming experience is a plus • Contributions to open-source compiler or machine learning projects are advantageous • Experience mentoring early career engineers and interns is a bonus

🏖️ Benefits

• Equity • Benefits package • Competitive salary

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume