AI Kernel Engineering Manager

Job not on LinkedIn

🔥 17 minutes ago

🏄 California – Remote

🏄 California – Remote

💵 $255.4k - $383.2k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

👮‍♀️ Software Engineering Manager

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Modular

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤖 Artificial Intelligence

🏢 Enterprise

💰 $100.5G Series B on 2023-08

Artificial Intelligence • Enterprise

Modular is the next-generation AI developer platform unifying the development and deployment of AI for the world. The company focuses on enabling AI to be accessible to anyone, anywhere, leveraging specialties in machine learning, AI technologies, and platforms such as TensorFlow and PyTorch, along with hardware solutions.

📋 Description

• Lead, hire, coach, and grow a team of approximately 12 kernel engineers across NVIDIA, AMD, and ASIC hardware • Own the MAX kernel roadmap and delivery • Match or exceed the performance of open-source kernel libraries for each business-essential model and hardware target • Support portable kernel architecture, including TileTensor, TensorEngine, TileIO, MegaFFN, and attention building blocks • Partner with Framework, Serve, Compiler/Runtime, Hardware Enablement, and Qualcomm kernel teams on priorities, interfaces, and escalations • Advance AI-assisted kernel development through kernel agents, fuzz verification, and playbooks • Grow the kernel engineering community across Modular and Qualcomm • Own career development, performance management, and team health

🎯 Requirements

• 3+ years as an engineering manager leading GPU kernel, compiler, HPC, or ML performance engineering teams • Strong cross-functional communication and ability to drive technical decisions with tech leads • Ability to communicate status, risks, and tradeoffs to engineering leadership and customers • Track record of hiring, retaining, and growing senior kernel or performance engineers • Working knowledge of writing and optimizing GPU/accelerator kernels using CUDA, HIP/ROCm, Triton, CUTLASS/CuTe, or similar • Deep understanding of profiling, benchmarking, and roofline analysis • Candidates must be based in the United States • Ability to work remotely from home or in the Los Altos, CA office • Willingness to attend in-person onboarding in Los Altos, CA • Willingness to travel 2–4 times a year • Helpful but not required: Mojo or other kernel and tile-level programming models • Helpful but not required: Multi-target experience beyond NVIDIA, including AMD, NPUs/ASICs, or edge/on-device • Helpful but not required: AI-assisted or agentic kernel development • Helpful but not required: Open-source contributions to kernel libraries or inference engines

🏖️ Benefits

• Comprehensive healthcare coverage • Retirement and savings programs • Employee stock purchase opportunities • Paid time off • Wellbeing resources • Family support programs • Learning and development opportunities • RSU grants/equity • Annual target bonus • Regular team onsites and local meetups • Travel 2–4 times a year • Remote work from home • In-person onboarding in Los Altos, CA

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume