Principal Software Engineer – AI Frameworks

🔥 51 minutes ago

🇺🇸 United States – Remote

💵 $142.8k - $274.8k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

Where this job comes from

Posted on Microsoft's careers page ↗Microsoft's careers page, not through a job board

First seen by Remote Rocketship 51 minutes ago

Apply Now
Logo of Microsoft

Microsoft

10,000+ employees

☁️ SaaS

🤖 Artificial Intelligence

🎮 Gaming

🔥 Funding within the last year

💰 PRIVATE PLACEMENT VC on 2026-04

SaaS • Artificial Intelligence • Gaming

Microsoft is a technology company that develops software, cloud services, and artificial intelligence products for consumers and businesses. Its offerings include Windows, Microsoft 365, Azure, Copilot, and Xbox.

📋 Description

• Define technical vision, architecture, and multi-release strategy for critical AI framework, performance, benchmarking, and developer-productivity capabilities • Lead ambiguous, cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, services, and silicon • Establish measurement, automation, observability, and engineering mechanisms for scalable platform capabilities • Drive improvements in model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency • Influence architecture and priorities across teams and align researchers, product groups, infrastructure owners, and hardware partners • Provide hands-on leadership through prototypes, critical-path implementation, design and code reviews, debugging, and operational readiness • Mentor engineers, develop technical leaders, and advance standards for quality, maintainability, and inclusive collaboration • Embody Microsoft’s culture and values

🎯 Requirements

• Bachelor’s Degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in C++, Python, or equivalent experience • Ability to meet Microsoft, customer and/or government security screening requirements • Required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter • Deep expertise in GPU or equivalent accelerator programming, compilation, and low-level execution • Expertise in LLM training and inference parallelism, including tensor, pipeline, data, and expert parallelism • Expertise in distributed inference acceleration, including prefill/decode disaggregation, KV-cache transfer, collective communication, and compute/communication overlap • Strong understanding of LLM serving architectures such as vLLM, SGLang, or equivalent systems • Demonstrated leadership of cross-team technical initiatives from strategy and design through implementation, deployment, and sustained production impact • Track record of creating reusable platforms, influencing stakeholders, and mentoring engineers • Ability to use AI-assisted development tools effectively while maintaining correctness, performance, and maintainability

🏖️ Benefits

• Flexibility through trust, autonomy, and shared accountability • Growth and professional development support • Wellbeing support for body, mind, and financial future • Community and networking support • Certain roles may be eligible for benefits and other compensation • Less than 25% travel • Remote work with 0 days per week in-office

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 52 minutes ago

Kettle

51 - 200

📣 Marketing

🤝 B2B

Product Design Lead shaping AI-powered features and experiences for Kettle’s enterprise technology and consumer-product clients. Owning design workstreams across UI, UX, visual design, and prototyping.

🔥 1 hour ago

Micron Technology

10,000+ employees

🔧 Hardware

🏭 Manufacturing

🤝 B2B

Agentic AI Architect designing autonomous agents, evaluation systems, and Kubernetes pipelines. Powering Micron’s semiconductor manufacturing with production-grade AI solutions.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 POST IPO EQUITY on 2026-05

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🔥 1 hour ago

UKG

10,000+ employees

👥 HR Tech

☁️ SaaS

🤝 B2B

Fellow AI Engineer leading agentic AI architecture and strategy for UKG’s workforce operating platform. Advising customers and shaping scalable, responsible AI products.

🔥 1 hour ago

Legence

10,000+ employees

🏗️ Construction

🤝 B2B

⚡ Energy

Applied AI Lead deploying AI solutions for an Installation & Maintenance business. Building agentic tools, training field teams, and improving maintenance, service, and operational performance.

🔥 1 hour ago

Legence

10,000+ employees

🏗️ Construction

🤝 B2B

⚡ Energy

Applied AI Lead deploying LLM and agentic AI solutions across engineering and construction project delivery. Training project teams and driving adoption on live work.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok