Senior Software Engineer – AI Frameworks

🔥 31 minutes ago

🇺🇸 United States – Remote

💵 $119.8k - $234.7k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

Where this job comes from

Posted on Microsoft's careers page ↗Microsoft's careers page, not through a job board

First seen by Remote Rocketship 31 minutes ago

Apply Now
Logo of Microsoft

Microsoft

10,000+ employees

☁️ SaaS

🤖 Artificial Intelligence

🎮 Gaming

🔥 Funding within the last year

💰 PRIVATE PLACEMENT VC on 2026-04

SaaS • Artificial Intelligence • Gaming

Microsoft is a technology company that develops software, cloud services, and artificial intelligence products for consumers and businesses. Its offerings include Windows, Microsoft 365, Azure, Copilot, and Xbox.

📋 Description

• Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations • Benchmark, profile, debug, and optimize large language model training and inference workloads across GPUs and Microsoft hardware • Build automation and observability to detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding • Drive projects from problem definition through deployment while balancing delivery speed, maintainability, reliability, and measurable impact • Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions • Contribute to technical design reviews, engineering standards, operational health, and mentoring of other engineers • Embody Microsoft’s culture and values

🎯 Requirements

• Bachelor’s Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience • Ability to meet Microsoft, customer and/or government security screening requirements • Must pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter • Expertise in GPU or equivalent accelerator programming and kernel optimization using CUDA, Triton, or comparable technologies • Experience using profiling and benchmarking to deliver measurable performance improvements • Understanding of memory hierarchy, parallel execution, synchronization, and hardware utilization • Familiarity with vLLM, SGLang, or equivalent inference frameworks, including model execution, scheduling, batching, and KV-cache mechanisms • Demonstrated technical ownership and cross-team collaboration • Ability to use AI-assisted development tools effectively while maintaining engineering judgment and accountability for correctness, performance, and maintainability

🏖️ Benefits

• Remote work: 0 days / week in-office • Flexibility through trust, autonomy, and shared accountability • Growth support to stretch skills, expand impact, and develop professionally • Wellbeing support for body, mind, and financial future • Community and networking support • Certain roles may be eligible for benefits and other compensation

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 32 minutes ago

Kettle

51 - 200

📣 Marketing

🤝 B2B

Product Design Lead shaping AI-powered features and experiences for Kettle’s enterprise technology and consumer-product clients. Owning design workstreams across UI, UX, visual design, and prototyping.

🔥 1 hour ago

Micron Technology

10,000+ employees

🔧 Hardware

🏭 Manufacturing

🤝 B2B

Agentic AI Architect designing autonomous agents, evaluation systems, and Kubernetes pipelines. Powering Micron’s semiconductor manufacturing with production-grade AI solutions.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 POST IPO EQUITY on 2026-05

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🔥 1 hour ago

Legence

10,000+ employees

🏗️ Construction

🤝 B2B

⚡ Energy

Applied AI Lead deploying AI solutions for an Installation & Maintenance business. Building agentic tools, training field teams, and improving maintenance, service, and operational performance.

🔥 1 hour ago

Legence

10,000+ employees

🏗️ Construction

🤝 B2B

⚡ Energy

Applied AI Lead deploying LLM and agentic AI solutions across engineering and construction project delivery. Training project teams and driving adoption on live work.

🕒 2 days ago

Workiva

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

AI Platform Product Manager owning shared AI primitives, governance, and developer adoption. Building trusted infrastructure for Workiva’s finance, risk, and sustainability platform.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok