Senior and/or Principal Software Engineer – Performance

🔥 12 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

Where this job comes from

Posted on Microsoft's careers page ↗Microsoft's careers page, not through a job board

First seen by Remote Rocketship 12 minutes ago

Apply Now
Logo of Microsoft

Microsoft

10,000+ employees

☁️ SaaS

🤖 Artificial Intelligence

🎮 Gaming

🔥 Funding within the last year

💰 PRIVATE PLACEMENT VC on 2026-04

SaaS • Artificial Intelligence • Gaming

Microsoft is a technology company that develops software, cloud services, and artificial intelligence products for consumers and businesses. Its offerings include Windows, Microsoft 365, Azure, Copilot, and Xbox.

📋 Description

• Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs • Measure and benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon • Optimize and monitor LLM performance and build software tooling to identify performance opportunities from model level to systems and silicon level • Improve customer experience and reduce the computing fleet footprint • Build software tools to accelerate porting models onto new Nvidia and AMD GPUs • Design, implement, and test functions or components for AI/DNN/LLM frameworks and tools • Speed up and reduce complexity of key components and pipelines • Communicate and collaborate with internal and external partners • Work across the AI software stack, including abstractions, programming models, compilers, runtimes, libraries, and APIs

🎯 Requirements

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience • Ability to meet Microsoft, customer and/or government security screening requirements • Must pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter • Technical background and solid foundation in software engineering principles, computer architecture, GPU architecture, HW neural net acceleration • Experience in end-to-end performance analysis and optimization of state of the art LLMs, including proficiency using GPU profiling tools • Experience in DNN/LLM inference • Experience with one or more DL frameworks such as PyTorch, Tensorflow, or ONNX Runtime • Familiarity with CUDA, ROCm, Triton • Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers

🏖️ Benefits

• 0 days / week in-office – remote • Less than 25% travel • Flexibility: Balance what matters—your work, your life, and your team—through trust, autonomy, and shared accountability • Growth: Stretch your skills, expand your impact, and grow with support that meets you where you are • Wellbeing: Support for your body, mind, and financial future—so you can stay energized and do your best work • Community PCS: Find your people, build your network, and feel supported every step of the way

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 14 minutes ago

IndraSoft

201 - 500

Palo Alto security lead managing IDS/IPS deployments for IndraSoft’s federal defense clients. Leading cybersecurity staff and enterprise firewall, monitoring, and vulnerability-management operations.

🔥 14 minutes ago

IndraSoft

201 - 500

IndraSoft Cloud Container Security Technical Lead securing Kubernetes and multi-cloud infrastructure for DoD customers. Managing policies, vulnerability operations, logging, and incident-response capabilities.

🔥 14 minutes ago

IndraSoft

201 - 500

Senior software developer building cybersecurity products and solutions for IndraSoft’s DoD and intelligence clients. Leading SDLC delivery, DevSecOps capabilities, and technology innovation.

🔥 17 minutes ago

Orderful

51 - 200

📦 Logistics

💼 Consulting

🏥 Healthcare

Senior Software Engineer owning Orderful’s API platform for global commerce EDI. Designing reliable backend systems, directing AI coding agents, and mentoring engineers.

🔥 42 minutes ago

Symetra

1001 - 5000

🛡️ Insurance

💸 Finance

⚕️ Healthcare Insurance

Staff Software Engineer leading architecture and development of Symetra’s cloud-native Stop Loss insurance platform. Driving reliability, CI/CD, scalability, and technical direction across engineering teams.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok