Staff Engineer, Inference Optimizations

🕒 October 31

🇺🇸 United States – Remote

💵 $191.2k - $239k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

Where this job comes from

Posted on DigitalOcean's careers page ↗DigitalOcean's careers page, not through a job board

First seen by Remote Rocketship October 31

Still open on DigitalOcean's site. Checked 2 hours ago.

Apply Now
Logo of DigitalOcean

DigitalOcean

1001 - 5000 employees

Founded 2011

☁️ SaaS

SaaS • Cloud Computing

DigitalOcean is a cloud infrastructure provider that offers a suite of products and services for developers to build, deploy, and scale applications. Their platform provides comprehensive tutorials, reference material, and support documentation to assist users in managing resources effectively using their API and CLI tools. With features like Droplets (virtual machines), managed databases, Kubernetes, and a marketplace for third-party applications, DigitalOcean focuses on simplicity and performance. They cater to both individual developers and larger organizations looking for cloud solutions that are easy to implement and manage.

📋 Description

• Lead technical strategy for benchmarking and performance optimizations at inference engine and GPU kernel layers • Engineer solutions for attention-layer optimization, memory and precision management, and advanced parallelization across multi-node GPU clusters • Implement cutting-edge optimization techniques for generative AI infrastructure • Improve batch-size performance using AMD's AITER library for AMD MI355X, tuning CK or ASK for FP8/BF16 • Identify kernel-fusion opportunities for GLM-5 Transformer-block kernels, including FlashAttention and RMS Norm • Tune expert-gateway router kernels for MoE models such as Qwen3-235B, DeepSeek V3, and GLM-5 • Advise on modern NVIDIA and AMD GPU hardware procurement and software integration • Develop and deploy quantization techniques using FP8, INT8, and experimental FP4 • Provide technical mentorship through high-quality code and design reviews without direct management • Partner with Product Management and TPMs to translate hardware limits into shippable product features • Contribute to and integrate open-source AI while maintaining a presence in GPU infrastructure and model-performance communities

🎯 Requirements

• 5+ years of experience in high-performance computing or AI infrastructure • Proven track record of solving compute utilization and memory bandwidth bottlenecks • Deep familiarity with the Gen AI landscape, including LLM, VLM, and LMM model families • Hands-on experience with attention-layer optimizations and parallelization strategies across distributed GPU environments • Comprehensive understanding of NVIDIA and AMD GPU architectures and software ecosystems, including CUDA and ROCm • Extensive experience integrating, building with, and contributing to open-source software projects • Excellent system design skills related to low-level GPU programming, optimization, memory access patterns, and parallel execution • Experience acting as a technical lead and driving design and delivery through cross-functional alignment and expert-level delegation • Deep understanding of GPU architectures, including SMs, warp scheduling, and Tensor Cores • Expert-level Triton or CUDA proficiency • Experience contributing to the Triton compiler or writing custom CUDA kernels for a major LLM is desired by the posting's wording

🏖️ Benefits

• Reimbursement for relevant conferences, training, and education, subject to company policy • Flexible time off • Local team meetups • Mental health and well-being support • Annual bonus plan eligibility for non-sales roles, subject to plan terms and local eligibility • Potential new hire equity grant, subject to plan terms and local eligibility • Employee Stock Purchase Program opportunity in participating countries, subject to eligibility • Comprehensive total rewards package • Professional development resources and career development support

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 31

Ordergroove

51 - 200

🍽️ Food & Beverage

💼 Consulting

📣 Marketing

Staff Full Stack Engineer building AI-powered subscription experiences for Ordergroove’s recurring-commerce platform. Leading scalable full-stack initiatives serving millions of subscribers.

🇺🇸 United States – Remote

💵 $170k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🕒 October 31

Speechify

51 - 200

🏥 Healthcare

🏨 Hospitality

📚 Education

Tech Lead owning Android features for Speechify’s text-to-speech apps. Shaping Android architecture, reliability, releases, and user experiences for millions of readers.

🇺🇸 United States – Remote

💵 $140k - $200k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

Android

Dagger

JUnit

Kotlin

🕒 October 31

Speechify

51 - 200

🏥 Healthcare

🏨 Hospitality

📚 Education

Tech Lead building Speechify’s Android text-to-speech app for millions of readers. Owning major features, reliability, releases, and Android team direction.

🇺🇸 United States – Remote

💵 $140k - $200k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🕒 October 31

Speechify

51 - 200

🏥 Healthcare

🏨 Hospitality

📚 Education

Tech Lead owning major features and Android team direction for Speechify’s text-to-speech products. Delivering reliable Kotlin experiences used by over 50 million people.

🇺🇸 United States – Remote

💵 $140k - $200k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🕒 October 31

Speechify

51 - 200

🏥 Healthcare

🏨 Hospitality

📚 Education

Tech Lead owning Android features and reliability for Speechify’s text-to-speech products. Shaping the Android team and delivering accessible audio reading experiences to millions of users.

🇺🇸 United States – Remote

💵 $140k - $200k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok