Senior Engineering Manager – Akamai Inference Cloud

November 21

Apply Now

Receive Emails with Similar Jobs

Akamai Technologies

WebsiteLinkedInAll Job Openings

Cloud Computing • Cybersecurity • Content Delivery

Akamai Technologies is a leading cloud services provider that specializes in delivering security, cloud computing, and content delivery solutions. It offers a range of services such as API security, DDoS protection, and performance optimization for web applications, ensuring secure and reliable user experiences. With a robust global infrastructure, Akamai empowers businesses to streamline their digital presence while safeguarding against various cyber threats and enhancing application performance.

5001 - 10000 employees

🔒 Cybersecurity

💰 Post-IPO Equity on 2001-07

📋 Description

• Oversee and establish a high-performing team of platform and ML engineers. • Create a global AI inference platform, offering OpenAI-compatible endpoints and managing workloads across regions. • Lead the technical strategy for a global AI inference platform that is performant, compliant, economical, and explainable. • Ensure availability, performance, scalability, and security within the Akamai Inference Cloud environment. • Design global traffic orchestration for AI workloads and establish platform standards and blueprints for production-grade AI applications. • Evaluate AI tools thoroughly while ensuring platform adherence to FedRAMP, GDPR, SOX, and various other regulatory standards.

🎯 Requirements

• Have relevant experience with a track record of building and scaling high-performing engineering teams that shipped successful AI/ML products. • Bring hands-on experience with AI inference optimization, model serving, and LLM deployment at scale with deep knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton). • Implement containerization strategies for AI workloads, optimize hardware-specific processes, and demonstrate expertise in cloud-native technologies like Kubernetes and distributed systems globally. • Demonstrate expertise in building highly available, low-latency platforms with strict SLOs and cost optimization strategies for compute-intensive AI workloads. • Have experience with AI application platforms (RAG, agents, fine-tuning). • Possess knowledge of AI safety and explainability frameworks. • Show familiarity with GPU infrastructure and hardware acceleration.

🏖️ Benefits

• Your health • Your finances • Your family • Your time at work • Your time pursuing other endeavors