Senior II Software Engineer Lead – Akamai Inference Cloud

🕒 May 13

🍂 Massachusetts – Remote

🍂 Massachusetts – Remote

💵 $126.1k - $261.9k / year

⏰ Full Time

🟠 Senior

☁️ Cloud Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Akamai Technologies

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

🔒 Cybersecurity

🏢 Enterprise

📱 Media

Cybersecurity • Enterprise • Media

Akamai Technologies is a global edge platform and cloud services company that delivers content delivery, edge computing, and security solutions. The company operates one of the world’s largest distributed networks to accelerate and protect web, media, and application traffic, offering products for content delivery, DDoS protection, API and app security, bot management, edge compute (serverless/edge functions), and AI inference at the edge. Akamai also provides enterprise-focused security services (zero trust, identity and access management, secure internet access) and cloud/AI infrastructure tools, and has recently expanded capabilities through acquisitions (for example LayerX) to add browser-based AI usage control.

📋 Description

• Driving design and implementation of critical components of AI inference platform • Building and optimizing systems for OpenAI-compatible endpoints • Guiding other engineers and influencing technical direction • Ensuring delivery of high-quality, scalable solutions • Mentoring engineers through code reviews and design discussions • Collaborating across teams to define technical requirements

🎯 Requirements

• 8 years of relevant experience and a Bachelor's degree or its equivalent • Solid proficiency in distributed systems, cloud services, and platform engineering • Hands-on experience with AI inference, model serving, or LLM deployment with knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton) • Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures • Proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code • Solid technical leadership through mentoring and code quality advocacy • Familiarity with API design and development (REST/gRPC patterns), GPU infrastructure, and hardware acceleration • Knowledge of observability, monitoring, and debugging distributed systems

🏖️ Benefits

• Healthcare • 401K savings plan • Company holidays • Vacation (in the form of PTO) • Sick time • Family friendly benefits including parental leave • Employee assistance program including a focus on mental and financial wellness