Senior II Software Engineer Lead – Akamai Inference Cloud

November 20

🍂 Massachusetts – Remote

Although this job is listed in Massachusetts, this company may be open to hiring remote in other states.

💵 $126.1k - $261.9k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

Akamai Technologies

WebsiteLinkedInAll Job Openings

Cloud Computing • Cybersecurity • Content Delivery

Akamai Technologies is a leading cloud services provider that specializes in delivering security, cloud computing, and content delivery solutions. It offers a range of services such as API security, DDoS protection, and performance optimization for web applications, ensuring secure and reliable user experiences. With a robust global infrastructure, Akamai empowers businesses to streamline their digital presence while safeguarding against various cyber threats and enhancing application performance.

5001 - 10000 employees

🔒 Cybersecurity

💰 Post-IPO Equity on 2001-07

📋 Description

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability • Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads • Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving • Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale • Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence

🎯 Requirements

• 8 years of relevant experience and a Bachelor's degree or its equivalent • Solid proficiency in distributed systems, cloud services, and platform engineering • Hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton) • Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures • Proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code • Familiarity with API design and development (REST/gRPC patterns), GPU infrastructure and hardware acceleration • Knowledge of observability, monitoring, and debugging distributed systems

🏖️ Benefits

• Health insurance • 401K savings plan • Company holidays • Vacation (in the form of PTO) • Sick time • Family friendly benefits including parental leave • Employee assistance program including a focus on mental and financial wellness • Employee Stock Purchase Plan (ESPP)