Principal Software Engineer – Akamai Inference Cloud

November 20

🍂 Massachusetts – Remote

Although this job is listed in Massachusetts, this company may be open to hiring remote in other states.

💵 $148.2k - $307.8k / year

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

Akamai Technologies

WebsiteLinkedInAll Job Openings

Cloud Computing • Cybersecurity • Content Delivery

Akamai Technologies is a leading cloud services provider that specializes in delivering security, cloud computing, and content delivery solutions. It offers a range of services such as API security, DDoS protection, and performance optimization for web applications, ensuring secure and reliable user experiences. With a robust global infrastructure, Akamai empowers businesses to streamline their digital presence while safeguarding against various cyber threats and enhancing application performance.

5001 - 10000 employees

🔒 Cybersecurity

💰 Post-IPO Equity on 2001-07

📋 Description

• serve as a technical leader and architect for our globally distributed AI inference platform • drive critical technical decisions, establish architectural patterns • guide the team in building a platform that delivers OpenAI-compatible endpoints while orchestrating inference workloads across regions at massive scale • provide thought leadership, drive architectural decisions, and mentor engineers while delivering hands-on technical contributions • architect and design the core infrastructure of Akamai Inference Cloud, ensuring it is performant, compliant, economical, and explainable • make critical technical decisions on frameworks, tools, and approaches for AI workload deployment and global traffic orchestration • collaborate with cross-functional teams to define technical requirements and elevate team capabilities

🎯 Requirements

• 12+ years of relevant experience and a Bachelor's degree or its equivalent • deep expertise in AI inference optimization, model serving, and LLM deployment at scale • expert-level proficiency with cloud-native technologies, Kubernetes, distributed systems, and architecting services at global scale with strict SLOs • solid opinions and proven experience building AI platforms developers love, including API design and cost optimization for compute-intensive workloads • experience with building platforms for AI application developers (RAG, agents, fine-tuning workflow) • working knowledge of AI safety and practices, MLOps practices and AI model lifecycle management

🏖️ Benefits

• healthcare • 401K savings plan • company holidays • vacation (in the form of PTO) • sick time • family friendly benefits including parental leave • employee assistance program including a focus on mental and financial wellness