Software Engineer, AI Gateway

🕒 February 12

🏢🏡 San Francisco – Hybrid

💵 $196k - $294k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

info
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Vercel

Vercel

WebsiteLinkedIn

201 - 500 employees

Founded 2016

☁️ SaaS

🌐 Web 3

💰 $150M Series D on 2021-11

SaaS • Web 3 • Cloud Computing

Vercel is a platform providing developer tools and cloud infrastructure to build, scale, and secure faster and more personalized web applications. It specializes in optimizing web performance through features like fast load times, scalable infrastructure, and global CDN distribution. The platform supports developers with automated workflows, a wide range of templates, and seamless integration with tools like Git for quick deployment. Vercel also emphasizes observability and security, offering privacy-friendly analytics and enterprise-level conformance.

📋 Description

• Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability. • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests. • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges. • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools. • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

🎯 Requirements

• You have at least 5+ years of relevant experience • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers) • Experience contributing to or participating in open source projects • Excellent communication skills and the ability to work effectively in a collaborative team environment.

🏖️ Benefits

• Competitive compensation package, including equity. • Inclusive Healthcare Package. • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills. • Flexible Time Off. • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

Apply Now

Similar Jobs

🕒 February 12

Orb

11 - 50

WebsiteLinkedIn

Senior Software Engineer building the technical foundations of Billing Lifecycle product at Orb. Collaborating with customers and teams to deliver an impactful user experience.

🕒 February 11

Scribe

51 - 200

☁️ SaaS

⚡ Productivity

🏢 Enterprise

WebsiteLinkedIn

Senior Full Stack Engineer at Scribe building scalable distributed systems and application code. Focused on large-scale data ingestion and processing systems alongside custom AI models.

🕒 February 10

Plaud

201 - 500

🤖 Artificial Intelligence

🔧 Hardware

☁️ SaaS

WebsiteLinkedIn

Software Engineer designing backend and platform capabilities for Plaud's Developer Platform. Collaborating with cross-functional teams to ensure security, scalability, and efficient integrations.

🏢🏡 San Francisco – Hybrid

💵 $130k - $180k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🕒 February 10

OpenAI

201 - 500

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

WebsiteLinkedIn

Full-Stack Engineer developing tools for the ChatGPT ecosystem through SDKs and platforms. Collaborate across teams to improve developer experiences and contribute to robust feature development.

🕒 February 10

Heidi Health

11 - 50

🤖 Artificial Intelligence

⚕️ Healthcare Insurance

⚡ Productivity

WebsiteLinkedIn

Senior Full Stack Software Engineer shaping AI Care Partner integration with EHRs. Delivering robust systems simplifying US healthcare complexities in a collaborative environment.

🏢🏡 San Francisco – Hybrid

💵 $150k - $220k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer