Kong AI Gateway Engineer

πŸ•’ October 28

Where this job comes from

Posted on Allstate's careers page β†—Allstate's careers page, not through a job board

First seen by Remote Rocketship October 28

Still open on Allstate's site. Checked 2 hours ago.

Apply Now
Logo of Allstate

Allstate

10,000+ employees

Founded 1931

πŸ’Ό Consulting

πŸ“¦ Logistics

πŸ›‘οΈ Insurance

πŸ’° Post-IPO Equity on 2014-01

Consulting β€’ Logistics β€’ Insurance

Allstate is an industry leader in providing insurance solutions, focusing on home, auto, device, and identity protection. With a commitment to customer well-being, Allstate aims to instill peace of mind and financial security for its customers. The company also emphasizes community impact and sustainability through various initiatives, showcasing their dedication to social responsibility and positive change.

πŸ“‹ Description

β€’ Serve as a technical lead focused on Kong AI Gateway β€’ Architect, design, build, test, and support modern digital products β€’ Own applications through production and drive their success against key performance goals β€’ Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway β€’ Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails β€’ Enable secure access to multiple LLM providers through a unified gateway architecture β€’ Implement AI observability, token analytics, usage tracking, and cost governance β€’ Develop routing strategies across multiple AI models based on latency, cost, and availability β€’ Integrate RAG-based AI services through secure API management frameworks β€’ Ensure compliance with enterprise AI governance, security, and regulatory requirements β€’ Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption β€’ Support AI agent and MCP-based integrations within enterprise ecosystems β€’ Drive AI platform reliability, scalability, and operational excellence β€’ Configure, administer, and support Kong Gateway environments β€’ Develop and manage AI Gateway proxies for GenAI/LLM services β€’ Implement API security, authentication, throttling, and governance policies β€’ Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways β€’ Deploy and manage Kong in Kubernetes-based environments β€’ Monitor, troubleshoot, and optimize gateway performance and availability β€’ Automate deployments and operational processes using DevOps tools

🎯 Requirements

β€’ 8 Plus years of experience in API Management, Middleware, or Platform Engineering β€’ Minimum 3 to 5 years of hands-on experience with Kong Gateway Administration β€’ Experience with cloud-native and microservices architectures preferred β€’ Kong Gateway (OSS/Enterprise), Kong Konnect β€’ API Management & API Lifecycle Management β€’ AI Gateway / LLM Proxy Development β€’ OpenAI / Azure OpenAI Integration β€’ REST APIs, GraphQL β€’ OAuth2, JWT, OIDC, API Security β€’ Kubernetes, Docker, Helm β€’ CI/CD (Jenkins, GitHub Actions, Azure DevOps) β€’ Monitoring: Prometheus, Grafana, ELK/Splunk β€’ Cloud Platforms: Azure, AWS, or GCP β€’ Kong AI Gateway Configuration & Administration β€’ LLM Traffic Routing, Load Balancing and Failover Management β€’ Prompt Management, Prompt Security and Guardrails β€’ AI Security, Responsible AI and Model Governance β€’ Token Usage Monitoring, Rate Limiting and Cost Optimization β€’ Multi-LLM Integration (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama) β€’ Retrieval-Augmented Generation (RAG) Architecture Concepts β€’ Vector Databases β€’ LLMOps, AI Observability and Model Performance Monitoring β€’ AI API Governance, Compliance and Data Protection β€’ Prompt Caching, Semantic Caching and Response Optimization β€’ Model Gateway Policy Development and AI Consumption Controls β€’ MCP (Model Context Protocol) and AI Agent Integration Concepts β€’ GenAI Platform Engineering and Enterprise AI Enablement β€’ Candidates must be able to work Central Time or Eastern Time hours β€’ Background investigation required β€’ Allstate generally does not sponsor individuals for employment-based visas for this position

πŸ–οΈ Benefits

β€’ Comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse β€’ Monthly connectivity reimbursement to help offset internet costs for employees eligible to work from home

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 28

Myriad360

51 - 200

πŸ’Ό Consulting

πŸ₯ Healthcare

🏭 Manufacturing

Senior AI Delivery Engineer building governed enterprise AI solutions for Myriad360 clients. Leading agent, automation, and generative AI engagements from discovery through production adoption.

πŸ•’ October 28

Guidehouse

10,000+ employees

πŸ₯ Healthcare

πŸŽ–οΈ Defense

πŸ“¦ Logistics

Guidehouse AI and data leader growing consulting services for utility providers. Leading strategic engagements, client growth, technology partnerships, and multidisciplinary teams.

πŸ•’ October 28

KIPP Foundation

51 - 200

πŸ“š Education

🀝 Non-profit

🌍 Social Impact

Senior Director leading AI strategy, pilots, evaluation, and partnerships for KIPP’s national network of tuition-free public charter schools. Advising schools and leaders on effective, equitable, and privacy-conscious AI adoption.

πŸ•’ October 28

EY

10,000+ employees

πŸ₯ Healthcare

βš–οΈ Legal

πŸ“£ Marketing

Alliance Relationship Associate Director driving SAP Data & AI go-to-market campaigns for EY. Coordinating global sales, marketing, technical enablement, and alliance execution with SAP.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok