Staff AI Engineer – AI Infrastructure, Agentic Platform

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ShiftKey

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2017

⚕️ Healthcare Insurance

🏪 Marketplace

☁️ SaaS

💰 $3G Private Equity Round on 2023-01

Healthcare Insurance • Marketplace • SaaS

ShiftKey is a platform that empowers healthcare professionals to work on their own terms by connecting them with facilities that need their expertise. The platform features a Schedule Automation Marketplace Integration (SAMI) product, allowing healthcare facilities to manage their schedules, identify gaps, and ensure patients receive professional care without hassle. ShiftKey provides transparency and flexibility for independent credentialed professionals, allowing them to choose work that fits their schedule and lifestyle. This innovative approach not only enhances the work-life balance of healthcare professionals but also equips facilities with advanced technology to improve care delivery.

📋 Description

• Evolving the AI knowledge platform - taking the retrieval, indexing, and synthesis layer (currently semantic RAG + re-ranking + HyDE) to an organization-wide platform serving both internal engineering tools and customer-facing capabilities. • Architecting and operating agentic infrastructure on AWS - multi-step, tool-using AI systems that plan, retrieve, and act on complex queries and operational events, with cost guardrails and observability built in from day one. • Designing and building graph-based, relationship-aware retrieval across the organization's data sources, enabling multi-hop queries and letting agents accumulate organizational knowledge over time. This is on our roadmap, not in production - you will define the approach. • Partnering with product engineering to define the AI platform API surface, translating infrastructure primitives into developer-ready abstractions. • Building reference agent implementations on the platform - operational-incident triage, customer support, and future agentic use cases - grounding each agent's reasoning in institutional knowledge. • Owning the AI infrastructure cost model: monitoring compute, model, and storage spend, flagging anomalies, and proposing guardrails to keep workloads within defined budgets.

🎯 Requirements

• 7+ years of professional software engineering experience, with at least 2 years building and operating production AI/LLM application systems - not research, not prototyping, not demos. • Retrieval engineering beyond the basics. Our stack already includes re-ranking and HyDE; we need someone who has worked at or above that level: hybrid search, re-ranking, query transformation, context-window management, and evaluation of retrieval quality in production. • Working experience with agentic frameworks and multi-step reasoning loops - tool use, iteration control, cost governance, and model routing trade-offs. • Production-grade software engineering fluency (strict typing, testing, async/concurrency, modern toolchain) in Go, Python, or TypeScript, with the ability to ramp into another quickly. • Hands-on experience operating AI workloads on a managed cloud AI platform (AWS Bedrock or Azure AI Foundry), including the identity/secrets model and model access governance. Bedrock preferred given our AWS stack. • Hands-on Terraform experience - able to author and provision new infrastructure independently, not just modify existing modules. • Familiarity with production observability for AI systems: metrics, structured logging for model spend and latency, and evaluation harnesses to detect regressions. • Understanding of HIPAA-style data-handling requirements in a regulated SaaS environment. Prior healthcare experience is a plus, not a requirement.

🏖️ Benefits

• Inclusive and collaborative work environment where all voices are valued. • Hybrid-friendly office spaces designed to be fun and engaging. • Comprehensive health, vision, and dental coverage. • Benefits begin on your first day. • Generous PTO and company-paid holidays, including flexible floating holidays. • 100% 401(k) employer match up to 6%. • Paid parental leave. • Wellness support, including access to mental health resources.