Applied AI Engineer

πŸ•’ October 5

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ”΄ Lead

πŸ€– AI Engineer

Where this job comes from

Posted on OpenLoop's careers page β†—OpenLoop's careers page, not through a job board

First seen by Remote Rocketship October 5

Still open on OpenLoop's site. Checked 2 hours ago.

Apply Now
Logo of OpenLoop

OpenLoop

201 - 500 employees

Founded 2020

πŸ’Ό Consulting

βš–οΈ Legal

πŸ“¦ Logistics

πŸ’° $15M Series A - OpenLoop Health on 2023-03

Consulting β€’ Legal β€’ Logistics

OpenLoop is a white-label telehealth platform and managed services provider that helps organizations launch and scale virtual care programs. It combines SaaS-based, brandable technology (scheduling, booking, payments, EHR/API integrations) with clinical staffing, credentialing, payer coverage and RCM, regulatory/legal support, and 24/7 patient support. OpenLoop serves health plans, hospitals and health systems, retailers, employers and digital health companies with AI-powered operations, a nationwide clinician network and broad insurance coverage including Medicare and Medicaid.

πŸ“‹ Description

β€’ Build and run production LLM-based agents and assistants β€’ Build agent runtime and orchestration, including tool calls, context handling, handoffs, failure handling, retries, timeouts, and sandboxing β€’ Build evaluation sets, test harnesses, regression tests, and AI-graded evaluations β€’ Work across multiple model providers, manage version upgrades, and plan provider fallbacks β€’ Trace agent behavior, monitor production performance, and attribute AI spend to agents and use cases β€’ Connect agents to company data using retrieval (RAG), context design, and prompt engineering β€’ Work with operations teams to determine which workflow steps agents can perform reliably and when to escalate to people β€’ Protect patient data (PHI), control agent access, and defend against prompt injection β€’ Build on GCP and partner with Data Platform teams β€’ Contribute to code and design reviews and support engineers newer to AI β€’ Explain AI trade-offs to product, operations, and clinical stakeholders β€’ Perform other duties as assigned

🎯 Requirements

β€’ Bachelor's degree in Computer Science, Engineering, or a related technical field β€’ 5 to 15+ years of software engineering experience β€’ Hands-on experience building and running LLM-based systems in production that real users relied on β€’ Senior Staff candidates typically bring 2+ years of production LLM experience β€’ Hands-on depth in at least one core area: agent runtime, evaluation, retrieval, or observability and cost β€’ Staff and Senior Staff candidates need depth in agent runtime or evaluation β€’ Senior Staff candidates need a second deep area plus working knowledge across the rest β€’ Experience measuring AI system performance with evaluation data β€’ Strong production engineering across testing, debugging, services, APIs, deployment, and on-call β€’ Experience handling sensitive data with a security-first mindset β€’ Comfort working in a greenfield space β€’ Clear communication with technical and non-technical partners β€’ Healthcare, finance, or insurance experience preferred β€’ GCP production services experience preferred β€’ Experience migrating systems between model versions or providers preferred β€’ Machine learning experience beyond LLMs preferred β€’ Experience building internal platforms used by other engineering teams preferred β€’ For Senior Staff, experience leading a small team's technical direction and growing a single pod into multiple teams preferred

πŸ–οΈ Benefits

β€’ Medical, Dental, and Vision plans β€’ Flexible Spending/Health Savings Accounts β€’ Flexible PTO β€’ 401(k) + Company Match β€’ Life Insurance β€’ Pet insurance

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 5

Weedmaps

501 - 1000

πŸ“£ Marketing

πŸ₯ Healthcare

πŸ’Ό Consulting

Senior Software Engineer building production AI agents, retrieval systems, and an internal MCP platform for Weedmaps, a global cannabis marketplace. Improving agent reliability, security, evaluation, cost, and latency.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $197k - $222k / year

πŸ’° $325M Post-IPO Equity on 2021-06

⏰ Full Time

🟠 Senior

πŸ€– AI Engineer

πŸ•’ October 5

F5

5001 - 10000

πŸ”’ Cybersecurity

☁️ SaaS

🏒 Enterprise

Forward Deployed Engineer leading technical onboarding and deployments of F5’s AI cybersecurity solutions. Supporting enterprise customers across the Central and Midwest United States.

πŸ•’ October 5

F5

5001 - 10000

πŸ”’ Cybersecurity

☁️ SaaS

🏒 Enterprise

Forward Deployed Engineer leading technical onboarding and deployments of F5’s AI cybersecurity solutions. Supporting enterprise customers and improving adoption, implementation speed, and long-term success.

πŸ•’ October 5

F5

5001 - 10000

πŸ”’ Cybersecurity

☁️ SaaS

🏒 Enterprise

Forward Deployed Engineer leading technical onboarding and deployments of F5’s AI cybersecurity solutions. Supporting enterprise customers and informing product roadmap through post-sales technical partnership.

πŸ•’ October 4

Brillio

1001 - 5000

πŸ₯ Healthcare

πŸ›‘οΈ Insurance

πŸ“¦ Logistics

Applied AI Architect designing governed, scalable AI platforms for Brillio’s Fortune 1000 digital technology clients. Integrating enterprise data, cloud, security, and production ML systems.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $150k - $250k / year

πŸ’° Private Equity Round on 2019-01

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

πŸ€– AI Engineer

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok