Senior LLM Ops Engineer

🕒 August 27

🌏 Anywhere in the World

⏰ Full Time

🟠 Senior

⚙️ Operations

👻 Ghost score 17%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CINC Systems

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2005

☁️ SaaS

🏠 Real Estate

🤝 B2B

💰 Private Equity Round - CINC Systems on 2023-12

SaaS • Real Estate • B2B

CINC Systems is a cloud-based, all-in-one software platform for community association management (HOAs and COAs) that helps management companies, boards, and homeowners streamline operations and improve resident experience. The platform provides financial management and oversight (including online payments and a secure payment portal), AI-driven reporting and forecasting (Cephai), communication and resident engagement tools, online voting and surveys, maintenance/work-order coordination, compliance tracking, and centralized data and insights. CINC targets professional association management firms and homeowner boards with automation, security, and scalability; the company reports 1,000+ association management company customers, 51,000+ homeowner associations served, 6M+ doors, and $11B+ payments processed annually.

📋 Description

• Design and operate LLM orchestration and runtime systems supporting reliable, low-latency AI workflows • Build and maintain evaluation pipelines measuring quality, regressions, and business impact of LLM-driven features • Implement observability for AI systems, including tracing, metrics, and feedback loops at prompt, agent, and workflow levels • Establish LLM cost-management strategies including budgeting, rate limiting, caching, and optimization • Partner with AI and product engineers to productionize AI features safely and incrementally • Define and enforce security, privacy, and data-handling guardrails in AI workflows • Support experimentation with new models and tools while ensuring production stability • Improve incident readiness and response for AI-related failures and degradations • Influence build-versus-buy decisions for LLM tooling and platforms • Mentor engineers and establish best practices for operating AI systems at scale

🎯 Requirements

• 8+ years of experience in software engineering, platform engineering, or DevOps roles • Hands-on experience operating LLM-powered systems in production • Familiarity with LLM providers and orchestration frameworks • Strong understanding of distributed systems, APIs, and cloud-native architectures • Experience designing observability and evaluation systems for complex workflows • Practical knowledge of cost and performance optimization in cloud environments • Experience working with event-driven architectures and asynchronous workflows • Proven ability to lead through influence rather than authority • Highly structured thinker with strong problem-solving skills • Clear communicator capable of explaining AI operational trade-offs to technical and non-technical stakeholders • Comfortable working across teams in a fast-moving, evolving environment • Builder mindset with a focus on reliability and outcomes • Belief that AI amplifies engineering fundamentals rather than replaces them • Learning-first attitude, staying current with evolving AI tools and practices • Pragmatic and calm under pressure, especially during incidents • Customer-aware, understanding the real-world impact of AI behavior