Senior LLMOps Engineer, Development

🔥 16 minutes ago

🇺🇸 United States – Remote

💵 $155k - $195k / year

⏰ Full Time

🟠 Senior

👷🏻‍♀️ Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Citrin Cooperman

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1979

💼 Consulting

🏥 Healthcare

🏭 Manufacturing

Consulting • Healthcare • Manufacturing

Citrin Cooperman is an independent, full-service professional services firm that provides accounting, audit, tax, advisory, and consulting services to businesses and high‑net‑worth individuals. The firm offers outsourced finance and accounting, transaction advisory, valuation and forensic services, risk and cybersecurity advisory, and technology platform integrations across a wide range of industries. With a focus on client-centric, industry-specific solutions (including healthcare, manufacturing, real estate, restaurants, private equity, and professional services), Citrin Cooperman supports both private companies and family offices and operates as part of a broader international network for expanded reach.

📋 Description

• Design and build automated CI/CD deployment pipelines for generative AI applications • Safely promote prompt, LangGraph state-machine, and RAG retrieval updates across Dev, Test, and Prod environments • Deploy and manage continuous AI evaluation infrastructure • Embed precision, recall, and toxicity checks into deployment gates • Instrument AI applications and build dashboards for token consumption, latency, reasoning traces, and API failure rates • Implement version control and auditable registries for prompts and model configurations • Integrate guardrails and content filtering to block prompt injection, PII leakage, and off-topic responses • Monitor AI financial usage, set token-spike alerts, and optimize embedding and retrieval strategies • Collaborate with AI Engineers to industrialize generative AI applications and support enterprise AI operations

🎯 Requirements

• Bachelor’s degree in computer science, information technology, engineering, or equivalent practical experience • Databricks Certified: Machine Learning Professional • Microsoft Certified: Azure DevOps Engineer Expert (AZ-400) • DeepLearning.AI: Machine Learning Engineering for Production (MLOps) • 4+ years of experience in DevOps, MLOps, or Site Reliability Engineering (SRE) • Specific hands-on experience managing generative AI deployments in the last 1–2 years • Proficiency building CI/CD pipelines using Azure DevOps, GitHub Actions, or GitLab CI • Hands-on experience with LLMOps tools and frameworks such as MLflow, LangSmith, PromptFlow, or Arize • Strong Python scripting skills • Experience containerizing machine learning or API workloads with Docker and Kubernetes • Understanding of frontier-model APIs including OpenAI, Anthropic, and Google Vertex AI • Understanding of multi-agent frameworks including LangChain and LangGraph • Familiarity with Azure, AWS, and infrastructure-as-code principles

🏖️ Benefits

• Competitive compensation and benefits • Professional development support • Flexibility to manage personal and professional life