Senior AI Developer

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $200k - $250k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

ClickUp

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2017

☁️ SaaS

⚡ Productivity

🏢 Enterprise

💰 $400M Series C - ClickUp on 2021-10

SaaS • Productivity • Enterprise

ClickUp is a cloud-based SaaS work management and productivity platform that consolidates projects, docs, chat, time tracking, automations and AI-driven "Super Agents" into a single workspace. It helps teams and enterprises streamline workflows, replace fragmented software stacks, and boost productivity with integrations, customizable agents/workflows, and enterprise-grade security and compliance.

📋 Description

• Design, build, and own ClickUp's AI evaluation system, including golden datasets, LLM-as-judge and automated scorers, regression detection, and quality tracking across AI features • Build and evolve the core agent harness and the AI that performs well on evaluations, partnering with product and engineering to define quality standards • Build self-improvement loops where agents modify other agents or prompts, rerun evaluations, and iterate automatically • Benchmark new models and own model selection, routing, and fallback strategies across providers while balancing quality, latency, and cost • Architect, design, and implement scalable AI platform services for deployment, orchestration, and lifecycle management of LLMs and other AI models • Build and maintain robust APIs and backend systems integrating AI-powered features into ClickUp's core platform • Develop infrastructure for model serving, monitoring, logging, and automated evaluation for reliable, high-performance production AI services • Drive best practices in AI privacy, security, and compliance, including data anonymization, secure data handling, and regulatory adherence • Collaborate cross-functionally with product, frontend, and data teams to deliver reliable, user-centric AI experiences

🎯 Requirements

• 5+ years of software engineering experience, including 2+ years building production LLM or ML systems • Hands-on experience building LLM evaluation systems in production, including golden datasets, LLM-as-judge, judge calibration, offline and online evals, tied to real product quality • Strong experiment design and statistical rigor, including A/B testing, offline vs. online metrics, and separating real regressions from noisy or variable results • Proven track record of applying LLMs and AI models to real-world, customer-facing product features • Proven experience integrating and managing multiple LLMs, including benchmarking, routing, and cost/latency/quality tradeoffs • Deep expertise in backend engineering, distributed systems, and cloud-native technologies such as Kubernetes, Docker, and AWS/GCP/Azure • Strong programming skills in Python, Go, TypeScript, or similar backend and AI platform languages • Proficiency in orchestration frameworks and workflow engines such as LangGraph, Airflow, Ray, or similar • Familiarity with search and retrieval technologies and their integration into AI-driven applications • Excellent collaboration and communication skills, with a track record of working effectively in cross-functional teams • Passion for staying at the forefront of AI and applying new technologies to solve real-world problems at scale • Nice to have: background in data science, applied science, or machine learning engineering • Nice to have: experience with eval tooling such as Braintrust, LangSmith, Weave, Arize, or in-house frameworks • Nice to have: experience with model routing, AI gateways, or inference optimization • Must be located in or legally authorized to work in the United States; visa sponsorship is not guaranteed and depends on business needs

🏖️ Benefits

• Equity • 401k • Health, Dental, and Vision insurance • Spending accounts • Life & Disability • Paid parental leave • Flexible paid time off • Enhanced employee assistance program • Employee wellness stipend • Professional development stipend

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume