Senior AI Developer

Job not on LinkedIn

πŸ•’ November 5

Where this job comes from

Posted on ClickUp's careers page β†—ClickUp's careers page, not through a job board

First seen by Remote Rocketship November 5

Still open on ClickUp's site. Checked 57 minutes ago.

Apply Now
Logo of ClickUp

ClickUp

1001 - 5000 employees

Founded 2017

☁️ SaaS

⚑ Productivity

🏒 Enterprise

πŸ’° $400M Series C - ClickUp on 2021-10

SaaS β€’ Productivity β€’ Enterprise

ClickUp is a cloud-based SaaS work management and productivity platform that consolidates projects, docs, chat, time tracking, automations and AI-driven "Super Agents" into a single workspace. It helps teams and enterprises streamline workflows, replace fragmented software stacks, and boost productivity with integrations, customizable agents/workflows, and enterprise-grade security and compliance.

πŸ“‹ Description

β€’ Design, build, and own ClickUp's AI evaluation system, including golden datasets, LLM-as-judge and automated scorers, regression detection, and quality tracking across AI features β€’ Build and evolve the core agent harness and the AI that performs well on evaluations, partnering with product and engineering to define quality standards β€’ Build self-improvement loops where agents modify other agents or prompts, rerun evaluations, and iterate automatically β€’ Benchmark new models and own model selection, routing, and fallback strategies across providers while balancing quality, latency, and cost β€’ Architect, design, and implement scalable AI platform services for deployment, orchestration, and lifecycle management of LLMs and other AI models β€’ Build and maintain robust APIs and backend systems integrating AI-powered features into ClickUp's core platform β€’ Develop infrastructure for model serving, monitoring, logging, and automated evaluation for reliable, high-performance production AI services β€’ Drive best practices in AI privacy, security, and compliance, including data anonymization, secure data handling, and regulatory adherence β€’ Collaborate cross-functionally with product, frontend, and data teams to deliver reliable, user-centric AI experiences

🎯 Requirements

β€’ 5+ years of software engineering experience, including 2+ years building production LLM or ML systems β€’ Hands-on experience building LLM evaluation systems in production, including golden datasets, LLM-as-judge, judge calibration, offline and online evals, tied to real product quality β€’ Strong experiment design and statistical rigor, including A/B testing, offline vs. online metrics, and separating real regressions from noisy or variable results β€’ Proven track record of applying LLMs and AI models to real-world, customer-facing product features β€’ Proven experience integrating and managing multiple LLMs, including benchmarking, routing, and cost/latency/quality tradeoffs β€’ Deep expertise in backend engineering, distributed systems, and cloud-native technologies such as Kubernetes, Docker, and AWS/GCP/Azure β€’ Strong programming skills in Python, Go, TypeScript, or similar backend and AI platform languages β€’ Proficiency in orchestration frameworks and workflow engines such as LangGraph, Airflow, Ray, or similar β€’ Familiarity with search and retrieval technologies and their integration into AI-driven applications β€’ Excellent collaboration and communication skills, with a track record of working effectively in cross-functional teams β€’ Passion for staying at the forefront of AI and applying new technologies to solve real-world problems at scale β€’ Nice to have: background in data science, applied science, or machine learning engineering β€’ Nice to have: experience with eval tooling such as Braintrust, LangSmith, Weave, Arize, or in-house frameworks β€’ Nice to have: experience with model routing, AI gateways, or inference optimization β€’ Must be located in or legally authorized to work in the United States; visa sponsorship is not guaranteed and depends on business needs

πŸ–οΈ Benefits

β€’ Equity β€’ 401k β€’ Health, Dental, and Vision insurance β€’ Spending accounts β€’ Life & Disability β€’ Paid parental leave β€’ Flexible paid time off β€’ Enhanced employee assistance program β€’ Employee wellness stipend β€’ Professional development stipend

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ November 5

EvolutionIQ

51 - 200

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

AI Engineer building production LLM features and agentic workflows for CCC’s cloud insurance platform. Improving claims automation with trustworthy evaluations, secure services, and auditable model tracing.

πŸ•’ November 5

EvolutionIQ

51 - 200

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

Senior AI Engineer building LLM-powered claims automation for CCC’s insurance cloud platform. Designing agentic workflows, NLP pipelines, evaluations, and secure production systems.

πŸ•’ November 5

TRM Labs

201 - 500

β‚Ώ Crypto

πŸ“‹ Compliance

🀝 B2B

Senior AI Engineer building Python/TypeScript agents and automations for TRM Labs’ AI-powered crime and threat intelligence platforms. Embedded with Product, Marketing, and Design to accelerate decisions and delivery.

πŸ•’ November 4

Inviso

201 - 500

πŸ’Ό Consulting

πŸ“£ Marketing

☁️ SaaS

Applied AI Engineer building and operating production AI capabilities for a global software conglomerate. Delivering reliable, measurable, safe, and cost-aware agent and LLM systems.

πŸ•’ November 4

Elbit Systems of America

1001 - 5000

πŸŽ–οΈ Defense

πŸ”§ Hardware

πŸš€ Aerospace

Senior AI Engineer developing and optimizing production AI/ML algorithms for business-critical applications. Guiding teams on scalable, ethical, and high-performing solutions.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok