AI Engineer – Instrumentation

Job not on LinkedIn

September 29

Apply Now

Receive Emails with Similar Jobs

Arize AI

WebsiteLinkedInAll Job Openings

Artificial Intelligence • SaaS • Enterprise

Arize AI is a company that provides a comprehensive AI observability and evaluation platform designed for AI engineers to build and manage AI applications, particularly those involving large language models (LLMs). The platform offers end-to-end AI tracing, monitoring, and evaluation tools to help users identify and resolve performance bottlenecks, ensure data quality, and improve the performance of AI systems. Arize also supports experimentation and visualization, enabling users to iterate rapidly on AI applications and maintain high-quality service delivery. The company caters to top AI companies, offering solutions for both online and offline LLM evaluation and observability. Arize's tools are particularly valuable for AI model monitoring, troubleshooting, and performance optimization, helping businesses mitigate risks and improve AI outcomes.

51 - 200 employees

Founded 2019

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

📋 Description

• Build new LLM and instrumentation libraries for emerging LLM providers and agent frameworks • Maintain and enhance existing instrumentation across Python and TypeScript ecosystems (OpenAI, Anthropic, LlamaIndex, CrewAI and many more) • Drive improvements to semantic conventions and OpenTelemetry standards that define AI observability • Collaborate with the global developer community through GitHub, Slack, and conferences, as well as Arize PMs and solution architects • Synthesize requirements from open-source community and enterprise deployments into practical instrumentation capabilities • Take complex problems from ideation to completion with full ownership and accountability • Work directly on the OpenInference repository that powers AI observability for developers worldwide

🎯 Requirements

• 3-5+ years of software development experience shipping production code • Expert-level proficiency in both Python and TypeScript • Community-oriented mindset with genuine passion for collaborative open-source development • Deep interest in AI/LLM ecosystem with desire to stay current on emerging technologies • Strong analytical skills to distill requirements from diverse sources and stakeholders • Bonus: Experience building SDK clients, instrumentation libraries, or platform APIs • Bonus: Hands-on experience with AI/ML observability or evaluation systems

🏖️ Benefits

• comprehensive benefits package, including medical, dental, vision • 401(k) plan • unlimited paid time off • generous parental leave plan • additional support for mental health and wellness • competitive equity package • WFH monthly stipend to pay for co-working spaces • remote-first company with optional offices in New York City and the San Francisco Bay Area • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem • Culturally conscious events such as LGBTQ trivia during pride month • Active Lady Arizers subgroup