Principal Engineer – AI Platform

🕒 June 20

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

iHerb, LLC

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1996

🍽️ Food & Beverage

🏥 Healthcare

🛍️ eCommerce

Food & Beverage • Healthcare • eCommerce

iHerb, LLC is an e-commerce platform that specializes in health and wellness products. The company offers a wide range of products including vitamins, supplements, herbs, sports nutrition, beauty products, grocery items, and more. iHerb is committed to providing high-quality products sourced directly from manufacturers or authorized distributors. The platform is known for its competitive pricing, extensive product reviews, prompt delivery services, and a strong emphasis on customer satisfaction. iHerb serves an international customer base, offering shipping to numerous countries worldwide.

📋 Description

• Define and own the AI platform architecture: retrieval infrastructure, model lifecycle, evals framework, guardrails, and GenAI product feature design. • Lead the build of the shared AI platform layer consumed by all AI product features and reusable by internal business teams. • Hands-on contributor: build production AI systems, write proofs of concept, and validate architecture through working software. • Set and enforce technical standards for the AI Platform team; drive architecture reviews and model quality reviews. • Coordinate with the Personalization team to define clear boundaries between the GenAI product layer and existing ML personalization infrastructure. • Contribute AI platform-specific patterns and lessons into iHerb's shared AI-driven SDLC golden path. • Drive the hardest cross-cutting technical decisions across multiple teams and shared platform services. • Establish and evolve iHerb's AI-driven SDLC golden path: shared standards, Claude Code skills, guardrails, and automation patterns. • Lead complex multi-team technical efforts by coordinating architecture reviews, aligning peer Principals and EMs, and resolving competing approaches. • Mentor and raise the technical bar across the engineering organization through code review, architecture review, and direct coaching of senior engineers. • Represent engineering in cross-functional conversations with product, data science, security, and infrastructure. • Feed architectural decisions into the shared knowledge base so institutional knowledge compounds across the organization.

🎯 Requirements

• Generally requires a minimum of 10+ years of software engineering experience, with a significant portion at senior, staff, or principal IC level. • AI-driven SDLC (required): demonstrated use of AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor to ship production systems. • Architecture at scale: experience designing and evolving large-scale distributed systems across multiple teams and years: APIs, data pipelines, event-driven architectures, or high-traffic platforms. • Cross-org technical leadership: track record of driving architectural standards, technical roadmaps, or platform initiatives that span multiple teams or organizations. • Engineering quality mindset: deeply held opinions on code quality, observability, CI/CD, test automation, and maintaining velocity without accumulating hidden debt. • Communication and influence: able to write clear architecture documents, present to technical and non-technical audiences, and build consensus without formal authority. • Experience working in distributed teams across the US, China, and Latin America. • Production experience designing and operating AI platform systems: RAG pipelines, vector search, embedding infrastructure, or retrieval-augmented applications at scale. • Hands-on experience with LLM evaluation: building eval frameworks, defining quality metrics, and iterating on model and prompt quality using data. • MLOps experience: model deployment, monitoring, lifecycle management, and cost governance in a production environment. • Experience building and operating agentic systems using frameworks such as LangChain, LlamaIndex, or equivalent. • GenAI in production is required; prototype or research-only experience is not sufficient at this level. • High degree of accuracy and attention to detail. • Excellent organization skills and ability to multi-task.

🏖️ Benefits

• Employees (and their families) that meet eligibility criteria as outlined in applicable plan documents are eligible to participate in our medical, dental, vision, and basic life insurance programs and may enroll in our company’s 401(k) plan. • Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company’s policies. Employees will enjoy paid holidays throughout the calendar year. • Hired applicant may be awarded Restrict Stock Units and receive annual bonuses pursuant to eligibility and performance criteria defined in the respective plan documents and policies.