Senior Software Engineer II – AI

🕒 2 days ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of iHerb, LLC

iHerb, LLC

1001 - 5000 employees

Founded 1996

🛍️ eCommerce

🧘 Wellness

🛒 Retail

eCommerce • Wellness • Retail

iHerb, LLC is an e-commerce platform that specializes in health and wellness products. The company offers a wide range of products including vitamins, supplements, herbs, sports nutrition, beauty products, grocery items, and more. iHerb is committed to providing high-quality products sourced directly from manufacturers or authorized distributors. The platform is known for its competitive pricing, extensive product reviews, prompt delivery services, and a strong emphasis on customer satisfaction. iHerb serves an international customer base, offering shipping to numerous countries worldwide.

📋 Description

• Lead the build of GenAI-powered product experiences and shared AI platform infrastructure • Design, build, and operate production AI features • Build shared AI platform layer including retrieval infrastructure and eval frameworks • Write LLM applications and integrations with marketing platforms and BI tools • Evaluate model and feature quality using structured eval frameworks • Use AI-driven SDLC tooling for AI and non-AI code • Coordinate with the Personalization team • Document AI system design decisions and operational lessons • Own the observability of AI systems built including latency, cost, quality drift, and error rates

🎯 Requirements

• 10+ years of software engineering experience • Hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor • Comfortable contributing across layers of the stack • Experience owning features end-to-end from spec through deployment • Strong grasp of software design principles, automated testing, code review, and CI/CD • Fully autonomous; drives technical decisions within the team; mentors junior engineers • Python proficiency; comfortable building and operating production LLM applications • Experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex or similar), or LLM-based workflow automation • Understanding of prompt engineering, context window management, and LLM output quality tradeoffs • Familiarity with vector databases, embedding models, or semantic search • High degree of accuracy and attention to detail • Excellent organization skills and ability to multi-task

🏖️ Benefits

• Medical, dental, vision, and basic life insurance programs • Enrollment in the company’s 401(k) plan • Paid Time Off • Paid Sick Leave • Paid holidays throughout the calendar year • Potential award of Restrict Stock Units • Annual bonuses pursuant to eligibility and performance criteria

Apply Now

Similar Jobs

🕒 2 days ago

Gigawatt

11 - 50

⚡ Energy

🤖 Artificial Intelligence

🏢 Enterprise

Software Engineer integrating AI tools and maintaining APIs in backend systems at Gigawatt AI. Collaborating in agile teams, designing secure and scalable solutions to modernize utilities.

AWS

Azure

Cloud

Distributed Systems

Google Cloud Platform

Java

NoSQL

Python

React

SQL

Go

🕒 2 days ago

Cobalt AI

51 - 200

🤖 Artificial Intelligence

🔐 Security

🏢 Enterprise

Senior Full Stack Engineer developing real-time security monitoring tools at Cobalt AI. Collaborating on frontend and backend technologies including React, TypeScript, Django, and GraphQL.

AWS

Django

GraphQL

Postgres

Python

React

TypeScript

🕒 2 days ago

Shippo

201 - 500

🔌 API

🛍️ eCommerce

☁️ SaaS

Senior Backend Software Engineer powering ML backend services for data products at Shippo. Building and maintaining high-performance solutions that deliver predictions to merchants in the logistics domain.

Distributed Systems

Kafka

Postgres

Python

🕒 3 days ago

Harbor Compliance

201 - 500

📋 Compliance

☁️ SaaS

🤝 B2B

Software Architect at Harbor Compliance defining and modernizing technical architecture for entity compliance platform. Leading AI-driven design and architecture for scalable systems.

Cloud

Distributed Systems

Microservices

🕒 3 days ago

ACD Direct

11 - 50

Full Stack Developer role for ACD Direct, Inc. building and maintaining platforms for non-profit clients. Collaborate on design decisions and leverage AI tools in daily development workflows.

Angular

SQL