Principal Engineer, LLM

πŸ”₯ 16 hours ago

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $238.4k - $330.2k / year

⏰ Full Time

🟠 Senior

πŸ—£οΈ LLM Engineer

Where this job comes from

Posted on Upstart's careers page β†—Upstart's careers page, not through a job board

First seen by Remote Rocketship 16 hours ago

Still open on Upstart's site. Checked 36 minutes ago.

Apply Now
Logo of Upstart

Upstart

1001 - 5000 employees

🚘 Automotive

πŸ’Ό Consulting

πŸ₯ Healthcare

Automotive β€’ Consulting β€’ Healthcare

Upstart is a leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. The company focuses on revolutionizing lending and credit risk evaluation by leveraging its AI marketplace, which allows for higher approval rates and lower loss rates for Upstart-powered banks and credit unions. Recently, Upstart has expanded its offerings to include automobile refinancing. With a mission to enable effortless credit based on true risk, Upstart is also known for its digital-first lending experience and holds a significant position in the financial services sector.

πŸ“‹ Description

β€’ Build and support an agent platform enabling non-technical users to build, launch, and operate voice, chat, and text AI agents β€’ Build orchestration for a unified personal assistant sharing context across specialized agents β€’ Improve borrower-connected internal workflows β€’ Rapidly prototype high-ambiguity, 0-to-1 initiatives across agent platforms, orchestration, borrower-facing assistants, and internal workflows β€’ Partner with Product and Design to validate non-deterministic UX and establish architectural patterns β€’ Deliver golden datasets, automated evaluation harnesses, failure-mode maps, latency/cost benchmarks, and architectural blueprints β€’ Partner with engineering squads from technical spike through productionization, including go/no-go decisions, PR reviews, and debugging model behavior β€’ Design agent handoffs, fallback paths, and trustworthy non-deterministic user experiences β€’ Make pragmatic decisions about prompting, guardrails, model routing, fine-tuning, and distillation β€’ Model agentic coding and verification practices and raise applied AI capabilities across squads

🎯 Requirements

β€’ 8+ years of software engineering experience β€’ Hands-on experience shipping non-deterministic, user-facing LLM or AI products to real users β€’ Deep practical experience designing production LLM systems involving structured outputs, tool calling, context engineering, retrieval/memory patterns, and multi-step or multi-agent orchestration β€’ Strong distributed-systems and backend fundamentals, including async orchestration, streaming UX, caching, timeouts, fallback paths, rate-limit handling, and end-to-end observability/tracing β€’ Proven experience building golden datasets, automated evaluation harnesses, regression gates, and systematic failure-mode analyses β€’ Strong judgment regarding deterministic logic, prompting, context engineering, guardrails, routing, fine-tuning, and distillation β€’ Backend and frontend prototyping fluency, such as Python, TypeScript/React, and modern REST or streaming APIs β€’ Track record collaborating with partner squads and Product, Design, operations, or business leaders β€’ Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience β€’ East/West coast time-zone availability β€’ Preferred: startup or 0-to-1 incubation experience; agent platforms/shared abstractions; production fine-tuning/distillation; AI-native engineering habits; regulated or high-trust consumer-domain experience

πŸ–οΈ Benefits

β€’ Competitive compensation, including base pay, bonus opportunities, and annual equity grants that vest quarterly β€’ Retirement benefits including a 401(k) or Group Retirement Savings Plan with a company match of $2 for every $1 contributed, up to $15,000 annually β€’ Employee Stock Purchase Plan (ESPP) with discounted stock purchase options for eligible employees (US only) β€’ Comprehensive medical, dental, vision, and wellness coverage/resources β€’ Supplemental health coverage for Canada β€’ Health Savings Account contributions for eligible plans (US only) β€’ Life insurance and disability coverage β€’ Paid time off, sick leave, and company holidays β€’ Paid family and parental leave β€’ Family-centered fertility, parenthood, and caregiving benefits β€’ Employee Assistance Program offering mental health support and life-centered resources β€’ Financial planning tools and financial concierge service (US only) β€’ Annual wellness allowance β€’ Annual productivity allowance for relevant tools and resources β€’ Team events, all-company updates, and employee resource groups (ERGs) β€’ Catered lunches and fully stocked micro-kitchens at offices in the Bay Area, Austin, Columbus, and New York City

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ Yesterday

CVS Health Careers

10,000+ employees

πŸ₯ Healthcare

πŸ›’ Retail

πŸ“¦ Logistics

CVS Health staff engineer leading a Conversational AI engineering squad. Designing scalable distributed systems and delivering enterprise AI-powered healthcare solutions.

πŸ•’ Yesterday

CVS Health

10,000+ employees

πŸ₯ Healthcare

βš•οΈ Healthcare Insurance

πŸ›’ Retail

CVS Health Staff Software Engineer leading a conversational AI squad. Designing scalable enterprise systems and delivering strategic AI-powered healthcare solutions.

πŸ•’ November 3

Blue Rose Research

11 - 50

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ”¬ Science

Engineering lead building LLM-powered agents and research tools at Blue Rose Research. Leading engineers creating AI systems that help Democrats win elections and advance progressive causes.

πŸ•’ October 30

Magpie Health Analytics

11 - 50

πŸ₯ Healthcare

πŸ›οΈ Government

πŸ€– Artificial Intelligence

Generative AI Engineer building grounded LLM search and decision-support tools for healthcare clients. Deploying secure AWS solutions with citations, guardrails, and responsible AI oversight.

πŸ•’ October 29

FICO

1001 - 5000

πŸ’Ό Consulting

πŸ›‘οΈ Insurance

πŸ₯ Healthcare

Software Engineer building and evaluating Python/Java LLM applications for FICO, a global analytics software company. Improving AI assistants’ quality, safety, compliance, cost, and performance.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok