Senior LLM Systems Engineer

Job not on LinkedIn

🕒 May 25

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Risk Labs Foundation

WebsiteLinkedInAll Job Openings

11 - 50 employees

₿ Crypto

🌐 Web 3

Crypto • Web 3 • Technology

Risk Labs Foundation is the organization behind the Across and UMA Protocols, offering technology solutions focused on decentralized systems. Across is a cross-chain bridge for Layer 2s (L2s), secured by UMA's optimistic oracle, designed for capital efficiency with a single liquidity pool, a competitive relayer landscape, and a no-slippage fee model. UMA is an optimistic oracle that can record any verifiable truth onto a blockchain. Risk Labs emphasizes a flexible and supportive working environment for its international team, offering benefits such as unlimited PTO, family care leave, and training and development opportunities.

📋 Description

• We are hiring a Senior LLM Systems Engineer to own and improve the LLM-driven components of our oracle automation stack. • Focus on the accuracy, performance, resilience, and operational quality of the systems that use models to reason about wide ranging prediction market rules, evidence, and oracle outcomes. • Build the evaluations, observability, tooling, fallbacks, and feedback loops that make LLM behavior measurable and dependable in real-world conditions. • Improve prompts, model selection, tool usage, structured outputs, retrieval, and evaluation coverage so the system gets more decisions right over time. • Design validation, retries, fallbacks, uncertainty handling, and human review paths for ambiguous, adversarial, incomplete, or conflicting inputs. • Build datasets, regression tests, dashboards, traces, and review loops that make model quality visible and prevent repeated failures. • Help debug live issues, investigate regressions, improve runbooks, and reduce repeated operator friction.

🎯 Requirements

• 3+ years of professional software engineering experience in Python, TypeScript, or similar production languages. • Hands-on experience building production systems that use LLMs, agents, retrieval, structured outputs, or model-powered workflows. • Experience designing evaluations, test datasets, regression checks, quality metrics, or manual review loops for AI systems. • Strong debugging ability across APIs, databases, queues, logs, model outputs, and external data sources. • Practical understanding of prompt engineering, tool calling, structured output validation, retrieval, and common LLM failure modes. • Ability to reason carefully about correctness in uncertain or adversarial environments. • High agency, strong ownership, and clear written communication.

🏖️ Benefits

• Pay packages include competitive salaries & meaningful long term equity participation • Salaries for this role range from $100-200k (USD) • Will pay in stablecoins or fiat • Philosophies for a culture that show we care: Take vacation when you need it, family care, training and development (just to name a few) • 100% remote, which means we encourage you to create the work environment that you thrive in • At least two team wide offsites a year