Member of Engineering, Evaluations

Job not on LinkedIn

🕒 April 20

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

poolside

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2023

🤖 Artificial Intelligence

🏢 Enterprise

Artificial Intelligence • Enterprise

poolside is a frontier AI lab and enterprise platform that builds and deploys foundation models, multi-agent systems, and developer-facing tools focused on automating complex software work. The company specializes in on-prem and VPC deployments, security-first integrations, governance, and connectors to enterprise data sources so organizations can run agents and models inside their own boundaries. Poolside embeds research and engineering with customers to deliver outcome ownership, risk controls, and measurable business impact while advancing toward AGI by starting in high-consequence software environments.

📋 Description

• Research and implementation of evaluations and benchmarks; both for base models and for instruction following models • Collaborate with both applied research and product teams to define meaningful metrics and evaluations that capture our progress on real world software development skills • Work in a team: plan future steps, discuss, and communicate clearly with your peers

🎯 Requirements

• Experience with Large Language Models (LLM) • Strong understanding and intuition of LLMs, and their limitations • Good taste, and a curious mindset • Strong engineering background • Strong programming skills, ideally across multiple languages • Familiar with full software development life cycle • Programming experience • Linux • Strong algorithmic skills • Multiple languages, including Python • Use modern tools and are always looking to improve • Strong critical thinking and ability to question code quality policies when applicable

🏖️ Benefits

• Fully remote work & flexible hours • 37 days/year of vacation & holidays • Health insurance allowance for you and dependents • Company-provided equipment • Wellbeing, always-be-learning and home office allowances • Frequent team get togethers • Great diverse & inclusive people-first culture