Member of Engineering – Evaluations, Engineering

Job not on LinkedIn

🕒 April 20

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of poolside

poolside

51 - 200 employees

Founded 2023

🤖 Artificial Intelligence

🏢 Enterprise

Artificial Intelligence • Enterprise

poolside is a frontier AI lab and enterprise platform that builds and deploys foundation models, multi-agent systems, and developer-facing tools focused on automating complex software work. The company specializes in on-prem and VPC deployments, security-first integrations, governance, and connectors to enterprise data sources so organizations can run agents and models inside their own boundaries. Poolside embeds research and engineering with customers to deliver outcome ownership, risk controls, and measurable business impact while advancing toward AGI by starting in high-consequence software environments.

📋 Description

• Design a Python framework that makes it easy for poolsiders to implement both internal and public benchmarks in a centralized way • Build and maintain the pipeline that runs distributed evaluations at scale • Collaborate with modeling and product teams to identify opportunities to improve our experimentation and evaluation tooling

🎯 Requirements

• Strong engineering background • Experience leading software projects cross functionally • Experience building highly reliable and well tested services • Experience with distributed systems • Data pipelines, distributed processing • Message queues, event-driven architectures, e.g. Kafka, Google pub/sub. • Clouds: managed services, storage. GCP, AWS, Azure. • Monitoring and alerting: Grafana, Prometheus, Datadog • Plus: Experience designing frameworks or tooling for developers • A product mindset towards building developer facing software • A knack for collaborating with researchers and ML engineers to identify opportunities • Plus: Experience with ML ops and data visualization platforms

🏖️ Benefits

• Fully remote work & flexible hours • 37 days/year of vacation & holidays • Health insurance allowance for you and dependents • Company-provided equipment • Wellbeing, always-be-learning and home office allowances • Frequent team get togethers • Great diverse & inclusive people-first culture

Apply Now

Similar Jobs

🕒 April 15

Infovista

501 - 1000

🤝 B2B

📡 Telecommunications

Engineering Operations Manager overseeing SDLC process and governance at Infovista. Leading cross-functional teams to ensure disciplined and compliant engineering practices.

SDLC

🕒 March 31

Aquiva Labs

201 - 500

🤝 B2B

☁️ SaaS

🏢 Enterprise

Mulesoft Developer designing and implementing integrations between Salesforce and other enterprise systems. Requires expertise in MuleSoft Anypoint Platform with Agile team collaboration.

Cloud

SOAP

🕒 March 28

Weaviate

51 - 200

🤖 Artificial Intelligence

🤝 B2B

Manage Weaviate's social media channels, creating engaging content for a tech-savvy audience. Collaborate with teams to drive marketing strategies in an AI-focused startup.

🕒 March 28

SPACE44

11 - 50

🤝 B2B

☁️ SaaS

👥 HR Tech

Freelance Engineer/Developer at SPACE44 building scalable applications and cloud environments for diverse client projects. Join an expert community of engineers across various technical domains.

Airflow

Angular

AWS

Azure

Cloud

Docker

ETL

Google Cloud Platform

Java

JavaScript

Kafka

Kubernetes

MySQL

Node.js

PHP

Postgres

Python

React

Spark

SQL

Terraform

TypeScript

Vue.js

Go

🕒 March 24

magier

11 - 50

🤝 B2B

☁️ SaaS

Webflow Developer in a fully remote position with a focus on projects for European Tech Startups. Join a global team and work with a fixed set of clients to deliver quality web development.