Member of Engineering, Evaluations

Job not on LinkedIn

August 20

Apply Now
Logo of poolside

poolside

Artificial Intelligence • Enterprise

poolside is a frontier AI lab and enterprise platform that builds and deploys foundation models, multi-agent systems, and developer-facing tools focused on automating complex software work. The company specializes in on-prem and VPC deployments, security-first integrations, governance, and connectors to enterprise data sources so organizations can run agents and models inside their own boundaries. Poolside embeds research and engineering with customers to deliver outcome ownership, risk controls, and measurable business impact while advancing toward AGI by starting in high-consequence software environments.

51 - 200 employees

Founded 2023

🤖 Artificial Intelligence

🏢 Enterprise

📋 Description

• Evaluation is one of the most important pillars of building a frontier model and product - it informs the direction of research and development, powers our experimentation and ensures quality and alignment with our users. • To support this, we need a powerful pipeline and self-serve evaluation framework that helps poolsiders build, run and extract insight from evals easily. • In this role, you will design and implement this platform to build and run evaluations at scale.

🎯 Requirements

• Strong engineering background • Experience leading software projects cross functionally • Experience building highly reliable and well tested services • Experience with distributed systems • Data pipelines, distributed processing • Message queues, event-driven architectures, e.g. Kafka, Google pub/sub. • Clouds: managed services, storage. GCP, AWS, Azure. • Monitoring and alerting: Grafana, Prometheus, Datadog • Plus: Experience designing frameworks or tooling for developers • A product mindset towards building developer facing software • A knack for collaborating with researchers and ML engineers to identify opportunities • Plus: Experience with ML ops and data visualization platforms

🏖️ Benefits

• Fully remote work & flexible hours • 37 days/year of vacation & holidays • Health insurance allowance for you and dependents • Company-provided equipment • Wellbeing, always-be-learning and home office allowances • Frequent team get togethers • Great diverse & inclusive people-first culture

Apply Now

Similar Jobs

August 12

Devoteam

5001 - 10000

🤖 Artificial Intelligence

🔒 Cybersecurity

Devoteam seeks a Dynamics 365 developer for the energy/resources sector. Design, develop and integrate Dynamics 365 solutions.

🇵🇹 Portugal – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🖥 Software Engineer

April 30

Ciellos

51 - 200

🤝 B2B

🏢 Enterprise

☁️ SaaS

Work remotely as a Senior Developer at Ciellos, upgrading NAV to Business Central.

🇵🇹 Portugal – Remote

⏰ Full Time

🟠 Senior

🖥 Software Engineer

April 30

Devoteam

5001 - 10000

🤖 Artificial Intelligence

🔒 Cybersecurity

Join Devoteam as a Salesforce Integration Developer specializing in system connectivity and loyalty management implementation.

🇵🇹 Portugal – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🖥 Software Engineer

March 15

KĂśrber

10,000+ employees

🏢 Enterprise

💊 Pharmaceuticals

KĂśrber Supply Chain seeks a Senior C# Developer to build solutions for logistics projects. Join a remote R&D team focused on innovative software development.

🇵🇹 Portugal – Remote

⏰ Full Time

🟠 Senior

🖥 Software Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com