Benchmark & Evaluation Engineer

Job not on LinkedIn

🕒 October 9

🇵🇭 Philippines – Remote

⏰ Full Time

🟠 Senior

👷🏻‍♀️ Engineer

Where this job comes from

Posted on Expedock's careers page ↗Expedock's careers page, not through a job board

First seen by Remote Rocketship October 9

Still open on Expedock's site. Checked 8 hours ago.

Apply Now
Logo of Expedock

Expedock

51 - 200 employees

📦 Logistics

🤖 Artificial Intelligence

🚗 Transport

Logistics • Artificial Intelligence • Transport

Expedock is the AI-powered automation service behind some of the leading players in the 7 trillion USD global supply chain. The company is on a mission to build a powerful data infrastructure that drives unprecedented efficiency and profitability across the industry. Expedock focuses on automating the manual processing and inputting of data for freight forwarding and logistics, achieving 99. 99% accuracy. With a team of experts in artificial intelligence and logistics, Expedock aims to transform the future of supply chain and logistics.

📋 Description

• Design and stand up multi-system enterprise environments, including warehouses, lakes, APIs, and databases, at scale • Build environments across domains such as healthcare, finance, and product analytics • Generate calibrated, large-scale benchmark datasets with realistic noise, seasonality, drift, and synthetic PII • Test query scalability and reasoning using benchmark datasets • Write and verify benchmark tasks, golden SQL, and rubric-scored reasoning keys • Eliminate data leakage and ambiguity from benchmark tasks • Extend grading systems using deterministic checks and LLM judges • Maintain regression-tracked leaderboards • Ensure evaluation scoring integrity

🎯 Requirements

• Expert proficiency in production-grade SQL, including CTEs, window functions, query plans, and cardinality • Expertise in data modeling, including star/snowflake schemas, SCDs, and referential integrity • Strong Python skills with pandas, NumPy, and Polars • Hands-on experience standing up and loading data into at least one major warehouse: Snowflake, BigQuery, Redshift, or Postgres • Proven experience designing evaluation sets or benchmark tasks • Experience with golden-answer/golden-SQL verification, rubric/LLM-judge calibration, avoiding data leakage, and tracking regressions • Ability to construct realistic multi-system setups including warehouses, data lakes, operational databases, and APIs • Experience with large-scale, semi-structured, or dirty synthetic data • Domain knowledge in Healthcare/Health Insurance, Finance/FP&A, Product Analytics, or Supply Chain is nice to have • Experience with LLM evaluation frameworks or streaming/data-lake stacks is nice to have

🏖️ Benefits

• Remote work in the Philippines • US Shift schedule

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 5

ScalableOS

201 - 500

💼 Consulting

☁️ SaaS

Microsoft Modern Work Engineer delivering Microsoft 365 migrations, hybrid identity, and endpoint modernization. Supporting enterprise clients through tenant consolidations and cloud transformation projects.

🕒 September 24

CompassMSP

201 - 500

🔒 Cybersecurity

🤝 B2B

💼 Consulting

Remediation Engineer hardening infrastructure, managing Microsoft and Azure environments, and remediating vulnerabilities for CompassMSP managed-services clients.

🕒 August 3

Trident BPO

1 - 10

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Senior Process Engineer extending process engineering capability at health benefits platform. Autonomous role involving diagnosis, design, and implementation in operational processes.

🕒 July 21

Workstreet

11 - 50

🔒 Cybersecurity

📋 Compliance

🤝 B2B

Vulnerability Management Engineer securing startup applications, code, pipelines, and cloud infrastructure. Advising Workstreet clients on vulnerability remediation and compliance evidence.

🕒 July 18

3Cloud

501 - 1000

💼 Consulting

🏥 Healthcare

🏭 Manufacturing

Senior Modern Workplace Engineer at 3Cloud handling Microsoft 365 and Intune solutions. Responsible for troubleshooting, engineering, and configuration tasks for endpoint management.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok