Evaluation and ML Systems Engineer, AI Safety and Security Engineering

🕒 July 27

🏄 California, Florida, +3 more states – Remote

infoinfo

💵 $152k - $241.5k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Machine Learning Engineer

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 25%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Build benchmarking and reproducibility systems • Define metrics and protocols for ML system evaluation • Map every result to the code and runs that produced it • Keep findings reviewable and conclusions traceable • Automate measurement processes • Partner with security researchers and platform engineers to design trustworthy, reproducible experiments • Support internal review of results and evidence-based conclusions

🎯 Requirements

• Bachelor's degree (or equivalent experience) • 5+ years in ML engineering or evaluation • Experience designing benchmarks, metrics, and statistically sound comparisons for ML systems • Careful, skeptical approach to metrics, baselines, and claims • Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines • Exposure to evaluating security tooling or pipelines • Experience measuring agent or LLM behavior • Contributions to public benchmarks or evaluation frameworks

🏖️ Benefits

• Competitive salaries • Generous benefits package • Equity • Benefits

Apply Now

Similar Jobs

🕒 July 27

E Source

201 - 500

⚡ Energy

💼 Consulting

🤝 B2B

AI / ML Engineer developing scalable ML and AI systems for utilities-focused projects. Collaborating with dynamic teams to implement innovative solutions in a rapidly changing landscape.

🕒 July 27

Coral AI

11 - 50

🏥 Healthcare

🤖 Artificial Intelligence

☁️ SaaS

Senior ML Engineer developing and deploying machine learning solutions for OCR and NLP at Coral AI. Collaborating with cross-functional teams to optimize advanced models for healthcare applications.

🕒 July 27

Allocate

51 - 200

☁️ SaaS

💳 Fintech

🤝 B2B

AI / Extraction Engineer developing machine-learning models for Allocate's platform. Building and evaluating models to enhance AI capabilities in private market investing.

🇺🇸 United States – Remote

💵 $165k - $185k / year

💰 $30.5M Series B - Allocate on 2025-09

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Machine Learning Engineer

🕒 July 27

Adelphi Data

2 - 10

🏛️ Government

🎖️ Defense

🔒 Cybersecurity

Senior Machine Learning Engineer position focusing on LLM Ops and software development for national security. Work with defense and intelligence sectors to deliver full-stack systems and ML services.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 $7.1M Series unknown on 2025-10

⏰ Full Time

🟠 Senior

🤖 Machine Learning Engineer

🕒 July 27

Adelphi Data

2 - 10

🏛️ Government

🎖️ Defense

🔒 Cybersecurity

Machine Learning Engineer contributing to end-to-end delivery of full-stack AI services in the national security sector. Working with defense and intelligence customers and leveraging LLMs in production environments.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 $7.1M Series unknown on 2025-10

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Machine Learning Engineer