Senior GenAI Engineer – 3-6 month contract

Job not on LinkedIn

🔥 1 minute ago

🍂 Massachusetts – Remote

🍂 Massachusetts – Remote

💵 $129 - $150 / hour

⏳ Contract/Temporary

🟠 Senior

👷🏻‍♀️ Engineer

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Newfire Global Partners

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2016

💼 Consulting

🏥 Healthcare

📣 Marketing

Consulting • Healthcare • Marketing

Newfire Global Partners is an American IT services and advisory firm (founded in 2016 in Boston) that provides talent augmentation, software engineering, data & analytics, and AI/ML advisory to enterprise and investor clients. The company offers multidisciplinary engineering, product, and marketing teams, technical due diligence for VC/PE, data platform optimization, and an internal ML tool (Novel Heat) to improve code quality and Scrum velocity. Newfire operates across the Americas, Europe, and APAC with a 24x5 follow-the-sun delivery model and focuses on sectors such as digital healthcare, fintech, cybersecurity, and education technology.

📋 Description

• Test and evaluate GenAI applications, AI agents, and LLM-powered workflows for quality, reliability, accuracy, safety, and task effectiveness • Develop and execute repeatable GenAI evaluation methodologies, test datasets, benchmark suites, regression tests, and automated evaluation pipelines • Use DeepEval and related evaluation approaches to measure GenAI output quality and identify regressions • Optimize GenAI solution architecture by decomposing complex prompts and workflows into appropriate subtasks, tools, and specialized agents • Build and improve multi-agent workflows using frameworks such as LangGraph and LangChain • Optimize prompts, system instructions, context management, agent interactions, and model selection/configurations using evaluation results and production feedback • Evaluate new foundation models and model versions for quality, behavior, risks, performance, and use-case suitability • Design and implement GenAI monitoring capabilities, including quality metrics, operational telemetry, audit trails, alerts, and performance reporting • Support AI governance activities, including documentation, risk assessments, evaluation evidence, model versioning, registry management, experiment tracking, and change traceability • Collaborate with engineering, data science, architecture, security, compliance, governance, and business stakeholders • Support AI governance activities for approximately 25% of the role

🎯 Requirements

• 10+ years of overall professional experience in data science, machine learning, AI engineering, or a related technical field • 2+ years of hands-on experience developing, testing, evaluating, or optimizing Generative AI systems • Demonstrated experience testing GenAI applications and establishing systematic methods for assessing LLM output quality • Hands-on experience with DeepEval, LangGraph, LangChain, Python, and modern AI and machine learning libraries • Experience designing or optimizing multi-agent systems, agent orchestration patterns, or complex LLM workflows • Strong hands-on experience with Databricks for data, AI, or machine learning workloads, including model versioning, model registries, and experiment tracking • Practical experience supporting AI governance, model lifecycle controls, documentation, traceability, and auditability • Prior experience on traditional machine learning projects as an ML engineer, data scientist, or similar contributor, with a strong understanding of model testing and validation methods • Ability to communicate technical findings, evaluation results, risks, and recommendations to technical and nontechnical stakeholders • Ability to maintain at least four hours of overlap with U.S. Eastern Time (EST/EDT) each workday • Bachelor's or advanced degree in computer science, data science, engineering, mathematics, statistics, physics, computational science, or another scientific, quantitative, or computational discipline

🏖️ Benefits

• Remote-first company with flexibility, autonomy, and results-focused work • Equal opportunity employer • Reasonable accommodations for qualified individuals with disabilities • Background screening conducted with candidate consent and in compliance with applicable laws

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume