AI Engineer

Job not on LinkedIn

🕒 July 17

🇺🇸 United States – Remote

💵 $120k - $170k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

👻 Ghost score 23%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

GovWorx

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2023

💼 Consulting

🏥 Healthcare

📦 Logistics

💰 Private equity on 2025-07

Consulting • Healthcare • Logistics

GovWorx is a software company that delivers AI-powered solutions to support emergency communications centers and other first responder agencies. Their platform offers real-time call guidance and translation, automated quality assurance, pre-hire assessments, AI-driven simulations and training, live transcription, and analytics to improve performance, consistency, and retention for 9-1-1 telecommunicators, law enforcement, and EMS professionals. GovWorx integrates with CAD, radio, and phone systems to streamline QA/QI, coaching, and operational workflows for public safety organizations.

📋 Description

• Design, build, and maintain automated AI evaluation pipelines for production LLM applications • Develop prompt engineering strategies and iterate on prompts and compare LLMs using quantitative evaluation methods • Build offline evaluation datasets and regression testing frameworks to measure AI performance over time • Analyze production AI behavior using Python, SQL, and statistical techniques to identify opportunities for improvement • Design experiments, A/B tests, and benchmarking methodologies for evaluating prompt and model changes • Develop dashboards and reporting that communicate AI quality, reliability, and performance metrics • Partner with engineering and product teams to safely deploy and monitor improvements to production AI systems • Investigate model failures through detailed error analysis and recommend improvements to prompts, evaluation datasets, and workflows • Help establish best practices for Responsible AI, evaluation methodologies, and continuous model improvement • Collaborate with data scientists, data engineers, and product managers to maintain accurate, reliable, and trustworthy AI systems

🎯 Requirements

• Must pass FBI fingerprint and background check in multiple states • U.S. Citizenship is strongly preferred • 3+ years of experience in software engineering, machine learning, data science, or a related technical field • Experience designing evaluation metrics and interpreting AI model performance • Understanding of statistical methods including hypothesis testing and experiment design • Strong Python development experience • Strong SQL skills with experience analyzing large datasets • Experience building or supporting production LLM or Generative AI applications • Experience with prompt engineering and systematic prompt evaluation • Experience using AI evaluation or observability platforms such as Langfuse, LangSmith, MLflow, or Label Studio • Experience with AWS services such as Bedrock, Lambda, S3, Glue, or SageMaker • Experience building dashboards using Tableau, Sisense, Power BI, or similar tools • Knowledge of Responsible AI principles and evaluation methodologies

🏖️ Benefits

• Bonus • Health insurance • Dental insurance • Vision insurance • Flexible time off • Opportunity to support first responders and emergency communications professionals • Ownership of AI quality, evaluation, and continuous improvement for production applications • Work on LLM technologies and Responsible AI • Collaboration with AI, engineering, product, and data science teams • Opportunity to influence AI strategy and evaluation practices