Senior Automation Engineer

🔥 17 hours ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🤖 QA Automation Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

VetsEZ

WebsiteLinkedInAll Job Openings

201 - 500 employees

🏥 Healthcare

💼 Consulting

📦 Logistics

Healthcare • Consulting • Logistics

VetsEZ is a company specializing in digital transformation within the federal sector. It provides solutions such as PMO (Project Management Office), software solutions, and data solutions to its clients. VetsEZ is actively involved in securing and managing large contracts, such as a 5-year, $158M contract for Community Care Development, Security, and Operations (CCDSO) Support Services, and a 5-year, $415M contract for Health Middleware and Data Management (HMDM) DevSecOps Support Services. The company also supports the Veterans Affairs (VA) through prescription drug monitoring programs and other health data management services. VetsEZ focuses on leveraging technology to improve healthcare and data management for federal clients.

📋 Description

• Support development, validation, and automation of an AI-powered Patient Health Data Summarization capability within the JLV Clinical Decision Support platform • Develop comprehensive test plans, test cases, and acceptance criteria • Create traceability between business requirements, clinical data standards, and test scenarios • Design test coverage across CCDs, Discharge Summaries, Progress Notes, and History & Physical documents • Develop positive, negative, boundary, and edge-case testing scenarios • Analyze and validate C-CDA XML documents, including headers, sections, templates, and clinical entries • Verify extraction and summarization of medications, allergies, laboratory results, procedures, care plans, and diagnoses • Ensure AI-generated summaries reflect source documentation and remain traceable to clinical sources • Perform functional, integration, system, regression, performance, and user acceptance testing • Develop and maintain automated test suites for document ingestion, AI summarization, APIs, and user interfaces • Test CDS workflows and patient-context-driven launch scenarios across multiple data sources and encounters • Support CI/CD pipelines through automated quality gates and continuous testing • Build automated validation frameworks for AI-generated summaries • Evaluate AI-generated content for completeness, consistency, usability, accuracy, and reliability • Identify omissions, inaccuracies, hallucinations, and other AI-generated defects • Validate AI guardrails, monitoring, auditability, and quality controls • Participate in defect triage, root-cause analysis, and release-readiness activities • Create test documentation, defect reports, traceability matrices, and quality assessments • Collaborate with software engineers, solution architects, clinicians, product owners, cybersecurity teams, and government stakeholders • Leverage AI-assisted tools to accelerate testing, automation, regression testing, defect analysis, and quality assurance • Take on additional tasks as needed to support team objectives and project success

🎯 Requirements

• Bachelor’s degree in Computer Science, Information Technology, Health Informatics, Engineering, or a related technical discipline, or equivalent experience • Minimum of 5 years of experience testing healthcare software applications • Strong knowledge of Consolidated Clinical Document Architecture (C-CDA) standards, including clinical document structure, sections, templates, and entries • Hands-on experience reading, validating, and troubleshooting XML-based healthcare data • Experience with healthcare interoperability standards and clinical data exchange • Experience testing Clinical Decision Support (CDS) applications and workflows • Familiarity with SMART on FHIR, CDS Hooks, REST APIs, and related interoperability technologies • Experience with test automation frameworks, API testing tools, and defect management platforms • Experience developing and maintaining automated testing solutions within Agile and DevSecOps environments • Experience with AI-assisted testing tools and techniques for test case generation, automation development, regression testing, defect analysis, and quality assurance • Familiarity with Generative AI and Large Language Models (LLMs), including using AI to create and maintain automated test scripts, validation frameworks, and test data • Experience validating AI-generated outputs and establishing quality controls for accuracy, consistency, repeatability, and reliability • Strong analytical, troubleshooting, and problem-solving skills • Excellent written and verbal communication skills • Additional qualifications include VA healthcare systems experience, USCDI knowledge, SNOMED CT/LOINC/RxNorm/ICD familiarity, AI/ML healthcare solution validation, AI-powered testing platform experience, autonomous or semi-autonomous AI testing workflows, prompt engineering, AI evaluation methodologies, accessibility and usability testing, Agile/DevSecOps/cloud-native experience, and federal healthcare modernization exposure • U.S. Citizenship is required • All selected candidates must successfully complete a background check • Ability to obtain and maintain a Government/Public Trust clearance, including required fingerprinting, when required • Sponsorship is not offered

🏖️ Benefits

• Medical/Dental/Vision • 401k with Employer Match • PTO + Federal Holidays • Corporate Laptop • Training Opportunities • Remote Opportunity