Automation Test Engineer

🕒 September 11

🦀 Maryland – Remote

🦀 Maryland – Remote

💵 $110k - $130k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 16%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Skyward

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤖 Artificial Intelligence

🏛️ Government

Artificial Intelligence • Government • Technology

Skyward is a Maryland-based digital services organization that specializes in AI/ML, Agile DevSecOps, and Data Science, serving as a trusted Federal partner. With a mission to serve the American people, Skyward delivers agile, user-centered, and scalable solutions for mission-critical programs, working closely with Federal Government allies. The company prides itself on being a member of the Digital Services Coalition and focuses on advancing innovation and excellence in government technology. Skyward is dedicated to transforming AI possibilities into impactful realities and is committed to improving customer experiences and software delivery processes. The company has significantly grown its workforce and impacts millions of Americans and small businesses through its services.

📋 Description

• Support development of an AI/ML platform leveraging generative AI to relieve user burden across the Centers for Medicare and Medicaid Services (CMS) • Design and maintain robust, scalable automated test frameworks for web apps, APIs, and AI-driven features • Develop automated pipelines for model validation, bias detection, and drift monitoring in ML-based systems • Define and execute functional, regression, performance, and AI-specific test plans • Partner with AI/ML engineers to create test datasets and simulate real-world user behavior and edge cases • Implement CI/CD-integrated quality gates for AI release reliability and fairness metrics • Mentor junior engineers and establish best practices in intelligent automation and AI testing • Advocate for ethical AI standards and contribute to cross-functional responsible AI discussions

🎯 Requirements

• 5+ years of experience in software QA/automation engineering, with at least 1 year focused on AI/ML product testing • Strong proficiency in at least one automation framework (e.g., Selenium, Cypress, Playwright) and scripting language (Python preferred) • Hands-on experience with testing AI models, including validation metrics, dataset versioning, and model explainability • Familiarity with tools like MLflow, TensorBoard, or similar for AI observability • Understanding of model bias, fairness audits, and compliance considerations in government or regulated environments • Experience working in Agile DevSecOps environments with modern CI/CD tooling (Jenkins, GitHub Actions, GitLab, etc.) • Strong collaboration skills with clear communication across engineering, data science, and product teams • Ability to obtain and maintain a Public Trust security clearance • Acceptable results of a background investigation • Previous support for the Centers for Medicare and Medicaid Services (CMS) would be advantageous

🏖️ Benefits

• Medical, dental, vision insurance • 15 days of paid leave • 7 days of sick leave • 2 days bereavement leave • 11 paid Federal holidays • Up to 40 hours for jury duty • 401K with 4% employer contribution (and no vesting period) • Up to 4 weeks of paid paternity and maternity leave • Company provided laptop • $5,000 per year for professional development • $600 per year for technical supplies and equipment • $2,000 referral bonus • Life and disability insurance • HSA and FSA • Legal Shield and ID Shield Voluntary Benefits • Flexible working hours • Remote opportunities • Opportunity to work in a collaborative, motivated team focused on modernizing government services with cutting-edge technology and innovative solutions

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume