Automation Test Engineer

🕒 September 11

Where this job comes from

Posted on Skyward's careers page ↗Skyward's careers page, not through a job board

First seen by Remote Rocketship September 11

Still open on Skyward's site. Checked 2 hours ago.

Apply Now
Logo of Skyward

Skyward

51 - 200 employees

🤖 Artificial Intelligence

🏛️ Government

Artificial Intelligence • Government • Technology

Skyward is a Maryland-based digital services organization that specializes in AI/ML, Agile DevSecOps, and Data Science, serving as a trusted Federal partner. With a mission to serve the American people, Skyward delivers agile, user-centered, and scalable solutions for mission-critical programs, working closely with Federal Government allies. The company prides itself on being a member of the Digital Services Coalition and focuses on advancing innovation and excellence in government technology. Skyward is dedicated to transforming AI possibilities into impactful realities and is committed to improving customer experiences and software delivery processes. The company has significantly grown its workforce and impacts millions of Americans and small businesses through its services.

📋 Description

• Support development of an AI/ML platform leveraging generative AI to relieve user burden across the Centers for Medicare and Medicaid Services (CMS) • Design and maintain robust, scalable automated test frameworks for web apps, APIs, and AI-driven features • Develop automated pipelines for model validation, bias detection, and drift monitoring in ML-based systems • Define and execute functional, regression, performance, and AI-specific test plans • Partner with AI/ML engineers to create test datasets and simulate real-world user behavior and edge cases • Implement CI/CD-integrated quality gates for AI release reliability and fairness metrics • Mentor junior engineers and establish best practices in intelligent automation and AI testing • Advocate for ethical AI standards and contribute to cross-functional responsible AI discussions

🎯 Requirements

• 5+ years of experience in software QA/automation engineering, with at least 1 year focused on AI/ML product testing • Strong proficiency in at least one automation framework (e.g., Selenium, Cypress, Playwright) and scripting language (Python preferred) • Hands-on experience with testing AI models, including validation metrics, dataset versioning, and model explainability • Familiarity with tools like MLflow, TensorBoard, or similar for AI observability • Understanding of model bias, fairness audits, and compliance considerations in government or regulated environments • Experience working in Agile DevSecOps environments with modern CI/CD tooling (Jenkins, GitHub Actions, GitLab, etc.) • Strong collaboration skills with clear communication across engineering, data science, and product teams • Ability to obtain and maintain a Public Trust security clearance • Acceptable results of a background investigation • Previous support for the Centers for Medicare and Medicaid Services (CMS) would be advantageous

🏖️ Benefits

• Medical, dental, vision insurance • 15 days of paid leave • 7 days of sick leave • 2 days bereavement leave • 11 paid Federal holidays • Up to 40 hours for jury duty • 401K with 4% employer contribution (and no vesting period) • Up to 4 weeks of paid paternity and maternity leave • Company provided laptop • $5,000 per year for professional development • $600 per year for technical supplies and equipment • $2,000 referral bonus • Life and disability insurance • HSA and FSA • Legal Shield and ID Shield Voluntary Benefits • Flexible working hours • Remote opportunities • Opportunity to work in a collaborative, motivated team focused on modernizing government services with cutting-edge technology and innovative solutions

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 September 10

S&P Global

10,000+ employees

💼 Consulting

📦 Logistics

📣 Marketing

Lead penetration testing across applications, infrastructure, and cloud environments for S&P Global’s financial intelligence business. Develop offensive security tooling, assess threats, and guide remediation.

🕒 September 10

S&P Global

10,000+ employees

💼 Consulting

📦 Logistics

📣 Marketing

Lead penetration testing across web, infrastructure, and cloud environments for S&P Global, a financial intelligence provider. Develop offensive security tools, assess threats, and guide remediation.

🕒 September 10

Mercury Insurance

5001 - 10000

🚘 Automotive

💼 Consulting

📦 Logistics

Staff Test Engineer leading Java/Selenium UI and API automation for Mercury Insurance’s Personal Lines products. Owning test strategy, quality improvements, metrics, and QA mentorship.

🕒 September 2

Reveleer

51 - 200

🏥 Healthcare

⚕️ Healthcare Insurance

☁️ SaaS

SDET automating API, backend, and SaaS tests for Reveleer’s healthcare data and analytics platform. Improving compliance, performance, and release quality with AI-assisted automation.

🕒 August 26

VetsEZ

201 - 500

🏥 Healthcare

💼 Consulting

📦 Logistics

Senior Test Engineer establishing enterprise testing and AI-assisted quality practices. Supporting VetsEZ’s federal healthcare modernization and U.S. Census Bureau systems remotely.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok