Softgic
51 - 200 employees
Founded 2011
🔒 Cybersecurity
🤖 Artificial Intelligence
Cloud • Cybersecurity • Artificial Intelligence
Softgic is a technology company focused on driving digital and cognitive transformation for its clients. With over 12 years of experience, Softgic provides innovative and tailored solutions across various areas, including software development, cloud data security, the metaverse, and automation. Their approach combines design, coding, and implementation to enhance business processes and ensure security and efficiency in technological infrastructure.
Agent Quality, Evals Engineer
🕒 June 23
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
Softgic
51 - 200 employees
Founded 2011
🔒 Cybersecurity
🤖 Artificial Intelligence
Cloud • Cybersecurity • Artificial Intelligence
Softgic is a technology company focused on driving digital and cognitive transformation for its clients. With over 12 years of experience, Softgic provides innovative and tailored solutions across various areas, including software development, cloud data security, the metaverse, and automation. Their approach combines design, coding, and implementation to enhance business processes and ensure security and efficiency in technological infrastructure.
📋 Description
• Build and maintain the MVP eval harness: golden tasks, exception tasks, scorecard metrics, and regression packs. • Wire evals into CI so quality regressions fail builds and releases. • Define and maintain release-gate thresholds with Product and the Tech Lead. • Lay the path for later adversarial and drift-testing expansion without overbuilding MVP scope.
🎯 Requirements
• Experience evaluating ML, LLM, or non-deterministic systems. • Strong test and benchmark design capability. • Comfort working with noisy metrics, thresholds, and probabilistic behavior. • Good scripting and automation skills.
🏖️ Benefits
• Health insurance • Retirement plans • Paid time off • Flexible work arrangements • Professional development
Apply NowSimilar Jobs
🕒 June 20
Quality Assurance Manager leading QA team and conducting audits for property claims. Ensuring high-quality standards and compliance while developing field adjusters' skills.
🕒 June 20
Manual QA Engineer performing functional and customer-focused testing for new features and production issues. Execute test cases and validate workflows for Frontline Feature & Support Testing at HeadSpin.
🇺🇸 United States – Remote
⏰ Full Time
🟡 Mid-level
🟠 Senior
🔧 QA Engineer (Quality Assurance)
🦅 H1B Visa Sponsor
Azure
Distributed Systems
SQL
🕒 June 20
Manual QA Engineer performing exploratory, functional testing and data validation at HeadSpin. Collaborate on new feature testing and provide frontline support for hot fixes and patches.
🇺🇸 United States – Remote
⏰ Full Time
🟡 Mid-level
🟠 Senior
🔧 QA Engineer (Quality Assurance)
🦅 H1B Visa Sponsor
Azure
Distributed Systems
SQL
🕒 June 20
QA Triage & Execution Analyst ensuring automated test execution stability and quality. Analyzing, debugging, and resolving failing scripts across Azure DevOps pipelines.
🇺🇸 United States – Remote
⏰ Full Time
🟡 Mid-level
🟠 Senior
🔧 QA Engineer (Quality Assurance)
🦅 H1B Visa Sponsor
Azure
GraphQL
Selenium
🕒 June 20
Quality Assurance Engineer ensuring quality in AGent's software for distributed energy optimization. Collaborating on cloud, IoT, and embedded systems testing with a focus on reliability and automation.
AWS
Cloud
IoT
SQL
