Softgic
51 - 200 employees
Founded 2011
🔒 Cybersecurity
🤖 Artificial Intelligence
Cloud • Cybersecurity • Artificial Intelligence
Softgic is a technology company focused on driving digital and cognitive transformation for its clients. With over 12 years of experience, Softgic provides innovative and tailored solutions across various areas, including software development, cloud data security, the metaverse, and automation. Their approach combines design, coding, and implementation to enhance business processes and ensure security and efficiency in technological infrastructure.
Agent Quality, Evals Engineer
🕒 4 days ago
📊 Check your resume score for this job
Improve your chances of getting an interview by checking your resume score before you apply.
Softgic
51 - 200 employees
Founded 2011
🔒 Cybersecurity
🤖 Artificial Intelligence
Cloud • Cybersecurity • Artificial Intelligence
Softgic is a technology company focused on driving digital and cognitive transformation for its clients. With over 12 years of experience, Softgic provides innovative and tailored solutions across various areas, including software development, cloud data security, the metaverse, and automation. Their approach combines design, coding, and implementation to enhance business processes and ensure security and efficiency in technological infrastructure.
📋 Description
• Build and maintain the MVP eval harness: golden tasks, exception tasks, scorecard metrics, and regression packs. • Wire evals into CI so quality regressions fail builds and releases. • Define and maintain release-gate thresholds with Product and the Tech Lead. • Lay the path for later adversarial and drift-testing expansion without overbuilding MVP scope.
🎯 Requirements
• Experience evaluating ML, LLM, or non-deterministic systems. • Strong test and benchmark design capability. • Comfort working with noisy metrics, thresholds, and probabilistic behavior. • Good scripting and automation skills.
🏖️ Benefits
• Health insurance • Retirement plans • Paid time off • Flexible work arrangements • Professional development
Apply NowSimilar Jobs
🕒 4 days ago
Quality Assurance Engineer developing testing strategies for Veterans Benefits Administration solutions. Responsible for executing QA processes and automated testing for quality delivery.
🕒 4 days ago
Senior Consultant designing and delivering quality engineering solutions at 3Cloud. Hands-on role collaborating with stakeholders to achieve measurable business outcomes.
🇺🇸 United States – Remote
💵 $103.1k - $154.7k / year
⏰ Full Time
🟠 Senior
🔧 QA Engineer (Quality Assurance)
🕒 4 days ago
QA Engineer developing and implementing security strategies and testing AI models at Orion Innovation. Collaborating with global teams to ensure consistent security standards and communicate risks.
🇺🇸 United States – Remote
💰 Funding Round on 2015-01
⏰ Full Time
🟡 Mid-level
🟠 Senior
🔧 QA Engineer (Quality Assurance)
🕒 5 days ago
ABC Supply Co. Inc.
10,000+ employees
IT Quality Assurance Lead ensuring high-quality software solutions at ABC Supply. Leading QA efforts across large projects and managing testing processes.
🕒 June 20
Quality Assurance Manager leading QA team and conducting audits for property claims. Ensuring high-quality standards and compliance while developing field adjusters' skills.
