Search Remote Jobs

AI QA Trainer – Freelance Project

Job not on LinkedIn

🔥 19 minutes ago

🇸🇬 Singapore – Remote

💵 $6 - $65 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

Where this job comes from

Posted on Invisible Technologies's careers page, not through a job board

First seen by Remote Rocketship 19 minutes ago

Logo of Invisible Technologies

Invisible Technologies

201 - 500 employees

Founded 2015

💼 Consulting

🏥 Healthcare

📦 Logistics

💰 $100M Series unknown on 2025-10

Consulting • Healthcare • Logistics

Invisible Technologies is an enterprise AI platform and services company that builds and deploys production-grade AI systems for large organizations. They combine a modular SaaS platform (data platform, process builder, agents, evaluations) with an expert human marketplace to train models, automate complex back-office workflows, power contact centers, provide computer vision and demand-forecasting solutions, and ensure ongoing evaluation and governance. Invisible works across sectors (finance, healthcare, public sector, sports, retail) to integrate AI into real operational systems and scale outcomes.

📋 Description

• Challenge advanced language models through model evaluation and testing • Converse with models on real-world scenarios and evaluation prompts • Verify factual accuracy and logical soundness • Design and run test plans and regression suites • Build rubrics and pass/fail criteria • Capture reproducible error traces with root-cause hypotheses • Suggest improvements to prompt engineering, guardrails, and evaluation metrics • Partner on adversarial red-teaming and automation using Python/SQL • Build dashboards to track quality changes over time • Document failure modes to improve model reasoning and reliability

🎯 Requirements

• Expertise in model evaluation, LLM safety, prompt robustness, data quality assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks • Experience with hallucination detection, factual consistency, prompt-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation fidelity, and end-to-end workflow validation • Bachelor’s, master’s, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal • Shipped QA for ML/AI systems • Safety/red-team experience • Experience with test automation frameworks such as PyTest • Hands-on work with LLM evaluation tooling such as OpenAI Evals, RAG evaluators, and W&B • Evaluation rubric design • Adversarial testing/red-teaming • Regression testing at scale • Bias/fairness auditing • Grounding verification • Prompt and system-prompt engineering • Test automation using Python/SQL • High-signal bug reporting • Clear, metacognitive communication • Secure computer and high-speed internet as a contractor

🏖️ Benefits

• Secure computer and high-speed internet supplied by contractor • Company-sponsored health insurance and PTO do not apply

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok