AI Quality and Automation Specialist

🔥 1 hour ago

🌐 Poland, Georgia, +3 more countries – Remote

🇵🇱 Poland – Remote 🇬🇪 Georgia – Remote 🇧🇬 Bulgaria – Remote 🇮🇲 Isle of Man – Remote 🇷🇴 Romania – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 11%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Patrianna

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2011

💼 Consulting

📣 Marketing

🎮 Gaming

Consulting • Marketing • Gaming

Patrianna is an international iGaming product and technology company headquartered in Gibraltar that builds engaging web and app-based gaming products for millions of players worldwide. The remote-first team focuses on strategy, product development, product management, and technology innovation to deliver tailored iGaming experiences and scalable software solutions. Patrianna also actively recruits across product, design, technology, marketing, and operations and expresses public support for Ukraine.

📋 Description

• Build and maintain API, integration and end-to-end regression tests • Evaluate AI agents on task completion, response quality, tool use and permissions • Measure the effects of model, prompt and context changes • Build quality checks into CI/CD pipelines • Convert production defects into regression test cases • Use AI agents to explore workflows, generate tests and reproduce bugs • Validate findings from AI-generated tests and bug reproductions • Share effective tools and methods with the wider AI team and central QA department

🎯 Requirements

• Strong test automation and programming skills in TypeScript or Python • Solid hands-on experience with web apps, APIs, Git and CI/CD • Structured approach to judging AI output against clear, measurable criteria • Ability to reproduce, isolate and identify root causes of bugs quickly • Direct communication and documentation skills • Bonus: agentic browser testing, LLM evaluation frameworks, Supabase, Vercel or GCP • Current location must be one of the eligible locations: Poland, Georgia, Bulgaria, Isle of Man, or Romania

🏖️ Benefits

• Opportunity to work at the cutting edge of AI agent evaluation • Real ownership and accountability • Open culture with Slack, Monday.com, and Google Meet • Cameras-on Google Meet calls • Diverse and inclusive work environment • Freedom to innovate and take ownership

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume