Senior QA Automation Engineer

Job not on LinkedIn

🔥 14 hours ago

🇨🇴 Colombia – Remote

⏰ Full Time

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

IDT BY INDET GROUP

WebsiteLinkedInAll Job Openings

201 - 500 employees

📡 Telecommunications

💸 Finance

🤝 B2B

Telecommunications • Finance • B2B

IDT BY INDET GROUP is a global company that develops communication and payment services, aiming to unite families and grow businesses worldwide. Founded in 1990, IDT has grown to become the third-largest voice carrier with operations in over 20 countries and an annual revenue of $1. 5 billion. The company is known for its variety of communication tools and financial services, including its flagship brand BOSS Revolution, which offers international calling, mobile top-up, and money transfer services. IDT also provides cloud-based VoIP solutions through Net2Phone, as well as sales management systems and POS equipment for small and medium-sized businesses via National Retail Solutions. Additionally, IDT Express offers voice termination, DIDs, and SMS services globally, while Awards2Go provides custom prepaid Visa cards. Based in Newark, New Jersey, IDT is committed to innovation and quality, serving a diverse, multicultural community.

📋 Description

• Embed fully within a Scrum team and participate in all ceremonies and associated artifacts • Own the end-to-end test strategy for the AI voice virtual agent across LLM, speech, and telephony layers • Design test scenarios for multi-turn dialogues, interruptions, ambiguous input, escalations, and failure recovery • Build and maintain an evaluation framework for non-deterministic output using golden datasets and semantic/rubric-based assertions • Adversarially test hallucinations, incorrect grounding, guardrail bypasses, prompt injections, and unauthorized customer-data disclosure • Prepare and provision SIP devices, endpoints, and end-to-end call scenarios • Diagnose failures across LLM, ASR, TTS, media path, and call-routing layers • Extend automated coverage and integrate test suites into CI/CD release gates • Define and track quality metrics such as task completion, containment, intent accuracy, transcription accuracy, latency, and escalation correctness • Maintain documented test coverage in the TMS with traceability to business requirements • Communicate and escalate quality risks using data and evidence

🎯 Requirements

• 5+ years in QA, with recent hands-on ownership of a complex, integrated product • Practical experience testing SIP/VoIP systems, including call flows, SIP signaling, media handling, softphones, or SIP trunking • Ability to troubleshoot using SIP traces or packet captures • Demonstrated creativity in test design • Proficiency in Python, sufficient to independently build and maintain automation frameworks • Experience testing non-deterministic or probabilistic systems • Strong analytical skills, including defining quality metrics and using data for release decisions • Hands-on experience with formal TMS tools and Jira • Professional fluency in English, spoken and written • Reliable overlap with US Eastern business hours • Advanced spoken English is required • Candidates must be from LATAM

🏖️ Benefits

• Remote work opportunity • B2B Employment ($, gross) • Stable job with long-term growth perspective • Competitive salary with annual performance review • Really good hardware • Continuous learning and career growth opportunities • Compensation for professional training, seminars, and conferences • Referral program with rewards • Company-supported English classes