AI Software Development Engineer in Test – SDET

🔥 5 minutes ago

🌐 Argentina, India – Remote

🇦🇷 Argentina – Remote 🇮🇳 India – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Just posted.
• Jobs at this company usually fill in 43 days.
• No salary listed.

Apply Now

Find Similar Remote Jobs

Newfold Digital

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2021

💼 Consulting

📣 Marketing

📦 Logistics

💰 Venture Round on 2021-01

Consulting • Marketing • Logistics

Newfold Digital is a leading web presence solutions provider serving millions of small-to-medium businesses globally. Through its portfolio of brands, including Bluehost, CrazyDomains, HostGator, Network Solutions, Register. com, Web. com, and many others, Newfold Digital helps customers of all sizes build a digital presence that delivers results and adds value to businesses. With extensive product offerings such as domains, website builders, hosting, security, online marketing, professional website design, and SEO services, along with personalized support, Newfold Digital collaborates with its customers to meet their online presence needs.

📋 Description

• Design, validate, and optimise testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents • Develop AI evaluation frameworks for hallucination detection, groundedness, toxicity and bias, response quality, context relevance, prompt regression, determinism, consistency, safety, and guardrails • Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics • Create synthetic and benchmark datasets for AI testing scenarios • Test multi-agent orchestration workflows and agent memory/context retention • Validate MCP integrations and tool interoperability • Work on Context Engineering, Prompt Engineering, and Prompt Optimisation strategies • Evaluate latency, token usage, model cost optimisation, throughput, and scalability • Develop and maintain scalable UI/API automation frameworks using Python and testing tools • Automate testing for REST APIs, GraphQL APIs, event-driven systems, streaming systems, webhooks, microservices, and MFE architectures • Build reusable automation libraries, utilities, and AI-assisted testing workflows • Integrate automation into CI/CD pipelines and quality gates • Validate RAG architectures, vector databases, embeddings, retrieval accuracy, re-ranking, and vector search relevance • Build or validate AI agents and workflows involving tool calling, function calling, agent memory, planning/execution, multimodal systems, and structured outputs • Maintain quality workflows integrated with CI/CD platforms • Work with Docker and Kubernetes environments • Perform cloud-based testing and deployments across AWS, Azure, OCI, and GCP • Validate distributed systems reliability and resiliency • Monitor AI system behaviour using observability, logging, and tracing tools • Contribute to shift-left and quality engineering best practices • Collaborate with Engineering, AI/ML, Platform, Product, and DevOps teams

🎯 Requirements

• Strong programming experience in Python • Strong understanding of Software Testing & Quality Engineering principles • Hands-on experience with AI/LLM testing, Prompt Engineering, Context Engineering, AI Evals, RAG systems, and AI Agents • Experience with CI/CD pipelines, Docker & Kubernetes, cloud platforms (AWS/Azure/OCI/GCP), API testing & automation, microservices testing, and UI automation • Experience with SQL and data validation • Strong debugging, analytical, and troubleshooting skills • Experience working in Agile/Scrum environments • Experience with Robot Framework preferred • Experience with Playwright preferred • Knowledge of LangChain, LangGraph, LlamaIndex, CrewAI, Semantic Kernel, and MCP preferred • Hands-on experience with Cursor, GitHub Copilot, Claude, Gemini, and OpenAI APIs preferred • Experience with vector databases and embeddings preferred • Exposure to MLOps workflows and ML lifecycle testing preferred • Knowledge of performance testing and security testing preferred • Experience validating AI governance/compliance requirements preferred • Experience with contract testing, chaos testing, or resilience engineering preferred • Familiarity with accessibility testing and cross-browser/device testing preferred • Exposure to synthetic monitoring and production observability preferred • Bachelor’s/Master’s degree in Computer Science, Engineering, AI/ML, or related field preferred • Equivalent hands-on experience and demonstrable projects highly valued

🏖️ Benefits

• Work-from-home, hybrid, or work-from-the-office environment scenarios • OSDE 310 Health Care • Monthly Salary Reviews • Tuition Reimbursement • Internet Reimbursement • In-company English Lessons • LinkedIn Learning • Referral Program Bonus • F5 extra days off • Annual Bonus • Opportunity to work on global projects with a multicultural team • Learning and development opportunities • 20+ affinity groups for networking and connection • Mentoring and career growth opportunities

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume