Software Development Engineer in Test – AI

🔥 0 minutes ago

🇮🇳 India – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Newfold Digital

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2021

💼 Consulting

📣 Marketing

📦 Logistics

💰 Venture Round on 2021-01

Consulting • Marketing • Logistics

Newfold Digital is a leading web presence solutions provider serving millions of small-to-medium businesses globally. Through its portfolio of brands, including Bluehost, CrazyDomains, HostGator, Network Solutions, Register. com, Web. com, and many others, Newfold Digital helps customers of all sizes build a digital presence that delivers results and adds value to businesses. With extensive product offerings such as domains, website builders, hosting, security, online marketing, professional website design, and SEO services, along with personalized support, Newfold Digital collaborates with its customers to meet their online presence needs.

📋 Description

• Design, validate, and optimize testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents • Develop AI evaluation frameworks for hallucination detection, groundedness, toxicity and bias validation, response quality, context relevance, prompt regression, determinism, consistency, safety, and guardrail validation • Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics • Create synthetic and benchmark datasets for AI testing scenarios • Test multi-agent orchestration workflows and agent memory/context retention • Validate MCP integrations and tool interoperability • Work on Context Engineering, Prompt Engineering, and Prompt Optimization strategies • Evaluate latency, token usage, model cost optimization, throughput, and scalability • Develop and maintain scalable UI/API automation frameworks using Python and tools such as Robot Framework, Playwright, Selenium, and Cypress • Automate testing for REST APIs, GraphQL APIs, event-driven systems, streaming systems, webhooks, microservices, and MFE architectures • Build reusable automation libraries, utilities, and AI-assisted testing workflows • Integrate automation into CI/CD pipelines and quality gates • Validate RAG architectures, including chunking, embedding quality, retrieval accuracy, re-ranking, and vector search relevance • Build or validate AI agents using LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, and OpenAI SDKs • Validate tool calling, function calling, agent memory, agent planning/execution, multimodal AI systems, and structured outputs • Maintain quality workflows with GitHub Actions, Jenkins, GitLab CI/CD, and Azure DevOps • Work with Docker and Kubernetes environments • Perform cloud-based testing and deployments across AWS, Azure, OCI, and GCP • Validate distributed systems reliability and resiliency • Monitor AI system behaviors using observability, logging, and tracing tools • Contribute to shift-left and quality engineering best practices • Collaborate with Engineering, AI/ML, Platform, Product, and DevOps teams

🎯 Requirements

• Bachelor’s/Master’s degree in Computer Science, Engineering, AI/ML, or related field preferred • Equivalent hands-on experience and demonstrated projects are highly valued • Strong programming experience in Python • Strong understanding of Software Testing & Quality Engineering principles • Hands-on experience with AI/LLM testing, Prompt Engineering, Context Engineering, AI Evals, RAG systems, and AI Agents • Experience with CI/CD pipelines, Docker & Kubernetes, cloud platforms (AWS/Azure/OCI/GCP), API testing & automation, microservices testing, and UI automation • Experience with SQL and data validation • Strong debugging, analytical, and troubleshooting skills • Experience working in Agile/Scrum environments • Robot Framework experience preferred • Playwright experience preferred • Knowledge of LangChain, LangGraph, LlamaIndex, CrewAI, Semantic Kernel, and MCP • Hands-on experience with Cursor, GitHub Copilot, Claude, Gemini, and OpenAI APIs • Experience with vector databases and embeddings • Exposure to MLOps workflows and ML lifecycle testing • Knowledge of performance testing and security testing • Experience validating AI governance/compliance requirements • Experience with contract testing, chaos testing, or resilience engineering • Familiarity with accessibility testing and cross-browser/device testing • Exposure to synthetic monitoring and production observability • AI Red Teaming, LLM Security Testing, Agent Reliability & Safety Testing, AI Cost Optimization, Distributed Systems Testing, Test Data Engineering, Feature Flag Testing, AI Observability & Telemetry, Reinforcement Learning feedback workflows, Human-in-the-loop evaluation systems, Knowledge Graph integrations, and Multi-modal AI testing are high-impact bonus skills • Ability to experiment with AI tools and build side projects, prototypes, PoCs, or open-source contributions • Ability to rapidly learn emerging AI frameworks, tools, and architectures

🏖️ Benefits

• Work-life balance • Diversity and inclusion programs • Learning and development opportunities • 20+ affinity groups for networking and connection • Competitive HMO benefits – 175k MBL with one free dependent upon one year of service • Punctuality Bonus • Generous Vacation policy • Mentoring and career growth opportunities

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume