AI - Software Development Engineer in Test (AI - SDET)

About the Role

This role goes beyond traditional QA; the ideal candidate should be capable of validating, evaluating, and improving AI-powered systems, agents, copilots, and LLM-driven workflows while building scalable automation frameworks and intelligent quality solutions. You will work closely with Engineering, AI/ML, Platform, Product, and DevOps teams to ensure reliability, safety, observability, scalability, and quality of modern AI-native applications and Agentic systems. Who Are We. Newfold Digital is a leading web technology company serving nearly seven million customers globally. Established in 2021 through the combination of leading web services providers Endurance Web Presence and Web.com Group, our portfolio of brands includes: Bluehost, BigRock, ResellerClub, CrazyDomains, HostGator, Network Solutions, Register.com, Web.com and many others. We help customers of all sizes build a digital presence that delivers results. With our extensive product offerings and personalized support, we take pride in collaborating with our customers to serve their online presence needs. Key Responsibilities AI/LLM Quality Engineering Design, validate, and optimise testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents. Develop AI evaluation (Evals) frameworks for:Hallucination detectionGroundednessToxicity & bias validationResponse qualityContext relevancePrompt regression testingDeterminism & consistencySafety and guardrail validation Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics. Create synthetic datasets and benchmark datasets for AI testing scenarios. Test multi-agent orchestration workflows and agent memory/context retention. Validate MCP (Model Context Protocol) integrations and tool interoperability. Work on Context Engineering, Prompt Engineering, and Prompt Optimisation strategies. Evaluate latency, token usage, model cost

Requirements & Qualifications

• Strong problem solving foundations, knowledge of modern engineering practices, and interest in technology systems.

Perks & Benefits

• Official mentor support
• verified hiring timeline
• and career progression.