Senior AI QA Test Automation Engineer – CX Agent
Job description
The Role: We're seeking a Senior AI QA Test Automation Engineer to take a leading technical role in AI quality and test automation. You will work primarily with our AWS Bedrock Agent. Core-based CX Agent Suite, a multi-agent customer-support system covering intent routing, FAQs, deposit-status queries, and human handoff.
You will design and build the evaluation and QA tooling required to validate AI agents reliably, while also contributing to technical standards and best practices across QA. This is a Senior Individual Contributor (IC) role with a strong technical and strategic focus. You'll work closely with QA leadership, Data Science, and Engineering to architect scalable AI evaluation systems, establish technical standards, and drive the evolution of our AI evaluation framework.
Our current evaluation harness is based on Deep. Eval and is evolving towards a broader agentic evaluation architecture. You will have the opportunity to evaluate and prototype emerging agent-orchestration approaches, including Strands Agents, and contribute to architectural decisions around their adoption.
Description copied from XM's careers page. Read the full posting before you apply.
More jobs at XM
AI Engineering Enablement Expert
XM· LimassolSenior Data Architect
XM· AthensTurkish-Speaking Content Writer
XM· LimassolOffice Administrator / Receptionist
XM· ThessalonikiPerformance Marketing Specialist
XM· Limassol
More jobs in Limassol
Demi Chef de Partie
LPM Restaurants· Kitchen, LimassolSales Manager, Marine
Wärtsilä· Limassol, CYSenior Auditor - Limassol Assurance Services
EY· Limassol, CY, 4003Operations Specialist
Icmarkets· LimassolSupervisor, Outbound Sales
Melco Resorts & Entertainment· COD Mediterranean, Limassol