QA Engineer

QA Engineer - AI \& Agentic SystemsWe're looking for a QA Engineer to help shape the next generation of AI-powered products. You'll be responsible for testing LLM-based applications and agentic AI systems, building robust evaluation frameworks, and driving quality across the entire development life cycle. What You'll Bring * Strong background in Quality Engineering, Test Automation, and QA best practices. * Hands-on experience testing LLMs, Generative AI applications, and AI agents. * Experience with golden datasets, AI evaluation frameworks, and LLM-as-a-Judge methodologies. * Strong Python skills and software engineering fundamentals. * Experience building test automation, evaluation, or CI/CD pipelines. * Knowledge of AI-specific challenges including hallucinations, reliability, prompt evaluation, safety, and agent orchestration. * A curious, forward-thinking mindset with a passion for staying on top of the latest AI and testing innovations. Nice to Have * LLM evaluation experience (golden datasets, LLM-as-a-judge, automated evaluation frameworks) * Quality Engineering mindset (metrics, strategy, automation, testing best practices) * Experience with Agentic AI, MCP tools, and modern AI testing frameworks. * Strong Python and engineering capability * Hybrid working: 2 days per week in the London office. * 6-month contract * £699 inside IR35 If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Email with an updated CV if you believe you are the right fit. If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Desired Skills and Experience LLM, Python, QA Engineering, agentice AI Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T\&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk