AI Ops Engineer

Job Title: AI Ops Engineer Reporting To: AI Lead Engineer Direct Reports: None Location: Basingstoke or London Hybrid working available (a minimum of 3 days working from the office, 2 days working from home) The job in a nutshell Monitors agent performance across the BB\&R estate - reporting and flagging on performance, whilst tuning the routing and logic. Works with AI Engineering Lead on delivery tasks. Owns the Orchestrators and Monitoring agents shared across all process areas. Also provides support on internal dotnet platforms. Who you will work with Internal: AI Lead Engineer (reports to); process area leads and agent-owning roles across Buying, Offer Admin and Customer Contact processes whose agents this role monitors. Application Support team for 3rd party app integrations External: Agentic platform vendors; Suppliers \& SaaS Providers, 3rd party business application partners What you will do * Owns Orchestrators and Monitoring agents (shared/central, cross-process) * Monitors agent performance across the estate * Reports and flags on performance issues * Tunes routing and logic * Optimise agent costs by testing and validating model performance using optimised lower cost models and progressing these into production * Define new AI agent capabilities and interfaces to replace legacy processes * Maintain and Enhance in house dotNet applications as directed What you will bring to the role Experience / Achievements * Demonstrable experience in quality assurance and output monitoring * Proven experience in escalation management and pattern recognition * Experience of analytical thinking applied to high-volume outputs * Experience producing clear written communication for exception reports * Demonstrable experience in AI agent development and optimisation * Deep experience with API and MCP integration and agentic platform system architecture * Understanding of Microsoft dotnet development platform and Azure+ services Your Skills, Knowledge and Behaviours * Strong attention to detail across high-volume agent outputs * [Desirable] Experience in Lyzr and/or Microsoft Foundry platform * [Desirable] AI output review experience * [Desirable] Dashboard and alerting tools * [Desirable] Process improvement methodology and data visualisation We support our colleagues with a wide range of benefits: you will start with 24 days' holiday, and 3 additional days over the Christmas period and 1 Personal Day, Private Medical cover \& Health plan, Life Insurance, Pension, Employee Assistance Programme (EAP), generous Employee discount (up to 40% off products), and many more. Closing Date: 22nd September 2026 N.B. We reserve the right to close a vacancy before the closing date in the event of an overwhelming response or a change in business priorities.