AI AnalystseniorSheffield, England, UKonsitefulltimeIT Services and IT ConsultingPythonPyTestPostmanGCPNeo4jVertex AILLMsprompt engineeringposted 13 Jul
Unlock apply linkApply links and the original listing are a Pro feature — £4.99/mo or £25 once.
Required Skills \& Experience
Core Technical Skills
* 5+ years of experience in Quality Engineering and Test Automation.
* Strong programming experience in
Python
and automation frameworks such as
PyTest
.
* Hands-on experience with API testing tools and frameworks (Postman, Rest Assured, Swagger/OpenAPI).
* Strong understanding of IAM concepts, Identity Governance, Authentication, Authorization, and Access Management.
* Experience with cloud platforms, preferably
Google Cloud Platform (GCP)
.
* Experience testing event-driven architectures and messaging systems such as Google Pub/Sub.
* Strong understanding of CI/CD pipelines using Jenkins or equivalent tools.
* Experience with defect and test management tools such as JIRA and Zephyr.
* Knowledge of graph databases, preferably Neo4j.
AI Testing Skills
* Experience validating AI/ML or Generative AI applications in enterprise environments.
* Understanding of Large Language Models (LLMs), prompt engineering, and AI quality evaluation techniques.
* Experience with AI-assisted testing tools and intelligent test automation frameworks.
* Familiarity with AI model lifecycle, training data validation, model performance evaluation, and drift monitoring.
* Exposure to Vertex AI, OpenAI, Azure AI, or similar AI platforms is preferred.
* Understanding of responsible AI practices, bias testing, explainability, and AI governance frameworks.
Preferred Qualifications
* Experience in Cloud Security, IAM, Identity Governance, or Zero Trust Security environments.
* Exposure to SailPoint, Okta, ForgeRock, Ping Identity, Entra ID (Azure AD), or similar IAM platforms.
* Knowledge of DevSecOps and Security Testing principles.
* Relevant certifications in GCP, Security, Automation Testing, AI/ML, or Cloud Technologies.
* Experience working within Agile/Scrum environments.
Key Competencies
* Quality-first and automation-first mindset
* Strong analytical and problem-solving skills
* Excellent stakeholder communication
* Ability to work in cross-functional cloud and AI teams
* Strong ownership and accountability
* Continuous learning mindset with interest in emerging AI technologies and cloud security practices
More AI Analyst roles like this, weekly
Roles like this expire in about a week. Get new AI Analyst openings across the UK in your inbox — free, unsubscribe any time.