Safety Insight Analyst with British English (native speaker level)

Grid Dynamics

London, England, UKfulltimeIT Services and IT Consultingposted
Unlock apply linkApply links and the original listing are a Pro feature: ยฃ4.99/mo or ยฃ25 once.
๐€๐ซ๐ž ๐ฒ๐จ๐ฎ ๐š ๐ง๐š๐ญ๐ข๐ฏ๐ž ๐๐ซ๐ข๐ญ๐ข๐ฌ๐ก ๐„๐ง๐ ๐ฅ๐ข๐ฌ๐ก ๐ฌ๐ฉ๐ž๐š๐ค๐ž๐ซ ๐ฐ๐ข๐ญ๐ก ๐š ๐ฉ๐š๐ฌ๐ฌ๐ข๐จ๐ง ๐Ÿ๐จ๐ซ ๐๐š๐ญ๐š, ๐ฌ๐š๐Ÿ๐ž๐ญ๐ฒ, ๐š๐ง๐ ๐๐ข๐ ๐ข๐ญ๐š๐ฅ ๐œ๐ฎ๐ฅ๐ญ๐ฎ๐ซ๐ž? Do you want to be at the forefront of AI safety evaluation and help shape the future of responsible AI development? If so, we have an exciting opportunity for you! Join our clientโ€™s team as a ๐’๐š๐Ÿ๐ž๐ญ๐ฒ ๐ˆ๐ง๐ฌ๐ข๐ ๐ก๐ญ๐ฌ ๐€๐ง๐š๐ฅ๐ฒ๐ฌ๐ญ and work on cutting-edge projects that make a real impact. Responsibilities * Provide Market Expertise: Support specific digital storefronts by providing deep language, cultural, and market expertise for the UK English locale. * Analyse Data: Apply statistical and computational methods to identify patterns, trends, and loss patterns in quantitative data. * Develop Tooling: Design and build dashboards, scripts, and workflows to streamline evaluation and reporting processes. * Drive Insights: Translate qualitative and quantitative findings into actionable insights and strategic guidance for product and engineering teams. * Stress-Test Models: Define dataset criteria and construct robust adversarial and stress-test datasets to evaluate system vulnerabilities. * Define Frameworks: Develop evaluation frameworks that capture nuanced safety criteria, ensuring strict fidelity to safety policies. * Scale Evaluations: Guide the development of automated evaluation pipelines to collect, automatically judge, and analyse model outputs at scale. Requirements * Language Proficiency: Expert proficiency in English (UK), with a deep understanding of regional cultural nuances. * Education: Bachelorโ€™s degree in Data Science, Computer Science, Data Analytics, or a related technical field. * Red Teaming: Expertise in AI red teaming methodologies, vulnerability discovery, and associated reporting strategies. * Technical Skills: Intermediate to advanced proficiency in Python for data analysis (e.g., pandas, NumPy, Jupyter) and familiarity with SQL for data retrieval. * Data Experience: Proven experience working with large-scale datasets and interpreting complex data (including identifying loss patterns). * AI/ML Experience: Experience working with Large Language Models (LLMs) or generative AI systems. * Guidelines/Annotation Task Design: Hands-on experience with guidelines and annotation task design and execution, including best practices for culturally and linguistically appropriate localisation across languages. * Collaboration: Proven experience working effectively with cross-functional, multi-domain, and multilingual experts. * Content Resilience: Comfort and resilience working with sensitive topics and trust \& safety content. * Willingness to work up to 8 PM UK time Nice to have * Data Visualisation: Experience utilising Business Intelligence (BI) tools (e.g., Tableau, Power BI) for data visualisation and reporting. We offer * Opportunity to work on bleeding-edge projects * Work with a highly motivated and dedicated team * Competitive salary * Flexible schedule * Benefits package - medical insurance, sports * Corporate social events * Professional development opportunities * Well-equipped office About Us Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud \& DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.