Data Scientist

Cognify Search

Data SciencemidhybridcontractIT Services and IT ConsultingDatabricksPythonDelta LakeRAGLLMOpsVector databasesPrompt engineeringMLOpsposted 27 Jul
Unlock apply linkApply links and the original listing are a Pro feature: £4.99/mo or £25 once.
Data Scientist – Databricks \& Generative AI Location: UK (Hybrid/Remote) Employment Type: Contract We're looking for an experienced Data Scientist to join a cutting-edge AI platform implementation project, helping to design, build and deploy enterprise-scale AI solutions using the Databricks ecosystem. This is an opportunity to work across the full AI lifecycle—from data engineering and platform build-out through to LLMOps, GenAI applications and production deployment. Key Responsibilities: * Design and implement AI solutions using the Databricks platform. * Build and optimise Medallion Architecture data pipelines (Bronze, Silver and Gold Delta tables). * Develop vector databases and AI-powered applications. * Process and transform structured and unstructured data at scale. * Build pipelines to ingest, chunk, process and store unstructured data. * Enrich data using AI agents and automated metadata generation. * Deploy and productionise AI and machine learning solutions using LLMOps best practices. * Engineer and optimise prompts and contextual workflows for Large Language Models (LLMs). * Develop custom front-end applications for AI platform management, workflow automation and results visualisation, leveraging modern AI coding assistants. * Collaborate closely with data engineers, architects and AI specialists to deliver scalable AI capabilities. Required Skills: * Commercial experience as a Data Scientist or Machine Learning Engineer. * Strong hands-on experience with Databricks. * Experience building AI or machine learning solutions in production environments. * Knowledge of Delta Lake and Medallion Architecture. * Experience working with structured and unstructured datasets. * Experience with vector databases and Retrieval-Augmented Generation (RAG) concepts. * Strong understanding of prompt engineering and Generative AI applications. * Experience deploying AI models using MLOps or LLMOps practices. * Proficiency in Python and modern data science libraries. Desirable Skills: * Unity Catalog experience. * Experience building AI agents or agentic workflows. * Front-end development experience (React, Streamlit, Gradio or similar). * Experience using AI-assisted development tools such as GitHub Copilot, Cursor or Claude Code. * Knowledge of cloud platforms such as Azure, AWS or GCP. About You: * Passionate about Generative AI and modern data platforms. * Comfortable working in fast-paced, collaborative environments. * Strong communication and problem-solving skills. * Able to take ownership of delivering scalable, production-ready AI solutions. If you're an experienced Data Scientist with strong Databricks and Generative AI experience and are looking to work on an innovative AI platform project, we'd love to hear from you.