Systems Research Engineer - Distributed Systems / C++

Systems Research Engineer - Distributed Systems / C++ We are currently partnered with a globally leading research centre in the UK looking to expand their team with a Systems Research Engineer. This is an incredibly high calibre team reshaping how large-scale models are trained and served through next-generation AI-native infrastructure and "super-node" clusters. This is a permanent opportunity based onsite in Edinburgh. Key responsibilities for this Systems Research Engineer position: * Architect and implement distributed system components for AI workloads across CPU, GPU, and NPU clusters. * Conduct in-depth profiling and performance tuning of inference pipelines, focusing on KV cache management. * Develop low-latency, fault-tolerant AI serving frameworks using vLLM, Ray Serve, and PyTorch Distributed. * Research and prototype novel techniques for cache sharing, data locality, and resource orchestration. * Translate innovative designs into publishable contributions at top-tier venues (e.g., OSDI, NSDI, MLSys). * Collaborate with global research teams to drive the internal adoption of novel system architectures. Key Requirements: * Preferably a PhD, at minimum a masters degree, in Computer Science, distributed systems, or related field. * Strong knowledge of Distributed Systems, OS internals, and Machine Learning systems architecture. * Hands-on experience with LLM serving frameworks (vLLM, Ray Serve, TensorRT-LLM, or TGI). * Proficiency in C/C++ for systems development and Python for research prototyping. * Solid grounding in distributed algorithms, load balancing, and state management. * Proven ability to conduct systems research, ideally evidenced by publications in top-tier conferences. - Keywords: Systems Research Engineer / Distributed Systems / AI Infrastructure / LLM Serving / vLLM / KV Cache / Performance Optimization / Machine Learning Systems / C++ / Python / Ray Serve / PyTorch Distributed / Cloud Infrastructure If you are interested in this Systems Research Engineer position, please send a copy of your CV to ts@eu-recruit.com *By applying to this role you understand that we may collect your personal data and store and process it on our systems. For more information please see our Privacy Notice https://eu-recruit.com/wp-content/uploads/2024/07/European-Tech-Recruit-Privacy-Notice-2024.pdf*