Unlock apply linkApply links and the original listing are a Pro feature — £4.99/mo or £25 once.
*hackajob
is collaborating with
HSBC
to connect them with exceptional professionals for this role.*
This is a hybrid role, based in Sheffield, UK
In This Role, You Will
* Design, build, and operate scalable model hosting platforms for LLMs, embeddings, and STT/TTS across heterogeneous hardware
* Optimise inference for latency, throughput, and cost (e.g., quantisation, KV-cache optimisation, dynamic/continuous batching)
* Evaluate and integrate inference frameworks (e.g., vLLM, TensorRT-LLM, SGLang) to maximise performance on target hardware
* Own inference health/performance monitoring (latency, throughput, TTFT, memory, availability) and troubleshoot bottlenecks/deployment issues
* Build end-to-end fine-tuning pipelines (data prep → distributed training → validation) and integrate fine-tuned models into the hosting/inference stack
To be successful in this role you should have the following skills:
* Extensive experience in building AI platforms covering model hosting/inference optimisation and fine-tuning pipelines (LLM experience strongly preferred)
* Strong Python and CUDA engineering; solid understanding of GPU/CPU architecture and HPC fundamentals
* Deep inference optimisation expertise: KV-cache, batching, quantisation (INT4/FP8/GPTQ/AWQ), operator optimisation, framework integration (vLLM/TensorRT-LLM/SGLang)
* Production hosting experience with Docker/Kubernetes and cloud platforms (AWS/GCP/Azure)
* End-to-end fine-tuning expertise: data preparation, distributed training, hyperparameter tuning, HF/Accelerate/LoRA/QLoRA, plus benchmarking/monitoring/troubleshooting