Leave us your email address and we'll send you all the new jobs according to your preferences.

Senior Software Engineer - Open-Source AI Inference & vLLM

Posted 9 hours 12 minutes ago by CommonAI Holdings Ltd

Permanent
Full Time
I.T. & Communications Jobs
Cambridgeshire, Cambridge, United Kingdom, CB1 0
Job Description

CommonAI CIC is seeking a Senior Software Engineer to help deploy, extend and optimise vLLM and related inference engines for our AI infrastructure projects. You will work across the Scaling Inference Lab and the High Assurance programme to drive performance, reliability and safety in production grade systems.

You will collaborate with open source communities, contribute core changes, and focus on latency, throughput and hardware utilisation while developing with Python and low level languages.

Email this Job