Staff Platform Engineer - GPU Inference Control Plane
Posted 1 hour 21 minutes ago by Fdetimes
Permanent
Full Time
Other
London, United Kingdom
Job Description
Together AI, the AI Native Cloud, seeks a software engineer to build a Kubernetes-native control plane that provisions and runs a GPU inference fleet. You'll design a manifest-driven API for clusters, models, and capacity changes, with controllers handling reconciliation and lifecycle management behind a single API.
Expect high emphasis on fragmentation, bin-packing, and efficient scheduling. You will own reliability, CI/CD for infrastructure code, and a self-service surface (API/CLI) while