Senior ML Engineer - LLM Inference Optimization

Nebius is seeking a Senior Machine Learning Engineer to own model and endpoint optimization from artifacts to production deployment on the Applied AI team. You will tackle quantization, model compression, speculative decoding, KV-cache optimization, and multi-node GPU execution to boost latency, throughput, and cost per token while preserving quality.

You will collaborate with kernel and platform engineers to investigate serving problems, compare configurations, and validate improvements through