LLM Inference Research Engineer - Latency & Throughput

Mistral is seeking a Research Engineer on the Latency & Throughput team to push the frontier of LLM inference. You will research and prototype techniques to reduce latency and increase throughput, from speculative decoding to KV compression, then ship proven methods into our serving stack.

You will work between inference engineers and research scientists, producing proofs of concept that bridge academia and production. Expect collaboration across teams and potential co-training scenarios.