R&D Associate in AI Infrastructure

Effective large-scale AI models remain a challenge. How can inference workloads be scheduled on heterogeneous GPUs? How can we minimize without sacrificing throughput? We address these questions and other related issues within a portfolio of applied research projects conducted with academic partners and are looking for a research engineer to design and build infrastructure for AI workloads, ranging from Kubernetes and custom solutions to inference pipelines and monitoring systems. The projects vary in scope, but their essence remains the same: write production-quality code and defend it using HEIG-VD research.MAIN MISSIONS:- Participate in the R&D projects of the institute- Design and implement schedulers and k8s controllers for inference- Integrate and extend inference engines (vLLM, Ray)- Instrument clusters and run reproducible benchmarks that evaluate various metrics: TTFT, accuracy, throughput, RAM/GPU usage- Study algorithms and economical placement on heterogeneous systems, contributing to the writing of academic papers- Collaborate with industrial partners throughout the process, addressing the technology challenge.DESIRED PROFILE:- Bachelor's or Master's degree in software engineering or a related field- Proven skills in C/C++, Go, and/or Python- Experience with Kubernetes and Linux, containers- Knowledge of GPU computing (CUDA, device management)- Technical skills in English and French- Experience with inference engines (vLLM, Ray, LiteLLM)- Knowledge of decoding and KV cache- Experience with monitoring stacks and high-performance networks- Open source contributions and/or activity: 80% to 100%Information: Pamela Delgado, Associate Professor, Phone: We invite you to send your complete application via JobUp by March 22. Total discretion is assured.The Haute Ecole d'Ingénierie et de Gestion du Canton de Vaud offers bachelor's and master's degrees in engineering and business economics as well as postgraduate programs. With over 5,000 students, it is the largest school of the Haute Ecole Spécialisée in Western Switzerland. jid2fe3399aen jit0310aen jpiy26aen