AI Benchmarking Engineer for Cross-Stack Evaluation

Callosum Technologies Ltd. is hiring for a research-driven role in London to build and run a unified benchmarking system for evaluating agentic and algorithmic LLM workflows.

You will design tasks, collect real commits/traces, and ensure robust, contamination-free evaluation with reproducible results. The role requires a PhD or equivalent track record, strong Python, and experience with sandboxed/distributed execution.