AI Testing Engineer - Python, LLM Evaluation Pipelines

Reply, Inc. is seeking a mid/senior AI Testing & Engineering Specialist in Greater London to design and evolve a next generation testing framework for generative AI agents. You will build evaluation pipelines, synthetic data generation, observability layers, and quality metrics for LLM-based systems.

You will work across AI engineering, data pipelines, and QA to shape standards for AI system validation in production, contributing to architecture and hands on implementation with autonomy.