Applied AI Engineer - Evaluation & Quality for Regulated AI

Adverant Limited in Ireland is seeking a role focused on designing and running evaluations for AI agents, ensuring honest and reliable performance. You will create golden sets to keep models honest, and craft quality reports that customers and regulators can verify.

You will own parts of the evaluation workflow, build pipelines to compare model families, and turn problematic results into robust test cases. Collaboration with platform engineers will help keep reviews affordable.