AI Engineer

Role Purpose

This is a blended role within the AI Centre of Excellence, mainly focusing on the development and engineering of solutions leveraging Large Language Models (LLMs). The key purpose of the role is to design, implement, and maintain customised LLM solutions that deliver measurable business value. Working within the central AI COE team the successful candidate will drive innovation, optimise processes, and ensure the scalability, reliability, and performance of LLM-based solutions with specific focus on safely scaling AI across the organisation and de risking the adoption. The successful candidate should keep abreast with and have the opportunity to research and experiment with the latest AI trends.

This role provides a unique opportunity to shape the organisation's AI strategy and lead the adoption of LLM technologies to drive business transformation.

Key Responsibilities

• Collaborate effectively with business stakeholders to identify opportunities for LLM integration and deliver value-aligned solutions
• Conduct regular demos, gather feedback, and refine solutions based on user needs
• Design and implement LLM-driven applications, workflows, and APIs, adhering to best practices for system architecture and performance optimisation
• Prototype, fine-tune, and deploy LLMs, customising pre-trained models to meet domain-specific requirements
• Stay updated on advancements in AI and LLM technologies and, where appropriate, incorporate them into our products
• Ensure robust security and data privacy in all LLM implementations, adhering to AI governance, risk management and compliance requirements
• Perform rigorous testing, including model validation, stress testing, and debugging
• Conduct code reviews to uphold high-quality standards and enforce best practices
• Monitor and maintain LLM systems, troubleshooting issues, and ensuring high availability and reliability
• Proactively identify and address technical debt, optimizing models for performance and scalability
• Support in defining architectural patterns, reusable components, and templates for LLM-based development
• Share knowledge and upskill colleagues, fostering a culture of continuous learning and innovation
• Actively contribute to technical discussions and knowledge-sharing forums within the organisation

Knowledge, experience, skills and abilities

Technical

• In depth knowledge of foundational AI concepts, including Natural Language Processing (NLP), LLMs, and transformer-based architectures
• Proficiency in one or more programming languages including Python and Java/Typescript, with a focus on AI libraries such as PyTorch or TensorFlow
• Understanding of distributed systems, containerization (Docker), and orchestration tools (Kubernetes)
• Knowledge of scaling LLM applications.
• Knowledge of annotation for fine tuning and evaluating LLMs
• Understanding of varied prompt engineering techniques
• Understanding how single and multi-agent setups can interact with extended logic.
• Familiarity with responsible AI practices, including bias mitigation, fairness, and model interpretability.
• Awareness of AI safety, data privacy, and ethical / regulatory considerations related to deploying LLMs

Personal

• Strong communication skills for engaging both technical and non-technical stakeholders
• Analytical mindset with the ability to solve complex problems efficiently
• Able to deliver work in line with internal policies and procedures and external requirements
• Demonstrated ability to manage multiple priorities and deliver high-quality work under tight deadlines
• Skilled in designing evaluation metrics and benchmarks for LLM performance, including accuracy, coherence, and safety.
• Proficiency with version control systems (e.g., Git) and collaborative development workflows
• Strong skills in data curation, preprocessing, fine-tuning, and evaluation
• Recognised qualification in AI or other relevant qualification such as CQF or Actuary a plus

In addition to a competitive base salary and the opportunity to participate in our annual, performance-related bonus plan, upon joining us here at Pension Insurance Corporation, you will get access to some great benefits, including private medical insurance, 28 days' annual leave (excluding bank holidays), a generous pension scheme and much more.