Engineering Lead - Enterprise Data Platform

Role Overview

Join us as an Engineering Lead - Enterprise Data Platform for Barclays Customer, Comms and MarTech team, where you will play a pivotal role in leading the technical design and delivery of data solutions supporting the migration to a cloud-based Enterprise Data Platform (EDP).

You will be responsible for shaping how Customer, Comms and MarTech data is provisioned and configured in the Data Lab environments, integrated and consumed, enabling scalable, secure, and efficient data capabilities across the organisation. This role sits at the heart of a strategic transformation to replace legacy data warehouses and platforms with a modern cloud-native EDP. You will lead engineering solution design, define new data architecture patterns including orchestration and scheduling, and ensure seamless integration with downstream systems while maintaining high standards of data quality, security, and operational resilience.

The role will include leading the design and build of scalable data pipelines and integrations on AWS, driving the migration of customer and MarTech datasets from legacy platforms to the EDP, and establishing robust DevOps and DataOps practices to ensure production ready, reliable, and high performing data products.

This role is based in Knutsford.

Purpose of the Role

To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues.

Accountabilities

• Development and delivery of high quality software solutions using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimised for performance.
• Cross functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives.
• Collaboration with peers, participation in code reviews, and promotion of a culture of code quality and knowledge sharing.
• Staying informed of industry technology trends and innovations and actively contributing to the organisation's technology communities to foster a culture of technical excellence and growth.
• Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions.
• Implementation of effective unit testing practices to ensure proper code design, readability, and reliability.

Qualifications

• Strong hands on expertise in Python, PySpark, SQL, and Databricks, with the ability to build and optimise scalable data pipelines and analytics ready datasets.
• Experience implementing CI/CD and DevOps practices for data platforms, including GitLab workflows, automated testing, deployment pipelines, and environment management.
• Proven experience delivering AWS solutions, including cloud infrastructure with a focus on performance tuning, monitoring, data quality, security, and cost optimisation.
• Understanding of Enterprise Data Platform concepts, including data products, domains, and consumption patterns with a focus on operability and production readiness.
• Awareness of data security practices, particularly in handling sensitive data using governed and automated approaches.
• Experience with file based integration patterns, including managing constraints around file formats, splitting, and downstream system limitations.
• Strong analytical, risk and controls, change and transformation, business acumen, strategic thinking, and digital technology skills.

Location

This role is based in Knutsford.

Professional Statements

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship - our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset - to Empower, Challenge and Drive - the operating manual for how we behave.