Lead Data Engineer

Lead Data Engineer

Leeds - Hybrid working

£85,000-£90,000

Robert Walters are delighted to be partnering with an 8-figure turnover business based in Leeds. They are currently undergoing a transformation and are looking to hire a Lead Data Engineer to spearhead a greenfield project. The ideal candidate will have experience with Microsoft Fabric, with additional experience in Azure or AWS being highly advantageous.

1. Lead the end-to-end design and development of a new, cloud-based data platform focusing on scalability, performance, and security to support enterprise data initiatives.
2. Serve as the subject matter expert for Microsoft Fabric, guiding its implementation and integration within the company's cloud environment, which is currently AWS with potential migration to Azure.
3. Establish and enforce best practices for data ingestion, transformation, storage, and orchestration, laying a solid foundation for analytics, reporting, and AI/ML projects.
4. Collaborate with data analysts, data scientists, and business leaders to gather requirements and develop scalable data solutions.
5. Design and build scalable data pipelines and ETL/ELT processes using modern cloud-native tools within AWS and/or Azure.
6. Drive data modeling, governance, and quality standards to ensure compliance with security and regulatory requirements.
7. Provide technical leadership and mentorship to the data engineering team, establishing coding standards and review processes.
8. Coordinate with Cloud Architects and DevOps teams to create secure, reliable, and cost-effective infrastructure for the data platform.
9. Stay updated on emerging technologies within the Microsoft Fabric ecosystem and broader cloud data landscape to foster continuous improvement.
10. Lead migration and integration strategies, ensuring minimal disruption and data integrity during potential transition from AWS to Azure.

Robert Walters Operations Limited is an employment business and agency and welcomes applications from all candidates.