Senior Data engineer - Databricks

This is an exciting opportunity for a Senior Data Engineer to own the Azure/Databricks data & AI platform end-to-end from architecture and pipelines to governance, data quality, observability, ML enablement so the business gets trusted, timely, and cost-efficient data and models.

Client Details

Senior Data Engineer

The organisation is a well established entity within the financial services industry. It operates as a medium-sized firm and focuses on providing reliable and innovative solutions to its clients.

Description

Senior Data Engineer

• Develop and oversee Azure-based solutions to support analytics functions.
• Design and evolve the Azure/Databricks modern data platform architecture.
• Build, optimise and maintain scalable ETL/ELT pipelines and data models.
• Implement data governance, lineage and cataloguing using Purview/Unity Catalog.
• Establish data quality frameworks, monitoring and observability across pipelines.
• Manage orchestration, platform operations and ITIL-aligned incident/change processes.
• Ensure strong data security, access controls and regulatory compliance.
• Support and enable machine learning and AI solutions within Databricks.
• Monitor and optimise cloud and compute costs using Azure FinOps tooling.
• Provide guidance and mentorship to the analytics team on Azure best practices.

Profile

Senior Data Engineer

A successful senior data engineer will have deep, hands-on experience with Databricks and Azure, with the ability to own platform architecture, delivery and operations end-to-end (including DevOps, monitoring, reliability and cost control). They will be fluent across data engineering, governance, ML enablement and ITIL-aligned change and incident management.

• Proven expertise in delivering Azure and Databricks data platform solutions.
• Strong background in designing and optimising complex ETL/ELT pipelines.
• Hands-on experience with data governance, lineage and cataloguing tools.
• Proven ability to implement data quality, monitoring and observability practices.
• Experience leading platform operations, including incident and change management.
• Demonstrated capability in mentoring others and collaborating with diverse stakeholders.
• Strong leadership skills with the ability to guide and develop teams.
• Excellent analytical and problem-solving abilities.

Job Offer

Senior Data Engineer

• Competitive salary up to £70,000 + Bonus & Benefits.
• Standard benefits package provided.
• Permanent position within a reputable organisation.
• Chance to develop and lead innovative Azure-driven projects.

Take the next step in your career by applying for this Senior Data Engineer position in Basingstoke today. Join a trusted organisation and make a significant impact.