Data Engineer (SC Cleared)

About Scrumconnect Consulting:

Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. With a strong commitment to user-centred design and agile delivery, and more to deliver innovative digital services that matter

Clearance: Active SC clearance is mandatory
Role Overview

We are looking for an experienced Data Engineer to develop and maintain data products and a Strategic Data Platform. You will work as part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of data solutions. The role focuses on designing, delivering, and optimising scalable data architectures, with a strong emphasis on Azure-based tools and modern engineering practices.

Key Responsibilities

• Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse.

• Manage data development life cycle within Agile delivery teams.

• Integrate and automate data workflows into Azure DevOps pipelines.

• Create and maintain dimension data models and semantic models for integration with Power BI.

• Develop complex dashboards, visualisations, and reporting solutions using Power BI.

• Implement data governance, quality checks, and profiling to ensure accuracy and compliance.

• Migrate Legacy data capabilities to modern Azure-based platforms.

• Collaborate with business stakeholders to translate requirements into robust technical solutions.

• Coach and mentor team members to enhance capability in data engineering best practices

Essential Skills & Experience

• Active SC Clearance (must be valid and in place at application stage).

• Proven experience with:

  • Azure Data Factory & Azure Synapse

  • Azure DevOps & Microsoft Azure

  • Power BI (including semantic models)

  • Python (including PySpark)

  • SQL (proficient level)

  • Dimension data modelling

• Experience with Terraform for infrastructure-as-code deployments.

• Ability to deliver solutions using structured and unstructured data.

• Experience in Agile environments.

• Strong business analysis skills to understand service needs and document accurately.

• Proven experience in Legacy migration projects within complex organisations.

• Ability to work collaboratively and communicate effectively with technical and non-technical stakeholders.

Desirable

• Azure certifications (Data Engineering, Data Scientist, or related specialisation).

• Knowledge of GDPR compliance, data security, and governance best practices.