Data Engineer

Data Engineer

Location: UK

Our client are on an exciting journey to build a modern, scalable cloud data platform that powers insight, innovation and future AI capabilities across the Group. We're looking for a talented Data Engineer to help shape and deliver that vision.

As a key member of our Group Data Team, you'll work hand-in-hand with technical and business stakeholders to design, build and optimise data products that drive real business value. If you thrive on solving complex data challenges and want to play a pivotal role in a growing data function, we want to hear from you.

Job description:

• Translating architectural designs into high-quality, low-level technical documentation.
• Partnering with cloud infrastructure and development teams to deliver robust solutions.
• Working within an established SDLC to ensure quality, consistency and control.
• Collaborating with analysts and system owners to define data extraction and transformation rules, including interface contracts.
• Supporting data modelling initiatives and maintaining transformation logic.
• Building ETL/ELT batch and micro-batch pipelines.
• Developing modelled data sources and products in Snowflake for end-users.
• Maintaining metadata, enforcing data quality and defining platform standards.
• Administering the cloud data platform.
• Designing and implementing Real Time streaming pipelines using AWS Kinesis, Firehose, and Kafka (MSK).

Skills required:

• Hands-on experience delivering ETL/ELT pipelines.
• Experience with transformation tooling such as dbt.
• Strong proficiency in SQL and Python.
• Deep understanding of Snowflake and modern data platform principles.
• Knowledge of cloud-based data architectures (lakes, Lakehouses, warehouses).
• Familiarity with AWS services
• Understanding of Lakehouse storage formats
• Working knowledge of data modelling methodologies
• Excellent communication skills and the ability to tailor messages for technical and non-technical audiences.
• Strong documentation skills, including LLDS and runbooks.

Desirable Experience

• Streaming technologies (Kinesis, Firehose, Kafka, Flink).
• Infrastructure-as-Code tools such as CloudFormation or Terraform.
• AWS Data Engineer certification.
• A relevant degree or equivalent experience.

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.