Data Engineer - Senior Manager

Posted 4 hours 3 minutes ago by Silverdrum

Permanent
Part Time
I.T. & Communications Jobs
London, United Kingdom
Job Description
Senior Data Engineer Global Media Agency Group

3 days per week in London office

A global media agency group is hiring a Senior Data Engineer to join its high-profile Data & Technology team. You'll own and extend a config-driven platform that turns paid media data from 26+ ad platforms into trusted, analysis-ready datasets. Media industry experience is essential - along with strong hands on skills in dbt, Python, SQL, GCP/BigQuery and Terraform. This is a chance to take real ownership, tackle complex engineering challenges and help shape how the agency delivers data at scale - with excellent scope for career progression.

What you'll be doing:
  • Owning end-to-end ELT pipelines, from Cloud Function ingestion through dbt transformation to BigQuery.
  • Building reusable macros, templates and configurations that scale across platforms and clients.
  • Developing Python tooling to automate client onboarding and pipeline execution.
  • Improving cloud infrastructure, reliability and data quality.
  • Mentoring data engineers and driving best practice in testing, code reviews and documentation.
  • Working with analysts, data scientists and BI teams to turn well-modelled data into business value.
The essential skills and tools:
  • Media experience: experience working with digital or paid media data and an understanding of advertising platforms.
  • dbt: macros, Jinja templating, incremental models, seeds, testing and packages.
  • Python 3.11+: building CLI tools, data processing and automation.
  • SQL: strong querying and transformation skills, ideally using BigQuery.
  • Google Cloud Platform: BigQuery, Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub and Cloud Scheduler.
  • Terraform: provisioning and managing cloud infrastructure as code.
  • Data modelling: star schemas, dimension/fact architecture and slowly changing dimensions.
  • Git and CI/CD: branching, pull requests and automated delivery using Cloud Build or similar.
  • Communication: translating business requirements into clear technical specifications.
Useful extras that will help you stand out:
  • Docker and containerised workloads, including Cloud Run Jobs.
  • Click, Pydantic and YAML-based configuration.
  • Multi-client mono-repo experience.
  • Azure Blob, AWS S3 and SFTP integrations.
  • pytest, MkDocs and modern Python tooling such as Poetry, ruff, mypy and pre-commit.
  • Databricks and dbt-databricks.
Why make the move?

You'll join an established platform with meaningful engineering challenges, global reach and room to make your mark. Bring your ideas, take ownership and help a talented team build smarter, more scalable ways to work with media data.