Principal Data Engineer

Posted 2 hours 32 minutes ago by BBC Group and Public Services

Permanent
Full Time
Other
Glasgow, United Kingdom
Job Description

Glasgow, GBR, G511DA London, GBR, W1A 1AA Newcastle-upon-Tyne, GBR, NE991RN Salford, GBR, M50 2QH

JOB DETAILS

JOB BAND: D

CONTRACT TYPE: Permanent, Full-time

DEPARTMENT: Product Group

LOCATION: Newcastle, London, Salford or Glasgow - Hybrid

PROPOSED SALARY RANGE: up to £87,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights.

We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application - though there's no obligation to do so now. Flexible working will be part of the discussion at offer stage.

The Principal Data Engineer is a role that will support the Product Data Domain teams. You will help to build ETL pipelines to ingest and transform data to develop the data products that will power key value use cases across the BBC. You will work in an agile multi-disciplinary team alongside product analytics developers, product data managers, data modelers and data operations managers, ensuring that all work delivers maximum value to the BBC.

YOUR KEY RESPONSIBILITIES AND IMPACT
  • Leads and architects on developing robust and scalable complex data pipelines to ingest, transform, and analyse large volumes of structured and unstructured data from diverse data sources. Pipelines must be optimised for performance, reliability, and scalability in line with the BBC's scale.
  • Lead initiatives to enhance data quality, governance and security across the organisation, ensuring compliance with BBC guidelines and industry best practices.
  • Prioritises stakeholders requirements and identify the best solution for timely delivery.
  • Leads on building automation workflows including monitoring and alerting.
  • Encouraging and mentoring team members in partnership with other disciplines to create value with data across the wider organisation.
  • Helps set standards for coding, testing and other engineering practices.
  • Leads on the building and testing of business continuity & disaster recovery procedures per requirements.
  • Proactively evaluates and provides feedback on future technologies and new releases/upgrades based on deep understanding of the domain.
YOUR SKILLS AND EXPERIENCE
  • Essential Skills
    • 5+ years experience in a data engineering or analytics engineering role in AWS, preferably in digital products, building ETL pipelines, ingesting data from a diverse set of data sources (including event streams, various forms of batch processing)
    • Excellent SQL and Python skills with experience in deploying and scheduling code bases in a data development environment, using technologies such as Airflow.
    • Working knowledge of cloud-based Data Warehousing technologies (such as AWS Redshift, GCP BigQuery or Snowflake)
    • Demonstrable experience of working alongside cross-functional teams interacting with Product Managers, Infrastructure Engineers, Data Scientists, and Data Analysts
    • Strong stakeholder management skills with the ability to prioritise and a structured approach and ability to bring others on the journey
  • Additional Capabilities
    • Ability to listen to others' ideas and build on them
    • Ability to clearly communicate to both technical and non-technical audiences
    • Ability to collaborate effectively, working alongside other team members towards the team's goals, and enabling others to succeed, where possible
    • Strong attention to detail

Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Contracts of Employment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer.

Disclaimer

This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved.

Please note: If you were to be offered this role, the BBC will conduct Employment screening checks which include Reference checks; Eligibility to work checks; and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory.

The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk.

Diversity, inclusion & belonging

We welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. Find out more about diversity, inclusion and belonging in our strategy below.

Disability confident

We are a disability confident employer. If you need to discuss adjustments or access requirements for the interview process, or to carry out this role, please contact us via email and we'd be happy to discuss:

BBC Group and Public Services, Broadcasting House, Portland Place, London, United Kingdom, W1A 1AA. BBC Studios Distribution Limited, company no: , registered address: 1 Television Centre, 101 Wood Lane, London, United Kingdom W12 7FA.