Senior Data Engineer

On behalf of DWP, we are looking for a Senior Data Engineer for a 12 Month (Inside IR35) contract. Hybrid 2 days per week based in London, Manchester, Newcastle or Leeds.

Note: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position, (and speed at which we require a postholder in situ), preference may be given to candidates who meet all of the essential criteria and hold active security clearance

Senior Data Engineer

Data Engineers are responsible for the creation and maintenance of analytics infrastructure, providing the foundations for data needs. Data Engineers are responsible for developing, constructing, maintenance and testing of architectures, such as databases and large-scale processing systems, implementing data flows to connect operational systems, and writing and executing ETL scripts and codes.

As a Senior Data Engineer you are responsible for leading, managing and delivering all aspects of data development activities to meet customer needs to agreed timescales. You own the overall Data Engineering Development process within Data Engineering along with setting the strategies for products and the wider community. As a Senior Data Engineer you will provide technical leadership to a team of Data Engineers along with providing oversight to the products they develop.

You will be:
. Responsible for leading, managing and delivering all aspects of development activities to meet customer need;
. Lead the shaping of solutions, ensuring strategic fit, following the agreed principles and contribute to the continuous improvement of the Data Engineer Development life cycle
. Develop, own, maintain and ensure adherence to standards across the Data Engineering community;
. Promote the development of reusable, robust and scalable products eg code, citizen centric data models, exploitation products
. Quality assuring documentation for projects, including project plans, and resource estimates;
. Designing and developing reusable metadata libraries and promote reuse across the department;
. Work with other technologists, including Lead Data Engineers and Data Architects to investigate and develop solutions;
. Developing, maintaining and continually improving data engineering, automation and scaling capabilities;
. Providing technical leadership to individuals and building the Data Engineer community and capability.

You will have:
. Knowledge of data architecture concepts/technologies eg data warehouse, data lakes, big data
. Expert level experience in the development of complex data routines and patterns
. Experience of developing data solutions on Oracle, Cloudera or Horton Works platforms
. Knowledge of database architecture, relational database diagrams, data warehousing principles and integrity constraints
. Knowledge of API development
. Experience of developing data solutions using cloud native services for collection, storage, processing, analysis, visualisation and security of data
. Experience of leading teams and building sustainable, modern data engineering capability.
. Experience of leading the design and development of complex data pipelines
. Stakeholder Management in a large cross functional environment
. Experience of modern engineering concepts and application in a data environment (devops/dataops/CI/CD)

Please be aware that this role can only be worked within the UK and not Overseas.