Leave us your email address and we'll send you all the new jobs according to your preferences.

Data Engineer

Posted 5 hours 31 minutes ago by Devonshire Hayes Recruitment Specialists Ltd.

Permanent

Full Time

Other

Glasgow, United Kingdom

Job Description

If you are an experienced Data Engineer with excellent communication skills and a proven track record of working on large scale data enablement projects, we have a new contract we would like to discuss with you. Please note this role requires onsite attendance once a week and has been deemed inside IR35.

Requirements

Experience in Azure Synapse, ETL, Pyspark, SQL, data modelling and Data Bricks.
Design and develop Azure Pipelines including data transformation and data cleansing.
Document source-to-target mappings.
Re-engineer manual data flows to enable scaling and repeatable use.
Build accessible datasets for distribution and analysis.
Development of Azure Pipelines for transforming data.
A scalable meta-data driven ingestion and transformation framework.
Aligning transformation pipelines and datasets with Purview.
Experience of working with Azure Data Lakes, Data warehousing, and pipelines and Storage accounts.
Experience in building and managing Pipelines including: building data interfaces to source systems, combining and transforming data into appropriate storage formats.
Experience identifying and resolving issues in databases, data processes, data products and services.
Proficiency in T SQL and Python to develop automation.