Senior Data Engineer

Posted 9 hours 33 minutes ago by Vivid Resourcing

Permanent
Not Specified
Other
Noord-Holland, Netherlands
Job Description

My client within the finance space just outside of Amsterdam is looking for a Senior Data Engineer who can help them scale a brand new data platform using the latest Azure stack. You will join an existing team of 3 people and focus on helping the data platform as the business portfolio expands!


Responsibilities:

  • Collaborate with the Lead Data Engineer and Team Lead in Azure DevOps to plan and prioritize tasks.
  • Develop data pipelines in Azure Synapse Analytics, along with data ingestion and process scripts using PySpark and Pandas, while managing version control through Git.
  • Create unit tests, test your own work and review work of colleagues to ensure quality control.
  • Enhance and maintain deployment pipelines to facilitate smooth releases to end users.
  • Monitor the data platform (including data pipelines, ingestion/processing jobs, and alerts), while continuously improving logging and monitoring practices.
  • Create new data pipeline solutions on various data sources (ERP, CRMs, etc.)


Requirements:

• 4+ years of experience within Data Engineering

• Strong Python and SQL skills

• Knowledge of Azure and related technologies is important for this role (Synapse, ADF, Databricks etc.)

• Knowledge of Pyspark would be a plus

• Experience with managing stakeholders would be a plus


Salary Package:

• Up to €110,000 per annum (D.O.E)

• Possibility to work from different offices around Europe

• 1 day per week in the office

• Pension plan


Make sure to apply here or reach me on the following:


Phone:

Email: