Senior Data Engineer
Posted 9 hours 33 minutes ago by Vivid Resourcing
My client within the finance space just outside of Amsterdam is looking for a Senior Data Engineer who can help them scale a brand new data platform using the latest Azure stack. You will join an existing team of 3 people and focus on helping the data platform as the business portfolio expands!
Responsibilities:
- Collaborate with the Lead Data Engineer and Team Lead in Azure DevOps to plan and prioritize tasks.
- Develop data pipelines in Azure Synapse Analytics, along with data ingestion and process scripts using PySpark and Pandas, while managing version control through Git.
- Create unit tests, test your own work and review work of colleagues to ensure quality control.
- Enhance and maintain deployment pipelines to facilitate smooth releases to end users.
- Monitor the data platform (including data pipelines, ingestion/processing jobs, and alerts), while continuously improving logging and monitoring practices.
- Create new data pipeline solutions on various data sources (ERP, CRMs, etc.)
Requirements:
• 4+ years of experience within Data Engineering
• Strong Python and SQL skills
• Knowledge of Azure and related technologies is important for this role (Synapse, ADF, Databricks etc.)
• Knowledge of Pyspark would be a plus
• Experience with managing stakeholders would be a plus
Salary Package:
• Up to €110,000 per annum (D.O.E)
• Possibility to work from different offices around Europe
• 1 day per week in the office
• Pension plan
Make sure to apply here or reach me on the following:
Phone:
Email: