Data Engineer

Job Title: Senior Azure Data Engineer

Location: Amsterdam, Netherlands

Role Overview:

We are seeking a highly experienced Senior Azure Data Engineer with over 10 years of expertise in building robust data pipelines and solutions on the Azure platform. The ideal candidate must hold the MS DP-203 certification and be proficient in working with Azure Data Factory, Azure Databricks, Python, and PySpark.

Key Responsibilities:

• Design, develop, and maintain advanced data pipelines using Azure Data Factory and Azure Databricks.
• Optimize large-scale data processing using PySpark on Databricks.
• Collaborate with business and engineering teams to translate data requirements into scalable solutions.
• Implement and manage CI/CD pipelines using Azure DevOps.
• Develop robust ETL processes using Python and SQL.
• Monitor and troubleshoot pipeline performance and ensure high data reliability and availability.
• Uphold best practices in data security, governance, and compliance.
• Continuously explore and integrate emerging tools and techniques in cloud data engineering.

Required Skills & Qualifications:

• Mandatory Certification: Microsoft Azure Data Engineer Associate (MS DP-203)
• 10+ years of relevant experience in data engineering and cloud environments.

Strong expertise in:

• Azure Data Factory
• Azure Databricks
• Python & PySpark
• CI/CD with Azure DevOps
• SQL and data modeling
• Solid understanding of data security and performance optimization.
• Excellent communication and documentation abilities.

Desirable Competencies:

• Experience with MySQL and other relational databases.
• Ability to work independently and as part of a global team.
• Strong problem-solving and critical-thinking mindset.