Cloud Data Engineer with Azure & Databricks certifications
Posted 4 hours 53 minutes ago by Base 3
Contract
Not Specified
Factory Jobs
Brussel, Brussel (Stad), Belgium
Job Description
Note: Only Belgium based candidates will be considered
Your role as a Data Engineering & Application Development
- Design, develop, test, and maintain scalable data engineering solutions on Microsoft Azure and Databricks.
- Build robust and reusable ETL/ELT pipelines using Python, PySpark, Scala, and SQL.
- Develop data processing applications for ingestion, transformation, enrichment, validation, and serving of analytical datasets.
- Implement reliable batch and streaming data workflows using Azure Databricks, Delta Lake, and modern data lakehouse patterns.
- Contribute to application design, code quality, performance optimization, and maintainability of data engineering solutions.
- Develop reusable libraries, utilities, frameworks, and technical components to accelerate data product delivery.
Required Qualifications
- 5+ years of hands-on experience in data engineering, application development, or cloud-based data platform development.
- Strong hands-on development experience with:
- Python
- PySpark
- Scala
- SQL
- ETL/ELT development
- Solid experience with the Azure Databricks ecosystem, including:
- Databricks notebooks and jobs
- Spark clusters
- Delta Lake
- Lakehouse architecture
- Performance tuning and optimization
- Experience designing, developing, and operating production data pipelines.
- Good knowledge of Azure data services such as:
- Azure Data Lake Storage
- Azure Data Factory
- Azure Key Vault
- Azure DevOps
- Azure monitoring/logging capabilities
- Experience with CI/CD pipelines, preferably using Azure DevOps YAML pipelines.
- Strong understanding of software engineering practices, including version control, automated testing, modular development, and code reviews.
- Understanding of cloud security, access management, observability, and cost-aware development practices.
- Working knowledge of Terraform or infrastructure-as-code concepts is a plus, but not the primary focus of the role.