Databricks Architect

Job Description:
We are looking for a hands-on Databricks Architect with strong experience in designing and delivering scalable data and AI solutions in production environments. This role is perfect for someone who enjoys setting architectural direction while remaining deeply technical and hands-on.

Key Responsibilities

• Design and implement end-to-end data solutions on Databricks (Spark, Delta Lake, notebooks, jobs, clusters, Lakehouse)
• Define reference architectures, best practices, and standards for data/AI workloads
• Work closely with stakeholders to translate business requirements into scalable Databricks designs
• Implement CI/CD pipelines, DevSecOps practices, and IaC for data platform deployments
• Ensure strong data governance, security, and cost optimisation across cloud environments
• Collaborate across engineering teams to deliver production-grade solutions

Must-Have Skills

• 7+ years of data architecture & engineering experience
• 3-4+ years hands-on with Databricks in production environments
• Strong expertise with Spark, Delta Lake, Databricks jobs, notebooks, and cluster management
• Architectural experience defining standards and best practices
• Strong knowledge of at least one cloud platform (Azure, AWS, or GCP)
• Experience with CI/CD, DevSecOps, and infrastructure as code (eg, Terraform)
• Solid understanding of security, governance, and cost management on cloud data platforms
• Excellent stakeholder management and requirement-translation skills

Nice to Have

• Experience integrating Databricks with dbt Cloud, Snowflake, Fivetran, BI tools, etc.
• Background in financial services or capital markets
• Experience with Machine Learning/AI workloads on Databricks