AWS / Databricks Platform Engineer - Outside IR35

We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform. The role will focus on building secure, scalable, and cost-optimised AWS infrastructure, implementing governance, and enabling advanced data services across multiple business domains.

Key Responsibilities

• Design, build, and maintain AWS infrastructure using Terraform (IaC).
• Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
• Implement secure network connectivity using AWS PrivateLink (Interface VPC Endpoints) and VPC endpoint services.
• Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
• Enforce consistency and control through AWS Organizations, Service Control Policies (SCPs), AWS Config, and compliance frameworks.
• Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
• Apply AWS security best practices, including Defense in Depth, BCDR, and high availability.
• Monitor and optimise cloud cost efficiency using AWS Cost Explorer, Budgets, and FinOps best practices.
• Collaborate with data, platform, and security teams to ensure a resilient, governed, and high-performing cloud ecosystem.

Required Skills & Experience

• Proven experience delivering Terraform-based AWS infrastructure.
• Strong understanding of GitHub Actions and CI/CD automation.
• Hands on expertise with AWS Private Link, VPC networking, and secure service exposure.
• Deep knowledge of Databricks and Unity Catalog for governance and security.
• Solid experience with AWS Organizations, SCPs, AWS Config, and resource governance.
• Background in AWS IAM, federated authentication, OAuth, and identity integration.
• Proven ability to design with security, resilience, and cost-optimisation in mind.
• Excellent collaboration and documentation skills within cross functional teams.

Additional Information

• Day Rate: Up to £550
• IR35 Status: Outside IR35
• Start Date: February
• Duration: Initial 3-month contract, significant opportunity for extension
• Location: Remote with occasional travel to client site (London)