Senior Data Engineer (contract) - outside IR35

Senior Data Engineer (contract) On-site 5 days.

Outside IR35 - £500 - £600

The Role

We're looking for a Senior Data Engineer to join our team on a permanent basis. You'll design, build, and manage complex data infrastructure across hybrid on-premises and Azure cloud environments, enabling scalable, secure, and high-performing data operations.

What You'll Do

• Build and maintain robust data pipelines (Python/Go/Azure Data Factory) for streaming and batch processing

• Implement hybrid cloud and storage solutions (on-prem + Azure)

• Work with Docker, GitHub and Kubernetes for containerisation and orchestration

• Automate workflows and data flows with Azure Data Factory

• Manage Real Time data streams with Kafka/NATS

• Ensure security and compliance using Keycloak and best practice access controls

• Design and optimise PostgreSQL and Elasticsearch databases

What We're Looking For

• Strong Python skills for automation and data engineering

• Hands-on ETL/ELT experience in hybrid environments

• Proven expertise in hybrid cloud data architecture (on-prem + Azure)

• Solid containerisation/orchestration experience (Docker, GitHub, Kubernetes)

• Practical knowledge of Azure Data Factory

• Event streaming experience (Kafka/NATS)

• Understanding of security practices across multi-platform environments

• Strong database development (PostgreSQL, Elasticsearch)

Nice to Have

• 5+ years' data engineering experience across cloud and on-prem

• Azure or related certifications

• Some DevOps engineering exposure

Clearance
This role requires Security Clearance (ACTIVE SC).