Hadoop Developer

Job Title: Hadoop Developer
Location: Birmingham/Sheffield
Salary/Rate: £514 per day INSIDE IR35
Start Date: 26/08/2025
Job Type: Contract

Company Introduction

We are seeking a highly skilled Hadoop Engineer to support and enhance our Operational Data Platform (ODP) deployed in an on-premises environment. The ideal candidate will have extensive experience in the Hadoop ecosystem, strong programming skills, and a solid understanding of infrastructure-level data analytics. This role focuses on building and maintaining scalable, secure, and high-performance data pipelines within enterprise-grade on-prem systems.

Job Responsibilities/Objectives

Design, develop, and maintain data pipelines using Hadoop technologies in an on-premises infrastructure.
Build and optimize workflows using Apache Airflow and Spark Streaming for real-time data processing.
Develop robust data engineering solutions using Python for automation and transformation.
Collaborate with infrastructure and analytics teams to support operational data use cases.
Monitor and troubleshoot data jobs, ensuring reliability and performance across the platform.
Ensure compliance with enterprise security and data governance standards.

Required Skills/Experience
The ideal candidate will have the following:

Strong experience in Hadoop and data engineering.
Strong hands-on experience with Python, Apache Airflow, and Spark Streaming.
Deep understanding of Hadoop components (HDFS, Hive, HBase, YARN) in on-prem environments.
Exposure to data analytics, preferably involving infrastructure or operational data.
Experience working with Linux systems, shell scripting, and enterprise-grade deployment tools.
Familiarity with monitoring and logging tools relevant to on-prem setups.

If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format.

Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.
Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.