Data Engineer
Posted 6 days 3 hours ago by Leap29
Permanent
Full Time
Other
London, United Kingdom
Job Description
Data Engineer 
I'm recruiting for a Data Engineer to work on large-scale data projects, building reliable pipelines and developing scalable solutions to process and transform data from multiple sources.
Key Responsibilities- Design, build and maintain scalable data pipelines.
- Transform and standardise data across different data models.
- Develop reusable, maintainable solutions using Python and software engineering best practices.
- Work with cloud platforms, distributed processing technologies and modern data architectures.
- Collaborate with engineers and stakeholders in an Agile environment.
- Proven Data Engineering experience in complex, large-scale environments.
- Strong Python skills and experience building data pipelines.
- Experience with data modelling and transforming data between different formats.
- Knowledge of cloud platforms, ideally Azure, alongside Spark and Databricks.
- Familiarity with data storage technologies such as Parquet and Delta Lake.
- Experience with Docker, Kubernetes, Git/GitHub and Linux/Unix environments.
- Ability to contribute to shared codebases and collaborative development teams.
If you're a Data Engineer with strong Python skills and experience working with modern data platforms,