Data Engineer

Our client based in Poland, is looking for a Data Engineer, please see the details below:

Role: Data Engineer

Location: Krakow, Poland (onsite)

Duration: 6 months initially

Rate: 400 Euros/day

For performing data collection, processing, storage and integration. Proficiency in data Extract-Transform-Load (ETL) processes, data pipeline, database and data warehouse technologies on AWS cloud are required. Prior experience with timeseries and unstructured (eg, image) data is essential.

Job Description:

• Overall, 5-8 years' experience with expertise in performing data collection, processing, storage and integration.
• Designing and building ETL Pipelines using AWS Glue/Pyspark and familiar with ETL processes
• Standardizing code across all workflows to maintain consistency and scalability.
• Loading initial data into the required workflows and validating data integrity. Conducting unit tests on all converted jobs to ensure accuracy and reliability.
• Implementing a layered architecture in AWS and Snowflake for efficient data consumption.
• Creating comprehensive mapping documents for all existing processes and assets.
• Experience in processing all timeseries and Structured/Unstructured data to support ongoing Data requirements
• Developing additional views and logic to supplement reporting requirements.
• Deploying solutions to QA/UAT environments and providing support for Production migration.
• Knowledge of CICD pipelines and Jenkins.
• Proficient in architecture principles, design patterns, and best practices.
• Hands-on experience with cloud platforms (eg, AWS) and related services(AWS Glue, AWS Athena, AWS Lambda, AWS Devops, AWS CloudWatch, AWS S3, Event Bridge).
• Proficiency in PySpark, Python and Snowflake.

If this sounds like something you'd be interested in, please apply with your latest CV, rate and availability, for immediate consideration.

Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law.

Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.

By applying for this role your details will be submitted to Modis International Ltd and/or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.