Data Engineering Lead

Top TalentRecruitment is working with a leading tech outsourcing company that is looking to recruit a Data Engineering Lead to join their team in Dublin, Ireland.

Position: Data Engineering Lead

Location: Onsite - Dublin, Ireland

Employment type: Full-time

Remuneration: Competitive package.

DUTIES AND RESPONSIBILITIES

• Lead the design, development, and implementation of scalable data engineering solutions
• Build and optimise large-scale data pipelines for analytics and machine learning use cases
• Design and maintain reusable, high-performance data products and frameworks
• Integrate data from multiple structured and unstructured sources into unified platforms
• Drive automation across data engineering and data science workflows
• Define and evolve data architecture to support scalability, reliability, and performance
• Identify opportunities to simplify complex systems and improve platform efficiency
• Ensure best practices in engineering design, coding standards, and system reliability
• Collaborate on the design of distributed systems and cloud-based data platforms
• Work closely with Data Scientists, Product Managers, and Engineering teams
• Translate business requirements into scalable technical solutions
• Support cross-functional delivery of data-driven products and services
• Communicate technical concepts effectively to both technical and non-technical stakeholders
• Lead and mentor data engineers across projects and squads
• Provide technical guidance and support engineering capability development
• Contribute to team growth and engineering excellence across the organization
• Promote agile delivery and collaborative engineering practices
• Develop and maintain robust ETL/ELT pipelines
• Optimise performance of data processing systems and workflows
• Ensure data quality, reliability, and consistency across platforms
• Support production-grade deployment of data engineering solutions.

REQUIREMENTS

• 8+ years of experience in Data Engineering or Big Data environments
• Strong experience with Python, Scala, or Java
• Hands on experience with Apache Spark / PySpark
• Strong experience with Databricks
• Experience with Hadoop ecosystem (Hive, Impala, Oozie, Sqoop, NiFi)
• Strong SQL skills and experience with relational and NoSQL databases
• Experience building and maintaining large-scale data pipelines
• Strong understanding of distributed systems and data architecture principles
• Experience working in Agile engineering environments
• Proven experience leading technical initiatives or engineering teams
• Degree in Computer Science, Software Engineering, or related field
• Experience with cloud native data engineering platforms/Cloud experience (AWS or Azure).

BENEFITS

• Competitive salary package aligned to senior data engineering market
• Opportunity to work on enterprise scale payment technology platforms
• Exposure to cutting edge Big Data, cloud, and analytics ecosystems
• Leadership opportunity within a global engineering organization
• Career progression within a major international technology environment
• Work on high-impact data platforms powering analytics and AI solutions
• Guidance and tools to reach career potential.