Data Engineering Lead

David Kennedy Recruitment is working with a leading tech outsourcing company that is looking to recruit a Data Engineering Lead to join their team in Dublin, Ireland.

Position: Data Engineering Lead

Location: Onsite - Dublin, Ireland 

Employment type: Full-time

Remuneration: Competitive package.

DUTIES AND RESPONSIBILITIES:

• Lead the design, development, and implementation of scalable data engineering solutions

• Build and optimise large-scale data pipelines for analytics and machine learning use cases

• Design and maintain reusable, high-performance data products and frameworks

• Integrate data from multiple structured and unstructured sources into unified platforms

• Drive automation across data engineering and data science workflows

• Define and evolve data architecture to support scalability, reliability, and performance

• Identify opportunities to simplify complex systems and improve platform efficiency

• Ensure best practices in engineering design, coding standards, and system reliability

• Collaborate on the design of distributed systems and cloud-based data platforms

• Work closely with Data Scientists, Product Managers, and Engineering teams

• Translate business requirements into scalable technical solutions

• Support cross-functional delivery of data-driven products and services

• Communicate technical concepts effectively to both technical and non-technical stakeholders

• Lead and mentor data engineers across projects and squads

• Provide technical guidance and support engineering capability development

• Contribute to team growth and engineering excellence across the organisation

• Promote agile delivery and collaborative engineering practices

• Develop and maintain robust ETL/ELT pipelines

• Optimise performance of data processing systems and workflows

• Ensure data quality, reliability, and consistency across platforms

• Support production-grade deployment of data engineering solutions.

REQUIREMENTS:

• 8+ years of experience in Data Engineering or Big Data environments

• Strong experience with Python, Scala, or Java

• Hands-on experience with Apache Spark / PySpark

• Strong experience with Databrick

• Experience with Hadoop ecosystem (Hive, Impala, Oozie, Sqoop, NiFi)

• Strong SQL skills and experience with relational and NoSQL databases

• Experience building and maintaining large-scale data pipelines

• Strong understanding of distributed systems and data architecture principles

• Experience working in Agile engineering environments

• Proven experience leading technical initiatives or engineering teams

• Degree in Computer Science, Software Engineering, or related field

• Experience with cloud-native data engineering platforms/Cloud experience (AWS or Azure).

BENEFITS:

• Competitive salary package aligned to senior data engineering market

• Opportunity to work on enterprise-scale payment technology platforms

• Exposure to cutting-edge Big Data, cloud, and analytics ecosystems

• Leadership opportunity within a global engineering organisation

• Career progression within a major international technology environment

• Work on high-impact data platforms powering analytics and AI solutions

• Guidance and tools to reach career potential.