Data Integration Engineer

Main Purpose:

As a highly experienced Data Engineer in our Digital Transformation Team, you will play a crucial role in developing advanced data abstraction layers to facilitate seamless integration between legacy trading systems (built on WPF, Oracle, Java) and our modern AWS-based data and analytics stack. Your expertise will drive the successful transformation of our data infrastructure, furthering the use of advanced analytics and data-driven decision-making across the company. You will manage a specialist team of engineers and scientists in order to achieve your objectives.

Knowledge Skills and Abilities, Key Responsibilities:

Key Responsibilities:

• Develop abstraction layers to integrate disparate systems, ensuring data consistency, validity, traceability and accessibility for self-service by data scientists and analysts.
• Work closely with stakeholders to understand data requirements and translate business needs into well-structured technical specifications.
• Collaborate closely with our Trading Technology, Data Science and Cloud DevOps teams.
• Manage a small team of engineers / computer scientists / data scientists.

Abilities, Experience and Qualifications:

• Bachelor's degree in Software Engineering, Computer Science or a related field.
• Proven experience in enterprise scale data engineering.
• Expertise in working with legacy systems (Windows, Oracle, Java) and integrating them with cloud platforms, preferably AWS (S3, RDS, Lambda, Glue, Redshift).
• Proven experience with Object Relational Mapping systems (ORMs) and SOAP APIs.
• Strong programming skills in Java and Python.
• Familiarity with SQL and NoSQL databases, data modelling, and ETL processes.
• Knowledge of data warehousing principles and architectures.
• Experience with data governance and security.

• Experience in a Commodity Trading, Financial Markets or Logistics Management environment is desirable.

Competencies:

• Ability to solve difficult technical problems under pressure.
• Ability to communicate effectively with a diverse set of stakeholders across business lines and technologies.
• Understanding and experience implementing software engineering best practices.
• Ability to manage and prioritise your and other’s work.

Key Relationships and Department Overview:

• You will report to the head of the Strategic Systems Integration Team who reports to CIO and Chief Data Scientist.
• The Digital Transformation Team is a joint venture between Trading Technology and the Data Science and Engineering Team.