Data Engineer

Introduction

At Cambridge Consultants, we help our clients deliver new world-changing technology, with data driving much of this innovation. Undertaking ambitious projects for our clients, we need to be able to effectively manage, process, and transform data to deliver insight and solve challenging problems. We are looking to recruit a Data Engineer to work as part of our project delivery teams, designing and leading the implementation of data pipelines.

The role

As a Data Engineer at Cambridge Consultants, you will become part of a wider team of AI specialists in a cross-functional capability, and have the opportunity to work on projects across many of the market sectors we work in. For example, the systems you’ll be creating could be used to store images to improve medical diagnostic equipment, generate simulated network traffic to optimise a communications network, or use multi-modal data to predict and reduce energy consumption.

As a part of a consultancy business, our projects range widely in duration. We may deliver a report or “proof of concept” to a client in weeks, or spend months developing a system as part of a large multidisciplinary team. You are likely to experience a wide variety of work with different clients, with each project bringing unique requirements and the opportunity to learn and develop new techniques and approaches. You’ll be embedded in one of our AI groups, so will be involved in projects using data to develop cutting-edge Machine Learning models.  You’ll also be working alongside domain experts from other disciplines – bio-informatics, medical devices, communications and more.

Cambridge Consultants invests in its people, and we aim to provide a supportive environment where you can develop your career through training and mentoring alongside the experience gained working on client projects. Aside from project work, we have many in-house interest groups to share ideas and learn from. You’ll also have opportunities to propose and develop your own ideas through our Early Investment Program.

What you'll be doing

• Design and implementation of data pipelines, taking performance, and the requirements of niche workloads into consideration
• Help to develop and promote MLOps best practices, including experiment tracking, data validation and efficient resource utilisation
• Support conversations with clients to determine project requirements, and to explain the commercial benefits of our approach
• Provide technical input to project proposals, and work with Project Managers to plan and estimate tasks
• Participate in code review processes ensuring high quality software delivered by you and others
• Mentor and guide junior team members, assigning and reviewing tasks
• Support maintenance and development of cloud infrastructure (primarily AWS, but Azure and GCP also used depending on client requirements)

What you can bring

• A solid understanding of managing large datasets, structuring and optimising databases
• Experience of setting up automated MLOps pipelines using CI/CD
• Experience of configuring and using Kubeflow / Kubernetes or other workflow orchestration platforms.
• Excellent communication skills and the ability to coordinate with internal and client stakeholders
• Experience of writing high quality software in Python