dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.
Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world’s most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First.
dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola, Meijer, Procter & Gamble and Metro.
We are seeking a highly motivated and experienced Big Data Engineering Manager to lead the design, development, and delivery of robust, scalable data processing platforms. This leadership role involves overseeing the end-to-end execution of big data solutions while fostering innovation, ensuring high performance, and driving alignment with business goals. The ideal candidate will have a proven track record in managing technical teams, implementing distributed systems, and delivering high-quality big data architectures.
This leadership role within the Retail Media Platform is designed to address the evolving challenges of modern grocery retail. By unlocking new revenue streams, driving sales growth, and fostering stronger customer connections, this role is pivotal to shaping the future of retail media. Our team is committed to empowering brands and retailers to measure the impact of advertising across all channels with precision and efficiency, leveraging best-in-class dunnhumby customer data science to deliver seamless, data-driven insights.
Key Responsibilities
Platform Development & Delivery
- Architect and deliver scalable data processing platforms for batch and streaming workflows.
- Develop ETL pipelines, data ingestion frameworks, and data lake solutions.
- Optimize platforms for performance, reliability, and scalability in cloud and hybrid environments.
Collaboration & Stakeholder Engagement
- Partner with product, analytics, and business teams to define data platform needs.
- Act as the technical liaison between business goals and engineering execution.
Technical Expertise
- Build distributed data systems with tools like Spark, Flink, Kafka, and Hive.
- Ensure data platform designs meet security and compliance standards.
- Champion modern architecture practices, including serverless and event-driven designs.
Process & Quality Assurance
- Establish best practices for CI/CD, testing, and code reviews.
- Implement robust monitoring and observability frameworks.
Team Leadership & Management
- Lead and mentor a team of data engineers, fostering growth and performance.
- Cultivate a culture of innovation, collaboration, and excellence.
Innovation & Continuous Improvement
- Evaluate and integrate emerging technologies to enhance platform capabilities.
- Drive continuous improvement in engineering practices and infrastructure.
Skills & Qualifications
Must-Have Skills
- Leadership: Proven experience in scaling and managing data engineering teams.
- Big Data Tools: Hands-on expertise with Spark, Kafka, Hive, and Airflow.
- Cloud Platforms: Proficiency in GCP, AWS, or Azure for big data solutions.
- Data Architecture: Experience designing scalable, distributed data platforms.
- Programming: Advanced skills in Python, Java, or Scala.
- Processing Workflows: Expertise in building real-time and batch data pipelines.
- DevOps: Proficiency in CI/CD, Docker, Kubernetes, and Terraform.
- Data Governance: Understanding of frameworks like GDPR and CCPA.
- Problem Solving: Ability to tackle complex challenges with innovative solutions.
- Communication: Strong skills to align cross-functional stakeholders.
Nice-to-Have Skills
- Experience with ML Ops frameworks (e.g., Kubeflow, Vertex AI).
- Knowledge of metadata management and data cataloging tools.
- Familiarity with event-driven architectures and streaming frameworks.
- Expertise with cloud-native big data services like BigQuery, Redshift, or Snowflake.
What you can expect from us
We won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards package you’d expect from a leading technology company. But also, a degree of personal flexibility you might not expect. Plus, thoughtful perks, like flexible working hours and your birthday off.
You’ll also benefit from an investment in cutting-edge technology that reflects our global ambition. But with a nimble, small-business feel that gives you the freedom to play, experiment and learn.
And we don’t just talk about diversity and inclusion. We live it every day – with thriving networks including dh Gender Equality Network, dh Proud, dh Family, dh One and dh Thrive as the living proof. We want everyone to have the opportunity to shine and perform at your best throughout our recruitment process. Please let us know how we can make this process work best for you. For an informal and confidential chat please contact stephanie.winson@dunnhumby.com to discuss how we can meet your needs.
Our approach to Flexible Working
At dunnhumby, we value and respect difference and are committed to building an inclusive culture by creating an environment where you can balance a successful career with your commitments and interests outside of work.
We believe that you will do your best at work if you have a work / life balance. Some roles lend themselves to flexible options more than others, so if this is important to you please raise this with your recruiter, as we are open to discussing agile working opportunities during the hiring process.
For further information about how we collect and use your personal information please see our Privacy Notice which can be found (here)
0 applies
3 views
Other Jobs from dunnhumby
Senior Engineer
Senior Data Science Engineer
Lead Engineer
Senior Big Data Engineer
Similar Jobs
ML Engineer H/F
Staff Site Reliability Engineer - Cloud Engineering
Staff Engineer - Data Reliability Engineering (REMOTE)
Senior Streaming Engineer (GCP)
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 401 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say