Backend/Data Engineer - Data Processing

What You'll Do

• You’ll collaborate with product and engineering to build and support the infrastructure that empowers Spotify teams to process data to tackle critical business needs
• Increase developer efficiency by building innovative tools that reduce overhead of working with data pipelines, help increase platform reliability, and are cost-efficient
• Work with engineers with deep expertise in data and collaborate closely with squads in Spotify to drive improvements in the data processing ecosystem through support, best-practices and standards
• Help scales the new platform to reach targets that ensure the painless and flawless migration of data pipelines from all across the company to the new stack
• You love working in an environment where you constantly experiment and iterate quickly and believe data is the most powerful tool for informed decision-making

Who You Are

• You are proficient in backend development using Java
• You are comfortable working with big data using SQL and data analytics platforms such as BigQuery
• You have experience with one or more higher-level JVM-based data processing frameworks such as Flink, Beam, Dataflow, Spark, etc.
• DevOps is part of your day-to-day work and you are used to working with cloud-based infrastructure and services, containerised applications
• You have some experience working with Kubernetes and are familiar with its basic concepts
• You have experience working with data engineering pipelines in Scala and/or Python
• Quality is important to you and you know what it means to ship high-quality code
• You appreciate agile software processes, and sound engineering practices like continuous delivery, defensive programming, and automated testing
• You love working in an environment where you experiment and iterate quickly. You are comfortable with ambiguity, enjoy working on open-ended problems, and believe data is the most powerful tool for informed decision-making!

Where You'll Be

• For this role you will be based in London, UK