echojobs.io
Login

Octopus Energy

Senior Data Engineer - KrakenFlex

UK Remote Hybrid
AWS Spark SQL DynamoDB Terraform Microservices API Python
Search for More Jobs
Description
Help us use technology to make a big green dent in the universe!

Kraken powers some of the most innovative global developments in energy.

We’re a technology company focused on creating a smart, sustainable energy system. From optimising renewable generation, creating a more intelligent grid and enabling utilities to provide excellent customer experiences, our operating system for energy is transforming the industry around the world in a way that benefits everyone.

It’s a really exciting time in energy. Help us make a real impact on shaping a better, more sustainable future.

KrakenFlex

The energy industry is undergoing the largest transformation since industrialisation at an unprecedented rate of change and we are positioning ourselves to be at the heart of that change. 

Our aim is to be the leading global provider of solutions that enable customers to release £30bn of value per annum from distributed energy resources (DERs). We are building a Software as a Service (SaaS) subscription business with a global addressable market of £2.4 billion per annum, by digitally connecting hundreds of thousands of DERs with energy markets.

We have already attained a market leading position and KrakenFlex is a recognised thought leader and innovator in the industry. Our efforts have not gone unnoticed and we are pleased to announce that we now have the full support and backing of Octopus Energy, an award-winning UK energy supplier who share our passion and values.

As we enter the stage of rapid commercialisation and customer account growth, we have a number of exciting new offerings to launch to customers. We’re looking for an exceptional person to help us continuously deliver features that provide value to our customers. Our ideal engineer would be an individual who loves to engage with interesting software problems, with an interest in data related development and the passion to build and shape the future within a collaborative, community-based environment. We operate a highly agile development approach, giving wide scope to be involved with hands-on system-design, test driven development, deployment and operations.

Our data sources and problems are many and varied.  We have some simple but high throughput data sources (e.g. over 5,000,000,000 rows a day and growing rapidly), complex unstructured and semi structured data and complex application data from our various microservices.

Our aim is to allow our business and our customers to answer increasingly complex questions, and gain new insights, based on our data, additional external data, and things we can learn and models we can extract from our data.  


What you'll do

  • Build and maintain data pipelines that deliver key data and insights to the business and our customers
  • Advocate for best data practices throughout the organisation
  • Integrate new data sources into the data platform through APIs, CDC or bulk data transfer
  • Build and maintain testing and documentation frameworks for our data sources
  • Work with the business to scope and deliver new data engineering projects and requirements
  • Maintain and build on our existing data infrastructure and tools
  • Support the internationalisation of our data infrastructure as we continue to grow globally
  • Contribute to the software engineering and data engineering culture here at Kraken
  • Collaborate regularly with colleagues with many different professional specialities, including software engineers and data scientists, to create innovative solutions that delight our customers and colleagues
  • Work as part of a globally distributed team of engineers, regularly seeking feedback and growing your skills as technical professionals.

What you'll need

  • In depth industry experience in a data engineering capacity
  • Experience in Python
  • Experience with data processing and/or analytics technologies e.g. Databricks, dbt, AWS Glue, Spark, Airflow, Redshift, SQL, Parquet/delta (don’t worry, we don’t expect or want you to have them all, and experience with other technologies doing the same jobs is also interesting).
  • Industry experience in software development & design
  • A drive to get things done in a collaborative, agile development environment
  • An interest in working with large data sets, both processing and analysing, and building data products for our customers
  • A proven ability to perform and communicate well in a fast-paced environment
  • Excellent analytical and multitasking skills

It would be great if you had

  • Experience with BI and/or Analytics tools, e.g. Athena, Tableau, Quicksight
  • Experience working with data lakes and data at scale
  • Experience migrating data between platforms at scale
  • Experience with AWS or similar cloud providers, and serverless technologies e.g. AWS Lambda, Kinesis, DynamoDB, API Gateway 
  • Experience developing, securing or operating cloud scale applications or infrastructure; ideally terraform or cloudformation
  • Experience working with a team distributed across multiple continents and timezones

Why else you'll love it here

  • Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
  • Octopus Energy is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people 
  • Visit our perks hub - Octopus Employee Benefits
If this sounds like you then we'd love to hear from you.

Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential. Need any specific accommodations? Whether you require specific accommodations or have a unique preference, let us know, and we'll do what we can to customise your interview process for comfort and maximum magic!

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.
Octopus Energy
Octopus Energy
Energy Energy Efficiency GreenTech Renewable Energy

0 applies

1 views

Other Jobs from Octopus Energy

Senior/Mid Software Engineer 🇦🇺 (Java/AWS)

Melbourne, Australia Remote Hybrid

Backend Developer - Utilities

London, UK Remote Hybrid

Senior Backend Software Engineer (m/w/d)

Berlin, Germany Munich, Germany

Similar Jobs

GoLang Developer

Bengaluru, India

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say