Description
The Energy Markets team at Octopus Energy is responsible for making sure that we always have the electricity and gas we need to support our customer demand whilst also supporting the grid to enable the Net Zero transition.
To achieve this mission across all Octopus international regions, we have sub-teams focused on forecasting energy demand and generation, hedging and shaping our trade position, tracking and reporting the ongoing risk to Octopus, and driving the proportion of our supply directly from generators via PPA agreements.
The Engineering sub-team owns our global technical platform that supports these different processes and drives forward long-term solutions to enhance Group capabilities.
We are looking for a Data Engineer to help achieve this goal - ideally someone who is comfortable diving into different tasks to support each team using a variety of coding languages across our platform setup, who enjoys developing relationships across the company while explaining technical processes in the most appropriate way, and who keeps an eye on scalable solutions to support data growth.
This is therefore an exciting opportunity to take on a role that combines complex data engineering, visual analytics and business critical need.
What you'll do...
- Supporting different Energy Markets teams to design and build key operational and reporting pipelines across all Octopus Energy regions;
- Taking responsibility for the maintenance of these critical data pipelines supporting core trading, forecasting, risk and PPA processes;
- Developing automations and alerts to quickly debug where these pipelines are failing or showing unprecedented trends;
- Setting up and maintaining processes for capturing, preparing and loading valuable new data into the data lake;
- Designing and building dashboards that cover operational processes and reporting requirements;
- Working with international teams across the Octopus Energy Group to ensure everyone shares the best possible practises and code is standardised where possible;
- Taking ownership of data platform improvements that enhance the capabilities for all Energy Markets teams and drives trust in the stability of the setup;
- Sharing, enhancing and upskilling team members on available tools and best practices.
What you'll need...
- Strong aptitude with SQL, Python and Airflow;
- Experience in kubernetes, docker, django, Spark and related monitoring tools for devops a big plus (e.g. Grafana, Prometheus);
- Experience with dbt for pipeline modelling also beneficial;
- Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them;
- Able to quickly understand new domain areas and visualise data effectively;
- Team player excited at the idea of ownership across lots of different projects and tools;Passion for driving towards Net Zero;
- Drives knowledge sharing and documentation for a more effective platform;
- Open to travelling to Octopus offices across Europe and the US.
Our Data Stack:
- SQL-based pipelines built with dbt on Databricks
- Analysis via Python jupyter notebooks
- Pyspark in Databricks workflows for heavy lifting
- Streamlit and Python for dashboarding
- Airflow DAGs with Python for ETL running on kubernetes and docker
- Django for custom app/database development
- Kubernetes for container management, with Grafana/Prometheus for monitoring
- Hugo/Markdown for data documentation
Why else you'll love it here:
- Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
- Octopus Energy is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership
- Visit our UK perks hub - Octopus Employee Benefits
Other Jobs from Octopus Energy
Data Analyst
Milan, Italy
Remote Hybrid
Operations Data Analyst
Europe
Lead Mobile Engineer
Remote
London, UK
Global Head of Data Engineering
London, UK
Remote Hybrid
Frontend Engineer II - Flexibility
London, UK
Remote Hybrid
Similar Jobs
Sr. Software Engineer - Data Assets
Remote
San Francisco, CA
Data Engineer - #1696
Remote
US
Senior Software Engineer II
Warsaw, Poland
Principal Member of technical Staff- AI & Data Engineering
Remote
Chennai, India
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
