echojobs.io
Login

Octopus Energy

Platform Engineer - Data 🇦🇺

Melbourne, Australia Remote Hybrid
Spark PostgreSQL Streaming Docker Kubernetes Python AWS Terraform Git
Search for More Jobs Talk to a recruiter now 💪
Description
About Octopus Energy and Kraken

Since 2016, Octopus has been on a mission to bring affordable, green energy to the world. With the help of our in-house developed technology platform, Kraken, we’ve become the largest energy supplier in the UK, opened retailers in 7 other countries, and licensed our software to retail giants including E.ON in the UK and Origin Energy in Australia. We’ve reinvented energy products with smart, data-driven tariffs to balance customer demand with renewable generation - and we’re the biggest investor in renewable generation in the UK.

We've since expanded our tentacles and we are now looking for a Platform Engineer, based in Melbourne. We're looking for someone with a general interest in technology and problem-solving; someone diligent and thoughtful. Working with Kraken is a chance to join an exciting scale-up business within the energy supply sector, one that’s at the forefront of changing the landscape of the energy industry across the world. A role with us offers you the chance to contribute to building world-class operations that will catapult you into a fantastic career.

Our team
At Kraken we have developed a platform to provide data services to our retail businesses and clients across 22 deployments globally.

The data platform engineering team develops and manages the back-end systems and processes supporting this platform, predominantly working with time-series data fed into the system by our customers’ smart metres. We have developed a suite of applications to process, transform, and make this data available to downstream services.

To process the volume of data we typically see, our applications run PySpark or dbt jobs using Databricks as our Spark engine. We also leverage Airflow and Kubernetes heavily. We also employ software engineering best practices to design, test, and deploy our data platform and services.

For our stack we use…
Python as our main programming language
Terraform for our infrastructure definition
Kubernetes for data services and task orchestration
Helm for deploying and managing kubernetes apps
Airflow for job scheduling and tracking
Circle CI / Github Actions for continuous deployment
Parquet and Delta file formats on S3 for data lake storage
Postgres / aurora for our relational databases
Spark / Databricks for data processing
dbt for data modelling
SparkSQL for analytics
Streamlit for data applications
Git for version control

What you'll do...

  • We are hiring a Platform engineer to support the operation and maintenance of our data infrastructure. We are constantly growing and our current goal is to be able to deploy a new data platform end-to-end in a working week.
  • We are looking for someone who can support and contribute to that, is able to self-direct as well as working asynchronously across global product teams to ensure that best practice is followed in everything we build, deploy, and deliver
  • First and foremost, we want our platform engineers to have a passion for writing high quality code and building lean processes. We are a team of passionate and opinionated engineers working to build robust and reusable systems.

About you

  • We are looking for a candidate who will self-manage, adapt to our changing business requirements, and proactively work to scope problems and deliver pragmatic solutions. As well as growing our core functionality, maintenance of existing client infrastructure will be required.

  • Ideally you will have experience working with…
  • AWS
  • Terraform
  • CDC systems (DMS, Debezium etc.)
  • Kubernetes (EKS)
  • Python
  • CI/CD systems (CircleCI/Github Actions)
  • Version control (Git)

    • Additionally it would be useful to have….
  • Experience working with, managing, or tuning Postgres or similar DBs
  • An interest in or experience with data or network security
  • Experience with building repeatable and reusable patterns for deployment
  • Experience with maintaining and uplifting capabilities of existing infrastructure
  • Experience in identifying and resolving issues with critical batch and/or streaming processes
  • Experience with supporting colleagues on DevOps related queries/requests
  • Experience with other elements of our stack
  • Airflow
  • Jupyter
  • Spark/Databricks
  • Helm
  • Docker

What you will love about us

  • Our company culture - We are organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people.
  • Flexible working environment - genuine work life balance here, we are in the top 5 companies in the UK, we treat you as a human, and do our best to make work and life merge smoothly together 
  • Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success 
  • Office - have a certain tech requirement? We’ll do our best to get it. We also have drinks, snacks and a coffee machine at the WeWork office space.
  • Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you 
Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.
Octopus Energy
Octopus Energy
Energy Energy Efficiency GreenTech Renewable Energy

0 applies

40 views

Jobs from our Partners

Other Jobs from Octopus Energy

Senior Data Engineer

Tokyo, Japan Remote Hybrid

Software Project Manager (H/F/X)

Paris, France Remote Hybrid

Similar Jobs

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 320 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

Cancel anytime / Money-back guarantee

Wall of love from fellow engineers