Kpler

Junior Data Engineer

London, UK Remote Hybrid
Python Git Scala Kafka AWS SQL Streaming Kubernetes Machine Learning Pandas Docker Elasticsearch Terraform
Description
At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.

Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 600 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.


Kpler is seeking a talented and motivated, Junior Data engineer to join our Commodities Market Data team. This role The CMD team is responsible for the ingestion, filtering, enrichment, and distribution of externally sourced data. This data is coming from thousands of sources related to maritime trade, and is critical to the business processing entities in Kpler, so they can provide a live and accurate picture of the global trade to our customers.

Your mission

  • Get up to speed with our domain, working independently on some tasks, with support on more complex projects.
  • Working alongside other engineers, take responsibility for the development and implementation of our core data ingestion and distribution pipelines, and associated back-end systems based on project requirements and design specifications.
  • Help to troubleshoot and optimise existing workflows to improve performance and efficiency. Ensure data integrity and accuracy across various pipelines.
  • Demonstrate strong analytical and debugging skills with a proactive approach to learning.

You'll be a match if you

  • Are proficient in Python, or other scripting languages, with experience in data manipulation and transformation (such as with Pandas).
  • Are familiar with SQL, RDBMS or Big Data technologies.
  • Have knowledge of data integration, ETL processes, and batch/streaming data processing.
  • Are comfortable working with Git, code reviews, and Agile methodologies.
  • Have an understanding of containerisation and orchestration tools (e.g., Docker, Kubernetes, Airflow).
  • Are eager to learn new languages and technologies.

It will be even better if you

  • Have experience with Scala.
  • Are familiar with Machine Learning, especially with NLP.
  • Have worked with Kafka or other message-broker technologies.
  • Have exposure to Elasticsearch.
  • Have worked with AWS (or another cloud provider), using Terraform.
We are a dynamic company dedicated to nurturing connections and innovating solutions to tackle market challenges head-on. If you thrive on customer satisfaction and turning ideas into reality, then you’ve found your ideal destination. Are you ready to embark on this exciting journey with us?

We make things happen
We act decisively and with purpose, going the extra mile.

We build
together
We foster relationships and develop creative solutions to address market challenges.

We are here to help
We are accessible and supportive to colleagues and clients with a friendly approach.


Our People Pledge

Don’t meet every single requirement? Research shows that women and people of color are less likely than others to apply if they feel like they don’t match 100% of the job requirements. Don’t let the confidence gap stand in your way, we’d love to hear from you! We understand that experience comes in many different forms and are dedicated to adding new perspectives to the team.

Kpler is committed to providing a fair, inclusive and diverse work-environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer.



By applying, I confirm that I have read and accept the Staff Privacy Notice
Kpler
Kpler
Analytics Big Data Finance Image Recognition Information Technology Oil and Gas Predictive Analytics Software

0 applies

5 views

Other Jobs from Kpler

Internship - Data Science

Paris, France Remote Hybrid

Senior Data Analyst

Remote London, UK

Junior Full Stack Engineer

Singapore Remote Hybrid

Staff Backend Engineer

Germany Remote Hybrid

Senior Full Stack Engineer

Paris, France Remote Hybrid

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say

Sid avatar
Sid
Very nice portal for searching jobs in this rough market.
Mar 6, 2025
Michael Duran avatar
Michael Duran
Software Engineer
I've been using this job search site for a while now, and it’s honestly one of the best out there! The clean and easy-to-navigate UI makes the whole job-hunting process so much smoother. Plus, the job postings are always up-to-date, so I never feel like I’m wasting time. The cherry on top is the owner—super kind and always quick to respond. Definitely recommend checking it out if you're on the job hunt!
Aug 21, 2024
Sai avatar
Sai
It’s really great website for finding jobs based on skills it’s really helpful give a go
Aug 21, 2024
Adinadh avatar
Adinadh
What I like most about Echo Jobs is how easy it is to use. The platform helps me quickly find jobs that match my skills and interests, thanks to its great recommendations and filters. Yes, I would definitely recommend Echo Jobs to a friend. It makes job searching simple and efficient, making it a great tool for anyone looking for a new job.
Jul 23, 2024
As a student navigating the job market, I've found LinkedIn increasingly frustrating due to numerous fake postings by consultancies. In contrast, this job posting website has been a game-changer for me. It offers genuine opportunities and a straightforward application process, making it much easier to find and apply for real jobs. Highly recommend it to fellow students seeking reliable job listings!
Jul 16, 2024
Cliff Gor avatar
Echo Jobs has been exceptional in my job hunt where it provides one platform to job hunt and I don't have to open 10 websites just to look for a job. It has also helped me focus much on the job skill and the location filtering out the onsite jobs and remote ones. The only feature that I would request is to display fully remote jobs that are not restricted to a country since the one available shows ie, Remote, US yet. But if it could show remote only, that would be helpful not only to me but to other people applying for full remote and not tied to only US candidates
Apr 22, 2024
I found EchoJobs in 2022, and I love it. It has a lot of remote jobs. It's exclusive to software and technology jobs (helpful for devs like me). What I like the most are its filters and its API. If you're a tech professional seeking remote work, I highly recommend giving it a try to EchoJobs.
Mar 4, 2024
Would definitely recommend it! Excellent product, dedicated founder, Jobs are easier to find. Congrats 🎉 to the entire team!
Mar 3, 2024
Brandon Banks avatar
Brandon Banks
Echo Jobs is really impressive. It provides a great user experience with an ability to quickly search through the many job postings. There is an impressive amount of jobs here and it is quickly updated. The details in the each job posting is helpful when determining if it is worth pursuing. I would highly recommend using Echo Jobs to find the next step in your career.
Mar 2, 2024
Tyler Young avatar
Tyler Young
tylerayoung.com
Best wishes with EchoJobs—it's become my favorite job board overnight!
Dec 16, 2023
Simply put, it's the most up to date tech jobs aggregator I’ve found. I'm like... "I don't have to check 10+ jobs boards daily just to see if there's a new job listing? sign me up!" The filters are also quite helpful! The UI is very clean and straightforward. Love it!
Oct 5, 2023