eBay

Data Engineer

Dublin, Ireland Remote Hybrid
Spark SQL Streaming Scala Python Hadoop Shell Java Kafka
Description

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

Data Engineer

About the team and the role:

We are looking for a Data Engineer (location Dublin, Ireland) to join the Cloud Data Technology team based in Dublin.


We are part of the Data and Metrics team at eBay, tasked with managing data within the Data Warehouse (DWH) for the Customer Support applications. Our team utilizes various tools(third party, open source) in creating and integrating data from these systems. We manage over 800 tables in the DWH. Our approach is distinctive, as we continuously seek to improve our platform, thereby enhancing our ability to drive business opportunities. We embrace rapid experimentation, learning from our failures, and swiftly iterating based on these learnings.

What you will accomplish:

Architectural Leadership: Design and enhance our data architecture to support real-time and batch processing with a focus on scalability and fault tolerance using Kafka, Flink, and lakehouse principles.

Data Managemnet: Classify data according to its sensitivity and importance. Establishing clear classification guidelines helps in managing data access and ensuring compliance with regulatory requirements.

Pipeline Automation: Develop and maintain automated data pipelines that ensure efficient data flow and processing from multiple sources to our lakehouse architecture.

Cross-functional Collaboration: Work closely with data scientists, business analysts, and other engineering teams to define and refine requirements that drive data solutions.

Innovation and Research: Stay abreast of the latest industry developments in data engineering and propose adoption of new technologies or methodologies to keep our data infrastructure ahead of the curve.

What you will bring:  

  • Design, build, and maintain scalable data pipelines using Python, Apache Spark, Hadoop, Unix Shell Scripting and SQL.

  • Extensive experience in working with Python, SQL and Unix Shell scripting

  • Proficiency in Hadoop ecosystem such as Hive, Iceberg, Spark.

  • Proven ability to Develop and optimize ETL processes to support data integration and analytics.

  • Good to have experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.

  • Nice to have experience in Java and scala programming (not Mandatory)

  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.

  • Ensure data quality and integrity through robust monitoring and validation processes.

  • Excellent Troubleshooting skills to resolve data-related issues in a timely manner.

#LI-AZ1

#LI-Hybrid

Please see the Talent Privacy Notice for information regarding how eBay handles your personal data collected when you use the eBay Careers website or apply for a job with eBay.

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at talent@ebay.com. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.

 

This website uses cookies to enhance your experience. By continuing to browse the site, you agree to our use of cookies. Visit our Privacy Center for more information.

eBay
eBay
Auctions E-Commerce Internet Marketplace Retail

0 applies

0 views

Other Jobs from eBay

Senior Staff Engineer

Remote Toronto, Ontario

Manager, Software Development

Remote Toronto, Ontario

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say