Udemy

Senior Staff Software Engineer, Data Platform

Chennai, India
Scala Python Spark Streaming SQL AWS Kafka Java
Description

About us

At Udemy, we’re on a mission to transform lives through learning. We’re a leading online skills marketplace and learning platform, serving more than 69 million learners and 15,700 organizations globally. Our goal is to provide flexible and effective skill development, empowering individuals and organizations to keep pace with innovation and prepare for the future of work.

We believe that talented people are everywhere, but oftentimes, those dream opportunities are hard to come by. That’s why we’re focused on revolutionizing learning, leveraging the deep expertise of Udemy’s 75,000 instructors and the power of our platform, to help individuals sharpen their skills and harness their full potential.

About you 

You’re an analytical problem-solver ready to put your skills toward purposeful work that has a global impact. You want to lead the way in innovation, exploring the latest technologies and finding new solutions. You thrive in a collaborative environment and are eager to work with and learn alongside the best in Product, Design, and Engineering.

About this role 

Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy’s groundbreaking AI, ML, and data products? Udemy’s Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing online education.

We are building highly available, scalable data infrastructure, services, tools, and libraries to serve critical data discovery, ML/data pipeline development & deployment, data security & compliance, and self-healing data operation needs.

What you'll be doing

  • Design, build, enhance, and support self-service data infrastructure as a platform, which would be used for Udemy’s data mesh.
  • Build robust, scalable, cloud-native, cost-optimized real-time and batch data integration pipelines in AWS with Airflow, Kafka, Databricks, Delta Lake, AWS services like S3, EMR, Athena, RDS, Redshift, EKS, etc., and Snowflake.
  • Contribute towards Udemy's comprehensive data quality initiatives like data contracts, data validation, observability, and alerting
  • Support data platform privacy with RBAC and encryption
  • On-call rotation business hours

What you’ll have

  • 8+ years of experience in building distributed systems with Java, Scala, or Python
  • 5+ years of experience managing big data platforms with storage (AWS S3), compute (AWS EMR or Databricks with Spark, AWS Athena or Presto), data warehouses (Redshift or Snowflake), streaming (Kafka or AWS Kinesis)
  • 5+ years of experience in agile development methodologies & test-driven development (TDD)
  • 5+ years of experience building and maintaining resilient real-time & batch data pipelines.
  • Experience in building or using any one of the data quality tools (in-house built, SODA SQL, Anomalo, Monte Carlo, Great Expectations, or any other)
  • Expertise in cloud data privacy tools in the area of authentication (AWS IAM/OKTA), encryption (AWS KMS/Safenet), authorization (Apache Ranger/Privacera)
  • Strong grasp of object-oriented design patterns, algorithms, and data structures

We understand that not everyone will match each of the above qualifications. However, we also realize that everyone has unique experiences that can add value to our company. Even if you think your background might not perfectly align, we'd love to hear from you!

Life at Udemy

We aspire to be as vibrant and dynamic as the communities we serve, as inquisitive as those who use our platform, and as revolutionary as the future we strive to open for everyone. Here are some of the things we love about life at Udemy:

We’re invested in creating an inclusive environment that welcomes a diverse range of backgrounds and experiences. From creating employee resource groups, ensuring we’re a Fair Pay Workplace, and building a flexible work culture, our belonging, equity, diversity, and inclusion (BEDI) initiatives always put our people first. We want you to be able to bring your authentic self to work because when we all do, we’re better for it.

  • Learning is what we do – inside and out. Our Learning & Development team is second to none, helping ensure your journey is one of continuous progression. You’ll also have unlimited access to Udemy courses, monthly UDays (meeting-free professional development days), and a generous annual professional development stipend.

  • Our reason to exist is to revolutionize learning – that calls for taking risks and learning from failures. Whether it’s our hackathons (a company-wide effort to envision new possibilities for our product) or sharing our prototypes, we see experimentation as a crucial step on the path to success.

  • We’re committed to creating world-class employee experiences and are proud of the recognition of this by Great Place to Work. 

Of course, the best thing about being part of Udemy is knowing your work makes a difference for people and organizations around the world. You’ve got the skills; why not use them to help others develop theirs?

At Udemy, we value diversity and inclusion and consider qualified applicants without regard to race, color, religion, sex, national origin, ancestry, age, genetic information, sexual orientation, gender identity, marital or family status, veteran status, medical condition, or disability. 

Our Benefits Start With U

Our benefits package at Udemy “starts with U” and is grounded in mission-driven benefits that intentionally align with our core values. Here’s a sneak peek at just a few highlighted benefits if you’re a full-time Udemate based in the India:

  • Core Benefits: Comprehensive medical, life and income protection coverage

  • Parental Benefits: Financial assistance for fertility (including egg-freezing), adoption, and surrogacy expenses; twelve weeks of paid family bonding for birth, surrogacy, adoption, and foster placement. 26 weeks paid maternity leave for birthing parents as well as a two-week “ease-back” program that enables parents to return part-time at full pay

  • Whole U: Fully paid memberships for meditation/mindfulness, therapy/coaching visits, financial planning, fertility and family building, maternity and newborn care, parenting and pediatrics, menopause care, breastmilk shipping, and caregiving support

  • Learning: Free access to Udemy and Udemy Business plus a yearly stipend to spend on professional development

  • Retirement: 12% of your base salary or INR 1,800 per month

  • Charitable Giving: Corporate charitable match for eligible nonprofits and charities

  • Holidays: 25 paid holidays throughout the year plus bank holidays

About our APAC region 

When you join Udemy in our Asia Pacific (APAC) region, you’ll have the chance to help our globally established business grow locally. We have a solid foundation and a great reputation — and you can be part of the next stage of our journey.

Our investment in the region is significant, with offices in Australia and India and an expanding presence in Singapore, Indonesia, Japan, and beyond. It comes with countless opportunities to make learning more accessible to millions. You’ll work with various cultures with unique needs, affording you the chance to learn and progress in your career. And that progression doesn’t come at the cost of work-life balance; people are at the heart of our mission, which is why we’re committed to looking after ours. 

Information regarding data privacy is available within the Udemy Careers Privacy Notice.

 

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

50,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 264 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

Cancel anytime / Money-back guarantee

Wall of love from fellow engineers