Description
Senior Data Engineer (Big Data Platform)
Team: Data
Location: Hong Kong SAR
Commitment: Full-time
Workplace Type: onsite
At Lalamove, we believe in the power of community. Millions of drivers and customers use our technology every day to connect with one another and move things that matter. Delivery is what we do best and we ensure it is always fast and simple. Since 2013, we have tackled the logistics industry head on to find the most innovative solutions for the world’s delivery needs. We are full steam ahead to make Lalamove synonymous with delivery and on a mission to impact as many local communities we can. We have massively scaled our efforts across Asia and now have our sights on taking our best in class technology to the rest of the world. And we are looking for talented professionals to join us in this journey!!
As a Data Platform Engineer at Lalamove, you will be joining the growing Data Platform team to develop and enhance our data platform. The data platform is the centralised portal that enables engineers and analysts across the company to ingest, process, orchestrate, analyse, and visualize the data of our company. As part of the Data Engineering function, the team will design, develop, maintain, and scale the data platform, including the data infrastructure and data services, which provides the foundation to downstream use cases such as data warehousing, reporting, machine learning, analytics, data products etc.
What you’ll do:
- Lead the architecture design, technology selection, deployment, development, management, monitoring, and performance tuning of large-scale data platforms based on the Hadoop ecosystem. Ensure efficient and stable cluster operations and deliver robust architectures for data storage, query engines, real-time computing, and metadata management.
- Develop and maintain core system components, mentor engineers, and continuously optimize system performance and stability.
- Collaborate across teams and departments to analyze and resolve operational and data-related issues within the big data platform.
- Build industry-leading data systems that support fast-growing data businesses and large-scale production workloads.
What you’ll need:
- Bachelor’s degree or above with 3–8 years of experience in big data platform development or distributed system engineering.
- Solid Java foundation; familiar with SOA architecture and mainstream frameworks such as Spring Boot and Spring Cloud.
- Proficient with mainstream big data computing engines, including:
- Experience with data change capture (CDC) pipelines, including Alibaba Canal and Flink CDC, covering MySQL/PostgreSQL binlog parsing, schema evolution handling, watermarking, consistency guarantees, and integration with data lakes or downstream streaming systems.
- Strong familiarity with OLAP engines and the big data ecosystem, including Doris, ClickHouse, Druid, Kylin, Hive, HBase, Kafka, Elasticsearch, and MapReduce.
- Experience with lakehouse table formats such as Apache Iceberg and Apache Paimon, including metadata management, table optimization, partition pruning, compaction, and file layout tuning.
- Strong Mandarin communication skills for daily business communication and technical documentation.
Flink: Flink on Kubernetes, state management, Checkpoint/Savepoint, exactly-once semantics, unified batch/stream processing, Flink SQL/Table API, CEP, runtime internals, and Flink CDC for real-time incremental change data capture.
Spark: Spark on Kubernetes, Spark SQL/Streaming, Adaptive Query Execution (AQE), shuffle optimization, resource isolation, and dynamic allocation.
Hive on Tez: Tez DAG optimization, container reuse, auto-parallelism tuning, and Hive MR-to-Tez migration performance optimization.
To all candidates- Lalamove respects your privacy and is committed to protecting your personal data.
This Notice will inform you how we will use your personal data, explain your privacy rights and the protection you have by the law when you apply to join us. Please take time to read and understand this Notice. Candidate Privacy Notice: https://www.lalamove.com/en-hk/candidate-privacy-notice
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say