Big Data Platform Engineer, AI Agent Platform
Location: Singapore, Singapore
Department: Engineering
Who We Are
About the role:
We are building the foundational data infrastructure that powers one of the world's leading crypto exchanges. As a Big Data Platform Engineer, you will design, build, and evolve the core platform services that enable hundreds of data engineers and analysts to move fast and ship reliable pipelines. You will be at the forefront of our AI agent initiative — embedding LLM-driven capabilities directly into the platform layer so that scheduling, cost optimization, and incident response increasingly run autonomously
Responsibilities:
-
Platform Core: Design and operate large-scale distributed data systems
- Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark)
- Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy
- Drive reliability and performance improvements across batch and real-time pipelines
-
AI Integration: Build the AI-native platform layer
- Develop and expose MCP (Model Context Protocol) tool interfaces so AI agents can interact with platform APIs
- Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity
- Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection
- Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases
-
Tooling & DX: Evolve the developer experience
- Own the internal data development platform — IDE integrations, code review automation, deployment tooling
- Build APIs-first tools (backfill, ingestion automation) designed for future MCP integration
- Collaborate with data warehouse and service teams to define platform contracts
-
Ops & Governance: Drive operational excellence
- Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets
- Build automated incident response and root-cause analysis pipelines
- Define and enforce infrastructure policies across multi-cloud environments
Requirements:
-
5+ years of experience building large-scale data platforms (Hadoop/Spark/Flink or equivalent)
-
Deep expertise in distributed storage and compute systems (MaxCompute, Hologres, ClickHouse, Hive)
-
Strong software engineering skills in Java, Scala, or Python; experience with API-first design
-
Hands-on experience with task scheduling systems (Airflow, DolphinScheduler, or in-house equivalents)
-
Solid understanding of multi-cloud architectures and cost governance
-
Familiarity with LLM integration patterns: tool calling, RAG pipelines, context management
- Experience with MCP or similar agent-tool frameworks is a strong plus
- Passion for building systems that make other engineers 10x more productive
Preferred Qualifications:
-
IELTS score of 7 or above in all four components.
-
3+ years of work experience in English-speaking regions.
-
Experience in cross border e-commerce, and familiarity with multi-country, multi-language architectural design is a plus.
Perks & Benefits:
-
Competitive total compensation package
-
L&D programs and Education subsidy for employees' growth and development
-
Various team building programs and company events
-
Wellness and meal allowances
-
Comprehensive healthcare schemes for employees and dependants
-
More that we love to tell you along the process!
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
