Senior Software Engineer, Data Platform (L3)
Team: Software Engineering
Location: Malaysia
Commitment: Full-time
Workplace Type: remote
What You Will Be Doing
- Data Pipeline Development: Design, build, and maintain scalable data pipelines that process high-volume, multi-source data feeds. Implement robust data models using star schema and dimensional modeling techniques to ensure data consistency, accuracy, and accessibility across the organization.
- Data Architecture & Infrastructure: Own end-to-end data infrastructure including pipeline orchestration, data warehousing, and OLAP systems. Manage cloud-based deployments and ensure optimal performance, cost efficiency, and reliability of data processing systems.
- Data Quality Management: Establish and maintain comprehensive data quality frameworks including automated validation, monitoring, and remediation processes. Define and track data quality KPIs and implement systematic approaches to data governance and lineage. Continuously monitor and optimize data pipeline performance, reducing latency, costs, and complexity while maintaining data integrity and reliability.
- Technical Leadership: Provide code reviews, technical direction, and mentorship to junior team members. Contribute to architectural decisions and drive adoption of data engineering best practices across the organization.
- Documentation & Knowledge Sharing: Create and maintain comprehensive technical documentation, contribute to team knowledge bases, and participate in cross-functional learning initiatives.
- Incident Response: Lead troubleshooting efforts for data-related issues, participate in post-mortems, and implement preventive measures to improve system reliability.
- Sharpen the Saw: Stay up-to-date with emerging trends and technologies to propose improvements and proof-of-concepts in technical roadmaps. Be a subject matter expert in multiple parts of the technological stack. Take initiatives and support upskilling activities within the team.
- Team Player: Partner with data analysts, product managers, and business stakeholders to translate requirements into scalable technical solutions. Provide technical guidance on data methodology and contribute to strategic data product initiatives.
- Coaching: Provide feedback on the performance of junior staff and participate in people development initiatives.
- Support any ad hoc tasks as required by the company.
What We Look For In You
- Proven Track Record: 5-8 years of data engineering experience with proven track record in building production-scale ETL/ELT pipelines, data warehousing, and analytics infrastructure to produce B2B and B2C data products.
- Education: Bachelor's degree in Computer Science, Data Engineering, Software Engineering, or related technical field, or equivalent professional experience.
- Technical Proficiency: Professional experience with cloud data warehouses (ClickHouse, BigQuery, Snowflake, Redshift), Python and common libraries (pandas, dask, pyarrow, pytest), workflow orchestration tools (Dagster, Airflow, or similar), stream processing technologies (Kafka, Flink, or similar). Knowledge of data modeling, dimensional modeling, and schema design principles.
- Infrastructure & DevOps: Experience managing cloud infrastructure, containerization, and CI/CD pipelines for data applications. Comfortable with infrastructure as code and deployment automation.
- People Skills: Excellent communicator who is able to build positive working relationships within the team and externally. Contributes thought leadership outside of day-to-day work.
- Leadership: Self-motivated and able to work independently with minimal supervision. Has a strong sense of shared leadership and values over all team members. Is curious & creative on finding ways to improve existing projects & workflows.
- Scope of Work: Works effectively in open-ended projects, where some, but not all, key results are clearly defined. Fully capable of taking substantial features from concept to shipping as a sole contributor.
- Problem Solving: Demonstrated ability to provide multiple solutions to complex problems, using sound judgment and arguments to present a well-structured, informed narrative.
- Nice to have:
- // Experience working in an early-to-growth stage startup.
- // Experience building applications in different tech stacks.
- // Keen interest in decentralized technologies and its applications including cryptocurrencies.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
