Description
Senior Data Engineer (Big Data Processing)
Team: Data Engineering
Location: Singapore, Singapore
Commitment: Full-time
Workplace Type: onsite
CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented senior data engineers to lead and build mission-critical products that identify, analyse and investigate threats.
Role
- As a senior data engineer in a team that is responsible for mission-critical data analytics systems, you will contribute to the development and maintenance of high-performance data pipelines and systems related to national security. You will be involved in complex technical projects to collect, parse and process large datasets with the aim to turn them into useful information and insights. Join us to seize the opportunity to use cutting-edge technologies to protect the nation.
Responsibilities
- Design and build data pipelines that are scalable, robust and maintainable to ingest crucial data using cutting-edge platforms and technologies
- Work with product managers, engineering managers and key stakeholders to deliver impactful data products that meet our business needs
- Optimise performance of large-scale data pipelines for low-latency, high-throughput and reliability
- Ensure data integrity, quality and governance through robust design and operational monitoring
- Troubleshoot and resolve complex issues in critical data pipelines
- Implement best practices in data engineer, including testing, orchestration and monitoring of data pipelines
- Lead technical discussions with the team and key stakeholders to shape the future of our data products
- Mentor junior data engineers and contribute to building a strong data engineering culture within the team
Requirements
- Background in computer science or equivalent
- 5+ years of experience in data engineering, with a strong focus on building large-scale data pipelines
- Proven experience in writing optimised ETL code to handle large datasets
- Proficient in programming languages such as Scala or Java
- Familiarity with the following technologies: Spark, Kafka, Hadoop, Elastic stack, Kudu
- Strong understanding of modern data architectures and data modelling paradigms
- Able to communicate technical details effectively and clearly
- Good interpersonal, analytical and problem-solving sklils to get things done in a dynamic environment
Why join us?
- The work is purposeful and meaningful
- You will get to work with talented and driven people
- We work with modern technologies and tech stacks
- We have excellent engineering culture and work-life balance
- We aspire for engineering and operational excellence
- We empower to innovate
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say