Senior Data Engineer
Location: Dubai, Dubai, United Arab Emirates
Workplace: on_site
Description
We are seeking a highly skilled Senior Data Engineer to join our Data Engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and enabling advanced analytics and machine learning use cases. This role requires strong expertise in big data technologies, data processing frameworks, and feature engineering to support ML models in a production environment.
Key Responsibilities
- Gather and analyze business and technical requirements for data solutions
- Perform Exploratory Data Analysis (EDA) to understand data patterns and quality
- Design, build, and maintain scalable and high-performance data pipelines
- Ingest structured and unstructured data from multiple sources
- Transform and process large datasets using PySpark and Python
- Implement feature engineering techniques for machine learning models
- Optimize Spark jobs for performance and cost efficiency
- Ensure data quality, integrity, and security across pipelines
- Collaborate with Data Scientists, Analytics Teams, and Delivery Leads
- Work in an Agile environment with cross-functional teams
- Communicate effectively with stakeholders and provide technical insights
- Maintain version control and CI/CD workflows using Git
Required Skills & Expertise
- Strong experience in Python and PySpark
- Hands-on expertise in Apache Spark (performance tuning & optimization)
- Solid knowledge of Hadoop ecosystem
- Advanced proficiency in SQL
- Experience in building end-to-end data pipelines and ML pipelines
- Strong understanding of data modeling and data warehousing concepts
- Experience with feature engineering for ML use cases
- Familiarity with Git and version control systems
- Exposure to cloud platforms (AWS/Azure/GCP) is a plus
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
- 8–10+ years of experience in Data Engineering / Big Data
- Prior experience working in banking or financial services is preferred
Soft Skills
- Strong problem-solving and analytical thinking
- Excellent communication and stakeholder management skills
- Ability to work independently and in a team environment
- Adaptability to fast-paced Agile workflows
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say