Senior Data Engineer (PySpark-Python)
Location: Dubai, Dubai, United Arab Emirates
Workplace: on_site
Description
We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark and Python to join our team for a leading banking client in Dubai. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and data architectures to support advanced analytics and business intelligence initiatives.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Python
- Work with large-scale distributed systems (Hadoop/Spark ecosystem)
- Build and optimize ETL/ELT workflows for structured and unstructured data
- Collaborate with data scientists, analysts, and stakeholders to deliver data solutions
- Ensure data quality, integrity, and governance across platforms
- Implement performance tuning and optimization for Spark jobs
- Work with cloud-based data platforms (AWS / Azure / GCP) if applicable
- Develop and maintain data models, schemas, and metadata management
- Troubleshoot production issues and provide timely resolutions
Required Skills & Qualifications:
- 7 years of experience in Data Engineering
- Strong hands-on experience with PySpark and Python
- Solid understanding of Apache Spark, Hadoop ecosystem
- Experience in SQL, data warehousing, and data modeling
- Familiarity with ETL tools and big data processing frameworks
- Experience with cloud platforms (AWS / Azure / GCP) is a plus
- Knowledge of data pipelines orchestration tools (Airflow, etc.)
- Strong problem-solving and analytical skills
Preferred Qualifications:
- Experience in the Banking / Financial Services domain
- Exposure to real-time data processing (Kafka, Spark Streaming)
- Understanding of data governance and security practices
Soft Skills:
- Strong communication and stakeholder management skills
- Ability to work in a fast-paced, collaborative environment
- Proactive and solution-oriented mindset
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say