Big Data Engineer
Location: Karachi, Sindh, Pakistan
Job Title: Big Data Engineer
Expericence - 5 to 8 Years - CV with relevant skills will be contacted.
Role Purpose
The Big Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and distributed data processing systems. This role enables efficient data ingestion, transformation, and analytics across batch and real-time environments, supporting enterprise-wide data initiatives.
Key Responsibilities
- Design, develop, and maintain scalable batch and real-time data pipelines to support analytics and business intelligence use cases
- Build and manage distributed data processing solutions using Apache Hadoop and Apache Spark within Cloudera Data Platform (CDP)
- Develop and orchestrate ETL workflows using tools such as Apache NiFi
- Implement and manage real-time streaming pipelines using Apache Kafka
- Work with distributed storage systems such as Hadoop Distributed File System (HDFS)
- Utilize query engines like Apache Hive and Apache Impala for data access and analytics
- Perform data ingestion, transformation, and integration from multiple structured and unstructured enterprise data sources
- Optimize data pipelines for performance, scalability, and reliability
- Monitor and troubleshoot data workflows, ensuring high availability and data integrity
- Collaborate closely with data architects, analysts, and business stakeholders to deliver data solutions aligned with business needs
- Ensure adherence to data governance, security, and data quality standards
- Document data processes, architectures, and workflows for operational efficiency
Required Skills & Experience
- 5–8 years of experience in Big Data Engineering or related roles
- Strong hands-on experience with:
- Apache Hadoop ecosystem
- Apache Spark (PySpark/Scala preferred)
- Apache Kafka (streaming)
- Apache NiFi (data ingestion/ETL)
- Experience with Cloudera Data Platform (CDP) or similar big data platforms
- Proficiency in SQL and at least one programming language (Python, Scala, or Java)
- Solid understanding of distributed computing and parallel processing concepts
- Experience working with HDFS, Hive, and Impala
- Knowledge of data modeling, ETL design, and data warehousing concepts
- Familiarity with data governance, security, and compliance frameworks
- Strong problem-solving and performance tuning skills
Preferred Qualifications
- Experience with cloud platforms (AWS, Azure, or GCP) in big data environments
- Knowledge of containerization (Docker/Kubernetes) is a plus
- Exposure to CI/CD pipelines for data engineering workflows
- Understanding of real-time analytics and event-driven architectures
Key Competencies
- Analytical thinking and problem-solving
- Strong collaboration and communication skills
- Ability to work in fast-paced, data-driven environments
- Attention to detail and commitment to data quality
Education
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say