echojobs.io
Login

Cloud Angles

Data Engineer

Hyderabad, India
Python PySpark Azure Data Factory Azure Databricks Synapse Analytics Azure Data Lake Storage Gen2 CI/CD Azure Logic Apps Azure DevOps GitHub Actions Jenkins
Search for More Jobs
Description

CA0253 - Data Engineer

Location: Hyderabad, India

Department: Centrica

Experience: 10 - 17 Years

Job Summary:
We are seeking a highly skilled Data Engineer with expertise in leveraging Data Lake architecture and the Azure cloud platform to develop, deploy, and optimize data-driven solutions. You will play a pivotal role in transforming raw data into actionable insights, supporting strategic decision-making across the organization.

Key Responsibilities
  • Develop and optimize scalable data pipelines using Python and PySpark
  • Build and orchestrate data workflows with Azure Data Factory
  • Design and implement solutions using Azure Databricks and Synapse Analytics
  • Manage and maintain data storage solutions in Azure Data Lake Storage Gen2, leveraging cost-efficient architecture
  • Implement and manage CI/CD pipelines using Azure Logic Apps, with integration of tools such as Azure DevOps, GitHub Actions, or Jenkins
  • Model and maintain Medallion Architecture across Bronze, Silver, and gold layers based on business requirements
  • Collaborate with data scientists, analysts, and business stakeholders to ensure reliable data availability
  • Monitor and optimize performance and cost efficiency of data solutions across the ecosystem
 
Required Skills & Experience
  • Strong proficiency in Python and PySpark for data manipulation and transformation
  • Hands-on experience with Azure Data Factory, Azure Databricks, and Synapse Analytics
  • Familiarity with Azure Logic Apps for CI/CD pipeline management
  • Knowledge of CI/CD tools such as:
  • Azure DevOps Pipelines
  • GitHub Actions
  • Jenkins
  • Expertise in managing Azure Data Lake Storage Gen2 environments with emphasis on security and cost optimization
  • Deep understanding of Medallion Architecture principles:
  • Bronze Layer: Raw data ingestion
  • Silver Layer: Cleansed, enriched, and business-ready data
  • Gold Layer: Aggregated and analytics-ready data models
  • Strong problem-solving and communication skills
  • Experience on Cost optimization

Cloud Angles
Cloud Angles

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say