Senior IT Data Engineer- DMO Pipelines

Location: HYDERABAD OFFICE INDIA PSC PGH

Time Type: Full time

Job Description

Job Location

Job Description

P&G was founded over 180 years ago as a simple soap and candle company. Today, we're the world’s largest consumer goods company and home to iconic, trusted brands that make life a little bit easier in small but meaningful ways. We've spanned three centuries thanks to three simple ideas: leadership, innovation and citizenship. The insight, innovation and passion of hardworking teams have helped us grow into a global company that is governed responsibly and ethically, that is open and visible, and that supports good causes and protects the environment. This is a place where you can be proud to work and do something that matters.

Dedication from Us: You'll be at the core of breakthrough innovations, be given exciting assignments, lead initiatives, and take ownership and responsibility, in creative workspaces where new insights thrive. All the while, you'll receive outstanding training to help you become a leader in your field. It is not just about what you'll do, but how you'll feel: encouraged, valued, purposeful, challenged, heard, and inspired.

What we Offer: Continuous mentorship – you will collaborate with peers and receive both formal training as well as day-to-day mentoring from your manager dynamic and encouraging work environment– employees are at the centre, we value every individual and support initiative, promoting agility and work/life balance.

We are looking for a Senior Data Engineer to accelerate the publication of data to our core Azure data lake.

You will work with established cloud data platforms and internal tooling to build and enhance data pipelines, ensuring that data is ingested, transformed, and published in a reliable, governed, and efficient way. The focus of this role is on executing and improving existing patterns and standards to deliver high-quality data for analytics and decision making.

Key Responsibilities:
- Productionize pipelines for large, complex data sets which meet technical and business requirements.
- Partner with data asset managers, architects, and development leads to ensure a sound technical solution.
- Follow, and contribute to, coding standards and best practices to ensure pipelines and components are efficient, robust, cost effective and reusable.
- Identify, design, and implement internal process improvements.
- Optimize Spark jobs for performance and cost. Tune configurations, minimize shuffles, and leverage advanced techniques like broadcast joins, caching, and partitioning.
- Ensure data quality, reliability, and performance by implementing best practices for data validation, monitoring, and optimization.
- Monitor and troubleshoot data pipelines and workflows to ensure seamless operation.
- Stay updated on the latest Databricks features, tools, and industry trends to continuously improve data engineering practices.
- Strong understanding of distributed computing concepts and big data processing.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
- Mentoring & coaching of junior engineers 

Job Qualifications

- Strong skills with Python, SQL, Delta Lake, Databricks, Spark/Pyspark, Github and Azure.
- You will be expected to Attain and/or maintain technical certifications related to the role (Databricks, Azure)
- Ability to use and implement CI/CD and associated tools such as Github Actions, SonarQube, Snyk
- Plus: Solid understanding of D&A Platform and Capabilities
- Plus: Experience and understanding of data engineering platforms and tools in use outside of P&G or D&A

About Us

We produce globally recognized brands, and we grow the best business leaders in the industry. With a portfolio of trusted brands as diverse as ours, it is paramount our leaders can lead with courage the vast array of brands, categories, and functions. We serve consumers around the world with one of the strongest portfolios of trusted, quality, leadership brands, including Always®, Ariel®, Gillette®, Head & Shoulders®, Herbal Essences®, Oral-B®, Pampers®, Pantene®, Tampax® and more. Our community includes operations in approximately 70 countries worldwide.

Visit http://www.pg.com to know more.

We are an equal-opportunity employer and value diversity at our company. We do not discriminate against individuals based on race, color, gender, age, national origin, religion, sexual orientation, gender identity or expression, marital status, citizenship, disability, HIV/AIDS status, or any other legally protected factor.

At P&G, the hiring journey is personalized every step of the way, thereby ensuring equal opportunities for all, with a strong foundation of Ethics & Corporate Responsibility guiding everything we do.

All the available job opportunities are posted either on our website - pgcareers.com, or on our official social media pages, for the convenience of prospective candidates, and do not require them to pay any kind of fees towards their application.”

Job Schedule

Job Number

Job Segmentation