Capco

Senior Data Engineering - Data Engineer

Bengaluru, India
AWS Kafka Spark SQL Python
Search for More Jobs Talk to a recruiter now 💪
Description

Job Title: 

Senior Data Engineering - Data Engineer

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

Location - Bangalore

Experience - 10-15

Skills and Qualifications:

 

Job Title: Data Engineer - AWS Cloud

Job Summary:

We are seeking an experienced Data Engineer to join our team, responsible for ensuring the design, development, quality, security, and governance of our data assets in the AWS Cloud. The successful candidate will work closely with Architects, and business stakeholders to develop and implement best data engineering practices

 

Key Responsibilities:

  1. Design and Development of robust data pipelines involving technologies like (not limited to) Kafka, Snowflake, AWS Glue, S3, Spark SQL, AWS Athena and Python  using principles of ETL and  Datawarehouse .
  2. Data Quality: Ensure data accuracy, completeness, and consistency across all data sources and systems.
  3. Data Product Implementation: Collaborate with cross-functional teams to implement data product principles, promoting a decentralized approach to data ownership and accountability.
  4. Data Security: Collaborate with security teams to implement data encryption, access controls, and compliance with regulatory requirements.
  5. Documentation and Metadata Management: Maintain comprehensive documentation for data assets, including data lineage, data definitions, and data quality rules. Implement and manage a data catalogue to enhance metadata visibility and accessibility.
    Data Lifecycle Management: Oversee the end-to-end data lifecycle, ensuring compliance with regulatory and organizational policies. Facilitate processes for data creation, storage, usage, and deletion.
  6. Data Lineage: Track data lineage, ensuring transparency and traceability of data transformations.

 

  1. Data Architecture: Collaborate with data architects to design and implement data architectures.
  2. AWS Cloud: Utilize AWS Cloud services (e.g., Glue, Lake Formation, EMR, S3) to manage and govern data.
  3. Continuous Improvement: Identify areas for process improvement and implement changes.

Requirements:

  • 12+ years of experience in data design and engineering data governance, data quality, or data management.
  • Strong understanding of key data Engineering architecture involving cloud and on prem data transformation.
  • Strong understanding of data governance principles, data modelling, and data architecture.
  • Experience with AWS Cloud services implementation (Glue, Lake Formation, S3, etc.)
  • Knowledge of data security and compliance regulations (GDPR, IFRS etc.)
  • Excellent communication and stakeholder management skills

If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.

Capco
Capco
Consulting Finance Financial Services Insurance

0 applies

2 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say