Quantiphi

Senior Data Engineer - KStream

Mumbai, India Bengaluru, India
Streaming Kafka AWS Python SQL MySQL Oracle
Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Experience : 4 to 6 Years

Location : Mumbai/ Pune (Hybrid)

Role: Senior Data Engineer

Required Skills:

  • Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

  • In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.

  • Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.

  • Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.

  • Ability to design and implement complex data processing pipelines in PySpark.

  • Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.

  • Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.

  • Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

  • Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

  • Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

  • Experience building and supporting large-scale systems in a production environment.

  • Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.

 

Good to have skills:

  • Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.

  • Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.

  • Prior experience of working on AWS Migration Acceleration Programs for customers.

  • Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.

  • Experience using Github/codecommit for developmental activities 

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Quantiphi
Quantiphi
Artificial Intelligence (AI) Cloud Data Services InsurTech Machine Learning Software

0 applies

1 views

Other Jobs from Quantiphi

Senior Platform Engineer

Bengaluru, India Mumbai, India

Senior Data Engineer - AWS Timestream

Bengaluru, India Mumbai, India

Senior Data Engineer

Mumbai, India Bengaluru, India

Senior Test Automation Engineer

Bengaluru, India Mumbai, India

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say