While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Experience : 4 to 6 Years
Location : Mumbai/ Pune (Hybrid)
Role: Senior Data Engineer
Required Skills:
Experience: 4+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.
In-depth knowledge and hands-on experience with on near real-time streaming use-cases using Apache Kafka and Kinesis, including topics, partitions, brokers, producers, consumers, and Kafka Connect for data ingestion.
Ability to analyze data sources, including Kafka Streams and Core Database Engine, to evaluate data quality, completeness, and transformations required for data ingestion.
Expertise in production grade solutions using: AWS (MSK, Redshift, S3, Glue, Lambda, Airflow), Python, Data pipelines using Glue/Airflow/Sagemaker.
Ability to design and implement complex data processing pipelines in PySpark.
Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases.
Data Warehousing - Hands-on experience to design and develop an Enterprise level data warehouse while leading a team of engineers for the same.
Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.
Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)
Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.
Experience building and supporting large-scale systems in a production environment.
Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads. Ability to work in an agile environment through estimating workloads effectively.
Good to have skills:
Basic understanding of data visualization tools like Quicksight can help in aligning the data ingestion pipeline with downstream reporting requirements.
Experience working in the Financial Services domain with knowledge of compliance regulations such as SOC2, PCI-DSS.
Prior experience of working on AWS Migration Acceleration Programs for customers.
Knowing how to optimize data ingestion processes and data storage in Kafka and Redshift environments will enhance the solution's performance.
Experience using Github/codecommit for developmental activities
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
0 applies
1 views
Other Jobs from Quantiphi
Senior Platform Engineer
Senior Data Engineer - AWS Timestream
Senior Software Developer
Senior Data Engineer
Senior Test Automation Engineer
Similar Jobs
Sr Software Engineer
Sr. Machine Learning Engineer
Software Development Engineer - Amazon MSK
Software Development Engineer - Amazon MSK
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 401 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say