Quantiphi

Senior Data Engineer

Mumbai, India Bengaluru, India
Azure Spark SQL Python Java Scala
Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role & Responsibilities:
● Support the planning and implementation of data flow design, provide sizing and configuration assistance.
● Assisting the Solution Architects on programs for transformations and modernizations of data solutions
using Azure cloud data technologies.
● Write production quality code to deploy ML workflows in a distributed environment.
● Design and Build Azure Data Pipelines and Data Streams Design and build a hybrid data solution using a
combination of on-premise and in-cloud services.
● Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant
impact on our massive scale.
● Build tools to ingest and process terabyte-scale data on a daily basis.
● Communicate with a wide set of teams, including product owners, business analysts, data and enterprise
architects, platform engineers, and cloud vendors, etc.
● Compilation of detailed design documents, technical specification documents, and test plans as required.
● Independently manage development tasks as per technical specification documents, prod deployment,
post-prod support, etc
● Managing support to Unit Testing, SIT & UAT.
● Coordinate with business and support teams on testing and migration activities.

Skills expectation:
● A strong hands-on knowledge of Spark/Pyspark.
● Expertise in writing SQL queries and performance optimization.
● Strong hands-on experience with a programming language like Python(preferred), java, or scala.
● Prior experience with working on cloud platforms like Azure(preferred).
● Prior experience of ADF is a plus.
● DataBricks experience is good to have.
● Data Warehouse: Snowflake or Synapse
● Design Dimensional Models for Data Warehouse and Data Marts.
● Knowledge of version control systems and build automation tools like Azure DevOps and/or MLOps
● Experience with operating system internals, file systems, disk/storage technologies, and storage Protocol.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Quantiphi
Quantiphi
Artificial Intelligence (AI) Cloud Data Services InsurTech Machine Learning Software

0 applies

0 views

Other Jobs from Quantiphi

Senior Data Engineer

Bengaluru, India Mumbai, India

Intern Research Engineer

Toronto, Ontario Canada

Senior Data Engineer

Mumbai, India Bengaluru, India

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say