Senior Data Engineer - Databricks

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.


If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Must have skills:

• 3+ years’ of hands-on experience in delivering data solutions

• Experience with Databricks implementations - developing data pipelines using PySpark

• Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs

• Experience in Python, Scala

• Experience in advanced SQL and Query optimization 

• Experience in implementing data integration projects using ETL 

• Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2 

Good to have skills : 

• Experience with AWS services - S3,Redshift,Secrets Manager

• Experience in implementing data integration projects using ETL (preferably Qlik Replicate & QlikCompose)

• Experience in using Airflow or Step Functions for orchestration

• Exposure to IaC tools like Terraform and to CI/CD tools

• Prior experience in migrating (on-prem to cloud)  and processing large amounts of data

• Experience in implementing data lake and data warehouse on cloud

• Experience in implementing the industry's best practices