Capco

Principal Consultant – Snowflake/Big Data/Cloud Tech Lead

New York, NY US
USD 151k - 195k
Machine Learning AWS Azure Python Java
Description

About the Team:

Capco’s Data Team helps our clients transform every aspect of their business. We are highly skilled at formulating data strategy, defining business and technology initiatives across the data management lifecycle, and aligning multi-year strategic roadmaps with client’s business goals. As digital technologies advance and regulations tighten, today’s consumers – and, therefore, today’s businesses – are becoming more aware of the importance of good quality data. We work to establish holistic ways to effectively manage data through the modern data supply chain and facilitate consumption through analytics, modelling, AI, machine learning, dashboarding, and reporting.

About the Job:

As a member of our Data Team, you will work across Capco’s different domains and solution offerings to help break down large problems, develop approaches and solutions. As a Principal Consultant Tech Lead, you will work with our clients to architect, design and implement complex cloud and big data solutions.

What You’ll Get to Do:

  • Architect and design complex data solutions on Snowflake, Data Sharing, Data Exchange, Snowflake Internal Marketplace, including data models, data ingestion pipelines, and data transformations, ensuring best practices and scalability.
  • Build and Implement Big Data principles/solutions on MS Fabric/OneLake.
  • Integrate Snowflake data platform with Non-snowflake clients (Vice-Versa.)
  • Design data structures and optimize data organization within Snowflake to support efficient querying and analysis.
  • Design standard Datawarehouse models using Star schema and Data Vault practices and support SCD-2 scenarios.
  • Implement ETL/ELT processes to integrate data from various sources into Snowflake and MS Fabric/OneLake, ensuring data quality and consistency.
  • Monitor and optimize Snowflake queries, data loading strategies, and warehouse configurations to maximize performance.
  • Implement data security measures within Snowflake to protect sensitive data, adhering to industry regulations and compliance standards.
  • Set up and maintain continuous integration and continuous delivery pipelines for Snowflake applications.
  • Work closely with cross-functional teams like business analysts, product managers, and data scientists to understand data requirements and translate them into technical solutions.
  • Lead and mentor a team of engineers on Snowflake development, providing technical guidance, code reviews, and problem-solving support.

What You’ll Bring with You:

  • Experience designing, building and implementing architectural strategies.
  • An understanding of Snowflake internals for any customization using configuration changes
  • Experience with Cloud-native Application/Big Data principles and experience building Cloud-native data solutions using AWS/Azure cloud stack.
  • Strong understanding of open data formats like Iceberg and delta for specific Investment banking use cases.
  • Experience building Data Mesh and Data Products, publishing/consuming data products on Marketplace using Snowflake or AWS or Azure.
  • Experience using AWS stack using S3, Glue, Lambda, Snowflake platform on AWS, Redshift and Glue catalog.
  • Strong understanding of Azure stack (ADLS2.0, ADF2.0, Synapse)
  • Programming experience in Python and Pyspark, Java, Notebook development using VSCode and performance improvement practices.
  • Excellent communication and collaboration skills to work with diverse teams.
  • Proven ability to lead technical projects and mentor junior engineers.

Why Capco? 

A career at Capco is a chance to help reshape the competitive landscape in financial services. We launch new banks, transform existing ones, and help our clients navigate complex change. As consultants, we work on the front-end business design all the way through to technology implementation.

We are the largest Financial Services focused consultancy in the world, serving everyone from global banks to emerging FinTechs, from strategy through digital transformation, design, business consulting, data and analytics, cyber, cloud, technology architecture, and engineering.

Capco is a young and growing firm. We maintain an entrepreneurial spirit and growth mindset, and have minimal bureaucracy. We have no internal silos that get in the way of your career opportunities or ability to focus on our clients and make a difference to the business. We offer the opportunity for everyone to learn rapidly, take on tough challenges, and get promoted quickly. We take pride in our creative, collaborative, diverse, and inclusive culture, where everyone can #BYAW.

We offer highly competitive benefits, including medical, dental and vision insurance, a 401(k) plan, tuition reimbursement, and a work culture focused on innovation and creation of lasting value for our clients and employees.

Ready to take the Next Step 

If this sounds like you, we would love to hear from you.  This is an opportunity to make a difference and contribute to a highly successful company with a significant growth trajectory.

 

#LI-Hybrid

New York Pay Range
$151,000$195,000 USD

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say