Staff Data Scientist

Join Credit Karma as a Staff Data Scientist - Machine Learning Ops, where you'll champion operational excellence across data and engineering organizations, driving AI-powered innovation and collaboration. With a deep understanding of data science and machine learning ecosystems, you'll build and lead elegant monitoring, alerting, and operational solutions, fostering a high performing culture of operational excellence. This highly cross-functional role requires building strong partnerships with engineering, product, business, finance, and analytics teams, as well as mentoring AI team members, setting clear accountability, and navigating fast-paced environments with agility and poise.

What You’ll Do:

• Design and maintain systems driving ML ecosystem health, such as monitoring and alerting to detect anomalies and performance degradation of ML models, balancing automated tooling with human actionability 
• Develop and maintain dashboards for stakeholder reporting in order to provide insights into model performance, data quality, and data incidents
• Immediately investigate and lead teams to quickly resolve any model- or data-related incidents, such as data quality issues and prediction errors
• Collaborate and communicate effectively with data scientists, engineers and architects on model validation, testing, and quality assurance
• Document processes and best practices, and lead training sessions to upskill data scientists in Data Science Ops, promoting ops excellence and continuous learning
• Design and implement cloud solutions (GCP) to containerize, deploy, version, and monitor data science models in production

Minimum Basic Requirement:

• Bachelor's or graduate degree in Computer Science, Software Engineering, or a related quantitative field (such as engineering, machine learning, data science, operations research, or economics) with a minimum of 8 years of industry experience
• Expertise in cloud computing, with hands-on experience using GPC or similar services
• Prior DS Ops or ML Ops experience, with a proven track record of success
• Expertise in monitoring and alerting tools, such as PagerDuty, with experience designing and managing alerting systems to ensure optimal model performance and data quality
• Ability to collaborate effectively across functions and with diverse stakeholders, including data scientists, engineers, analysts, and finance teams, in mid- or large-scale companies
• Strong communication skills, with the ability to articulate complex technical concepts and solutions to both technical and non-technical audiences

Preferred Qualifications: 

• Strong programming skills in SQL, Python, and Scala, with experience with ML frameworks like scikit-learn, Keras, PyTorch, and TensorFlow
• Proficiency with DS / ML Ops frameworks like Airflow, Kubeflow, MLFlow or similar
• Cloud solution design and implementation expertise, with experience building DS / ML Ops pipelines on GCP

Benefits at Credit Karma includes:

• Medical and Dental Coverage
• Retirement Plan
• Commuter Benefits
• Wellness perks
• Paid Time Off (Vacation, Sick, Baby Bonding, Cultural Observance, & More)
• Education Perks
• Paid Gift Week in December