Specialist Solutions Architect - Data Intelligence Platform

FEQ225R36

As a Specialist Solutions Architect (SSA) - Data Intelligence Platform, you will guide partners in building big data solutions on Databricks that span a large variety of use cases. You will be in a partner-facing role, working with and supporting our field Solution Architects and partner teams, that requires hands-on production experience with SQL, Apache Spark™ and expertise in other data technologies.  SSAs help partners build capabilities for design and successful implementation of essential workloads while aligning their technical roadmap for expanding the usage of the Databricks Intelligence Platform. As a deep go-to-expert reporting to the Field Engineering Leadership, you will continue to strengthen your technical skills through mentorship, learning, and internal training programs and establish yourself in an area of specialty - whether that be data governance, data science, machine learning, streaming, performance tuning, industry expertise, or more.

The impact you will have:

• Provide technical leadership to guide strategic partners to successful implementations on big data projects, ranging from architectural design to data engineering to model deployment
• Architect production level data pipelines, including end-to-end pipeline load performance testing and optimization
• Become a technical expert in an area such as data lake technology, big data streaming, or big data ingestion and workflows
• Assist Solution Architects with aspects of the technical sale as they work alongside partners including customizing proof of concept content, estimating workload sizing, and custom architectures
• Provide tutorials and training to improve partner community adoption (including hackathons and conference presentations)
• Contribute to the Databricks Community

What we look for:

• 7+ years experience in a technical role with expertise in at least one of the following:
• Software Engineering/Data Engineering: data ingestion, streaming technologies - such as Spark Streaming and Kafka, performance tuning, troubleshooting, and debugging Spark or other big data solutions.
• Data Applications Engineering: Build use cases that use data - such as risk modeling, fraud detection, partner life-time value.
• Data Science or Machine Learning Ops: Design and build of production infrastructure, model management, and deployment of advanced analytics that drives measurable business value (ie. getting models running in production).
• Must be able to work collaboratively and independently to achieve outcomes supporting go-to-market priorities and have the interpersonal savvy to influence both partners and internal stakeholders without direct authority
• Deep Specialty Expertise in at least one of the following areas:
• Expertise in data governance systems and solutions that may span technologies such as Unity Catalog, Alation, Collibra, Purview, etc.
• Experience with high-performance, production data processing systems (batch and streaming) on distributed infrastructure.
• Experience building large-scale real-time stream processing systems; expertise in high-volume, high-velocity data ingestion, change data capture, data replication, and data integration technologies.
• Experience migrating and modernizing Hadoop jobs to public cloud data lake platforms, including data lake modeling and cost optimization.
• Expertise in cloud data formats like Delta and declarative ETL frameworks like DLT.
• Expertise in building GenAI solutions such as RAG, Finetuning, or Pre-training for custom model creation.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent experience through work experience.
• Maintain and extend production data systems to evolve with complex needs.
• Production programming experience in SQL and Python, Scala, or Java.
• Experience with the AWS, Azure, or GCP clouds.
• 4+ years professional experience with Big Data technologies (Ex: Spark, Hadoop, Kafka) and architectures
• 4+ years with system integration partner or customer-facing experience in a pre-sales or post-sales role (consultant working for a partner)
• Can meet expectations for technical training and role-specific outcomes within 6 months of hire
• This role can be remote, but we prefer that you will be located in the job listing area and can travel up to 30% when needed.