ML/Backend Research Engineer

Department: Applied Research

Location: Palo Alto

Employment Type: FullTime

About Us

Hippocratic AI is the leading generative AI company in healthcare. We have the only system that can have safe, autonomous, clinical conversations with patients. We have trained our own LLMs as part of our Polaris constellation, resulting in a system with over 99.9% accuracy.

Why Join Our Team

Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Location Requirement

We believe the best ideas happen together. To support fast collaboration and a strong team culture, this role is expected to be in our Palo Alto office five days a week, unless otherwise specified.

About the Role

• Build the next generation of voice agents

• Work with an interdisciplinary team

• Develop a highly scalable infrastructure for LLM processing

What You'll Do

• Develop and maintain scalable backend systems to support high-performance AI applications in healthcare.

• Collaborate with cross-functional teams, including data scientists and ML engineers, to design and build efficient data pipelines for large-scale healthcare datasets.

• Build and manage APIs and microservices that enable smooth data retrieval, processing, and interaction with AI models.

• Monitor and improve backend systems to optimize performance, reliability, and uptime.

• Work closely with product managers to understand healthcare requirements and help transform them into technical solutions.

• Develop and optimize backend infrastructure supporting data ingestion, feature extraction, and tagging workflows.

• Implement tag management and metadata systems to streamline dataset organization and retrieval.

• Contribute to end-to-end ML workflows, integrating data preparation, training, evaluation, and deployment into reproducible pipelines.

What You Bring

Must‑Have:

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field. (Master's is preferred)

• 5+ years of experience in backend development using programming languages like Python, Golang, or similar.

• Experience building and maintaining multi-modal data pipelines (speech, vision, and text) using Ray or Apache Airflow for distributed processing and model experimentation.

• Distributed computing with Spark, Hadoop, or similar.

• Familiarity with relational database systems and RESTful APIs.

• Basic understanding of cloud infrastructure (e.g. AWS, GCP).

Nice-to-Have:

• Exposure to AI/ML concepts or experience working with LLMs.

• Experience working in teams that handle sensitive or regulated data.

• Familiarity with gRPC, graphQL or similar .

• Experience with real-time audio.

• Exposure to DevOps concepts - CI/CD, deployment, terraform, build systems.

• Experience with data science.

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.