Data Engineer

Team: Engineering

Location: Vauxhall, London

Commitment: Full Time

Workplace Type: onsite

Key Responsibilities

• Design, build, and maintain scalable data pipelines to ingest healthcare data from customer EHR systems and hospital databases.
• Develop integrations using:
• --> REST APIs and webhook-driven workflows
• --> Database log shipping and change data capture (CDC) mechanisms, including Microsoft SQL Server–based systems
• Transform, validate, and normalize incoming clinical data before loading it into Circadia’s MySQL and Snowflake environments.
• Ensure pipelines are robust, fault-tolerant, and capable of handling large data volumes.
• Integrate and manage healthcare data domains including:
• --> Admissions, Discharges, Transfers (ADT)
• --> Conditions, medications, allergies
• --> Clinical notes and progress notes
• --> Vital signs and physiological measurements
• Work with healthcare interoperability standards and protocols such as:
• --> HL7 v2
• --> FHIR
• Partner with customer technical teams to support onboarding, troubleshooting, and ongoing data reliability.
• Take ownership of Circadia’s operational databases and analytical data warehouses.
• Design schemas and transformations that support both real-time application needs and downstream analytics and ML workloads.
• Optimize performance, cost, and scalability within Snowflake and MySQL.
• Deploy and operate data pipelines and services in AWS.
• Implement monitoring, logging, alerting, and operational dashboards for data workflows.
• Support production reliability, incident response, and continuous improvement of data systems.
• Ensure all data pipelines meet healthcare security and privacy requirements, including HIPAA and SOC 2.
• Apply best practices for handling Protected Health Information (PHI), including access control, encryption, and audit logging.
• Maintain clear documentation of data flows, transformations, and operational processes.
• Work closely with Data Science and ML teams to support:
• --> Model training and evaluation
• --> Feature generation and data labeling workflows
• Collaborate with backend engineers to develop internal tooling for data ingestion, validation, and monitoring.
• Participate in architecture discussions to ensure data systems scale with Circadia’s growth.

Required Qualifications

• 5+ years of experience in Data Engineering, Backend Engineering, or a closely related role.
• Strong proficiency in Python for data pipeline and backend development.
• Strong proficiency in SQL.
• Hands-on experience with MySQL and Snowflake, including schema design and performance optimization.
• Experience integrating data from Microsoft SQL Server, including log shipping or CDC-style approaches.
• Experience building high-throughput data pipelines from ingestion through transformation and storage.
• Experience deploying and operating production systems in a major cloud provider (AWS preferred).
• Familiarity with APIs, webhooks, and event-driven architectures.
• Experience working with sensitive or regulated data.

Preferred Qualifications

• Experience integrating with EHR systems (e.g., Epic, Homecare Homebase, PointClickCare).
• Familiarity with healthcare data standards such as HL7 and FHIR.
• Experience supporting machine learning or data science teams.
• Experience with data orchestration, workflow management, or streaming systems.
• Background in healthcare, medical devices, or clinical data systems.
• Exposure to HIPAA compliance and healthcare security best practices.

What You Bring

• You take ownership of data systems end-to-end — from ingestion to analytics.
• You care deeply about data quality, reliability, and operational excellence.
• You are comfortable working in complex integration environments where every customer system is different.
• You communicate clearly across engineering, data, and clinical teams.
• You’re motivated by building technology that directly improves patient care.