Lead Data Engineer
Location: United States
Department: Technology
Workplace: remote
Employment Type: full
Description
We are seeking a Lead Data Engineer to architect, build, and scale our next-generation healthcare data platform. In this role, you will lead the effort to design robust pipelines, modernize data architecture, and ensure high-quality ingestion and transformation of clinical and operational data. You’ll collaborate closely with product, analytics, clinical informatics, machine learning, and engineering teams to deliver trusted, timely, and compliant insights.
This is a hands-on leadership role ideal for someone who enjoys setting technical direction while still contributing code and guiding stakeholders through complex healthcare data challenges.
Responsibilities
Architecture & Strategy
- Lead design and evolution of our cloud-native data platform built primarily on Google Cloud Platform, including BigQuery, Cloud Storage, Pub/Sub, Cloud Run, Airflow (Cloud Composer), and Healthcare API.
- Inform strategic decisions around multi-cloud or AWS interoperability when needed.
- Establish data engineering best practices, coding standards, and architectural patterns.
Pipeline Development
- Build scalable ETL/ELT pipelines using dbt for transformations and Airflow for orchestration.
- Develop ingestion pipelines for clinical and administrative data in HL7, FHIR, DICOM, and custom formats.
- Develop ingestion and transformation pipelines to be used for AI/ML development and model training.
- Implement streaming and batch dataflows using Pub/Sub, Dataflow, and serverless compute.
- Support or guide integrations with AWS-based partner systems or AWS-hosted data sources when applicable.
Data Modeling & Warehousing
- Design and maintain BigQuery datasets, semantic layers, and warehouse structures.
- Leverage industry standards such as FHIR resources for canonical healthcare models.
- Provide guidance on data modeling and warehouse best practices across both GCP and AWS ecosystems.
Data Quality, Observability & Governance
- Implement data quality frameworks, automated testing, and monitoring.
- Ensure HIPAA compliance and proper handling of PHI/PII across all pipelines and cloud environments.
- Drive lineage, documentation, metadata governance, and dbt docs adoption.
Leadership & Collaboration
- Partner with analytics, product, clinical informatics, and security teams to deliver high-quality, trustworthy data products.
- Provide oversight and technical direction for multi-cloud data integrations with AWS-based systems or partners.
- Assist in the recruitment and development of junior data engineers
Requirements
- 7+ years of data engineering experience; 2–3+ years in a lead or senior technical role.
- Deep, hands-on expertise in GCP, particularly:
- BigQuery
- GCP Healthcare API (FHIR and DICOM stores)
- Cloud Storage, Pub/Sub, Cloud Run/Functions
- Strong proficiency with:
- dbt (Core or Cloud)
- Airflow (Cloud Composer or self-managed)
- Python and advanced SQL (BigQuery preferred)
- Hands-on experience with healthcare standards:
- FHIR (R4/US Core), HL7 v2/v3, DICOM, C-CDA, X12
- Strong understanding of PHI handling, HIPAA compliance, and healthcare interoperability.
Preferred
- AWS experience, especially with:
- Redshift, Lambda, S3, Glue, Kinesis, Athena, API Gateway, Step Functions
- Experience building or maintaining multi-cloud pipelines bridging GCP and AWS.
- Background with Dataflow/Beam or other stream processing frameworks.
- Experience working with EHR integrations, claims processing, HIEs, or clinical data networks.
- Familiarity with ML-enabled data pipelines or feature engineering in healthcare contexts.
Benefits
Why Join Us?
Joining C the Signs is not just about building AI; it’s about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.
Benefits:
- Competitive salary and benefits package.
- Flexible working arrangements (remote or hybrid options available).
- The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
- Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
- Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say