H1

ETL Software Engineer

New York, NY Remote Hybrid
USD 120k - 135k
Terraform PostgreSQL AWS API Scala Python Docker Kubernetes Git Elasticsearch
Search for More Jobs Talk to a recruiter now 💪
Description
At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems. To accomplish this our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle.  Visit h1.co to learn more about us.

Product Engineering plays a pivotal role in developing and delivering our consumer-facing applications. Our team processes data from upstream sources, constructs robust data pipelines to ensure information remains current, and transforms this data for downstream use, providing our users with actionable, exportable insights. Our applications serve as gateways to our extensive knowledge base, which includes millions of healthcare professional profiles and their affiliations. The Product Engineering team is responsible for building these applications that enable our customers to search for and visualize information, facilitating quick, business-critical decisions. As we continue to expand into new markets and deepen the breadth of data we collect for our customers, it is essential that our team grows and scales accordingly to meet these increasing demands.


WHAT YOU'LL DO AT H1
As a product engineer on the Datafeeds and Pipeline team, you will be integral to designing, building, and maintaining efficient data pipelines to manage large volumes of data from various sources, ensuring high data quality and seamless flow within an AWS environment. You’ll be responsible for writing production grade pipelines using big data technologies to transform large datasets into file formats ready for clients to ingest. You’ll manage projects across all stages including application deployment to deliver the best scalable, stable, and high-quality healthcare data application in the market.


You will:
- Be responsible for product features related to data transformations, enrichment, and analytics
- Work closely with internal stakeholders, gathering requirements, delivering solutions, while effectively communicating progress and tracking tasks to meet project timelines
- You’ll design, build, and maintain efficient and reliable data pipelines to ingest, process, and distribute large volumes of data. This involves working with various data formats and sources, ensuring data quality, and managing data flow seamlessly between systems
- Implement and manage APIs and other integration methods to connect disparate systems and enable smooth data exchange. This might include integrating third-party data sources into the existing ecosystem
- Apply business logic to raw data to transform it into a usable format. This includes cleaning, aggregating, and manipulating data to meet specific business needs and to make it suitable for analysis and reporting
- Continuously monitor and optimize the performance of data pipelines and systems to handle increasing volumes of data efficiently. This may involve refining data storage practices, optimizing queries, and leveraging data caching strategies
- Provide technical support for data-related issues. This includes troubleshooting data pipeline failures and performance bottlenecks, as well as implementing fixes and enhancements to prevent future problems
- Implement security measures to protect data integrity and privacy. Ensure compliance with data governance and legal regulations pertaining to data handling and processing


ABOUT YOU
As a self-starter, you excel in managing projects across all stages, from requirement gathering and design to coding, testing, implementation, and ongoing support. You possess robust hands-on technical expertise encompassing both conventional and non-conventional ETL methodologies, alongside proficiency in T-SQL, Spark-SQL and Spark-Scala. Your proactive approach and diverse skill set make you an invaluable asset in driving innovation and delivering impactful solutions within our dynamic Product Engineering team.

- You possess a deep understanding of various distributed file formats such as Apache AVRO, Apache Parquet and common methods in data transformation
- You have experience performing root cause analysis on internal and external data and processes to answer specific business questions and find opportunities for improvement
- You have a proven ability to write clean code that is easy to maintain


REQUIREMENTS
- 3+ years of experience working with big data technologies and deploying products on AWS EMR
- Strong coding skills in Scala preferably or Python supporting large scale data processing 
- Familiarity with data engineering pipeline tools such as Apache Airflow
- Experience with Docker, Kubernetes or Terraform.
- Experience with databases like PostgreSQL
- Software management tools such as Git, JIRA, and CircleCI
- Familiarity with ElasticSearch, ETL API design, or  customer facing data delivery a plus


COMPENSATION
This role pays $120,000 to $135,000 per year, based on experience, in addition to stock options.

Anticipated role close date: 10/05/2024



H1 OFFERS
- Full suite of health insurance options, in addition to generous paid time off
- Pre-planned company-wide wellness holidays
- Retirement options
- Health & charitable donation stipends
- Impactful Business Resource Groups
- Flexible work hours & the opportunity to work from anywhere
- The opportunity to work with leading biotech and life sciences companies in an innovative industry with a mission to improve healthcare around the globe


H1 is proud to be an equal opportunity employer that celebrates diversity and is committed to creating an inclusive workplace with equal opportunity for all applicants and teammates. Our goal is to recruit the most talented people from a diverse candidate pool regardless of race, color, ancestry, national origin, religion, disability, sex (including pregnancy), age, gender, gender identity, sexual orientation, marital status, veteran status, or any other characteristic protected by law.
 
H1 is committed to working with and providing access and reasonable accommodation to applicants with mental and/or physical disabilities. If you require an accommodation, please reach out to your recruiter once you've begun the interview process. All requests for accommodations are treated discreetly and confidentially, as practical and permitted by law.
 H1
H1
Biotechnology Health Care Life Science Medical Therapeutics

0 applies

39 views

Other Jobs from H1

Sr. Data Engineer

Remote India

Data Engineer

Remote India

Senior Data Engineer

New York, NY Remote Hybrid

Staff Data Engineer

Remote New York, NY

Similar Jobs

DevOps Engineer

San Jose, CA US

Lead DevOps Engineer

Wroclaw, Poland

Lead DevOps Engineer

Trondheim, Norway

DevOps Engineer

Noida, India

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 389 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • Salaries for the engineering jobs on our site range from $100K-$200K. On average, senior engineer positions on our EchoJobs are about $160K.
  • The EchoJobs positions have been sourced and vetted from the top companies to work for in the US as a software engineer, including LinkedIn and other reputable job sites. We also have syndicated jobs from companies that have just raised funding, as well as those that have great unique products and culture. From all of these sources, our founder, Morgan, has also resourced the company's authenticity in terms of their website, public appearance, and more.
  • Yes, our users asked us for just this, so now our search filters allow you to search for your top jobs via location, as well as by onsite, remote, or both. Approximately 30% of our jobs are remote, so you’ve got the best options for you!
  • We have not yet implemented this option, but are considering doing so in the future. For the moment, you would need to cancel your subscription, and resubscribe when you wanted to come back.
  • We add new jobs to EchoJobs every day! We scan our sources for the newest jobs, verify them, and post them to EchoJobs within minutes. We add about 2,000-3,000 new jobs for you each day!
  • From starting your job search to getting hired, the entire job search process can take us software engineers anywhere between 3-6 months. However, at EchoJobs, we’re striving to shorten this duration by finding the best, newest jobs for you, so you can do less job searching, and more applying.
  • We’d recommend checking EchoJobs daily, as we add new jobs to the site each day. Additionally, if you got a chance to read our previous email on “what makes EchoJobs different from any other job search tools,” we also recommended that you set a job alert based on your job filters, so if you get emails on those new jobs, you could be checking more than once per day.
  • If you decide to continue with us after the 1-month trial, we definitely recommend this, as we all know it usually takes 3-6 months to find a quality job as a software engineer these days. So to best support you, we just adjusted our membership options at EchoJobs to monthly, 3 months, or 12 months (this option is more for passive job seekers looking a little bit for the future if they want to come back to work or make a job switch potentially. This lets you see what’s out there in case an even better fit job becomes available.)
  • EchoJobs is truly the only job site of its kind. We want to be THE spot for you to find the best job for you, and haven’t encountered any other company doing this. Other job sites are in niches besides software engineering or focus on a small portion of engineering jobs (like a specific coding language). In the words of Morgan, our founder, “I think what makes EchoJobs different is the amount of jobs, frequency that we add new jobs (we add 2,000-3,000 new jobs daily!), and the powerful search engines to find exactly the job you want more easily and efficiently. We can provide you with the most jobs that are vetted by us, we’ll continually find more new jobs for you, and we make it easier for you to apply and get hired.

What Fellow Engineers Say