Data Engineer
Team: 474 COGS - Data Solutions
Location: Bengaluru, India
Commitment: F - Full Time
Workplace Type: hybrid
Responsibilities:
- Lead the design, development, and optimization of ETL/ELT pipelines using Databricks, Python, Spark, and Delta Lake.
- Architect scalable data solutions using Medallion architecture (Bronze, Silver, Gold layers).
- Design and implement data models and transformations using SQL and Python.
- Build and maintain audit frameworks to ensure traceability, compliance, and data lineage.
- Develop data quality monitoring and automated testing frameworks for pipeline reliability.
- Perform data analysis to support operational data requests and user queries.
- Collaborate with clinical data teams to analyse IRT/RTSM datasets.
- Create and maintain dashboards and reports using BI tools (e.g., Superset Power BI, Tableau, Qlik, or similar).
- Help manage CICD and automated code branching/deployment
- Ensure compliance with GxP, CDISC, and other regulatory standards.
- Mentor junior engineers and promote engineering best practices.
Experience
- 8–10 years of experience in data engineering, with leadership or team lead responsibilities.
- Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.
- Advanced proficiency in SQL and Python for data transformation and automation.
- Experience with ETL/ELT orchestration, job optimization, and performance tuning.
- Proven experience designing and implementing audit, data quality, and testing frameworks.
- Hands-on experience with IRT/RTSM clinical trial data systems.
- Strong data analysis skills and ability to interpret complex datasets.
- Experience with BI/reporting tools such as Power BI, Tableau, or Qlik.
- Knowledge of clinical data standards (e.g., CDISC, SDTM, ADaM).
- Experience with cloud platforms (Azure, AWS, or GCP) and CI/CD pipelines.
Skills
- Experience in Pharma or Life Sciences, especially in clinical trial operations.
- Familiarity with data governance and metadata management tools.
- Certifications in Databricks, cloud platforms, or clinical data standards.
- Exposure to machine learning workflows or data science collaboration.
Education
- Bachelor’s degree in computer science, Engineering, or equivalent field or appropriate experience will be considered.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say