Senior Data Engineer
Location: Bengaluru, Hyderabad
Time Type: Full time
Job Description
Senior Data Engineer, Assurant, GCC-India
Reports To: Director of Product Engineering & Integrations.
Position Summary
We are seeking a highly skilled Senior Data Engineer to design, develop, and optimize data pipelines and cloud-based data solutions. The ideal candidate will have strong expertise in Azure Data Factory, Snowflake, and modern ETL/ELT practices, enabling scalable, secure, and high-performance data workflows. This role will collaborate closely with analytics and BI teams to deliver reliable data infrastructure supporting enterprise reporting and advanced analytics.
This position will be in Bangalore/Chennai/Hyderabad at our India location.
Work Time: 3:30 PM IST ~ 12:30 AM IST
What will be my duties and responsibilities in this job?
Data Engineering & ETL Development
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Snowflake Tasks, and Snowpipe for real-time and batch ingestion.
- Implement best practices for data modeling, transformation, and performance tuning within Snowflake.
- Build and manage pipelines connecting multiple structured and unstructured data sources across cloud and on-prem environments.
- Automate data quality checks, data lineage tracking, and error handling within ETL workflows.
Snowflake Development & Optimization
- Develop and maintain Snowflake schemas, views, stored procedures, and materialized views.
- Configure and optimize Snowpipe for continuous data loading.
- Utilize Snowsight for monitoring query performance, cost optimization, and workload analysis.
- Implement role-based access control and ensure data security in Snowflake.
Azure & Cloud Integration
- Integrate Azure Data Factory with other Azure services (Blob Storage, Synapse, Key Vault).
- Design scalable cloud architectures and orchestrate pipelines across hybrid environments.
- Implement CI/CD pipelines for data workflows using GitHub Actions.
Analytics & Reporting Enablement
- Collaborate with business analysts and BI teams to enable Power BI dashboards backed by optimized Snowflake data models.
- Create semantic models and data marts to support self-service analytics and reporting.
Scripting & Automation
- Develop Python scripts for automation, data processing, and custom integrations.
- Leverage Python-based frameworks (Pandas, PySpark, Airflow) to enhance pipeline capabilities.
What are the requirements needed for this position?
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- 8+ years of experience in data engineering, ETL development, and cloud data platforms.
- Strong proficiency in Snowflake, Azure Data Factory, and Python.
- Experience with CI/CD, data security, and performance optimization.
- Familiarity with BI tools (Power BI, Looker, etc.) and data modeling best practices.
- Excellent problem-solving skills and ability to work in a fast-paced environment.
What are the Preferred requirements needed for this position?
- Knowledge of Airflow, PySpark, and data orchestration frameworks.
- Experience with real-time data ingestion and streaming architectures.
- Understanding of cost optimization in cloud environments.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say