Description
Data Specialist - R01558819
Team: AI & Data Engineering : Data Engineering
Location: Pune, Maharashtra, India
Commitment: Employee
Workplace Type: hybrid
About the Role
We are seeking a Microsoft Fabric Data Engineer with 7+ years of experience for a lead role. The ideal candidate will be responsible for designing, developing, and deploying data pipelines, ensuring efficient data movement and integration within Microsoft Fabric.
Responsibilities
Data Pipeline Development: Design, develop, and deploy data pipelines within Microsoft Fabric, leveraging OneLake, Data Factory, and Apache Spark to ensure efficient, scalable, and secure data movement across systems.
ETL Architecture: Architect and implement ETL workflows optimized for Fabric’s unified data platform, streamlining ingestion, transformation, and storage.
Data Integration: Build and manage integration solutions that unify structured and unstructured sources into Fabric’s OneLake ecosystem. Utilize SQL, Python, Scala, and R for advanced data manipulation.
Fabric OneLake & Synapse: Leverage OneLake as the single data lake for enterprise-scale storage and analytics, integrating with Synapse Data Warehousing for big data processing and reporting.
Cross-functional Collaboration: Partner with Data Scientists, Analysts, and BI Engineers to ensure Fabric’s data infrastructure supports Power BI, AI workloads, and advanced analytics.
Performance Optimization: Monitor, troubleshoot, and optimize Fabric pipelines for high availability, fast query performance, and minimal downtime.
Data Governance & Security: Implement governance and compliance frameworks within Fabric, ensuring data lineage, privacy, and security across the unified platform.
Leadership & Mentorship: Lead and mentor a team of engineers, oversee Fabric workspace design, code reviews, and adoption of new Fabric features.
Automation & Monitoring: Automate workflows and orchestration using Fabric Data Factory, Azure DevOps, and Airflow, ensuring smooth operations.
Documentation & Standards: Document Fabric pipeline architecture, data models, and ETL processes. Contribute to Fabric engineering best practices and enterprise guidelines.
Innovation: Stay current with Fabric’s evolving capabilities (Real-Time Analytics, Data Activator, AI integration) and drive innovation within the team.
Qualifications
7+ years of experience in data engineering, with a strong focus on Microsoft Fabric and related technologies.
Required Skills
Proficiency in SQL, Python, Scala, and R.
Experience with data pipeline development and ETL processes.
Strong understanding of data governance and security practices.
Ability to lead and mentor a team effectively.
Preferred Skills
Experience with Azure DevOps and Airflow.
Familiarity with Power BI and AI workloads.
Knowledge of real-time analytics and data activator features.
Pay range and compensation package
Competitive salary based on experience and qualifications.
Equal Opportunity Statement
We are committed to creating a diverse and inclusive environment for all employees. We encourage applications from individuals of all backgrounds and experiences.
Primary Skills
- AKS, Event Hub, Azure DevOps, Cosmos DB, Azure Functions
Specialization
Job requirements
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say