Description
Data Engineer
Location: Gurugram
Department: Data Engineer
Experience: 2-5 years
About Analytics Vidhya
Analytics Vidhya is a leading platform for data science professionals, learners, and organizations. With a community of over 4 million users, we aim to empower everyone to learn, share, and grow in the fields of data science, machine learning, and artificial intelligence. Join
us to be at the forefront of transforming businesses through data!
Role Overview
We are seeking a Data Engineer who is passionate about building scalable data pipelines and infrastructure to support machine learning, analytics, and business intelligence. You will work closely with data scientists, product managers, and developers to ensure robust, secure, and efficient data systems.
Key Responsibilities
● Design, build, and maintain ETL / ELT pipelines using modern data engineering tools and frameworks.
● Develop and optimize data lakes and data warehouses (e.g., Databricks, Redshift, BigQuery,)
● Conduct exploratory queries and build scripts to understand and improve data models
● Develop dashboards and reports in partnership with the UX team and establish visualization standards
● Translate business requirements into scalable data models and tools
● Work with large-scale structured and unstructured data from multiple sources.
● Implement data validation, monitoring, and governance frameworks.
● Collaborate with data scientists and analysts to provide clean, organized, and real-time data
● Ensure data privacy, security, and compliance across all data processes.
● Participate in system architecture discussions and contribute to backend engineering
tasks.
Required Skills
● Strong proficiency in SQL, Python, and data modeling.
● Experience in Databricks / Snowflake
● Experience with Spark, Airflow, or similar data orchestration tools.
● Familiarity with cloud platforms (AWS, GCP, or Azure) and storage systems (S3, GCS).
● Understanding of CI/CD pipelines and DevOps principles for data workflows.
● Hands-on experience with real-time data streaming tools (Kafka, Flink, etc.) is a plus.
● Experience in scaling generative AI models and agentic workflows is a plus
● Solid understanding of APIs, microservices, and RESTful design.
Qualifications
● Bachelor’s or Master’s degree in Computer Science, Data Engineering, Mathematics or
related field.
● 2+ years of experience in a data engineering or backend data role.
● Exposure to machine learning pipelines or MLOps is a bonus.
Why Join Us?
● Work with a mission-driven, high-impact team.
● Access to cutting-edge tools and real-world data projects.
● Learn and grow in one of India’s most respected data science communities.
● Flexible work environment and continuous learning support.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say