Sr. Data Engineer
Team: Data
Location: Hyderabad, India
Commitment: Full-time
Workplace Type: hybrid
Responsibilities
- Ability to build Scalable Data / ETL pipelines in Batch & Realtime patterns for BI / Reporting Platforms
- Should be able to create automation workflows / Orchestrations for the Data Pipelines
- Define and enforce best practices for data engineering, including coding standards, source control, and CI/CD processes to minimize technical debt and ensure high-quality code deployments.
- Should be able to understand different cloud Platforms, preferably on AWS Platform Services for Data & Analytics
- Should be able to create Design Documents/Mapping documents
- Should have hands on experience in developing & optimizing Medium to Large Data Warehouses (on any of Cloud Data Warehouses), preferably Snowflake, SQL Server, MongoDB, real time DB's
- Should be aware of Data Architecture/ Design Patterns in the areas of Data Ingestion / Curation / Data Consumption / Reporting Semantic Models
- Aware of Data Ingestion Tools, Data Quality Management, Metadata Management, Data Lineage, Data Security
- Should be able to monitor Audit the logging to troubleshoot issues and provide a fix to reduce business impacts
- Should work collaboratively with Data Architect in Designing & Developing Reusable utilities, understand & align to Architecture Design principles
- Should be able to communicate & Collaborate with all stakeholders (Director level, Business Units, other Architects, Product Managers, Scrum Masters)
Qualifications
- Should hold a Bachelor’s degree of engineering/MCA with good Academic CGPA
- Should have at least 6-10 years of total IT experience in Software Development, with 2 years exclusively in ETL Design in Data Warehousing projects
- Snowflake (Stored procedures, Tasks, Streams, Snow pipes, Dynamic Tables)
- Open Table formats (Iceberg tables) on Snowflake/AWS
- SQL Server, MongoDB, Data Analysis, SQL Query proficiency
- Realtime Databases (like Cassandra, DynamoDB)
- Replication tools (DMS, Qlik Replica)
Nice To Have
- dBT tool
- Python/Spark
- Data Governance Processes
- SSIS Integrations
- Knowledge on Tableau/Power BI tools
- Solid understanding of Agile development process and software release processes.
- Must be a self-starter who is highly organized, hands-on, and a team player.
- Should be able to independently do Unit testing
- Should be able to do peer-peer Code reviews, Code walk-through sessions
- Detail-oriented, with strong written and verbal communication.
Working Conditions
- The company environment is dynamic and reflective of rapid growth
- Friendly, helpful, open, and all inclusive
- Fast paced with frequent changes
- Sits and works at desk computer-keyboard for extended periods of time
- Works with others
- Our company uses E-Verify to confirm the employment eligibility of all newly hired employees. To learn more about e-Verify, including your rights and responsibilities, please visit www.dhs.gov/E-Verify.
- All qualified applicants will receive consideration of employment without regard to race, color, religion, gender, national origin, or other status protected by applicable law
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
