Senior Data Engineer - Big Data

Location: Bengaluru, India; Hyderabad, India; Pune, India

Department: Data Engineering & Analytics

Experience: 5+

• Design, develop and maintain scalable and efficient data pipelines
• Analyze and Develop data quality and validation procedures.
• Work with stakeholders to understand the data requirements and provide solutions.
• Troubleshoot and resolve data issues in a timely manner
• Collaborate with cross-functional teams to ingest data from various sources.
• Continuously evaluate and improve data architecture and processes.
• Own, monitor, and improve solutions to ensure SLAs are met
• Develop and maintain documentation for Data infrastructure and processes.
• Executes projects using Agile Scrum methodologies. Team player.

• Bachelor's Degree in Computer Science, Data Analytics, Information Systems, etc.
• Experience developing data pipelines in one of the following languages: Python or Java
• 5+ years dimensional and relational data modeling experience
• Excellent SQL and database management skills

• 5+ years in data warehouse engineering (OLAP) Snowflake, BigQuery, Teradata, Redshift
• 5+ years with transactional databases (OLTP) Oracle, SQL Server, MySQL
• 5+ years with big data, Hadoop, Data Lake, Spark in a cloud environment(AWS)
• 5+ years with commercial ETL tools – dbt, Matillion, and SSIS/ADF
• 5+ years delivering ETL solutions from source systems, databases, APIs, flat-files, JSON
• Experience developing Entity Relationship Diagrams with Erwin, SQLDBM, or equivalent
• Experience working with job scheduling and monitoring systems (Airflow, Datadog, AWS SNS)
• Experience with Claude Code, Cortex Coco, VSCode copilot, AI enabled SDLC development models.
• Experience building BI Dashboards with tools like Tableau
• Experience in any of the financial, Marketing, Sales, accounts payable, accounts receivable, invoicing etc.. Domains are a plus.
• Experience managing work assignments using tools like Jira and Confluence
• Experience with Scrum/Agile methodologies is a plus.
• Ability to work independently and as part of a team
• Excellent analytical and problem solving skills