(IND) STAFF, DATA ENGINEER

Position Summary...

Drives the execution of multiple business plans and projects by identifying customer and operational needs; developing and communicating business plans and priorities; removing barriers and obstacles that impact performance; providing resources; identifying performance standards; measuring progress and adjusting performance accordingly; developing contingency plans; and demonstrating adaptability and supporting continuous learning. Provides supervision and development opportunities for associates by selecting and training; mentoring; assigning duties; building a team-based work environment; establishing performance expectations and conducting regular performance evaluations; providing recognition and rewards; coaching for success and improvement; and ensuring diversity awareness. Promotes and supports company policies, procedures, mission, values, and standards of ethics and integrity by training and providing direction to others in their use and application; ensuring compliance with them; and utilizing and supporting the Open Door Policy. Ensures business needs are being met by evaluating the ongoing effectiveness of current plans, programs, and initiatives; consulting with business partners, managers, co-workers, or other key stakeholders; soliciting, evaluating, and applying suggestions for improving efficiency and cost-effectiveness; and participating in and supporting community outreach events.

What you'll do...

About team:

Data analytics operations team is primarily responsible for enabling operational decisions for US Walmart Stores, DCs, SAMs and International markets by providing timely curated data through our enterprise warehouse which is loaded through thousands of ETL data pipelines under our maintenance. Domains include Inventory, finance, logistics etc.

Job description

We are looking for a Staff Data Engineer to join our growing team of engineering experts who will be  responsible for designing, architecting, building, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The right candidate will be excited by the prospect of re-designing our data architecture from legacy systems to our next generation tech stacks and data initiatives.

Roles & Responsibilities: (What you’ll do)

• Build and maintain robust, scalable ETL data pipelines for ingesting, transforming, and storing large volume of data to support multiple business domains within US Walmart Stores, DCs, SAMs and International markets.
• Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide to drive value from data at Walmart Scale .
• Work on cloud platforms like Azure and Google Cloud for data storage, processing and analytics.
• Collaborate with other scrum teams onsite while partnering with cross-functional project development teams.
• Participate in 24/7 on-call rotations to troubleshoot production issues across cross-functional teams.
• Manage data engineering projects from design to deployment, ensuring timely delivery and meeting project goals.
• Provide guidance and mentorship to junior data engineers and lead engineering projects.
• Coordinate, create, and complete technical design discussions to drive technical architecture
• Ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes
• Uses modern tools, techniques, and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks
• Updates knowledge of current and emerging big data analytics and data science trends and techniques

Required skills: (What you’ll bring)

• Minimum of 8 years of experience as a Data Engineer or in a similar role.
• Proven expertise in data engineering concepts, database design, ETL processes and data mining.
• Proficiency in working with data technologies including SQL, Python, Spark, Scala, Big data and related technologies and tools. Exposure on scala spark is an added advantage.
• Experience with ETL scheduling tools such as Apache Airflow.
• Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets
• Strong skills working with relational databases like Big Query, DB2, SQLSERVER, ORACLE , Azure SQL etc., and NoSQL databases (e.g. Cassandra).
• Experience with real time message processing using Apache Kafka.
• Experience with CI/CD tools.
• Experience in designing and implementing data models for efficient storage and retrieval.
• A growth-oriented mindset and a willingness to raise the technical bar, as well as to identify opportunities for improving existing processes, tools, and systems to achieve high scale and productivity.
• Experience working with Docker and Kubernetes a plus.
• Familiarity with Cloud Computing Services such as Google GCP and Microsoft Azure, as well as Distributed Storage Systems
• Excellent oral and written communication skills, with the ability to present to both technical and non-technical audiences.
• A strong sense of accountability and ownership, self-discipline, and focus on high-quality deliverables, and a team-oriented approach that values design thinking, efficiency, and innovation.
• Having idea on Mainframe and DataStage/Informatica is an added advantage

Minimum Qualifications...

Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.

Minimum Qualifications:Option 1: Bachelor's degree in Computer Science and 4 years' experience in software engineering or related field. Option 2: 6 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 2 years' experience in software engineering or related field. 3 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Preferred Qualifications...

Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.

Primary Location...

4,5,6, 7 Floor, Building 10, Sez, Cessna Business Park, Kadubeesanahalli Village, Varthur Hobli , India