Senior Data Engineer_GCP_ Python

About Lowe's: Lowe’s Companies, Inc. (NYSE: LOW) is a FORTUNE® 50 home improvement company serving approximately 16 million customer transactions a week in the United States. With total fiscal year 2023 sales of more than $86 billion, Lowe’s operates over 1,700 home improvement stores and employs approximately 300,000 associates. Based in Bengaluru, Lowe’s India develops innovative technology products and solutions and delivers business capabilities to provide the best omnichannel experience for Lowe’s customers. Lowe’s India employs over 4,200 associates across technology, analytics, merchandising, supply chain, marketing, finance and accounting, product management and shared services. Lowe’s India actively supports the communities it serves through programs focused on skill-building, sustainability and safe homes. For more information, visit, www.lowes.co.in.

Key Responsibilities

• Executes the development, maintenance, and enhancements of data ingestion solutions of varying complexity levels across various data sources like DBMS, File systems (structured and unstructured), APIs and Streaming on on‐prem and cloud infrastructure; demonstrates strong acumen in Data Ingestion toolsets and nurtures and grows junior members in this capability

• Excels in one more domain; understands pipelines and business metrics and develops expertise on cloud based data stacks and pipeline

• development

• Builds, tests and enhances data curation piplines integrationg data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity

• Supports the development of feature / inputs for the data models in an Agile manner; Hosts Model Via Rest APIs; ensures non‐functional requirements such as logging, authentication, error capturing, and concurrency management are accounted for when model hosting

• Works with Data Science team to understand mathematical models and algorithms; recommends improvements to analytic methods, techniques, standards, policies and procedures; participates in continuous improvement activities including training opportunities; trains others

• Works to ensure the manipulation and administration of data and systems are secure and in accordance with enterprise governance by

• staying compliant with industry best practices, enterprise standards, corporate policy and department procedures

• handles the manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards

• Maintains the health and monitoring of assigned data engineering capabilities that span analytic functions by triaging maintenances; ensures high availability of the platform; monitors workload demands; works with Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application.

Minimum Qualifications

• Bachelor's degree in engineering /computer science, CIS, or related field (or equivalent work experience in a related field)

• 5 years of experience in Data or BI Engineering, Data Warehousing/ETL, or Software Engineering

• 4 years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

• 3 years of experience in Hadoop or any Cloud Bigdata components

• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, Mlib), GCP, Kafka or equivalent Cloud Bigdata components

Preferred Qualification.

• Master's degree in computer science, CIS, or related field

• 5 years of IT experience developing and implementing business systems within an organization

• 5 years of experience working with defect or incident tracking software

• 5 years of experience writing technical documentation in a software development environment

• 3 years of experience working with an IT Infrastructure Library (ITIL) framework

• 3 years of experience leading teams, with or without direct reports

• 5 years of experience working with source code control systems

• Experience working with Continuous Integration/ Continuous Deployment tools

• 5 years of experience in systems analysis, including defining technical requirements and performing high level design for complex solutions direction on specific engineering tasks.

Lowe's is an equal opportunity employer and administers all personnel practices without regard to race, color, religious creed, sex, gender, age, ancestry, national origin, mental or physical disability or medical condition, sexual orientation, gender identity or expression, marital status, military or veteran status, genetic information, or any other category protected under federal, state, or local law.