Senior data engineer

Job Family Group:

IT&S Group

Job Description:

Role Synopsis

Digital Customers & Markets (DCM) works with customers & products (C&P), gas & low carbon energy (G&LCE), trading & shipping (T&S) and regions, cities & solutions (RC&S), and focus on enabling and delivering amazing customer experiences that generate value for bp in current and new markets.

DCM Intelligent operations (IO) bridges the gap between bp’s physical and digital worlds to release value and enable world-class operations through deployment of new and emerging digital solutions. Our SMEs and partners work closely with our business units to ensure safe, efficient, and optimized operations and great customer experiences.   

At DCM IO we have embarked on a very exciting journey with a pipeline of leading-edge programmes of work in the field of automation, Internet of Things (IoT) and Edge Vision to name a few. We are building platforms for the future and products focused on these technologies and more. We plan to build a Centre Of Excellence (COE) in Pune that will build and house essential digital capabilities, innovative solutions, toolsets required to deliver products for our customers thereby driving bp’s digital agenda. 

Senior Data Engineer will be part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers, product owners  and Portfolio managers.

Key Accountabilities

• Architects, designs, implements and maintains reliable and scalable data infrastructure.
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
• Adheres to and advocates for software engineering standard methodologies (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
• Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline,
• Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
• Actively contributes to improve developer velocity.
• Creating and code management of  data pipelines  and automation templates
• Testing new / changes to functionalities , creating  test cases
• Designing data storage
• Mentors others.
• Play active role in building DCM COE

Essential Education:

• Bachelor or master’s degree in computer science, Engineering, Informatics, Information Systems or in another quantitative fields

Essential Experience and Job Requirements:

Years of experience: 8 to 12 years with minimum of 5 to 7 years relevant experience

Required Criteria

• Deep and hands-on experience (typically 5+ years) designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
• Development experience in one or more object-oriented programming languages (e.g. Py-spark, Python, Java, C++)
• Experience designing and implementing large-scale distributed data pipelines on AWS/Azure cloud (preferably AWS)
• Advanced data modeling and dimensional modeling knowledge
• Advanced SQL knowledge
• Deep knowledge and hands-on experience in technologies across all data lifecycle stages
• Experience of working in relational and non-relational data bases
• Experience using Azure DevOps , GitHub
• Continuous learning and improvement attitude

Desirable criteria

• Strong customer management and ability to lead large organizations through influence
• Experience of working with Azure / AWS IoT services
• Experience of working in  Energy/Utilities  industry

Additional Information

Key Behaviours

• Empathetic: Cares about our people, our community and our planet
• Curious: Seeks to explore and excel
• Creative: Imagines the extraordinary
• Inclusive: Brings out the best in each other

Travel Requirement:

Up to 10% travel should be expected with this role

Relocation Assistance:

This role is eligible for relocation within country

Remote Type:

This position is a hybrid of office/remote working

Skills:

Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving

​
Legal Disclaimer:

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.