DevOps engineer, Data Science Platform - Data Platform Department (DPD)

Job Description:

Department Overview

Rakuten Group, Inc. continues to expand its business, and the data platform that supports it also continues to expand. In addition to maintaining stable operation, various projects are underway for new expansions.

Position:

Why We Hire

We are looking for DevOps engineers that are interested building and running a platform for AI applications.

The platform integrates latest solutions including on-prem/cloud computing resources, application frameworks for running new Machine Learning, Deep Learning applications for AI.

You will have many opportunities to use the latest technology, and choose the best platform solutions based on good design thinking.

You will work with small and quick moving teams, and also with other data scientists as the platform customers.

Position Details

-Design, implement and operate distributed system infrastructure.

-Development for infrastructure automation and tool creation.

-Collect infrastructure related metrics to create KPI dashboard.

-Build and maintain monitoring system.

-Lead operation to achieve 24/7 high availability.

Mandatory Qualifications:

-Minimum 5+ years of experience in UNIX/Linux and networking operation.

-Minimum 3+ years of experience in infrastructure automation technologies, such as Docker, Kubernetes, Terraform and Ansible.

-Experience in building logging, monitoring solution for web application, middleware, batch jobs.

-Experience with designing and building tools based on specific requirements.

-Experience in using Jenkins or other CI solutions.

-Ability to talk with Product Manager and our internal users to gather the requirements.

Desired Qualifications:

-Bachelor or Master degree in Computer Science or Engineering.

-Experience in operating public cloud platform such as Google Cloud, Microsoft Azure, etc.

-Experience with Hadoop, MapReduce, HDFS and Big Data querying tools, such as Tez, Hive, and Impala

-Experience with building and maintaining data science platform

-Experience with Nvidia GPU and GPU libraries

-Familiar with AI model lifecycle, data processing in pipeline and LLM model hosting.

#engineer #devopsengineer #technologyplatformdiv

Languages:

English (Speaking - 3 - Advanced)