Distributed Software Engineer

Cerebras Systems has pioneered a groundbreaking chip and system that revolutionizes deep learning applications. Our system empowers ML researchers to achieve unprecedented speeds in training and inference workloads, propelling AI innovation to new horizons. 

Condor Galaxy 1 (CG-1), a supercomputer set to revolutionize the world of artificial intelligence. With an astounding processing power of 4 ExaFLOPs, 54 million cores, and a cutting-edge 64-node architecture, the CG-1 is the first milestone of a larger project that will redefine the possibilities of AI. 

The successful completion and deployment of the CG-1, the first of nine powerful supercomputers, is a significant achievement for Cerebras. As we enter phase 2 of the project with CG2, we are taking a bold step towards creating a network of interconnected supercomputers that will collectively deliver a mind-boggling 36 ExaFLOPs of AI compute power upon completion.  

The Role

Cerebras Systems is a pioneer in large-scale AI Supercomputers. These multi-exaflop supercomputers are deployed in some of the biggest datacenters. These supercomputers are built using our Wafer-Scale Cluster technology - a cluster of several Wafer Scale Engine (WSE) chips. The Cluster engineering team is responsible for delivering software that are all-things related to cluster.

Responsibilities 

• A set of push button software workflow to quickly deploy large clusters involving Cerebras WSE, servers and switches
• Additional push button workflows for cluster upgrades, downgrades, and security patching with key metrics to minimize downtime on clusters
• An orchestration and scheduler system for resource allocation, job submission & placements for a multi-user environment on a cluster
• Seamless support for both on-premise and cloud mode deployment and operations
• A robust system for monitoring, detecting and handling failures for a variety of resources on the clusters (including High Availability of clusters)
• Broad cluster and job monitoring and visualization capabilities, along with alerting systems
• User facing tools to monitor the status of jobs and collect metrics
• Administrator facing tools to manage and operate large clusters

Skills and Qualifications 

• Strong track record of software architecture, system design and development for over 6 years or more
• Strong track record of development in distributed cluster environment.
• Strong understanding of Kubernetes (K8s) software ecosystem, Prometheus and Grafana
• Strong development skills in GoLang, Python, bash
• Strong debugging skills with distributed systems
• Strong skill to develop tests for the new features and regress old features

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection  point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

1. Build a breakthrough AI platform beyond the constraints of the GPU
2. Publish and open source their cutting-edge AI research
3. Work on one of the fastest AI supercomputers in the world
4. Enjoy job stability with startup vitality
5. Our simple, non-corporate work culture that respects individual beliefs

Read our blog: Five Reasons to Join Cerebras in 2024.

Apply today and become part of the forefront of groundbreaking advancements in AI.