Reflection AI

Research Software Engineer

New York, NY San Francisco, CA
Bash C++ Python SQL API Machine Learning Deep Learning Hadoop Kubernetes Docker Git AWS GCP Ray PyTorch JAX TensorFlow Spark
Description

Member of Technical Staff - Research Software Engineer

Department: Engineering

Location: New York, London, San Francisco

Employment Type: FullTime

Our Mission

Reflection’s mission is to build open superintelligence and make it accessible to all.

We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond.

The Roles Mission

Bridge the gap between research and production by turning cutting-edge algorithms into scalable training systems. You will design and optimize the core infrastructure behind frontier AI models — from reinforcement learning training loops and distributed GPU training to massive-scale data pipelines.

Our systems train models across thousands of GPUs and process petabyte-scale datasets. We care deeply about numerical stability, throughput, and reproducibility.

What This Team Does

This team owns and evolves the core infrastructure behind our training systems.

We focus on:

  • Reinforcement learning training infrastructure

  • Distributed training and inference systems

  • Experiment infrastructure and reproducibility

  • Large-scale data pipelines

The goal is to build the engineering foundation that allows researchers to iterate quickly while training models at massive scale.

About the Role

You will architect and optimize the core training infrastructure that powers our models. This includes RL training loops, distributed GPU systems, and large-scale data pipelines.

You will work closely with researchers to transform new ideas into reliable, scalable training systems.

Responsibilities include:

  • Designing and optimizing large-scale training loops and data pipelines.

  • Implementing state-of-the-art techniques and ensuring they are numerically stable and computationally efficient.

  • Building internal tooling for launching, monitoring, and reproducing complex experiments.

  • Diagnosing deep bottlenecks across the training stack (GPU memory issues, communication overhead, dataloader stalls).

  • Translating research prototypes into reusable, production-grade infrastructure.

What You'll Work With

Distributed Training

  • GPU parallelism (data, tensor, pipeline, expert)

  • Large-scale distributed training infrastructure

  • Communication optimization (NCCL, RDMA, GPU interconnects)

  • FSDP / ZeRO and model sharding

Orchestration & Runtime Systems

  • Ray, Kubernetes, Slurm

  • Distributed runtimes and async systems

  • Containerization and sandboxing

Frameworks

  • PyTorch

  • JAX

  • Megatron-style training stacks

  • Triton / custom kernels

Data Infrastructure

  • Large-scale dataset curation pipelines

  • Deduplication and filtering systems

  • Tokenization and preprocessing

  • Distributed data processing frameworks

About You

  • You are a strong software engineer who speaks the language of machine learning.

  • You may not have a PhD, but you know how to implement a research paper.

  • You have deep experience in at least one of the following: Distributed Training & Inference or Data Infrastructure

  • You enjoy working at the boundary between:

    • Machine learning algorithms

    • Distributed systems

    • High-performance computing

  • You care deeply about performance, numerical stability, and reproducibility.

  • You thrive in high-agency environments and enjoy solving hard technical problems.

What We Offer:

We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent-dense team. You will help define our future as a company, and help define the frontier of open foundational models.

We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.

  • Top-tier compensation: Salary and equity structured to recognize and retain the best talent globally.

  • Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance.

  • Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning.

  • Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time.

  • Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off-sites and team celebrations.

Reflection AI
Reflection AI

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say