AI Engineer & Researcher - Multimodal

About the Role

The multimodal team at xAI creates magical AI experiences beyond text, enabling understanding and generation of content across various modalities, including image, video, and audio.

As a multimodal researcher/engineer, you will drive the model’s multimodal capability through various aspects such as data, modeling, serving and product. You will collaborate with pre-training, post-training, data/reasoning, applied, product teams to push the frontiers of model capability as well as the end-to-end user experience.

Location

The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.

Focus

• Creating and driving research agenda to advance multimodal capabilities, which include both multimodal understanding and multimodal generation, across different modalities like image, video and audio.
• Improving data quality, developing data filtering/generation techniques, and performing data study.
• Creating evaluation frameworks and internal benchmarks.
• Designing and implementing effective and efficient algorithms for achieving state-of-the-art model performance.

Ideal Experience

• Track record in leading research that significantly improves the capability and performance of neural networks, whether better data or better modeling.
• Experience in data-driven experiment designs and systematic analysis for iterative model debugging.
• Experience in developing or working with large-scale distributed machine learning systems.
• Ability to do whatever is necessary to deliver the best end-to-end user experience.

Tech Stack

• Python
• Jax
• Rust

Interview Process

After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15 minute interview (“intro call”) during which a member of our team will ask some basic questions. If you clear the initial , you will enter the main process, which consists of four technical interviews:

• One-on-one research discussion & coding interviews (three meetings total)
• Meet the Team: Present your past exceptional work and your vision with xAI to a small audience.

Every application is reviewed by a member of our technical team. All interviews will be conducted via Google Meet.

Annual Salary Range

$180,000 - $440,000 USD