Machine Learning Research Engineer

Location: Menlo Park, CA

Department: Engineering

Location Type: IN_OFFICE

Employment Type: FULL_TIME

• Train foundation models from scratch that integrate multiple modalities.
• Train and fine-tune large language models (LLMs) and multi-modal models (MMMs).
• Design and implement models capable of solving discrete and continuous constraint reasoning tasks and graph-related challenges.
• Structure and optimize data for model training, ensuring high performance and efficiency.
• Create data synthetically and collect it from human interactions for diverse tasks.
• Build and optimize both open-source and proprietary models, considering various constraints.
• Design and execute innovative search and retrieval algorithms.

• Strong software engineering skills, particularly in Pytorch, Python, CUDA, and Triton.
• Deep expertise in machine learning, including sequence modeling, generative models, and model architecture.
• Experience in pre-training and fine-tuning large multi-modal models.
• Proven track record of publications in top AI conferences and competitions.
• Experience implementing research papers into production code.
• Familiarity with the latest state-of-the-art techniques, including prompting and inference-time search methods.
• Experience in developing and managing large-scale machine learning systems.
• Proficiency in configuring and optimizing hardware and operating systems for maximum performance.
• Experience building distributed training systems for AI models in high-performance computing (HPC) clusters.

• Unlimited PTO: Recharge when you need it, no questions asked.
• Comprehensive Health Coverage: Medical, dental, and vision insurance for you and your dependents. 
• Free Meals and Snacks: Daily lunches, dinners, and snacks in the office.
• Professional Growth: We invest in your continuous learning and offer opportunities to expand your skills.
• Visa Sponsorship: We welcome global talent and provide visa sponsorship to support qualified candidates.