Meta

Software Engineer, Systems ML - Collective Compute Enablement

Oslo, Norway
Machine Learning PyTorch C++ Python
Description
Meta is seeking an AI Research Scientist/Software Engineer to join our team. The ideal candidate will have industry experience working on AI infrastructure related topics. The position will involve taking these skills and applying them to solve some of the most crucial and exciting problems that exist on the web. The Collective Compute Enablement team is dedicated to maximizing training performance of Generative AI and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We model and project the performance of current and future training workloads on MTIA while it is being designed to provide early, crucial feedback to the architecture, compiler, and kernels teams. We employ cutting-edge optimization and data parallelization strategies to maximize training throughput for the next generations of LLMs and DLRMs, and we work cross-functionally with many partner teams to assure the end-to-end performance of large-scale training in order to more quickly deliver the next generation of AI experiences to our users.
Software Engineer, Systems ML - Collective Compute Enablement Responsibilities
  • Apply state-of-the-art AI infrastructure and software/hardware acceleration techniques to build and optimize our large-scale AI workloads
  • Analyze, benchmark, and optimize large-scale workloads on next-generation training superclusters
  • Define use cases and develop methodology and benchmarks to evaluate different approaches
  • Set direction and goals for the team related to project impact, AI system design, infrastructure, and developer efficiency
  • Lead large and complex technical efforts across many engineers and teams
  • Influence and impact next-generation of model and hardware architecture choices based on thorough data-driven analyses
  • Helps onboard new team members, provides mentorship, and enables successful ramp up on the team's code base
  • Mentor other engineers, research scientists and improve the quality of engineering work in the broader team
Minimum Qualifications
  • Bachelor’s degree in computer science or a related STEM field
  • Specialized experience in one or more of the following machine learning/AI domains: hardware accelerator architectures, machine learning compilers or ML systems, AI infrastructure, high-performance computing, performance optimizations or ML frameworks such as PyTorch
  • Proven C/C++ and Python programming skills in developing AI Systems infrastructure or AI algorithms
  • Experience with debugging in C++, Python and/or PyTorch
  • Track record of defining and leading long-term plans for the team
  • Track record of mentoring and growing other engineers
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
  • Technical leadership experience
Preferred Qualifications
  • Master's degree/PhD in computer science or related STEM field and experience in AI framework development or accelerating AI models on hardware architectures
  • Experience with training of large-scale AI models
  • Experience with distributed AI systems and communication protocols such as MPI or collective libraries such as NCCL
  • Experience or knowledge in one or more of LLM/LDM, ranking and recommender models or collective communication libraries
Locations
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.



Equal Employment Opportunity and Affirmative Action
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@meta.com.
Meta
Meta
Augmented Reality Metaverse Social Media Social Network Virtual Reality

0 applies

1 views

Other Jobs from Meta

Software Engineer

Bellevue, WA

Software Engineer

Bellevue, WA

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say