Senior Machine Learning Engineer - Platform, Monetization Generative AI

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

About the Generative AI Production Team
The Post-Training pod under Generative AI Production Team is at the forefront of refining and enhancing generative AI models for advertising, content creation, and beyond. Our mission is to take pre-trained models and fine-tune them to achieve state-of-the-art (SOTA) performance in vertical ad categories and multi-modal applications. We optimize models through fine-tuning, reinforcement learning, and domain adaptation, ensuring that AI-generated content meets the highest quality and relevance standards.

We work closely with pre-training teams, application teams, and multi-modal model developers (T2V, I2V, T2I) to bridge foundational AI advancements with real-world, high-performance applications. If you are passionate about pushing cognitive boundaries, optimizing AI models, and elevating AI-generated content to new heights, this is the team for you.

As a Machine Learning Platform Engineer, you will drive the development of our AI platform, ensuring scalability, efficiency, and robustness for training and serving large-scale diffusion models and multimodal generative AI systems. You will work closely with model researchers, infrastructure engineers, and data teams to optimize distributed training, inference efficiency, and production reliability.

Responsibilities
1) Architect and develop scalable and efficient AI infrastructure to support large-scale diffusion models and multi-modal generative AI workloads.
2) Optimize large model training and inference using PyTorch, Triton, TensorRT, and distributed training libraries (DeepSpeed, FSDP, vLLM).
3) Implement and optimize model using sequence parallelism, pipeline parallelism, and tensor parallelism etc to improve performance on high-throughput training clusters.
4) Scale and productionize generative AI models, ensuring efficient deployment on heterogeneous hardware environments (H100, A100, etc.).
5) Develop and integrate model distillation techniques to enhance the efficiency and performance of generative models, reducing computation costs while maintaining quality.
6) Design and maintain an automated model production pipeline for training/inference at scale, integrating distributed data processing frameworks (Ray, Spark, or custom solutions).
7) Enhance platform stability and efficiency by refining model orchestration, checkpointing, and retrieval strategies.
8) Collaborate with cross-functional teams (ML researchers, software engineers, infrastructure engineers) to ensure seamless model iteration cycles and deployments. Stay ahead of emerging trends in deep learning architectures, distributed training techniques, and AI infrastructure optimization, integrating best practices from academia and industry.Minimum Qualifications:
1) B.S., M.S., or Ph.D. in Computer Science, Electrical Engineering, or a related field. 5+ years of hands-on experience in large-scale machine learning infrastructure and distributed AI model training.
2) Deep expertise in PyTorch, CUDA optimization, and ML frameworks such as DeepSpeed, FSDP, and vLLM. Proven experience in optimizing diffusion models, sequence parallelism, and large-scale transformer-based architectures.
3) Strong understanding of high-performance computing, low-latency inference, and GPU acceleration techniques.
4) Hands-on experience in scaling AI infrastructure, leveraging Kubernetes, Docker, Ray, and Triton inference servers. Deep understanding of AI model orchestration, scheduling, and optimization across large clusters. Proficiency in profiling and debugging large-scale model training and inference bottlenecks.

Preferred Qualifications:
1) Experience deploying multi-modal generative AI models in production.
2) Expertise in compiler-level optimizations, TensorRT, and hardware-aware model tuning.
3) Familiarity with large-scale AI workloads in cloud environments (AWS, GCP, Azure).
4) Strong software engineering background, with a focus on scalability, efficiency, and reliability.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2