AI Systems Performance Specialist

Team: IT

Location: US

Commitment: Full-time

Workplace Type: remote

Accountabilities:

The AI Systems Performance Specialist will lead efforts to improve the efficiency and reliability of advanced AI workloads through profiling, optimization, and engineering best practices. This role requires strong technical ownership, analytical thinking, and the ability to collaborate across machine learning and infrastructure teams.

• Profile and optimize end-to-end AI training and inference pipelines to improve throughput, latency, and cost efficiency.
• Identify performance bottlenecks across data pipelines, model execution, memory usage, communication layers, and infrastructure components.
• Implement optimization strategies including quantization, sparsity, pruning, and other model efficiency techniques.
• Optimize distributed training systems using approaches such as tensor parallelism, pipeline parallelism, FSDP, and ZeRO-style sharding.
• Improve large language model serving performance through techniques such as KV cache optimization, continuous batching, and speculative decoding.
• Develop and apply compiler-level optimizations using technologies such as Triton, XLA, TorchInductor, or TVM.
• Optimize data loading, storage access patterns, and dataset sharding strategies for high-performance AI workloads.
• Build and maintain benchmarking frameworks, regression testing systems, and performance measurement tools.
• Collaborate with machine learning and platform engineering teams to integrate optimization best practices into production workflows.
• Drive cost optimization initiatives through improvements in model architecture, hardware utilization, and workload scheduling.
• Evaluate emerging AI hardware and software technologies and recommend adoption strategies.
• Create technical documentation, optimization playbooks, and knowledge-sharing materials for engineering teams.
• Stay current with AI systems research and translate new developments into practical production improvements.

Requirements:

The successful candidate will bring extensive experience in AI systems, performance engineering, or high-performance computing, with a strong ability to analyze and optimize complex machine learning workloads. The ideal profile combines software engineering expertise, deep understanding of modern AI infrastructure, and strong problem-solving skills.

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.
• 6+ years of experience in performance engineering, machine learning systems, distributed computing, or high-performance computing environments.
• Strong programming skills in Python and C++.
• Hands-on experience optimizing deep learning workloads on modern GPU architectures.
• Deep understanding of distributed training and inference architectures.
• Experience using profiling and performance analysis tools across CPU, GPU, and distributed systems.
• Strong knowledge of memory hierarchies, communication primitives, and parallel computing strategies.
• Familiarity with model compression techniques and understanding their impact on accuracy and performance.
• Excellent measurement, debugging, and analytical reasoning abilities.
• Strong communication and collaboration skills with the ability to work effectively across engineering teams.

Preferred qualifications include:

• Experience optimizing large language model inference systems at production scale.
• Contributions to AI infrastructure projects such as vLLM, TensorRT-LLM, DeepSpeed, or similar technologies.
• Experience developing custom GPU kernels using Triton, CUTLASS, or related frameworks.
• Familiarity with FinOps practices for managing AI infrastructure costs.
• Technical publications, conference presentations, or community contributions related to AI systems performance.

Benefits:

• Fully remote work opportunity within the Continental United States.
• Competitive annual salary range of approximately $100,000 - $150,000, depending on experience and qualifications.
• Full-time direct employment opportunity.
• Opportunity to work on advanced AI systems and large-scale machine learning infrastructure.
• Career growth opportunities within an innovative technology environment.
• Exposure to cutting-edge AI optimization techniques and emerging technologies.
• Collaborative culture focused on engineering excellence, learning, and continuous improvement.
• Opportunity to contribute to impactful cloud, AI, and enterprise technology solutions.
• Inclusive workplace committed to equal opportunity and professional development.