AMD logo

HPC & AI Infrastructure Engineer

AMD

On-site
San Jose, CA
Full-time
Mid Level
$176k–$251kPosted 1h ago

Real job — pulled straight from AMD’s careers page · Verified November 22, 2026 · No reposts.

Earn while you search

Sponsored

AI labs pay engineers by the hour to test and improve their models. Remote, part-time, your hours.

Job description

AMD is hiring a HPC & AI Infrastructure Engineer — a full-time, based in San Jose, CA role ($176k–$251k). Apply directly on AMD's careers page below.



ADVANCE YOUR CAREER. ADVANCE THE WORLD. 

At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. 

 

Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.




THE ROLE:

Join AMD IT’s Compute Platforms Engineering team and help build the infrastructure powering high-performance computing, distributed AI training, and inference workloads. As an HPC & AI Infrastructure Engineer, you will work in a highly technical, hands-on environment supporting large-scale CPU and GPU compute platforms across on-premises and cloud environments.

This is an opportunity to work at the intersection of AI, HPC, GPU computing, high-speed networking, storage, and cloud infrastructure. You will help bring new compute capabilities into production, improve the performance and reliability of existing platforms, and gain exposure to evolving technologies supporting increasingly complex AI and engineering workloads. You will collaborate with infrastructure architects, network and operations engineers, researchers, cloud providers, and hardware and technology partners to solve challenging systems problems and deliver scalable computing solutions.

 

THE PERSON:

You are a collaborative and curious engineer who enjoys solving complex infrastructure problems and understanding how systems perform from end to end. You approach troubleshooting methodically, use data to guide decisions, and look for opportunities to improve reliability and simplify operations through automation. You communicate technical information clearly, work effectively with globally distributed teams, and are comfortable independently delivering defined engineering work while collaborating with technical experts on broader architectural decisions.

 

KEY RESPONSIBILITIES:

  • Deploy, configure, and maintain Linux-based CPU and GPU compute clusters supporting HPC, distributed AI training, and inference workloads.
  • Administer and optimize workload environments utilizing technologies such as Slurm and Kubernetes, including scheduling, resource allocation, access, and workload troubleshooting.
  • Support AI and distributed computing platforms by managing software environments, containers, GPU runtimes, and workload deployments.
  • Automate infrastructure provisioning, configuration, and lifecycle management using scripting, configuration management, and infrastructure-as-code practices.
  • Validate compute hardware, BIOS, firmware, GPU drivers, and software compatibility and support platform upgrades through testing, rollout, and rollback planning.
  • Configure and troubleshoot host networking for HPC and GPU environments, including high-speed NICs, RDMA interfaces, VLANs, MTU configuration, IP addressing, and routing.
  • Partner with network engineering teams to deploy and validate high-performance RoCEv2 or InfiniBand fabrics and investigate connectivity, congestion, and end-to-end RDMA performance.
  • Troubleshoot complex issues spanning compute, GPU, networking, storage, virtualization, container, and cloud environments.
  • Perform cluster acceptance testing and workload benchmarking to identify performance bottlenecks and improve system performance, utilization, scalability, and reliability.
  • Develop and enhance monitoring, dashboards, and alerting while contributing to incident resolution, root-cause analysis, and preventive improvements.
  • Partner with security and operations teams to maintain platform security, apply updates, and address vulnerabilities.
  • Develop and maintain technical documentation, operating procedures, deployment guidance, and troubleshooting runbooks.
  • Collaborate with internal infrastructure teams, cloud providers, and technology and hardware partners to introduce new compute capabilities and resolve complex technical challenges.

 

PREFERRED EXPERIENCE:

  • Hands-on experience with Linux systems engineering, HPC infrastructure, distributed computing, GPU infrastructure, or large-scale compute environments.
  • Experience deploying, administering, or supporting production of HPC or GPU compute clusters.
  • Strong Linux administration and troubleshooting skills across operating systems, networking, storage, and system performance.
  • Experience with Slurm, Kubernetes, or comparable workload scheduling and orchestration platforms.
  • Experience with GPU drivers, containerized GPU workloads, and accelerator software stacks; familiarity with AMD Instinct GPUs, ROCm, or RCCL is particularly relevant.
  • Knowledge of distributed computing concepts such as MPI, collective communication, and multi-node AI training.
  • Experience with high-speed Ethernet or InfiniBand networking, including exposure to 100/200/400 Gb/s environments.
  • Knowledge of RDMA technologies such as RoCEv2 or InfiniBand and concepts including queue pairs, PFC, ECN, and their impact on fabric performance.
  • Familiarity with data center networking concepts including leaf-spine topologies, ECMP, oversubscription, latency, bandwidth, and congestion.
  • Familiarity with Kubernetes networking for GPU workloads, including CNI plugins, SR-IOV, or RDMA device plugins, is desired.
  • Experience with shared or parallel storage technologies such as NFS, Lustre, BeeGFS, IBM Storage Scale, Weka, or comparable platforms.
  • Proficiency with Python or Bash and experience with automation and infrastructure technologies such as Ansible, SaltStack, Terraform, or comparable tools.
  • Experience with Git-based development workflows and monitoring technologies such as Prometheus and Grafana.
  • Experience with cloud infrastructure such as OCI, Azure, AWS, specialized GPU cloud providers, or comparable platforms.
  • Familiarity with KVM virtualization, PyTorch, and AI inference platforms such as vLLM or SGLang are desired.

 

ACADEMIC CREDENTIALS:

  • Bachelor’s or master’s degree in Computer Science, Computer Engineering, or a related technical field is preferred.

 

This role is not eligible for visa sponsorship.

 

#LI-DP1




Benefits offered are described: AMD benefits at a glance.

 

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

 

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

 

This posting is for an existing vacancy.



THE ROLE:

Join AMD IT’s Compute Platforms Engineering team and help build the infrastructure powering high-performance computing, distributed AI training, and inference workloads. As an HPC & AI Infrastructure Engineer, you will work in a highly technical, hands-on environment supporting large-scale CPU and GPU compute platforms across on-premises and cloud environments.

This is an opportunity to work at the intersection of AI, HPC, GPU computing, high-speed networking, storage, and cloud infrastructure. You will help bring new compute capabilities into production, improve the performance and reliability of existing platforms, and gain exposure to evolving technologies supporting increasingly complex AI and engineering workloads. You will collaborate with infrastructure architects, network and operations engineers, researchers, cloud providers, and hardware and technology partners to solve challenging systems problems and deliver scalable computing solutions.

 

THE PERSON:

You are a collaborative and curious engineer who enjoys solving complex infrastructure problems and understanding how systems perform from end to end. You approach troubleshooting methodically, use data to guide decisions, and look for opportunities to improve reliability and simplify operations through automation. You communicate technical information clearly, work effectively with globally distributed teams, and are comfortable independently delivering defined engineering work while collaborating with technical experts on broader architectural decisions.

 

KEY RESPONSIBILITIES:

  • Deploy, configure, and maintain Linux-based CPU and GPU compute clusters supporting HPC, distributed AI training, and inference workloads.
  • Administer and optimize workload environments utilizing technologies such as Slurm and Kubernetes, including scheduling, resource allocation, access, and workload troubleshooting.
  • Support AI and distributed computing platforms by managing software environments, containers, GPU runtimes, and workload deployments.
  • Automate infrastructure provisioning, configuration, and lifecycle management using scripting, configuration management, and infrastructure-as-code practices.
  • Validate compute hardware, BIOS, firmware, GPU drivers, and software compatibility and support platform upgrades through testing, rollout, and rollback planning.
  • Configure and troubleshoot host networking for HPC and GPU environments, including high-speed NICs, RDMA interfaces, VLANs, MTU configuration, IP addressing, and routing.
  • Partner with network engineering teams to deploy and validate high-performance RoCEv2 or InfiniBand fabrics and investigate connectivity, congestion, and end-to-end RDMA performance.
  • Troubleshoot complex issues spanning compute, GPU, networking, storage, virtualization, container, and cloud environments.
  • Perform cluster acceptance testing and workload benchmarking to identify performance bottlenecks and improve system performance, utilization, scalability, and reliability.
  • Develop and enhance monitoring, dashboards, and alerting while contributing to incident resolution, root-cause analysis, and preventive improvements.
  • Partner with security and operations teams to maintain platform security, apply updates, and address vulnerabilities.
  • Develop and maintain technical documentation, operating procedures, deployment guidance, and troubleshooting runbooks.
  • Collaborate with internal infrastructure teams, cloud providers, and technology and hardware partners to introduce new compute capabilities and resolve complex technical challenges.

 

PREFERRED EXPERIENCE:

  • Hands-on experience with Linux systems engineering, HPC infrastructure, distributed computing, GPU infrastructure, or large-scale compute environments.
  • Experience deploying, administering, or supporting production of HPC or GPU compute clusters.
  • Strong Linux administration and troubleshooting skills across operating systems, networking, storage, and system performance.
  • Experience with Slurm, Kubernetes, or comparable workload scheduling and orchestration platforms.
  • Experience with GPU drivers, containerized GPU workloads, and accelerator software stacks; familiarity with AMD Instinct GPUs, ROCm, or RCCL is particularly relevant.
  • Knowledge of distributed computing concepts such as MPI, collective communication, and multi-node AI training.
  • Experience with high-speed Ethernet or InfiniBand networking, including exposure to 100/200/400 Gb/s environments.
  • Knowledge of RDMA technologies such as RoCEv2 or InfiniBand and concepts including queue pairs, PFC, ECN, and their impact on fabric performance.
  • Familiarity with data center networking concepts including leaf-spine topologies, ECMP, oversubscription, latency, bandwidth, and congestion.
  • Familiarity with Kubernetes networking for GPU workloads, including CNI plugins, SR-IOV, or RDMA device plugins, is desired.
  • Experience with shared or parallel storage technologies such as NFS, Lustre, BeeGFS, IBM Storage Scale, Weka, or comparable platforms.
  • Proficiency with Python or Bash and experience with automation and infrastructure technologies such as Ansible, SaltStack, Terraform, or comparable tools.
  • Experience with Git-based development workflows and monitoring technologies such as Prometheus and Grafana.
  • Experience with cloud infrastructure such as OCI, Azure, AWS, specialized GPU cloud providers, or comparable platforms.
  • Familiarity with KVM virtualization, PyTorch, and AI inference platforms such as vLLM or SGLang are desired.

 

ACADEMIC CREDENTIALS:

  • Bachelor’s or master’s degree in Computer Science, Computer Engineering, or a related technical field is preferred.

 

This role is not eligible for visa sponsorship.

 

#LI-DP1



Benefits offered are described:  AMD benefits at a glance.

 

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

 

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.  AMD’s “Responsible AI Policy” is available here.

 

This posting is for an existing vacancy.



Tags: No, USD $175,700.00/Yr., USD $251,000.00/Yr., US Careers (External)

Get HPC & AI Infrastructure Engineer jobs like this→

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
Maania Consultancy Services logo

DevOps Engineer

Houston, TX
✓ From careers page· 1d ago
Inabia Software & Consulting Inc. logo

HPE HSS & AAA Operations Engineer

$110k–$110kRidgeland, MS
✓ From careers page· 1d ago

Frequently asked questions

What is the salary for HPC & AI Infrastructure Engineer at AMD?

The estimated salary range for HPC & AI Infrastructure Engineer at AMD is $176,000 - $251,000 USD per year.

What skills are required for HPC & AI Infrastructure Engineer at AMD?

The required skills for HPC & AI Infrastructure Engineer at AMD include: Linux, AI, Kubernetes, Python, Bash, Ansible, Terraform, Git, Prometheus, Grafana, Oracle Cloud, Azure, AWS, PyTorch.

What is the seniority level for HPC & AI Infrastructure Engineer at AMD?

HPC & AI Infrastructure Engineer at AMD is a Mid Level level position.

How do I apply for HPC & AI Infrastructure Engineer at AMD?

You can view the full description and apply for HPC & AI Infrastructure Engineer at AMD on EchoJobs: https://echojobs.io/job/amd-hpc-ai-infrastructure-engineer-3tp64.