Hut 8

VP, AI Infrastructure

Remote San Francisco, CA
AI InfiniBand RoCE NVIDIA AMD
Description

VP, AI Infrastructure - Highrise.ai

Location: San Francisco, CA

Department: Highrise.ai

ABOUT HUT 8

Imagine the ultimate destination for those who want to work at the cutting edge of technology, energy, and infrastructure. Hut 8 is on a mission to build and operate some of the world’s largest data centers for next-generation computing workloads, including AI, Colocation, Cloud, and Bitcoin Mining. We are proud to offer interesting and challenging opportunities for individuals who want to build teams, solve problems, and make an impact from day one. If you’re an ambitious individual looking for a career that is as rewarding as it is challenging, you’ve come to the right place.

ABOUT HIGHRISE.AI

At Highrise.ai, we recognize that the shift from traditional software to AI represents one of the most significant technological transformations of our era. Our mission is to accelerate this shift across industries by providing the cutting-edge infrastructure needed to build, scale, and deploy AI at an unprecedented level. 

Our products empower the development and operation of the world’s most advanced large language models (LLMs), generative models, and computer vision models. By offering highly optimized GPU infrastructure, we enable organizations to unlock the full potential of AI, pushing the boundaries of what’s possible in fields such as natural language processing, image recognition, and beyond.

We are committed to driving innovation and efficiency in AI infrastructure, making it easier for companies to transition from concept to production at scale, with the reliability and performance necessary to stay ahead in a rapidly evolving technological landscape. 

ABOUT THE ROLE

Hut 8 is scaling our GPU platform that integrates power, colocation, and compute into a single, operationally owned stack. Customers don’t ask whether we have power or GPUs — they ask who actually runs the operation. 

This role exists to be that answer. 

Hut 8 leadership owns strategy, capital, and customer relationships. You own execution. You are accountable for taking raw, power-backed infrastructure and turning it into production-ready, SLA-backed GPU capacity — at scale. This is not a lab role or a traditional enterprise ops role. It is enterprise-grade operational discipline applied to hyperscale infrastructure, built on direct control of power, facilities, and compute. 

Some of the key responsibilities you should expect are the following:

  • You will run the full operational layer between Hut 8’s facilities and the customer:
    • Deployment, commissioning, and production sign-off
    • Performance, uptime, and SLA ownership
    • Incident response, escalation, and root cause resolution
    • OEM, vendor, and hardware lifecycle management
    • Scaling operations from ~1,100 GPUs to 20,000+ GPUs
  • You are accountable for end-to-end managed GPU operations, including:
    • RDMA networking (InfiniBand and/or RoCE)
    • Multi-tenant and single-tenant production environments
    • 99.9%+ availability targets
    • Repeatable, auditable commissioning processes
    • Enterprise readiness layered onto hyperscale infrastructure
  • You coordinate tightly with Hut 8 teams on:
    • Power, cooling, rack density, and facility readiness
    • Deployment sequencing and capacity expansion
    • Operating constraints driven by energy, thermal, and site realities
  • You build and lead the operational organization:
    • Field operations, deployment, and infra ops teams
    • Hiring, structure, and escalation paths as scale ramps
    • Clear ownership across sites and customers
  • You run a disciplined, hands-on operating rhythm:
    • Daily standups on deployment progress, risks, and blockers
    • Direct oversight of GPU failures, RDMA performance, and thermal issues
    • Production sign-off for each deployment tranche
    • Weekly capacity and readiness planning with facilities
    • Monthly OEM and vendor performance reviews
    • Quarterly planning for expansion, refresh cycles, and new platforms 

ABOUT YOU

  • You are a senior infrastructure operator who has scaled real systems, not just designed them.
  • 10+ years in large-scale infrastructure or hyperscale data center operations
  • 5+ years operating GPU-accelerated and/or HPC environments
  • Direct experience deploying and operating 10,000+ GPUs in managed, production settings
  • Deep expertise in RDMA networking (InfiniBand and/or RoCE)
  • Proven ownership of 99.9%+ uptime and customer-facing SLAs
  • Hands-on operator mindset — you drive issues from detection → root cause → resolution
  • Track record of building repeatable deployment and commissioning playbooks
  • Experience leading teams of 20–50+ across field ops, deployment, and infrastructure
  • Senior leadership background (Director / Senior Director / VP) at a recognized operator
  • Preferred/Bonus:
    • Direct working relationships with NVIDIA and/or AMD
    • Experience with H100, H200, GB200, and/or MI300X platforms
    • Multi-site, parallel deployment experience
    • Background spanning greenfield buildouts and steady-state hyperscale operations 

ABOUT THE WORK ENVIRONMENT

This role is remote or in office in San Francisco. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

WHAT MAKES HUT 8 A GREAT PLACE TO WORK

Hut 8 offers a benefits and wellness program that includes medical, dental, vision, life, and short-term and long-term disability insurance, as well as paid time off. We are proud to invest in building the best team in the industry. At all levels of the organization, we are driven by an entrepreneurial spirit, radical transparency, and relentless growth mentality.

At Hut 8, you will have the opportunity to:

▶ Work with bright, driven peers from a range of educational and professional backgrounds including software development, energy, engineering, entrepreneurship, investment banking, private equity, and management consulting

▶ Design and pitch new products, services, and other initiatives to a leadership team consisting of serial entrepreneurs and seasoned executives and backed by a board of directors consisting of industry veterans of energy, finance, and government

▶ Debate ideas and alternatives in a truly meritocratic setting where the learning curve is steep and the lessons come from both senior and junior members of the team

▶ Build a lifelong network of friends and professional connections at the cutting-edge intersection of technology, energy, and infrastructure

Hut 8
Hut 8

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say