Senior Infrastructure Engineer

About Foundry

At Foundry, we are transforming the way AI companies access compute power. Our mission is to orchestrate the world’s compute capacity, making it easier to use and optimized for AI workloads. We're building a new type of public cloud—one designed specifically for AI, where accessing high-performance compute is as simple and reliable as flipping a switch.

Spun out of a Stanford PhD lab just over a year ago, Foundry has already gained the backing of top-tier investors like Sequoia, Lightspeed, Jeff Dean, Eric Schmidt, and others. With $80M in funding, we’ve secured customers and are generating revenue.

Today’s machine learning infrastructure is overly complex. Engineers are forced to make tough decisions about hardware, when their focus should be on solving big problems and driving innovation. Our platform changes that. By abstracting away hardware management and providing seamless access to compute resources, we enable engineers to focus on what really matters—building transformative AI solutions.

We're not just making compute accessible; we're making it flexible, scalable, and tailored for the unique demands of AI. Our infrastructure marketplace brings the power of state-of-the-art hardware without the friction, allowing companies to innovate faster and more efficiently.

Working at Foundry

As an engineer at Foundry, you’ll be at the forefront of building the infrastructure that powers the future of AI. Your role is critical—not just in scaling our systems, but in ensuring they are secure at every level. In an era where AI workloads are becoming larger and more sensitive, security isn't just a priority, it's the foundation of everything we build.

Our platform supports cutting-edge AI workloads, managing vast amounts of data and operating in high-performance, multi-tenant environments. Security is integrated into every layer—from safeguarding GPU clusters to protecting data in real-time. We expect every engineer to be a security-first thinker, designing and implementing solutions that protect both our infrastructure and the AI workloads running on it.

If you're motivated by the challenge of securing the core infrastructure behind AI and thrive in a fast-paced, high-impact environment, Foundry is the place for you. Here, autonomy and ownership are paramount. You'll have the freedom to make significant decisions, backed by a collaborative and inclusive team. Our flat structure ensures your ideas don’t get lost in hierarchy—every engineer shapes both the product and the company's direction.

At Foundry, we demand precision, clear communication, and relentless innovation in how we approach security and scalability. If you’re passionate about pushing boundaries and securing the future of AI, join us and be a part of something transformative.

Joining Foundry

Foundry is looking for a skilled Infrastructure Engineer to join our team. In this role, you will collaborate closely with our development team to architect, build, and deploy cutting-edge infrastructure solutions. You will have the opportunity to learn from experienced industry professionals and gain hands-on experience in a dynamic startup setting.

This position offers a valuable chance for an Infrastructure Engineer to expand their expertise in a fast-paced and innovative environment. You will be involved in exciting projects and play a key role in shaping early infrastructure designs and implementations. If you are passionate about infrastructure engineering and eager to enhance your skills, we invite you to apply and be part of our team.

Responsibilities

• Demonstrate a strong interest and passion for development platforms, MLOps, CI/CD, infrastructure, or creating products for technical teams.
• Make well-informed trade-offs that consider both engineering and product requirements, while effectively balancing short-term needs with long-term goals.
• Utilize your 6+ years of relevant industry experience in a fast-paced, high-growth tech environment to build and scale internal platforms using technologies such as Python, Typescript, Postgres, Kubernetes, Terraform, and a variety of AWS products.
• Apply your expertise in system, API, and infrastructure design, leveraging cloud concepts such as storage volumes, private networks, container scheduling, and Kubernetes to drive effective solutions.
• Develop and maintain integrations with platform entities like storage providers, datasets, models, and metrics.
• Manage the product feature lifecycle, from planning and development to launch and ongoing maintenance.
• Engage in collaborative efforts with fellow engineers to devise elegant architectures and solutions.

Requirements

• Bachelor's or Master's degree in Computer Science or a related field.
• Minimum of 6 years of experience in Infrastructure engineering or a similar role.
• Extensive experience in deploying, managing, and scaling applications with Kubernetes in both cloud and on-premise settings. Familiarity with Kubernetes ecosystem tools (e.g., Helm, Kustomize) is essential.
• Proficiency in infrastructure automation and configuration management tools (e.g., Terraform, Ansible).
• Experience integrating and optimizing gRPC protocols to enhance system communication efficiency and performance.
• Exceptional problem-solving abilities with the capacity to thrive under pressure in a fast-paced environment.
• Ability to work autonomously as well as collaboratively within a team environment.

Nice to have

• Hands-on experience with event-driven data and machine learning infrastructure, encompassing streaming pipelines, database systems, model training, and GPU-accelerated inference.

Benefits

• Health, dental, and vision coverage for you and your dependents
• 401k Plan with 4% company match
• 21 days of PTO & 14 company holidays; including 2 floating holidays

In-Office requirement

At Foundry, we take our work extremely seriously, though not always ourselves. We recognize that we are striving to achieve something substantial—an all-too-rare and elusive counterfactual contribution. Our work is not easy, so we seek out any lever that can accelerate our progress and increase the likelihood of realizing our full ambitions. Working collaboratively in person is one such lever.

Our headquarters is in Palo Alto (next to Caltrain on University Ave.), and we recently opened a new office in San Francisco (Financial District/SoMa) for our teammates based there. We expect team members to primarily work from their home office, with everyone gathering at HQ one day a week while our team remains small and cross-team collaboration is critical.

This approach is built on trust. We take our mission seriously and are committed to fostering an environment where you can make impactful decisions and drive success. We also understand that life can present challenges, and if extenuating circumstances arise, we’re here to support you.

Ultimately, we believe this guidance helps us be as effective as possible while maintaining the spirit of teamwork and flexibility.

Salary Range Information 

In consideration of market analysis and various pertinent factors, the remuneration bracket for this role is set between $170,000 and $230,000. Nevertheless, adjustments beyond this range could be warranted for candidates whose qualifications substantially deviate from those delineated in the job description.

Equal Opportunity Employer

Foundry maintains a strict commitment to Equal Opportunity employment practices. All applicants are evaluated without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

We emphasize that candidates need not fulfill every expectation listed to be eligible for this position. Our objective is to cultivate a diverse team encompassing a spectrum of backgrounds, experiences, and skill sets.