Infrastructure Software Engineer, On Prem Deployments

The Opportunity

AI is rapidly transforming the world. Whether it’s developing the next generation of human-level intelligence, enhancing voice assistants, or enabling researchers to analyze genetic markers at scale, AI is increasingly integrated into various aspects of our daily lives.

Arize is the leading AI observability and Evaluation platform to help AI teams discover issues, diagnose problems, and improve the results of their AI Applications. We are here to build world class software that helps make AI applications work better.

As our On-Premises Infrastructure Engineer reporting to the Head of AI Infrastructure, you'll be instrumental in designing and implementing deployment architectures and software that bring Arize's powerful capabilities directly into our customers' environments. This is a unique opportunity to bridge the gap between cutting-edge AI observability and enterprise infrastructure requirements.

The Role

We're seeking an exceptional Infrastructure Engineer who can navigate complex enterprise environments and has a proven track record of building scalable on-premises solutions. You'll be a key player in our engineering organization, working directly with the CTO and customers to architect and implement solutions that enable seamless deployment of our platform across diverse customer environments.

We are a fully remote company with offices in Bay Area, NYC

What You’ll Work On

• Design and implement robust deployment architectures that enable Arize to run efficiently in diverse customer environments, from air-gapped systems to hybrid cloud setups
• Collaborate with customers to understand their infrastructure requirements and create tailored deployment solutions that meet their security, compliance, and performance needs
• Develop and maintain automation tools and frameworks that streamline the deployment, upgrade, and maintenance processes for on-premises installations
• Partner with the product team to ensure new features are compatible with on-premises deployments and create efficient release mechanisms
• Create comprehensive monitoring and observability solutions that enable customers to maintain and troubleshoot their Arize installations effectively
  
  

What Will Set You Apart

• 5+ years of experience in infrastructure engineering, with significant exposure to enterprise on-premises deployments
• Deep expertise in container orchestration platforms (especially Kubernetes) and infrastructure-as-code tools like Terraform
• Strong background in enterprise networking, security requirements, and compliance considerations
• Experience working with multiple cloud providers (AWS, GCP, Azure) and understanding how to adapt cloud-native architectures for on-premises environments
• Track record of building and maintaining automation tools that improve deployment reliability and reduce operational overhead
• Excellent communication skills and ability to work directly with customers to understand and address their infrastructure needs
• Experience with Python, Golang, and JavaScript is highly desirable
  
  

The estimated annual salary and variable compensation for this role is between $160,000 - $210,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.