Engineering Manager II, AI Infrastructure

WHAT IS BOX? 

Box is the world’s leader in Intelligent Content Management. We are trusted by more than 115K organizations around the world today, including nearly 70% of the Fortune 500 and leaders across deeply regulated industries (such as AstraZeneca, JLL, and Nationwide), to protect their data, fuel collaboration, and power critical workflows with secure, enterprise AI.

By joining Box, you will have the unique opportunity to continue driving our platform forward. Content powers how we work. It’s the billions of files and information flowing across teams, departments, and key business processes every single day: contracts, invoices, employee records, financials, product specs, marketing assets, and more. Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations. With the combination of AI and enterprise content, the opportunity has never been greater to transform how the world works together and at Box you will be on the front lines of this massive shift.

Founded in 2005, Box is headquartered in Redwood City, CA, and we have offices across the United States, Europe, and Asia.

WHY BOX NEEDS YOU 

Artificial Intelligence has been rapidly advancing, particularly in the realm of generative AI. Leveraging the latest large language models and massive datasets, AI systems can now generate and understand content at an unprecedented scale. Box AI is a cutting-edge product recently launched by Box to harness the power of these advanced AI models within the Box Content Cloud. Box AI enables organizations to uncover insights, extract metadata for automation, get timely answers to critical questions, and effortlessly create content—all within Box. Box AI is embedded into multiple products on the Box Platform, made possible by the robust AI Platform that powers it.

As an Engineering Manager on AI Platform you will lead a team of Infra and ML engineers to build out the core foundations of this platform that enable applying these AI models to solve real enterprise use cases at scale in a secure and compliant way. We invite you to explore this exciting opportunity to work at the forefront of applied machine learning and generative AI, shaping the future of enterprise productivity and collaboration. If you are enthusiastic about innovative AI solutions and enjoy collaborating with diverse teams, we’d love to hear from you!

WHAT YOU'LL DO

• Lead and mentor a team of infrastructure and ML engineers to develop the AI Platform that powers Box AI.
• Drive technical strategy while ensuring security, compliance, and reliability for our AI solutions.
• Collaborate with cross-functional teams—including Product, Design, Security, and Legal—to create seamless AI-powered experiences.
• Stay informed on trends in AI technology to enhance our platform's capabilities continuously.
• Foster a culture focused on innovation, technical excellence, and ongoing learning.
• Work alongside senior leadership to establish a roadmap for team initiatives over the next year.

WHO YOU ARE

• You are enthusiastic about solving complex machine learning challenges using data-driven approaches.
• You take initiative in your work aiming for outcomes that reflect your values while enjoying collaboration with others.
• You inspire teamwork through mentoring while also valuing opportunities to learn from fellow engineers.
• You bring experience contributing to designing or deploying machine learning systems effectively at various scales.
• You have strong analytical and problem-solving skills, with the ability to work with large and complex datasets.

Required skills

• 7+ years of experience in software engineering / machine learning, with at least 2 years in a people management role.
• Proven ability leading collaborative projects involving multiple stakeholders across different functions.
• Demonstrated capability building effective engineering teams focused on performance improvement.
• Excellent communication skills paired with a collaborative mindset are essential.
• Strong background in AI/ML infrastructure, distributed systems and cloud-based platforms.
• Hands on experience in programming languages (Python, C++, Java or R) with technical background.
• Strong understanding of data structures and algorithms.
• Bachelors in Computer Science or related fields.

Preferred skills

• Masters in Computer Science or a related field
• Proven track record of roadmap planning in which short-term projects ladder up to long-term vision
• Past experience working with AI Infrastructure related to Large Language Models (LLMs) and Retrieval Augmented Generation (RAG)
• Good understanding of one of these areas: information retrieval, natural language processing, query understanding, query expansion
• Familiarity with cloud based ML platforms such as Vertex AI, AWS Bedrock, AWS Sagemaker etc
• Experience with Kubernetes bases systems

Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 2 days per week, with a focus on Tuesdays and Thursdays. Your Recruiter will share more about how we work and company culture during the hiring process.

At Box, we believe unique and diverse experiences benefit our culture, our products, our customers, our company, and our world. We aim to recruit a passionate, high-performing workforce that reflects the world we live in. If you are head-over-heels about this role but unsure if you meet all the requirements, we encourage you to apply!

EQUAL OPPORTUNITY

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. Box strives to respect the dignity and ‎‎independence of people with disabilities and is committed to giving them the same ‎‎opportunity to succeed as all other employees. Inclusiveness is core to our culture at Box, and we strive to ensure you get the most from your interview experience.

Box makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please complete this form. Reasonable accommodations may include scheduling adjustments, document dictation and beyond.

Notice to applicants in Los Angeles:  Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chair Ordinance.  The Fair Chance Ordinance is provided here. 

Notice to applicants in San Francisco:  Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the San Francisco Fair Chair Ordinance.  The Fair Chance Ordinance is provided here. 

For details on how we protect your information when you apply, please see our Personnel Privacy Notice. If you are a California-resident, please read our California Applicant & Candidate Privacy Notice here.