Spectro Cloud

Technical Lead

San Jose, CA
Go Kubernetes Python Hugging Face FastAPI PyTorch LangChain LangGraph AWS Azure GCP Linux API Microservices AI Machine Learning LLM RAG
Description

Who We Are

Spectro Cloud aims to make infrastructure boundaryless for the enterprise, from data center to edge and every platform in between. We provide solutions that help enterprises run applications on Kubernetes, their way, anywhere.

Established by a team of multi-cloud management experts and industry veterans with a track record of success, we're at the forefront of multi-cloud management solutions. What makes us stand out is our team's commitment and strong backing from industry-leading investors, driving our progress. Our collective focus is on delivering unmatched value that resonates with our customers, and you can take pride in being involved with it.

About The Job

At Spectro Cloud, we are in search of a talented individual to become an integral part of our Engineering team, playing a pivotal role in shaping the future of our cutting-edge Palette platform.

As a software engineer within our organization, you will be at the forefront of building an always-on, self-healing, and declarative platform specifically engineered for the management of both infrastructure and applications. You will have the opportunity to contribute significantly by designing, optimizing, and streamlining GoLang-based microservices and AI-powered capabilities that serve as the foundation of our platform. Proficiency in Kubernetes is required - it lies at the very heart of our contemporary cloud-native, data center and edge solutions.

Your responsibilities will include building production-grade AI systems - designing, implementing, and maintaining LLM-powered applications, agentic AI workflows, and RAG pipelines across multiple product use-cases. You will actively participate in guided technical labs covering prompt engineering, vector databases, LLM deployment tooling, multi-agent orchestration, fine-tuning strategies, and evaluation techniques. You will develop, refine, and operationalize LLM solutions, including prompt design, retrieval strategies, embedding pipelines, LangChain/LangGraph workflows, and API integrations using Python, Hugging Face, FastAPI, and similar frameworks.

Your responsibilities will also include ensuring the seamless operation of our platform through a combination of automation, scripting, and rigorous testing. Our organization places a strong emphasis on code quality, and your commitment to producing clean and efficient code is highly regarded.

You will stay ahead of emerging AI trends - small models, efficient inference (vLLM/TensorRT), multimodal systems, on-device LLMs - and recommend tools, frameworks, or integrations that enhance our platform. Collaboration is of utmost importance. You will work closely with cross-functional teams to create scalable, dependable, and secure solutions that push boundaries. In this role, we encourage you to stay current with industry trends and emerging technologies, thereby ensuring that our solutions remain innovative and ahead of the curve. By joining our team, you will become an influential driving force in shaping the future of AI-powered Kubernetes management at scale through Palette, the modern enterprise Kubernetes management platform offered by Spectro Cloud.

Qualities

As a software engineer at Spectro Cloud, you'll succeed by embracing adaptability, tackling complex challenges, and navigating dynamic environments with confidence. Success in this role depends on your ability to break down intricate challenges into manageable steps and deliver value through iterative, test-and-learn approaches. At Spectro Cloud, we champion innovation and collaboration, fostering a culture where shared ideas drive progress.

Qualifications

While we don't expect candidates to check every box, we do look for the following when assessing applicants:

  • Bachelor's degree in Computer Science or related technical field

  • 8+ years of software development experience (or 6+ years with a Master's degree)

  • Strong LLM/GenAI fundamentals: Solid understanding of large language models, prompt engineering, embeddings, vector search, RAG systems, and lightweight fine-tuning (LoRA/PEFT preferred)

  • Python expertise: Proficiency in Python and hands-on experience with AI/ML libraries such as Hugging Face, PyTorch, LangChain, LangGraph, FastAPI, or similar frameworks

  • LLM deployment experience: Familiarity with Kubernetes-based inference stacks including vLLM, llm-d, TensorRT, PyTorch Serve, or comparable deployment frameworks

  • Proficiency in at least one modern programming language such as Go, Java, or equivalent

  • Solid understanding of containerization and orchestration concepts, including Kubernetes

  • Deep understanding of microservices architecture and REST API design principles

  • Experience designing and building scalable, cloud-native applications

  • Analytical problem-solving: Ability to debug model outputs, improve retrieval accuracy, optimize latency, and iterate quickly through experiments

  • Cloud & AI ecosystem knowledge: Experience with AI/agent frameworks (LangChain, AutoGen, LlamaIndex) and cloud platforms (AWS, Azure, GCP, etc.)

  • Familiarity with virtual machine usage and integration within software solutions

  • Comfortable working in Linux-based environments and using common command-line tools

  • Experience with Cluster-API or deploying AI models to edge devices (NVIDIA Jetson, x86 edge nodes, ARM platforms) is a plus

  • Exposure to Kubernetes-native developer tooling, observability, or MLOps pipelines is a plus

  • Kubernetes certification (CKA or CKAD) is a plus

The Hiring Process

At Spectro Cloud, we highly value your time and dedication throughout the hiring process. Therefore, we aim to ensure that our interactions are efficient and focused on delivering value.

Our interview process for Engineering roles typically comprises three to four stages:

  • Initial screening interview

  • One or two technical interviews, including hands-on coding assessments

  • Final round to assess team fit and engage in detailed discussions

The majority of our interviews are conducted via Zoom. We recommend having a laptop with a reliable internet connection, and if possible, a functional camera for a more engaging experience.

We appreciate your commitment to our hiring process and look forward to getting to know you better.

Become a Spectronaut and join us in shaping the future!


Work Authorization/Visa: Applicants are required to be eligible to lawfully work in the U.S. immediately; employer is unable to sponsor applicants for U.S. work authorization (e.g., H-1B visa) for this opportunity.

2026-118

Spectro Cloud
Spectro Cloud

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say