Software Architect

Location: Israel

We build products that transform spoken content into actionable intelligence- unlocking insights, assets, and value from every conversation. 
 

We are looking for an experienced Software Architect to lead the design and development of our AI-driven software solutions. This role combines deep hands-on architecture with technical leadership, working closely with the CTO to shape system design, guide teams, and align engineering efforts with business goals, with a strong focus on AI-driven capabilities. 

Responsibilities 

• Design and implement software architecture and system structure

• Provide technical leadership and architectural guidance to engineering teams

• Own the architectural vision and contribute to the technology roadmap

• Translate business requirements into scalable technical solutions

• Design and evolve AI/GenAI components, including model integration, orchestration and data flow 

• Guide teams on efficient use of LLMs (latency, cost, scalability)

• Evaluate and recommend tools, technologies, and processes

• Work closely with the CTO, product, and engineering teams to ensure alignment between architecture and business goals

• Ensure quality, scalability, performance, and reliability of the system

Requirements 

• Strong experience in software architecture and system design

• 5–10+ years of software development experience

• Strong proficiency in modern programming languages (e.g., Java, Python, Node.js)

• Experience building enterprise-grade systems, with a focus on performance, scalability, reliability, and security 

• Experience with cloud platforms and distributed systems (AWS / GCP)

• Strong understanding of microservices architectures and high-scale systems

• Hands-on experience building or architecting LLM-based systems in production

• Strong understanding of RAG architectures, embeddings, and vector databases 

• Strong understanding of agentic architectures 

• Experience with LLM orchestration frameworks and context engineering 

• Excellent problem-solving and communication skills 

• Highly hands-on — ability to design and implement solutions, not just define architecture 

• A team player who drives collaboration and communicates effectively across teams 
   

What makes Verbit unique? 
 
Our team of 250 professionals builds AI-driven solutions that help the world’s leading organizations get real value from their audio and video content. We serve high-end customers across the Legal, Media and Education markets with a next-generation verbal-intelligence platform that brings AI into the core of their workflows. 
 
Our in-house technology combines advanced LLMs, GenAI capabilities and speech AI to power everything from legal-tech automation and real-time insights to intelligent media and learning workflows. Beyond transcription or accessibility, Verbit provides actionable intelligence: smart summaries, analytics, search, knowledge extraction, legal-deposition insights and more. 
 
With more than 3,000 global customers relying on Verbit- including top law firms, universities, enterprises and media organizations- we’re building the future of how speech data is processed, understood and used. 

We’re a group of:

• Tech-savvy individuals who are always open to more growth and learning opportunities

• Adaptable and flexible people who thrive in a fast-paced, startup environment

• Creative minds who rethink and question how to outperform past results

• Effective communicators who can promote and represent Verbit’s tech and brand