Staff Software Engineer, Golang

Staff Software Engineer, Golang

Mission: Build the APIs and services that will enable over 1M developers to run incredibly fast inference workloads on GroqCloud.

Role Responsibilities & Outcomes:

• Design & Build APIs: Design, develop, and maintain scalable, high-performance backend systems and customer facing APIs that support our inference and console experiences.
• Infrastructure Deployment: Provision and deploy services into our Kubernetes-based environment.
• Testing and Validation: Develop and implement automated testing frameworks and test suites to ensure software quality and reliability. Write tests at all levels and scopes of Groq’s systems using best practices and pragmatic, scalable testing philosophy.
• Monitoring and Observability: Ensure that we understand the performance and quality of our services running in production and can swiftly respond when needed. 
• Cross Functional Collaboration: Collaborate with product, design, and other engineers to ship features from idea to production.

Ideal candidates have:

• 6+ years of software development experience
• 3+ years writing software in Go as your primary language
• Passion for LLMs and knowledge of how to interact with them (constrained decoding, output safeguards, etc)
• Strong understanding of API design principles and RESTful architectures
• Familiarity with multi-region application deployment and associated challenges
• Experience with Kubernetes, Terraform, PubSub/Kafka/Pulsar, and Stytch.
• Experience with Bigquery, Honeycomb, Prometheus + Grafana
• Experience building customer facing RESTful APIs
• Familiarity with streaming architectures and real-time data processing building large data processing flows 
• Experience shipping code to production daily

Logistical Requirements. You must be:

• Authorized to work in the United States
• Available to work US Pacific hours
• For in-person roles, available to work from the office at least Tuesday/Thursday

Attributes of a Groqster:

• Humility - Egos are checked at the door
• Collaborative & Team Savvy - We make up the smartest person in the room, together
• Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
• Curious & Innovative - Take a creative approach to projects, problems, and design
• Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking

If this sounds like you, we’d love to hear from you!

Compensation: At Groq, a competitive base salary is part of our comprehensive compensation package, which includes equity and benefits. For this role, the base salary range is $205,530 to $278,070, determined by your skills, qualifications, experience and internal benchmarks.