Data Scientist - LLM Pipeline focus

Gorgias is the conversational AI platform for ecommerce that drives sales and resolves support inquiries. Trusted by over 15,000 ecommerce brands, Gorgias supports growing independent shops to globally recognizable brands.

Built for Shopify and powered by advanced ecommerce integrations, Gorgias's conversational AI understands your brand, tools, policies, and customers to drive personalized, 1-to-1 conversations — from editing orders and initiating returns to making product recommendations. Gorgias, where every customer interaction feels personal, support becomes sales, and conversations shape success.

About the Team

You'll be joining our dynamic Automate team, a cross-functional group dedicated to revolutionizing customer support in the e-commerce space. Our mission is to seamlessly automate interactions between merchants and shoppers, creating effortless experiences for both sides. The Automate team consists of talented Software Engineers, Machine Learning Engineers, Product Managers, and Designers, all working collaboratively to push the boundaries of AI-driven customer support. Our primary focus is developing and refining an innovative AI Agent capable of automatically answering customer requests with accuracy and efficiency.

What you will do

Role Overview: As a Data Scientist focused on LLM at Gorgias, you will play a crucial role in developing, refining, and enabling our AI Agent, designed to automatically address and resolve shopper requests for our merchant clients. Beyond prompt engineering, you'll be instrumental in scaling the AI Agent's capabilities by developing the right LLM strategies to enable our services. You will work closely with our ML Engineers, Product Managers, and Software Engineers to create, optimize, and implement solutions that enhance the efficiency, accuracy, and functionality of our AI-driven customer support solutions.

• Key Responsibilities:

  • Engineering: Think as an Engineer to develop systems that can scale and allow for fast, reliable, and trusted iterations. Apply scientific and engineering principles to prompt design, LLM evaluation processes, and technical integrations with ecommerce platforms and tools.

  • LLM pipelines: Design, develop, and refine prompts to guide the AI Agent in generating accurate and contextually relevant responses to shopper inquiries. Identify patterns, and drive improvements in both prompt design and overall AI Agent performance.

  • Data Analysis: Analyze large-scale data from LLM evaluations to derive insights, Identify heuristics to sample improvement and non-regression dataset. Build reliable estimators for on-going AB tests, analyse optimal experiment stoping time and mitigate cross AB test contamination.

  • Testing & Evaluation: Conduct extensive testing of prompts to ensure they perform well in diverse scenarios. Design and implement robust methodologies for assessing LLM performance at scale. Evaluate prompts rationally via systematic testing protocols(off-line train/test splits, on-line with AB tests).

  • Collaboration: Work product managers to understand requirements, incorporate feedback into prompt design and improvement, and integrate findings from large-scale evaluations into the AI Agent's development. Work with ML engineers to build and fine-tune in-house LLMs that out-perform state of the art.

  • Documentation: Maintain comprehensive documentation for prompt design, usage, best practices, and evaluation methodologies to ensure clarity and consistency across the team.

  • Continuous Improvement: Stay up-to-date with advancements in AI, natural language processing (NLP), and prompt engineering techniques. Incorporate cutting-edge methodologies into prompt engineering and LLM evaluation processes.

  • User Experience: Analyze and interpret user interactions and large-scale performance data to identify areas for enhancement and ensure the AI Agent provides a seamless and positive experience for shoppers.

  • Performance Metrics: Develop and refine metrics for evaluating prompt and LLM performance at scale, ensuring that improvements can be quantifiably measured and validated.

  • Technical Enablement: Develop and scale connections between AI Agents and the e-commerce ecosystem, allowing the AI to perform a wide range of actions. Collaborate with Software Engineers to identify integration opportunities and implement scalable solutions that expand the AI Agent's capabilities across various platforms and tools used in e-commerce.

Who you are

• Experience: First experience in statistics, prompt engineering and LLM pipelines.

• Technical Skills: Proficiency in programming languages such as Python/SQL, large-scale data analysis, and prompt engineering tools and frameworks.

• Analytical Skills: Strong problem-solving abilities with a keen eye for detail and an understanding of how to work with AI to create a system with business impact.

• Communication: Excellent written and verbal communication skills, with the ability to articulate complex concepts to both technical and non-technical stakeholders.

• Education: Masters degree in STEM (science, technology, engineering and mathematics), or a related field.

Benefits and Perks

• 🏖️ 5-week vacation plus 2 weeks RTT (We follow each country's appropriate PTO Laws)

• 🤕 Paid sick leave

• 🧸 Paid parental leave (16 weeks)

• 💻 MacBook Pro

• 🍽️ Personal credit card to buy lunches (we use Swile)

• 🏥 We provide private health insurance (we use Alan)

• 💆🏻‍♀️ Get up to €700 to set up your workstation at home (working from home should feel breezy)

• 📚 Get up to €2000 of learning material and wellness support per year! This includes €1500 for learning material (such as books, courses, and individual coaching sessions) directly linked to your job scope, as well as a €500 wellness budget. Take advantage of these resources to grow in your role and prioritize your personal development and wellness.

• 🥰 Every quarter, we organize an online company-wide summit to discuss where we’re going and strengthen social bonds. Once per year we organize offsite team retreats and company retreats!

Diversity & Inclusion at Gorgias
We celebrate diversity and are committed to creating an inclusive environment for all employees. We welcome applicants of all backgrounds, experiences, and perspectives. At Gorgias, we believe that diverse teams drive innovation and better decision-making. We do not discriminate based on race, color, religion, gender identity, sexual orientation, disability, age, or any other protected status.

If you need accommodations to participate in the application or interview process, perform essential job functions, or access other employment benefits, please contact us at accommodation@gorgias.com. Let’s grow together!