Generative AI Engineer

As a Generative AI Engineer on the ED&A team, you will design, develop, and deploy enterprise AI applications for internal stakeholders — primarily using Dataiku’s platform and associated tooling. You’ll work with large language models (LLMs) from third-party providers (OpenAI, Anthropic, AWS Bedrock, Azure, etc.), build full-stack web applications, and create specialized “Agents” (and corresponding “Agent Tools”) capable of executing complex tasks. Success in this role requires strong programming abilities (Python, SQL, HTML/CSS/JS), excellent communication skills, and a deep interest in operationalizing generative AI across the company.

Key Responsibilities

1. Solution Development & Integration
• Design end-to-end Generative AI solutions on Dataiku’s platform (or Python-based frameworks where needed).
• Integrate and optimize third-party LLM APIs (OpenAI, Anthropic, AWS Bedrock, Azure), focusing on prompt engineering and orchestration (e.g., LangChain).
• Build and maintain robust data pipelines, ensuring AI applications are performant and secure.
2. Agent & Agent Tool Creation
• Develop and implement autonomous or semi-autonomous AI “Agents” that interact with multiple data sources and services.
• Design Agent Tools (e.g., data retrieval modules, decisioning logic, automated workflows) that Agents can leverage to fulfill complex tasks.
• Monitor Agent performance and iterate based on usage data, business feedback, and changing requirements.
3. Web Application Development
• Create front-end user interfaces (UI) for AI applications using HTML, CSS, and JavaScript—often within Dataiku’s webapps framework.
• Collaborate on UX design, ensuring internal stakeholders find solutions intuitive and responsive.
4. Collaboration & Governance
• Work closely with analytics and data engineering teams to maintain metadata on reference datasets for LLM consumption.
• Adhere to data governance, security, and regulatory compliance requirements for all GenAI solutions.
• Partner with stakeholders to identify opportunities for AI-driven process optimization and automation.
5. Continuous Learning & Thought Leadership
• Provide product feedback to the development team to improve the product.
• Stay current with industry trends, particularly around AI agent frameworks and LLM best practices (LangChain, prompt engineering, vector databases).

Qualifications

• Technical Proficiency
• Must have strong Python skills (including familiarity with typical data science libraries).
• Experience developing AI, ML, or analytics solutions in a production setting (generative AI/LLM experience is a plus but not strictly required).
• Web development fundamentals (HTML, CSS, JavaScript); experience with Dataiku webapps or similar frameworks a bonus.
• Familiarity with LangChain or similar LLM orchestration libraries is strongly preferred.
• Exposure to third-party LLMs (OpenAI, Anthropic, AWS Bedrock, Azure) or other NLP/AI APIs.
• Educational & Professional Background
• Bachelor’s or Master’s in Computer Science, Data Science, Engineering, or a related field; equivalent experience also considered.
• Demonstrated ability to integrate multiple technologies, optimize workflows, and deliver user-friendly AI solutions.
• Soft Skills
• Strong communication and presentation skills, capable of collaborating effectively with both technical and non-technical stakeholders.
• Problem-solving mindset with a passion for innovation and delivering measurable business value.
• Openness to learning new tools (e.g., Dataiku) and adapting to an evolving tech landscape.

Why Join Our Team?

• Work with Cutting-Edge Tech: You’ll gain hands-on experience with Dataiku’s platform, LangChain, and leading LLM providers.
• Impact & Visibility: Our GenAI solutions address critical business needs, offering high visibility and meaningful impact.
• Collaborative Environment: We prioritize teamwork, mentorship, and continuous learning—perfect for both experienced engineers and those just starting out.
• Career Growth: From contributing to technical roadmaps to presenting results to stakeholders, you’ll have countless opportunities to develop your skills and influence the company’s AI strategy.