Tuesday, May 14Digital Marketing Journals

New Conversational UX Stack: Integrating NLU, LLMs, & RAG | by Stefan Kojouharov | Mar, 2024


Large Language Models are redefining how we build Conversational Agents. Today, LLMs can do most of the heavy lifting in minutes. The days of building hundreds of flows of every useful intent or FAQ question are gone. Instead, LLMs can be trained on a knowledge base and be able to give great answers.

The role of a Conversation Designer has changed. Designers now have to start thinking differently. Instead of thinking linearly and having a flow-based approach to design, now we need to think more about knowledge, information, and data and how all of this leads to meaning-making.

Through stories, knowledge bases, and prompt engineering, designers will soon be creating experiences we once only dreamed of. The job has changed, and it is now more creative than ever.

Conversational AI Project will consist of the following design stack:

  1. Flows, Intents, and Entities: These will still be useful in use cases where the business needs very specific answers. Additionally, they can be used as a follow-up action to engage the user and take them down a flow towards a product or service of interst.
  2. Large Language Models (LLMs): Integrating Large Language Models into your project at multiple stages. LLMs can be used to interpret user intent, entities, and sentiments. They can be used to answer questions. Multiple LLMs can be used in a single project, where each LLM has a specific function.
  3. Prompt Engineering: Now the fun begins. Prompt Engineering includes all of the instructions given to an LLM in order to get back high-quality, accurate responses. This includes giving the LLM a role, for example…

Leave a Reply