Sunday, August 9Digital Marketing Journals

Tag: Treml

Continuous Speech Recognition Testing | by Florian Treml | Feb, 2022
4Mar By Florian TremlNo Comments
ai bot, ai chat, ai chatbot, best chatbot, chatbot, chatbot ai, chatbot app, chatbot online, chatbot website, chatbot-development, chatbots, conversation with ai, conversational-ai, creating chatbots, google chat bots, robot chat, speech-recognition, voice-assistant

Continuous Speech Recognition Testing | by Florian Treml | Feb, 2022

From traditional IVR systems, still very common in customer service, to voice assistants on Alexa or Google Assistant — voice technology is nowadays part of everyday life, and it will continue to gain importance in future. The component stack of a typical voice assistant includes speech recognition and speech synthesis, apart from the usual conversational components like NLU (natural language understanding), dialogue management and NLG (natural language generation).Botium Box enables companies to implement a holistic test strategy for voice assistants on all levels of the component stack. This article focuses on the speech recognition part and shows how to build a regression test suite based on audio files, transcription files and word error rate verification.Continuous Speech Recognition ...
Read More
Top 3 Chatbot Security Vulnerabilities in 2022 | by Florian Treml | Jan, 2022
26Jan By Florian TremlNo Comments
ai bot, ai chat, ai chatbot, automated-testing, best chatbot, chatbot, chatbot ai, chatbot app, chatbot online, chatbot website, chatbot-security, chatbots, conversation with ai, conversational-ai, creating chatbots, google chat bots, robot chat, security-testing

Top 3 Chatbot Security Vulnerabilities in 2022 | by Florian Treml | Jan, 2022

Chatbots have been around for a long time and based on the global chatbot market size (and the expected growth), they will stick around for a long time and gain importance. In the past they’ve rarely met customer expectations or provided much positive experience. However, over the last few years, advances in conversational AI have transformed how they can be used. Since chatbots offer a wide range of applications, in certain cases they become responsible for collecting and protecting personal information as well. Consequently, they are a great attraction for hackers and malicious attacks too. The responsibility of ensuring chatbot security has become more pronounced after the introduction of GDPR in Europe. As statistics show that this technology will be a determining factor in our lives, ...
Read More
4 DO’s and 3 DON’Ts for Chatbot Testing Strategies | by Florian Treml | Feb, 2021
16Mar By Florian TremlNo Comments
automation, best chatbot, botium, chatbot, chatbot app, chatbot online, chatbot website, chatbots, creating chatbots, devops, robot chat, testing

4 DO’s and 3 DON’Ts for Chatbot Testing Strategies | by Florian Treml | Feb, 2021

A quick summary of 7 important DO’s and DON’Ts when designing a chatbot testing strategy. We are continuously seeing teams ignoring those actually rather simple rules.✅DO plan for iterationsIn german we say rome was not built in a day — same applies for your chatbot training data. A robust chatbot is built by multiple iterations, training and testing cycles and by ongoing monitoring and performance tuning: CODE, TEST, DEPLOY, REPEAT❌ DON’T underestimate the need for constant performance measurementWithout measuring performance with real user conversations, you will never know if your chatbot is really working for your users.✅DO apply the 80/20 rule for testing utterancesMost teams are tempted to use 100% of the available data for training. Do not do this. You won’t kno...
Read More
4 DO’s and 3 DON’Ts for Training a Chatbot NLP Model | by Florian Treml | Mar, 2021
16Mar By Florian TremlNo Comments
ai, best chatbot, botium, chatbot, chatbot app, chatbot online, chatbot website, chatbots, creating chatbots, nlp, robot chat, training

4 DO’s and 3 DON’Ts for Training a Chatbot NLP Model | by Florian Treml | Mar, 2021

A quick summary of 7 important DO’s and DON’Ts when training an NLP model for a chatbot. They are best applied before starting a project, but can also help to build a mindset for quality training data in all chatbot project phases.✅DO: think in problem space, not in solution spaceUsers typically think in problem space, not in solution space, and so should you. As a quick example, consider the case of a user who ordered a shirt in an online shop and wants to know when it is expected to arrive. Consider this question:when will my shirt arriveThis is a question from problem space, describing the problem the user wants to be solved, while these are from solution space:what is the estimated shipping timeshow me the order statusThey are describing how your business will react to the probl...
Read More
Security Threats and Security Testing for Chatbots | by Florian Treml
9Feb By Florian TremlNo Comments
ai bot, ai chat, ai chatbot, best chatbot, botium, chatbot, chatbot ai, chatbot app, chatbot online, chatbot website, chatbots, conversation with ai, creating chatbots, robot chat, security, testing

Security Threats and Security Testing for Chatbots | by Florian Treml

This article is pointing out security threats and attack vectors of typical chatbot architectures — based on OWASP Top 10 and adversarial attacks.The well-known OWASP Top 10 is a list of top security threats for a web application. Most chatbots out there are available over a public web frontend, and as such all the OWASP security risks apply to those chatbot frontends as well. Out of these risks there are two especially important to defend against, as in contrary to the other risks, those two are nearly always a serious threat when talking about chatbots — XSS and SQL Injection.Recently another kind of security threat came up, specifically targeting NLP models — so-called “adversarial attacks”.A typical implementation of a chatbot frontend:There is a chat window with an input boxEverything...
Read More
How to Automate Testing of Your WhatsApp Chatbot | by Florian Treml | Jan, 2021
7Feb By Florian TremlNo Comments
ai bot, ai chat, ai chatbot, best chatbot, botium, bots, chatbot, chatbot ai, chatbot app, chatbot online, chatbot website, chatbots, conversation with ai, creating chatbots, google chat bots, robot chat, testing, Whatsapp

How to Automate Testing of Your WhatsApp Chatbot | by Florian Treml | Jan, 2021

Botium delivers again — in this case, automated end-2-end testing of WhatsApp chatbots on real or virtual devices. For the first time it is now possible to have a full enterprise-level test strategy for WhatsApp chatbots.When it comes to testing WhatsApp chatbots up to now there have been mainly two approaches:Testing manually on a smartphoneTesting backend functionality with API TestingBoth approaches are valid and no enterprise-level test strategy should miss any of them. But there are two obvious flaws:Manual testing is not scalable to the extent that is required to guarantee constant high quality for production-level chatbotsBackend testing does not consider the end user experienceBotium fills this gap with a new connector for testing WhatsApp chatbots on real and virtual smartphone de...
Read More