Sharing key insights on how to test GenAI: Exploring effective strategies and main focus areas for manual and automated tests.

As more and more companies implement GenAI and Chats on their product, ensuring the accuracy and quality of AI-generated responses is paramount. It may seem sometimes that these models are some kind of magic but , in fact, there are several ways of testing the GenAI. I have been developing testing strategy for an AI generative model and applying it to models similar to OpenAI’s ChatGPT

You will learn hands-on strategies to test AI. Currently we still lack knowledge in this area so having insights from a strategy that has been effective for the past months will offer a great toolkit to begin testing AI.

Key takeawys

• Intent and entity recognition is the most important thing to test
• Offensive content and security cannot be disregarded
• The approach for automation should be different when testing GenAI