Skip to main content

AI Test: Evaluate and Improve Your Assistant

Test your AI in Konvo before activating it. Step-by-step guide to evaluate responses, identify improvements, and optimise your assistant.

Updated over a month ago

Before activating your AI, you should always verify that it responds correctly to avoid confusion with your customers.

When you test your AI, you'll be able to evaluate each response and add improvements automatically. The AI will learn from your adjustments and optimize without needing to reconfigure everything from scratch. So here's a guide on how to test your AI.


Step 1: Access the Test section

Go to Konvo AI β†’ Test in the sidebar menu (under "Evaluate" section).


Step 2: Add questions to evaluate

Click the "+ Add Questions" button in the top right corner.

Choose how to create your questions:

Add from template: Select predefined questions from our library. Ideal for common use cases.

Add manually: Create specific questions for your business by writing the exact query you want to test.

πŸ’‘ You can combine both options for a complete evaluation of your AI.


Step 3: Evaluate and Improve your AI's responses

Click on any question to open the evaluation panel.

You'll see the user's question and the response generated by your AI.

Rate the response

In the "Rate this answer" section, choose:

  • βœ… Good - The response meets your expectations

  • πŸ’¬ Poor - The response needs improvement

When marking a response as "Poor", the "Improve this response" modal will open.

Why is this response poor?

Select the reason that best describes the problem:

  • πŸ“š Missing information on this topic

  • ❌ Incorrect information provided

  • πŸ“‹ Didn't follow instructions

  • πŸ’¬ Inappropriate tone or style

  • βž• Other

The system will show you suggestions to improve, such as "Add new knowledge source".

Click on the suggestion or add your own additional context so the AI has more information and can improve its response.


Step 4: Re-run the conversation with changes

You don't need to redo the conversation from scratch and rewrite all the questions.

Click on the "Re-run" icon πŸ”„ at the top of the evaluation panel.

What happens when you re-run?

  • The conversation is automatically recreated from scratch

  • All the improvements you added are applied

  • You can verify point by point if the changes work correctly

Use "Re-run" as many times as you need until you get perfect results. All changes are saved automatically.


Step 5: Continue the conversation (optional)

Test the natural flow of your conversations by adding follow-up questions.

Click "+ Add user response" to write an additional question and verify that the AI maintains context correctly.

Did this answer your question?