How to save a test conversation as a test case
Turn a conversation from the test environment into a test case, with the expected response, so you can check the agent whenever something changes.
2 min readBasicUpdated on November 12, 2026
Where to find it in Cognizy
Video lesson coming soon. For now, follow the steps below.
When a test conversation clearly shows what the agent needs to get right, it’s worth saving. A test case is that conversation with the expected result: whenever you change the agent or the knowledge base, run the cases and instantly see if anything broke.
Where to find it in Cognizy
Before you start
- Have an AI agent with a knowledge base.
- Only the owner and administrators can save test cases.
- The test conversation uses AI credits; saving the case does not.
Step by step
- Step 1:
In , type a question the way the customer would ask it and click Send.
- Step 2:
With the response on the screen, click Save as test case.
- Step 3:
Give it a Case name that says what it checks. The Conversation is already filled in: the customer’s last message is what will be evaluated.
- Step 4:
Say what the response must include. In The response must contain, write one phrase per line: here, the correct plan price. You can also list what it must not contain, or say whether it should hand off to a person.
- Step 5:
Click Save case.
How to know it worked
Cognizy lets you know that the test case was saved. It will then appear in the agents’ test case list, ready to run again whenever you change the agent or the knowledge base.
If it goes wrong
A message appears saying you need to define at least one expectation.
Fill in at least one of the fields: what the response must contain, what it must not contain, whether it should hand off to a person, or the AI evaluation criteria.
A message appears saying the last message must be from the customer.
The case evaluates the agent’s response to the customer’s last message. Remove the agent message that ended up last.
The Save as test case button does not appear.
It only appears after the agent responds in the test environment, and only for owners or administrators.
I reached the plan’s case limit.
Disable the cases you no longer use in the test case list, or change plans.
Next step
Run the test cases after every change to the agent or the knowledge base.
Sign in with your Cognizy account to save your progress.
Sign in