Q&A

The Q&A agent generates responses based on user prompts by analyzing available data, offering summary text, citations, and confidence scores. It can be linked to other agents to provide answers to questions in various places. For example, the Q&A agent can be linked to the Discord agent to provide answers to questions in your Discord.

Confidence scores and thresholds

When your users ask questions, they expect quality answers. Our Q&A agents help you respond to questions with high-quality answers using confidence scores and confidence thresholds. A confidence score is a measure of an agent's "confidence" in an answer it's generated, based on how well it's able to match the question to your documentation. Likewise, confidence thresholds are a cutoff, where answers at or above the threshold will be sent, and answers below the threshold will not. By setting a confidence threshold, you can control the quality of the answers sent to your users.

We default all of your Q&A agents with a confidence threshold of 90%. You can customize an agent's threshold in its advanced configuration options. For example, you may want to lower the confidence threshold if your agent is holding back quality answers. Conversely, you may want to increase the confidence threshold if your agent is responding with too many answers that aren't helpful.

Using the GenAI page to test your agent's confidence threshold

To get a better sense of how your Q&A agent answers questions, you can use the GenAI tab. Here, you can send questions to any of your Q&A agents, and receive answers with sources, as well as confidence scores relative to the agent's threshold. Unlike using Q&A agents in workflows, we also send back answers that don't meet the agent's threshold. This allows you to see what we could have sent as an answer, and can help you decide if the threshold should be adjusted.