When your AI agent gives a wrong answer, there's always a specific, fixable reason. This guide walks you through the diagnostic process to find the root cause — and the exact fix for each scenario.
Root cause 1 — The information isn't in the knowledge base
Symptom: Agent says "I don't have information on that" or gives a vague, hedging answer.
Fix:
- Go to your Knowledge Base tab
- Search for the topic the agent failed on
- If nothing relevant appears — that's your answer. Add the missing content as a manual Q&A entry.
Root cause 2 — The information is outdated or incorrect
Symptom: Agent gives a specific but wrong answer (old price, discontinued service, changed policy).
Fix:
- Search the knowledge base for the topic
- Find the outdated entry
- Delete it — don't disable it, delete it. Disabled entries can still be retrieved.
- Add a new entry with the correct information
- Re-test the question to confirm the fix
Root cause 3 — Conflicting information in the KB
Symptom: Agent gives inconsistent answers to the same question — sometimes right, sometimes wrong.
Fix: Search the knowledge base for the topic and look for multiple entries that say different things. Delete all but one — the most current, most accurate version. Inconsistency in the KB is one of the hardest problems to diagnose because it only shows up sporadically.
Root cause 4 — System prompt is too loose
Symptom: Agent goes off-topic, invents information, or gives answers outside its intended scope.
Fix: Add explicit scope limits to your system prompt:
Only answer questions about [business name] and its services. If asked about anything outside this scope, say: "That's outside what I can help with — but for [topic], you can reach us at [email]." Never speculate or guess beyond what you know.
Root cause 5 — Temperature too high
Symptom: Answers are varied, creative, sometimes off-base. The agent seems to be "making things up" occasionally.
Fix: Lower the temperature setting to 0.3–0.4 in your agent settings. This anchors responses more tightly to the knowledge base content.