Salesforce Decode
Salesforcedecode
Back to questions
AgentforceAdvancedhallucinationknowledgegrounding

Troubleshoot agent hallucinating product features not in knowledge base

Real World Scenario

Sales support agent tells customers a SKU supports feature never shipped; grounding enabled but responses still invent specifications.

Expected Answer

• Verify retrieval returns chunks before answer generation with citation requirement • System prompt instructs answer only from retrieved context or explicit uncertainty • Block speculative language for product specs via output guardrails • Evaluate retrieval recall — missing docs cause hallucination fill-in • Human feedback loop flagging incorrect answers to content team • Temperature and model settings conservative for factual domains • A/B test grounded vs ungrounded in staging with golden questions

Follow-Up Questions & Answers

Click to expand — each follow-up includes a direct, interview-ready answer

Direct answer: Verify retrieval returns chunks before answer generation with citation requirement Also consider: System prompt instructs answer only from retrieved context or explicit uncertainty In practice: Block speculative language for product specs via output guardrails Optimize for scale and operational observability.

Architect Perspective

Hallucination is often retrieval failure disguised — fix content and retrieval before blaming model.