system architectureChapter 3arXiv · 2023
Measuring and Reducing LLM Hallucination without Gold Standard Answers
Vipula Rawte (IIT Bombay), Amit Sheth (USC)
Abstract
We present methods for measuring and reducing LLM hallucinations without requiring gold standard reference answers. Our approach uses consistency checking and uncertainty estimation.
Key Contributions
- →Reference-free hallucination detection
- →Consistency-based reliability assessment
- →Uncertainty-guided correction
Topics
hallucination detectionuncertainty estimationconsistency checkingreliability
Relevance Scores
Long-Horizon Score82
Enterprise Score87
Completeness78
Paper Info
Year2023
VenuearXiv
Typesystem architecture
ChapterCh. 3
Authors2
Related Papers
ReAct: Synergizing Reasoning and Acting in Language Mod…
2023 · Ch.1
Reflexion: Language Agents with Verbal Reinforcement Le…
2023 · Ch.1
Tree of Thoughts: Deliberate Problem Solving with Large…
2023 · Ch.1
Toolformer: Language Models Can Teach Themselves to Use…
2023 · Ch.1
View all Chapter 3 papers →