Chapter 4 · 2026
Knowledge Graph Representations for LLM-Based Policy Compliance Reasoning
Wilder Baldwin, Sepideh Ghanavati
Abstract
The risks posed by AI features are increasing as they are rapidly integrated into software applications. In this paper, we present an agentic framework that constructs knowledge graphs (KGs) from AI policy documents and retrieves policy-relevant information to answer questions. We build KGs from three AI risk-related polices under two ontology schemas, and then evaluate five LLMs on 42 policy QA tasks spanning six reasoning types.
Topics
Knowledge GraphsLLMPolicy ComplianceAI AgentsRegulatory Compliance
Relevance Scores
Long-Horizon Score85
Enterprise Score80
Completeness75
Paper Info
Year2026
Venue
Type
ChapterCh. 4
Authors2
Zone III Analysis
Related Papers
ReAct: Synergizing Reasoning and Acting in Language Mod…
2023 · Ch.1
Reflexion: Language Agents with Verbal Reinforcement Le…
2023 · Ch.1
Toolformer: Language Models Can Teach Themselves to Use…
2023 · Ch.1
HuggingGPT: Solving AI Tasks with ChatGPT and its Frien…
2023 · Ch.4
View all Chapter 4 papers →