HomeResearch LibraryTree of Thoughts: Deliberate Problem Solving with Large…
system architectureChapter 1NeurIPS 2023 · 2023

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Shunyu Yao (Princeton), Dian Yu (Google DeepMind), Jeffrey Zhao (Google DeepMind)

Abstract

We introduce Tree of Thoughts (ToT), a framework that generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving.

Eigenvector Insight — Zone III / PASF-PADE AnalysisNot part of the original paper
Eigenvector Research — Marco van Hurne
How this paper contributes to solving the Zone III problem (PASF-PADE)

ToT is theoretically powerful but computationally expensive. In enterprise contexts, the cost of exploring multiple reasoning branches must be weighed against the value of the decision. It is most appropriate for high-stakes, low-frequency decisions — not for routine workflow steps.

Why AI is not sufficient for Zone III without this

Zone III refers to high-complexity, high-risk, long-running agentic workflows — the class of enterprise AI deployments where a single failure can cascade across hundreds of steps. Standard AI models, trained to predict the next token, are not inherently designed for durable, governed, multi-step execution. This paper addresses one or more of the structural gaps that make Zone III deployments unsafe without explicit architectural intervention.

Key Contributions

  • →Tree-structured thought exploration
  • →BFS/DFS over reasoning steps
  • →Self-evaluation of intermediate thoughts

Topics

planningdeliberate reasoningsearchtree search