Toolformer: Language Models Can Teach Themselves to Use Tools

Abstract

We introduce Toolformer, a model trained to decide which APIs to call, when to call them, what arguments to pass, and how to best incorporate the results into the future token prediction.

Key Contributions

• →Self-supervised tool use learning
• →API call decision mechanism
• →Demonstrated on calculator, QA, translation tools

Topics