Teaching Language Models to Use Tools

rw-book-cover

Metadata

Highlights

  • Giving an LLM access to an external tool is a reliable way to solve some of the limitations that these models face. However, LLMs will not know how to use tools naturally, which raises the question: How do we teach our model to leverage external tools (View Highlight)
  • Teaching an LLM to leverage tools is no different than learning how to solve any other task with an LLM. (View Highlight)
  • pre-training. The first and most basic form of learning for LLMs is pre-training. During pre-training, the model is trained over a large corpus of unlabeled textual data using a language modeling objective (View Highlight)