While building such pipelines, I quickly realized that while natural language is an excellent interface for a chatbot, it’s quite a difficult one to use with existing APIs. (View Highlight)
Output fixing parsers contain two components:
An easy, consistent way of generating output formatting instructions (using a popular TypeScript validation framework, Zod).
An LLM-powered recovery mechanism for handling badly formatted outputs using a more focused prompt. (View Highlight)
