t describes the journey of evaluation-driven development we undertook to add new features and enhancements to improve the performance of wandbot.
This development cycle was a meticulous process, marked by evaluations and enhancements. We focused on understanding the nuances of queries Wandbot dealt with and dove into the intricacies of our RAG pipeline to enhance its performance. (View Highlight)
Previously, we conducted extensive evaluations of the Wandbot RAG pipeline. The evaluations included manual and automatic annotation and evaluation of the bot’s response to historical queries from users we had seen in the past year. (View Highlight)
