Tag: Train

Experiments in Organizing Information for Optimal RetrievalOriginally Published on my SubstackSo recently, I have been experimenting with knowledge bases, and how information is structured is vital.In some sense, it directly relates to the context and overall meaning. It also makes it easier for LLMs to answer questions accurately and reduces hallucinations.And so we created a few experiments that you can play with and test yourself.But first, why does information structure matter?Imagine a library. One room has books strewn everywhere, titles mixed up, and no discernible order. In another room, the books are organized by subject, then by author, then by publication date. Which room would help you find the book you want more efficiently?LLMs are similar. The way knowledge is presented and ...