TL;DR – Rerankers are neural nets that enhance the quality of search results in applications such as Retrieval-Augmented Generation (RAG). They scor

Boosting Your Search and RAG with Voyage’s Rerankers – Voyage AI

submited by
Style Pass
2024-09-30 17:30:08

TL;DR – Rerankers are neural nets that enhance the quality of search results in applications such as Retrieval-Augmented Generation (RAG). They score the relevance of initial, coarse-grained search outcomes and re-rank them based on the scores. We’re thrilled to introduce Voyage’s inaugural general-purpose reranker, rerank-lite-1. Our comprehensive evaluation,  encompassing 27 datasets across diverse topics—ranging from technical documentation and code to law, finance, web reviews, long documents, medicine, and conversations—shows that Voyage rerank-lite-1 is the state-of-the-art reranker, consistently outperforming bge-rerank-large and Cohere’s rerank-english-v2.0.

Retrieval-augmented generation (RAG) is the predominant approach for enterprise generative AI, where relevant proprietary knowledge is retrieved to enhance the capability of LLMs.  The retrieval quality — the relevancy of the retrieved documents — significantly impacts the quality of the final responses.  Voyage AI now provides a reranker API endpoint that can seamlessly integrate into your RAG stack and turbocharge your retrieval quality and end-to-end response quality.

Leave a Comment