Faster Retrieval for Better, More Efficient RAG

Maximum inner product search sits at the core of recommendation systems, search, and retrieval-augmented generation RAG. The computational cost of running an exhaustive comparison of the query to all keys grows dramatically as the number of keys grows to millions and vector dimensions reach thousands.