--

The senders send back text chunks, not vectors. RAG does the same. Converting the query to vector, do a vector search in the vector database (where chunks are indexed by the vectors), the database finds the K nearest chunk and gives back the chunks (not vectors).

This conceptual decentralized network does the same. A DHT, where the keys are the embedding vectors, and that uses cosine similarity.

--

--

Laszlo Fazekas
Laszlo Fazekas

Responses (1)