Dec 6, 2023
The senders send back text chunks, not vectors. RAG does the same. Converting the query to vector, do a vector search in the vector database (where chunks are indexed by the vectors), the database finds the K nearest chunk and gives back the chunks (not vectors).
This conceptual decentralized network does the same. A DHT, where the keys are the embedding vectors, and that uses cosine similarity.