The system employs Matryoshka embeddings to shrink the data needed for searches, storing only the first 256 of 768 values in a vector. Google states that this approach reduces vector storage to 1/3 while maintaining approximately 95% of the original retrieval quality for speech and visuals, making large search indexes on consumer devices more practical.
