Harnessing the Universal Geometry of Embeddings

Researchers have developed an unsupervised method to translate text embeddings between different vector spaces without paired data or predefined matches, leveraging a conjectured universal semantic structure. The approach achieves high similarity across embeddings from models with different architectures and training datasets, but also reveals a significant security vulnerability: adversaries with access only to embedding vectors can extract sensitive information about underlying documents for classification and attribute inference.