I have a case that all the vector data will be encrypted before storing to the opensearch, which means the data stored in the opensearch is not the vector anymore but still want to have the similarity search function. I wanna to develop some plugins to do something like following
indexing and storage process:
- build the index using the original vector data before the encryption, which the index can be used for the similarity search later.
- do the encryption and store to the opensearch
similarity search process (with encrypted data ):
- decrypt the data and get the original vector data
- doing the similarity search by using the indexing and the decrypted vector data
Is there any available plugins to do that , or anyone could guide how to do that so.
very appreciated !