Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
OpenSearch 2.17
Describe the issue:
Im trying to register a custom model from hugging face but im having some issues with the URL. I created a zip file containing all the files from onnx folder from intfloat/multilingual-e5-large at main. Then i created a volume to add this zip file to the opensearch docker container. Then as URL for the model i simply wanted to use this local file but this didnt work. I also tried uploading this file to my google drive and using the link from google drive as URL but then im getting:
“error”: “zip END header not found”
Im guessing that i understood this URL and the file that is expected to be loaded from there completely wrong. Can someone please help me out here?
Here is the request to register the model:
{
“name”: “multilingual-e5-large”,
“version”: “1.0.0”,
“description”: “Multilingual E5-Large”,
“model_format”: “ONNX”,
“model_group_id”: “_Gjj3pIBJrX4nqy0y2ST”,
“model_content_hash_value”: “9aaa222c5a6529ae4a69ab6925c863af595d106edf565434c8280777b3126d64”,
“model_config”: {
“model_type”: “xlm-roberta”,
“embedding_dimension”: 1024,
“framework_type”: “sentence_transformers”,
“all_config”: “{"_name_or_path":"tmp/","architectures":["XLMRobertaModel"],"attention_probs_dropout_prob":0.1,"bos_token_id":0,"classifier_dropout":null,"eos_token_id":2,"hidden_act":"gelu","hidden_dropout_prob":0.1,"hidden_size":1024,"initializer_range":0.02,"intermediate_size":4096,"layer_norm_eps":0.00001,"max_position_embeddings":514,"model_type":"xlm-roberta","num_attention_heads":16,"num_hidden_layers":24,"output_past":true,"pad_token_id":1,"position_embedding_type":"absolute","torch_dtype":"float32","transformers_version":"4.29.0","type_vocab_size":1,"use_cache":true,"vocab_size":250002}”
},
“url”: “/usr/share/opensearch/models/multilingual-e5-large.zip”
}