Semantic field type not working

OpenSearch
1

Hi all,

I am trying to follow the guide in Semantic - OpenSearch Documentation but it did not work. No errors but no embeddings generated either!

Note that I deployed a model locally and tested it .. working fine! But nothing happens when using semantic field type. It only generates _semantic_info field but no embedding is generated
Appreciate your help.

Thanks

2

@asfoorial Could you share your index settings?
Which model did you use?

3

Below is the full index details. Note that it worked for me in Windows and Rocky Linux 8. But did not work on RHEL 8!

Note also that insert the vector values explicitly to it works fine! And neural search against it works fine too. It it just when I index a document it does not generate embeddings automatically!

GET semantic_index3

{
“semantic_index3”: {
“aliases”: {},
“mappings”: {
“properties”: {
“passage”: {
“type”: “semantic”,
“model_id”: “aoLdE5gBsdSQ3XOxh-Uv”,
“raw_field_type”: “text”
},
“passage_semantic_info”: {
“properties”: {
“embedding”: {
“type”: “knn_vector”,
“dimension”: 384,
“method”: {
“engine”: “faiss”,
“space_type”: “l2”,
“name”: “hnsw”,
“parameters”: {}
}
},
“model”: {
“properties”: {
“id”: {
“type”: “text”,
“index”: false
},
“name”: {
“type”: “text”,
“index”: false
},
“type”: {
“type”: “text”,
“index”: false
}
}
}
}
}
}
},
“settings”: {
“index”: {
“replication”: {
“type”: “DOCUMENT”
},
“number_of_shards”: “1”,
“provided_name”: “semantic_index3”,
“knn”: “true”,
“creation_date”: “1752680057614”,
“number_of_replicas”: “1”,
“uuid”: “e24cY2zWQXmofKbIhqRCvw”,
“version”: {
“created”: “137227827”
},
“knn.derived_source”: {
“enabled”: “true”
}
}
}
}
}

Full model details:
{
“_index”: “.plugins-ml-model”,
“_id”: “aoLdE5gBsdSQ3XOxh-Uv”,
“_version”: 6,
“_seq_no”: 163,
“_primary_term”: 2,
“_score”: 0,
“_source”: {
“last_deployed_time”: 1752680013579,
“model_version”: “9”,
“created_time”: 1752679941935,
“deploy_to_all_nodes”: true,
“model_format”: “TORCH_SCRIPT”,
“is_hidden”: false,
“description”: “”,
“model_state”: “DEPLOYED”,
“planning_worker_node_count”: 1,
“total_chunks”: 8,
“model_content_hash_value”: “999d400b542ac0f866fc7462eb44da1f96a723cb3e94fbe5d1aab037b6fb72fa”,
“model_config”: {
“all_config”: “”,
“model_type”: “bert”,
“embedding_dimension”: 384,
“framework_type”: “SENTENCE_TRANSFORMERS”,
“additional_config”: {
“space_type”: “l2”
}
},
“auto_redeploy_retry_times”: 0,
“last_updated_time”: 1752680013579,
“last_registered_time”: 1752679953746,
“name”: “sentence-transformers/paraphrase-MiniLM-L3-v2”,
“current_worker_node_count”: 1,
“model_group_id”: “MdSrE5gB1AiCYvc75tPe”,
“model_content_size_in_bytes”: 70401535,
“planning_worker_nodes”: [
“8Nm29zDURO-Cp5CLikecag”
],
“algorithm”: “TEXT_EMBEDDING”
}
}