Derived Source error with semantic field type

Plugins Machine Learning
1

OS 3.3.1

Hi all, I am getting the below error when created an index with derived_source enabled and having a semantic field type. Your help is highly appreciated.

HTTP Request:

PUT test_semantic2
{
“settings”: {
“index”: {
“knn”: true,
“derived_source.enabled”: true
}
},
“mappings”: {
“properties”: {
“passage”: {
“type”: “semantic”,
“model_id”: “SobLOpoBBxUKhJh31EiZ”
}
}
}
}

HTTP Response:

{
“error”: {
“root_cause”: [
{
“type”: “mapper_parsing_exception”,
“reason”: “Failed to parse mapping [_doc]: Derive source is not supported for field [passage] with field type [semantic]”
}
],
“type”: “mapper_parsing_exception”,
“reason”: “Failed to parse mapping [_doc]: Derive source is not supported for field [passage] with field type [semantic]”,
“caused_by”: {
“type”: “unsupported_operation_exception”,
“reason”: “Derive source is not supported for field [passage] with field type [semantic]”
}
},
“status”: 400
}

2

@asfoorial I believe the semantic field is a high-level/convenience mapper and not a physical vector field. As far as I know derived source is currently implemented only for vector fields such as knn_vector. The semantic mapper doesn’t expose a concrete knn_vector subfield for derived-source to target.

Therefore to make this work in your case you would need to either remove the derived source, or if you need derived source for space savings use knn_vector field instead of semantic