Hi we are getting this error in version 2.16
{“type”:“log”,“@timestamp”:“2024-08-19T19:25:52Z”,“tags”:[“error”,“opensearch”,“data”],“pid”:1,“message”:“[version_conflict_engine_exception]: [index-pattern:AWN0xQFkr3p2758aWQIZ]: version conflict, required seqNo [5851097], primary term [1]. current document has seqNo [5851194] and primary term [1]”}
Sometimes your cluster runs into this kind of error when updating documents is very frequent or massive documents are being indexed.(ie, multiple operations for the same documents might cause an issue).
That’s why external versioning is important in OpenSearch/Elasticsearch. (Index document - OpenSearch Documentation)
Could you try the below option(query parameter) with the command for updating documents?
?conflicts=proceed
with what command?
You can attach the query parameter(conflicts) for _reindex or _update_by_query API.
Anyway, which way the cluster indexes the documents?
Logstash/Data Pepper, KafkaConnector(sink), or through application(using 9200 port of OpenSearch Cluster)