[writer_uuid] issue on Restore from Elasticsearch snapshot to OpenSearch

OpenSearch
, ,
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
Elasticsearch version: 7.17.12
OpenSearch version : 2.17.0

Describe the issue: Restore from Elasticsearch snapshot to OpenSearch face OpenSearchParseException[unknown parameter [writer_uuid]]

Configuration:

Relevant Logs or Screenshots:

When restore from a snapshot which created from Elasticsearch s3 repository, facing below issue:

*Note : space-data_v3 is my index name
“unassigned_info”: {

"reason": "ALLOCATION_FAILED",

"at": "2025-04-17T09:58:39.507Z",

"failed_allocation_attempts": 5,

"details": "failed shard on node \[rvGHSX4iRQy5_re9pz4dFw\]: failed recovery, failure RecoveryFailedException\[\[**space-data_v3**\]\[0\]: Recovery failed on {d7ae2433a8203f7f9e1b6f704113a278}{rvGHSX4iRQy5_re9pz4dFw}{9n5lfhllRxmzKEQrkr9keg}{10.212.32.21}{10.212.32.21:9300}{dimr}{dp_version=20210501, admission_control_resource_tracker_feature_present=true, adv_sec_enabled=true, cross_cluster_transport_address=2a05:d014:b97:3b82:add2:3ea5:df6b:d0af, awareness_features_enabled=true, search_backpressure_feature_present=true, coordinator_nodes_stats_feature_present=true, plugins.security.custom_serialization.enabled=false, distributed_snapshot_deletion_enabled=false, cold_enabled=false, zone=eu-central-1b, indices.doc_status_stats_enabled=true, global_cpu_usage_ac_supported=true, shard_indexing_pressure_enabled=true, di_number=0, task_cancellation_monitoring_feature_present=true}\]; nested: IndexShardRecoveryException\[failed recovery\]; nested: IndexShardRestoreFailedException\[restore failed\]; nested: IndexShardRestoreFailedException\[failed to restore snapshot \[rfs-snapshot/C57krZkATBqLGVejEx8BeQ\]\]; nested: OpenSearchParseException\[unknown parameter \[writer_uuid\]\]; ",

"last_allocation_status": "no"

},

2

@Lion I think you might find this blog useful.

In your case you would have to use reindex or Migration Assistant.

Hope this helps

3

Hi Anthony,

so in my case, if I would like to choose Option 2: Migrating Data Using Snapshots, any other possible options ? as Option1 looks complex

4

@Lion Due to the additional field in later versions (writer_uuid), I do not believe this is possible to achieve without reindexing or using Migration Assistant.

5

Hi @Anthony , appreciate if you can provide more details page about how to use the Migration Assistant tool ?
From Elasticsearch Cluster 7.17.12 on couples of EC2 instance ,
To OpenSearch 2.x or 3.6.0 (latest) on couples of EC2 instance

6

btw - still wonder if it is possible to place any patch in open-search which support restore from existing s3 repository bucket which created by Elasticsearch then can make the migration process more smoothly ?

Currently when I try to create s3-repository in opensearch-dashboard 3.6.0 it got success but facing issue when query snapshot , possible to enhance the _snapshot API to make it supported?

image
image573×143 8.62 KB

Request:
PUT _snapshot/opensearch-s3-repository
{
“type”: “s3”,
“settings”: {
“bucket”: “my-s3-backup”,
“region”: “us-east-1”,
“server_side_encryption”: “true”,
“storage_class”: “standard_ia”,
“compress”: “true”,
“base_path”: “es-snapshot”,
“max_snapshot_bytes_per_sec”: “1g”,
“max_restore_bytes_per_sec”: “1g”
}
}

7

@Lion The migration docs are available here.

Regarding the patch, this would be a good candidate for a feature request that you can raise here.