How to move indexs from hot node to warm node?

OpenSearch
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
opensearch 2.8.0

Describe the issue:
First, Nodes setted attributes for nodes like this

node.attr.temp: hot
node.attr.temp: warm

this is my real env
image

Second, apply policy like this

{
    "id": "log-policy",
    "seqNo": 5446,
    "primaryTerm": 1,
    "policy": {
        "policy_id": "og-policy",
        "description": "hot warm delete workflow",
        "last_updated_time": 1690447532388,
        "schema_version": 18,
        "error_notification": null,
        "default_state": "hot",
        "states": [
            {
                "name": "hot",
                "actions": [
                    {
                        "retry": {
                            "count": 3,
                            "backoff": "exponential",
                            "delay": "1m"
                        },
                        "rollover": {
                            "min_index_age": "1d",
                            "min_primary_shard_size": "1gb"
                        }
                    }
                ],
                "transitions": [
                    {
                        "state_name": "warm"
                    }
                ]
            },
            {
                "name": "warm",
                "actions": [],
                "transitions": [
                    {
                        "state_name": "delete",
                        "conditions": {
                            "min_index_age": "45d"
                        }
                    }
                ]
            },
            {
                "name": "delete",
                "actions": [
                    {
                        "retry": {
                            "count": 3,
                            "backoff": "exponential",
                            "delay": "1m"
                        },
                        "delete": {}
                    }
                ],
                "transitions": []
            }
        ],
        "ism_template": [
            {
                "index_patterns": [
                    "log-network*"
                ],
                "priority": 1000,
                "last_updated_time": 1690419598300
            }
        ]
    }
}

so this rollover was successfully applied.
But Node did not move from hot node(os-node2, 3, 4, 5, 6) to warm node(os-node7)
The index in the warm step is still in the hot node, os-node2, 3, 4, and 5.

this is hot state in policy :arrow_down:

image
image746×175 41.7 KB

this is warm state in policy :arrow_down:(same node…:disappointed_relieved:)
image
image764×175 18.5 KB

plus, the delete policy also applies well…

how to move index from hot node to warm node using policy???

2

@cucukaka Your transition in the hot stage is missing conditions.

3

I added conditions in hot states but nodes in warm states still is in hot nodes(os-node2~6)

image
image523×537 22.9 KB

image
image908×173 23.5 KB

image
image771×199 40.9 KB

4

@cucukaka You need to add allocation in warm state

{
                "name": "warm",
                "actions": [
                    {
                        "retry": {
                            "count": 3,
                            "backoff": "exponential",
                            "delay": "1m"
                        },
                        "allocation": {
                            "require": {
                                "temp": "warm"
                            },
                            "include": {},
                            "exclude": {},
                            "wait_for": false
                        }
                    },
5

Thanks !! The setting has been changed, it worked!

6

:+1: :slight_smile:

Great, but I think this is not the only problem you will face when configuring ISM. For example, I now have the following question ISM shrink issue