Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
Opensearch 2.9.0
Describe the issue:
I’m trying to delete all the indices using custom script based on diskspace when it reaches 80%. The index deletion happens only after 80% diskspace is reached, diskspace may reach more than 80% before the index deletion actually happens.(We have 1min time interval for every check)
There is some time interval required for the opensearch cluster to indicate there is a free space , since logstash was parallely ingesting logs, new indices are created as as soon as old indices are deleted resulting in unassigned shards and also cluster state goes to red.
Kindly explain , is there any way to control the timeframe for creation of indices from logstash/ deletion of indices when running in parallel to avoid race condition
I have read the opensearch documentation about jitter mechanism, plugins.index_state_management.jitter 0.6.
Could you please explain me in detail, will jitter helps me in this case.