Data skew on opensearch cluster

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
os: 2.10.0

Describe the issue:
We are running our opensearch cluster on k8s for sometimes, it was working fine. recently we are getting a timeout error for few queries, and when we check the issue.
We found that there are few nodes was used more disk compared to others. because of this on those nodes the resource utilization was high and making the issue.

as you can see in the screenshort shards are allocated properly, but because of few index size was high, those shards are making cluster uneven.

Need guidance here

Configuration:
shared was default - 1000 max per node

Relevant Logs or Screenshots:



hi @radu.gheorghe
can you please guide here