Visualizations fail for Tenant Dashboards After Migration to .kibana_2 in OpenSearch Dashboards 2.15

@Leeroy A couple of clarifications around reindexing

  • When to perform reindexing? (I assume after migration, but wanted to confirm)
  • Reindex on which index? (global tenant’s index ( kibana_*) or the tenant’s index ) ?

We have more than 23k dashboards. I was getting error when I tried exporting earlier that opensearch does not allow to export more than 10k dashboards. But on further digging, I find this link which shows to download more. Though I think the configurable feature is from 2.17(current version is 2.15), but I will test this.

Since this is a prod cluster, deleting all indices might be risky. This becomes little tricky to operate as the issue is not reproducible locally, and we have not seen this issue in any other clusters. Any suggestion on this as well?