[AWS OpenSearch Managed Service User]
I’m ingesting millions of documents and was advised to create monthly indices.
To setup, I created monthly indices for a year back and a year forward. I’m not using aliases as I may need to write to these any at any time. These indices also have explicit mappings.
The problem is I get corrections that are years out and an index doesn’t exist, so opensearch automatically creates a new one. I’m using the bulk API, but opensearch doesn’t raise any errors if the index doesn’t exist. I can check for index existence, but that’s a costly operation for my volume.
Any suggestions? Am I making this too hard? I’d like to turn off automatic index construction if possible, or set an explicit default mapping for an index that doesn’t exist.