I am new to opensearch trace analytic data, currently, I deployed my data-prepper pod in my eks, and i can see the index sent by data-prepper in my AWS Opensearch.
what I noticed is that instead of date format suffix, its index-pattern is based on sequence , such as otel-v1-apm-span-000008，otel-v1-apm-span-000007… But I don’t know the rotate logic between those indexes e.g. when data-prepper will rotate index from otel-v1-apm-span-000007 to otel-v1-apm-span-000008, I have spent 2 hours on digging the rotating logic, but no luck. As i need to know how and when to clean those indexes base on the rotating logic, it’s very important.
So, it’s very appreciated that who could kindly provide some help, thanks in advance