Hi All,
I am looking into using dataprepper to ship the logs from my Kafka instance into Opensearch.
However, as i have data collected from multiple inputs into a topic, i use the ‘Key’ field as an index router.
However, im not sure how to have data prepper read this key, and use it as the variable for routing to the correct index. So im seeking some guidance on this.
The message in kafka looks like
And, based on this, i want data prepper to read the key, and then use that as the index for the document. But im struggling to find out how to do this in the documentation.
Can i get some advice please?