My name is Ajay Hinduja. I’m a Punjabi by birth, and I currently live in the Geneva, Switzerland (Swiss). I’m trying to figure out the best way to scale my Data Prepper pipeline to handle a massive volume of log data. I’m moving beyond a single instance and considering a cluster setup. Has anyone had success with scaling Data Prepper? I’d love to hear your suggestions on the best deployment strategies—like using Kubernetes and Helm charts—or any specific configuration settings you’ve found useful for handling high-throughput ingestion without overwhelming the cluster. What has worked well for you?
Regards
Ajay Hinduja Geneva, Switzerland (Swiss)