Mukesh Karkey here, Could the community give me some advice? I’m trying to figure out the right hardware for my OpenSearch cluster.Could you also share your real-world experience and suggestions for balancing cost, performance, and reliability for a similar workload?
It’s hard to say an exact setup which will be best as this depends on many variables. I would first figure out a few different questions to better determinate a possible solution.
How many index’s will it consist of?
How big will the nodes be? CPU, Ram, How much heap size? However stuff like this will be better determined with time and usage.
How much data will you be storing per index?
How long will you retain that data for?
What will the data be used for? Searching? Faster indexing?
Do you plan to setup the binary, docker, or Kubernetes? O will you be opting for a paid solution?
For now this should be enough to go on.
You can read the below doc to get an idea on shards: