Using S3 for index storage


Is there any work being done on using S3 for index storage? It’s replicated and cheap compared to local storage or AWS EBS for example. Loki and ChaosSearch both take pride in being able to store data to S3 and search/scan/retrieve them, thus making these tools cheaper than ES. Interestingly, neither solution makes any comparisons to search speed, as far as I am aware.

Elastic has this: Data tiers | Elasticsearch Guide [7.10] | Elastic

Is the Open Distro for ES community considering the use of S3 for storage?


Sematext - Full Stack Observability -
Log Management - Infra Monitoring - User Experience - Transaction Tracing

Is there any work being done for this?

Looks like its already available - Take and Restore Snapshots - Open Distro Documentation

That’s just for taking and restoring snapshots, I am interested in searchable snapshots Searchable snapshot | Elasticsearch Guide [7.10] | Elastic

In Amazon Elasticsearch Service this is covered by the “ultrawarm” nodes featur… Don’t know if AWS has already any plan to share this introducing a similar feature in ODFE/OpenSearch…