Using S3 for index storage

Open Source Elasticsearch and Kibana
1

Hi,

Is there any work being done on using S3 for index storage? It’s replicated and cheap compared to local storage or AWS EBS for example. Loki and ChaosSearch both take pride in being able to store data to S3 and search/scan/retrieve them, thus making these tools cheaper than ES. Interestingly, neither solution makes any comparisons to search speed, as far as I am aware.

Elastic has this: Data tiers | Elasticsearch Guide [7.10] | Elastic

Is the Open Distro for ES community considering the use of S3 for storage?

Thanks,
Otis

Sematext - Full Stack Observability - https://sematext.com
Log Management - Infra Monitoring - User Experience - Transaction Tracing

2

Is there any work being done for this?

3

Looks like its already available - Take and Restore Snapshots - Open Distro Documentation

4

That’s just for taking and restoring snapshots, I am interested in searchable snapshots Searchable snapshot | Elasticsearch Guide [7.10] | Elastic

5

In Amazon Elasticsearch Service this is covered by the “ultrawarm” nodes featur… Don’t know if AWS has already any plan to share this introducing a similar feature in ODFE/OpenSearch…