Docker Data Persistence and Importing Excel Files

OpenSearch Dashboards
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):

Describe the issue: Hello OpenSearch Community,

I’m a new user trying to set up OpenSearch on my local machine using Docker, and I have a couple of questions I couldn’t fully resolve from the documentation. I would greatly appreciate any guidance!

1. Docker Data Persistence

I’m running OpenSearch in a Docker container. Once I add my own data and documents, what happens if I stop the container and run it again? Will my data still be there, or is it erased? I’ve heard about using Docker volumes for persistence, could someone point me to the best practice or a simple example command for OpenSearch?

2. Importing Excel Files - Need Step-by-Step Guide

I have Excel files with different columns that I want to import into OpenSearch and visualize in Dashboards. I’m completely new to this process and would appreciate a clear, step-by-step explanation.

Could someone walk me through the exact steps from start to finish? Specifically:

  1. How do I convert my Excel file to the right format for OpenSearch?

  2. What tools or methods are easiest for beginners to use?

  3. How do I actually get the data into OpenSearch once it’s converted?

  4. How do I then connect this data to Dashboards to create visualizations?

Thank you so much for your time and for building a great community!

2

image
image1900×775 36.3 KB

I have added a sample data 2 days ago then again run the docker container and my data has been erased..

What’s the issue?

3

@hammad_xflow thank you for the question, the concept that you are asking about are very broad in nature, but I will try to point you to the right direction.

Regarding docker, are you using docker compose to run this? If not, I would recommend to use docker-compose example here. The data will remain persistent until you delete the volumes (or run docker-compose down -v)

Regarding the excel import, there are a number of ways to do this, if this is a once off, you could create a simple python script to parse excel/csv file and push to OpenSearch. Alternative option would be to use Data Prepper with CSV processor

There are examples in the above docs on the actual syntax that should be used.

I hope this helps

4

Thanks Anthony!
I have done this now!!

1 Like