EC2 Docker standalone logs

Open Source Elasticsearch and Kibana
1

Hello,

I have an EC2 instance with Docker container log files that I need monitored.

I need to know what is needed on the EC2 instance to get the logs to Open Distro Elasticsearch and Kibana (no Logstash) ?

Do I need to have Filebeat agent for docker or will filebeat-oss agent work fine?

Any help appreciated.

Thanks,

FREDDIE2020

2

Hi @FREDDIE2020 currently the opendistro docker container emits logs to stderr/stdout. Are you trying to store the logs to somewhere else? if yes, you can check the docker logging. View logs for a container or service | Docker Documentation

1 Like
3

Hi @weicongs

The logs are currently stored on the EC2 instance (standalone docker container) and logs are going to docker/container log location. I need get those logs into Kibana for viewing.

I have OD and Kibana setup, but need ideas on how to get this done easily?. Can you help with that?

Thanks,

Freddie2020

4

I see. You need upload the EC2 container logs into opendistro elasticsearch cluster. you can take a look at Fluentd for pure container or aws Firelens if you are using ECS. some resources:
http://eric-price.net/blog/centralized-logging-docker/
https://www.fluentd.org/

1 Like
5

@wicoongs

We have Filebeat. Will Filebeat agent work for Docker container to send logs to ODES for Kibana?

Thanks,

Freddie2020

6

not familiar with Filebeat. It should work since it seems to be a just replacement for logstash. you can have a try.

1 Like