I have an EC2 instance with Docker container log files that I need monitored.
I need to know what is needed on the EC2 instance to get the logs to Open Distro Elasticsearch and Kibana (no Logstash) ?
Do I need to have Filebeat agent for docker or will filebeat-oss agent work fine?
Any help appreciated.
Hi @FREDDIE2020 currently the opendistro docker container emits logs to stderr/stdout. Are you trying to store the logs to somewhere else? if yes, you can check the docker logging. View logs for a container or service | Docker Documentation
The logs are currently stored on the EC2 instance (standalone docker container) and logs are going to docker/container log location. I need get those logs into Kibana for viewing.
I have OD and Kibana setup, but need ideas on how to get this done easily?. Can you help with that?
I see. You need upload the EC2 container logs into opendistro elasticsearch cluster. you can take a look at Fluentd for pure container or aws Firelens if you are using ECS. some resources:
We have Filebeat. Will Filebeat agent work for Docker container to send logs to ODES for Kibana?
not familiar with Filebeat. It should work since it seems to be a just replacement for logstash. you can have a try.