I’m running Filebeat on Kubernetes in a EKS Cluster in AWS and send the logs to ElasticSearch in another AWS account. The logs reach the ElasticSearch and I can see the logs in Kibana. But I get these errors sometimes:
ERROR [publisher_pipeline_output] pipeline/output.go:155 Failed to connect to backoff(elasticsearch(https://<elasticsearch>.es.amazonaws.com:443)): Get https://<elasticsearch>.es.amazonaws.com:443: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
For testing, I setup a ElasticSearch in the same AWS Account and send the logs to this ElasticSearch. So I did’t get these errors. I only get the errors if I’m sending the logs to a ElasticSearch in another AWS account.
Anyone else had this problem and can help me?
Thank you in advance.