Originally in my ELK Stack, I had Logstash write to Elasticsearch (ES) and Kibana query from ES. All running with helm on Elastic Kubernetes Service (EKS). Since I am using Elastic APM (EAPM), I was told I can only replace ES with their version of it called OpenSearch (OS) and have my Kibana query from it. Their forked version of Kibana (OpenSearch Dashboards) does not support EAPM.
So now I have Logstash writing to AWS OpenSearch (OS). But I am having a hard time trying to get Kibana to query OS. Logstash’s pipeline config allows me to set aws_access_key_id and aws_secret_access_key but Kibana’s config does not. I cannot find docs on this anywhere. Is this possible? I keep getting the following xpack error which I believe OS does not support:
{"type":"log","@timestamp":"2022-08-26T18:04:16Z","tags":["warning","plugins","licensing"],"pid":7,"message":"License information could not be obtained from Elasticsearch due to Authorization Exception :: {\"path\":\"/_xpack\",\"statusCode\":403,\"response\":\"{\\\"message\\\":\\\"'ZWxhc3RpYzplbGFzdGlj' not a valid key=value pair (missing equal-sign) in Authorization header: 'Basic ZWxhc3RpYzplbGFzdGlj'.\\\"}\"} error"}
ZWxhc3RpYzplbGFzdGlj being base64 decoded to elastic:elastic