Compatibility of OpenSearch 2.x with Logstash 9.x and Filebeat 9.x

OpenSearch
, ,
1

The current Versions i use:

  • OpenSearch 2.19.2
  • logstash-oss 8.17.2
  • Filebeat 8.18.3

Hi OpenSearch team,

I’m currently considering using Logstash 9.x and Filebeat 9.x with OpenSearch 2.19.2 and in the future the transition to OpenSearch 3.x is possible closer to 3.5. I know from the documentation that OpenSearch 2.x is compatible with Logstash 8.x, but I couldn’t find an official compatibility matrix for Logstash 9.x and Filebeat 9.x.

I have the following questions:

  1. Is Logstash 9.x officially supported with OpenSearch 2.x?
  • If so, could I use the logstash from Docker Hub ?
  • Are there any limitations or known issues when using Logstash 9.x (e.g. ECS compatibility mode)?
  1. Is Filebeat 9.x compatible with OpenSearch 2.x?
  • Do I need to enable Elastic Common Schema (ECS) explicitly to ensure compatibility with OpenSearch ingestion and dashboards?
  1. Does OpenSearch provide any guidelines on how to properly configure ECS in this kind of setup?

I want to make sure I’m not introducing silent incompatibilities by moving to the 9.x versions of Logstash and Filebeat. Any documentation or clarification would be appreciated.

Thanks in advance!

Best regards,
Nick

2

Hi, in my environment i’m using Opensearch 3.0 with Logstash 8.18 and Filebeat 8.18. All compatibily, i don’t have the necessity of explicit the ECS.

But to make logstash compatible with opensearch, and all the logstash nodes you have to install the logstash-output-plugin.

And in the output section of your pipine you have to setup

output {
  opensearch {
    hosts => ["localhost:9200"]
    index => "xxxxx"
    user => "xxx"
    password => "xxxxxx"
    ssl => (true/false)
    cacert => ""
  }
}

But i don’t use Logstash-oss but just Logstash x64

3

Hi @abarocco, thanks a lot for your response!

Glad to hear your setup works well — I appreciate you sharing your configuration.

Just to clarify, my use case is a bit different:
I’m currently using OpenSearch 2.19.2, and I’m considering moving to Logstash 9.x and Filebeat 9.x (currently running logstash-oss 8.17.2 and Filebeat 8.18.3).
I’m mainly trying to avoid any subtle incompatibilities or surprises by moving to the 9.x stack.

4

Hi @private-email

Have tried running Logstash 9.x? Did it work.?
If you can provide more details it would be great.

5

@private-email

Does upgrading to 9.x worked for you?

6

Hi. I’m still on version 8.x. It still receives some updates. Just haven’t had the time to get around to upgrading yet. Since posting this, I haven’t done any further research on what I was asking about here. If you’ve found some useful info and feel like sharing it with everyone — feel free, welcome to do so. I’d be happy to hear it!

7

This information might be useful regarding Logstash and Filebeats version compatibility.

I would recommend to raise an issue to update the documentation here