We are planning to upgrade from OpenSearch 1.x to 2.x, along with it we are also planning to upgrade logstash and filebeat to 8.x. But we are not able to find version compatibilty between beats and
logstash-output-opensearch plugin.
Is Beat 8.x compatible with Logstash OSS with OpenSearch Output Plugin 8.x?
Also as per Beats 8.x breaking changes, the beat logs are now ECS compliant, does this impact its compatibilty with opensearch?
The OpenSearch Output Plugin is compatible with Logstash 8.x. However, looking at wbeckler’s response looks like you might run into some issues with Beats.
@wbeckler Thanks for the reply. we are already using Filebeat 7.16 with Logstash 7.16 and we didn’t faced this issue yet. Any idea does Filebeat 8.x introduces any other breaking changes? and particularly does ECS compliant beat logs introduce any break in opensearch stack?
I don’t know the answer to what you’re asking about ECS.
I think the issue of the breaking change in 7.13 was regarding the scenario where beats is talking directly to your cluster rather than going via logstash.