Send data to opensearch using dataprepper

Data Prepper
1

2022-01-04T05:12:10,360 [main] INFO com.amazon.dataprepper.parser.PipelineParser - Building [opensearch] as sink component
2022-01-04T05:12:10,361 [main] ERROR com.amazon.dataprepper.plugins.PluginFactory - Failed to find the plugin with name opensearch. Please ensure that plugin is annotated with appropriate values
2022-01-04T05:12:10,361 [main] ERROR com.amazon.dataprepper.parser.PipelineParser - Construction of pipeline components failed, skipping building of pipeline [service-map-pipeline] and its connected pipelines
com.amazon.dataprepper.plugins.PluginException: Failed to find the plugin with name [opensearch]. Please ensure that plugin is annotated with appropriate values
at com.amazon.dataprepper.plugins.PluginFactory.newPlugin(PluginFactory.java:19) ~[data-prepper.jar:1.0.3]
at com.amazon.dataprepper.plugins.sink.SinkFactory.newSink(SinkFactory.java:12) ~[data-prepper.jar:1.0.3]
at com.amazon.dataprepper.parser.PipelineParser.buildSinkOrConnector(PipelineParser.java:149) ~[data-prepper.jar:1.0.3]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
at com.amazon.dataprepper.parser.PipelineParser.buildPipelineFromConfiguration(PipelineParser.java:98) [data-prepper.jar:1.0.3]
at com.amazon.dataprepper.parser.PipelineParser.parseConfiguration(PipelineParser.java:64) [data-prepper.jar:1.0.3]
at com.amazon.dataprepper.DataPrepper.execute(DataPrepper.java:97) [data-prepper.jar:1.0.3]
at com.amazon.dataprepper.DataPrepperExecute.main(DataPrepperExecute.java:20) [data-prepper.jar:1.0.3]
2022-01-04T05:12:10,373 [main] ERROR com.amazon.dataprepper.DataPrepper - No valid pipeline is available for execution, exiting

2

Could you frame your question a little bit? All I’m seeing is an error message.

3

@subbu ,

I’m not quite sure of the context here. Your post only has a stack trace. But, I did notice this:

com.amazon.dataprepper.plugins.PluginException: Failed to find the plugin with name [opensearch].

My initial guess is that you are still using the OpenDistro Data Prepper. I encourage you to use the OpenSearch Data Prepper instead.

I’ll provide two links that can help.

This is a forum post on the topic:

Here is the currently maintained documentation on updating: