Data prepper is giving errror: ERROR org.opensearch.dataprepper.plugin.PluginCreator - Encountered exception while instantiating the plugin OpenSearchSink

[divnoorsingh]

Hey

I am setting up data-prepper server on my ec2 instance. I’ve created opensearch cluster in aws managed os service. My docker run command for data prepper is producing error related to missing opensearchsink plugin. Do i need to install opensearch separately on my ec2 machine?

Logs are below:

my pipelines.yaml is:

entry-pipeline:
  delay: "100"
  source:
    otel_trace_source:
      ssl: false

  sink:
    - pipeline:
        name: "raw-pipeline"

raw-pipeline:
  source:
    pipeline:
      name: "entry-pipeline"
  processor:
    - otel_trace_raw:
    - otel_trace_group:
        hosts: ["https://xxxxxxxxxxxxxh-1.es.amazonaws.com:443"]
        username: "admin"
        password: "admin"
 
  sink:
    - opensearch:
        hosts: [ "https://xxxxxxxxxxxxxh-1.es.amazonaws.com:443" ]
        aws_sigv4: false
        username: "admin"
        password: "admin"
        trace_analytics_raw: true

Let me know where’s the issue.

[kris]

@dlv would you or someone on the team be able to look at this? thanks

[divnoorsingh]

@kris yes, this issue was resolved. Thank you!