Data Prepper not starting

Data Prepper
21

Thanks I tried exposing the port to 4900 , still the same …could anybody else pls assist?

22

@ammujgd I think the port 21890 should be fine. For further assistance, could you let us know

  1. how you run the otel-collector?
  2. could you share your otel-collector-config.yaml? It seems from your posted collector log there is no otlp-exporter. You could refer to data-prepper/trace_analytics.md at dbe86bb622f19b6ad70bae3286c53fb87d48adf8 · opensearch-project/data-prepper · GitHub to see if it helps.
23

Thanks… I am starting opentelemtry collecotr as below

 docker run --rm -p 13133:13133 -p 14250:14250 -p 14268:14268 -p 55678-55679:55678-55679 -p 4317:4317 -p 8888:8888 -p 9411:9411 -v '/c/program files/docker/cli-plugins/otel-local-config.yml:/otel-local-config.yaml' --name otelcol otel/opentelemetry-collector

otel-local-config.yml is as below

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: 0.0.0.0:4317
      http:
        endpoint: 0.0.0.0:55681

processors:
  batch:

exporters:
  otlp:
    endpoint: 0.0.0.0:4317
  otlp/2:
    endpoint: 0.0.0.0:4317

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [logging, otlp]
24

Any updates pls…Is the configuration correct in collector config

25

Did you follow the link provided by @qchea? Your config needs to specify Data Prepper as an exporter. Similarly to how the following config adds Data Prepper as an exporter and assumes Data Prepper’s otel-trace-source is running on port 21890, which is the default.

receivers:
  jaeger:
    protocols:
      grpc:
  otlp:
    protocols:
      grpc:
  zipkin:

processors:
  batch/traces:
    timeout: 1s
    send_batch_size: 50

exporters:
  otlp/data-prepper:
    endpoint: localhost:21890
    insecure: true

service:
  pipelines:
    traces:
      receivers: [jaeger, otlp, zipkin]
      exporters: [otlp/data-prepper]