"kafka.bootstrap_servers" is not configurable

[pedro.nieto]

Hello everyone,

I am writing this because I found an issue creating an opensearch pipeline in AWS to ingest data from a custom Kafka into Opensearch. To do this I am creating an ingestion pipelin with the following code:

version: '2'
kafka-pipeline:
  source:
    kafka:
      bootstrap_servers:
        - '100.100.100.100:9092'
      topics:
        - name: Topic1
          group_id: groupID1
  sink:
    - opensearch:
        hosts: [ "https://XXXX.eu-central-1.amazonaws.com" ]
          aws:
            sts_role_arn: "arn:aws:iam::XXXXXXX:role/AWSROLE"
            region: "eu-central-1"
          index: "index_123"

The problem I get is that based on the doc “bootstrap_servers” is the correct name:

kafka

But in the validation process this is returning an error:

Pipeline configuration validation failed

1. “kafka.bootstrap_servers” is not configurable parameter for Amazon OpenSearch Ingestion pipelines using an aws kafka source: “$[‘kafka-pipeline’][‘source’][‘kafka’]”.

Any help in here? Seems like an issue with Opensearch…