DLQ configuration for s3 compatible storage (e.g. minio)

mbona · July 22, 2026, 10:51am

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):

Opensearch 3.3.2 / OpensearchDashboard 3.3.0 / Data-prepper 2.13.0 Installed on openshift environment via Helm Chart (no operator helm chart)

Describe the issue:

I’d like to configure DLQ to write to a Minio bucket, but the documentation only mentions Amazon S3, and it’s not possible to set any endpoint parameters ( Dead-letter queues - OpenSearch Documentation ).

Is it possible to achieve the result I want?

pablo · July 22, 2026, 12:20pm

@mbona As per the Data Prepper documentation and code, Data Prepper DQL doesn’t support a custom S3 endpoint.

github.com/opensearch-project/data-prepper

data-prepper-plugins/failures-common/src/main/java/org/opensearch/dataprepper/plugins/dlq/s3/S3DlqWriterConfig.java

3f18aab60


      
          }
          
          private Arn getArn() {
              try {
                  return Arn.fromString(stsRoleArn);
              } catch (final Exception e) {
                  throw new IllegalArgumentException("Invalid ARN format for sts_role_arn");
              }
          }
          
          public S3Client getS3Client() {
              S3ClientBuilder s3ClientBuilder = S3Client.builder()
                  .region(this.getRegion())
                  .forcePathStyle(this.getForcePathStyle())
                  .credentialsProvider(this.getAwsCredentialsProvider())
                  .overrideConfiguration(ClientOverrideConfiguration.builder()
                      .retryPolicy(RetryPolicy.builder().numRetries(MAX_NUMBER_OF_RETRIES).build())
                      .build());
          
              if (legacyMd5Checksum == true) {
                s3ClientBuilder.requestChecksumCalculation(RequestChecksumCalculation.WHEN_REQUIRED)

You can open a feature request in the Data Prepper Git repository. If you do so, please share the link here.

mbona · July 23, 2026, 8:38am

I’ve opened the feature request: [FEATURE] DLQ support for s3 compatible storage · Issue #7018 · opensearch-project/data-prepper · GitHub

Thanks.

Topic		Replies	Views
OpenSearch data-prepper pipeline source config for s3 compatible object storage Data Prepper	1	252	May 23, 2025
Sink to a compatible s3 bucket Data Prepper troubleshoot	1	46	October 16, 2025
Need Help understanding the authentication to SQS Data Prepper troubleshoot , configure	1	738	February 14, 2023
Using S3 Storage as a Data Storage for logs OpenSearch configure , install	1	1014	March 12, 2024
Configure S3 Datasource in Opensearch Dashboard OpenSearch Dashboards configure	2	275	August 16, 2024

DLQ configuration for s3 compatible storage (e.g. minio)

Related topics