How to use "match and patterns" in date processor of s3-log-pipeline

Data Prepper
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):

Describe the issue:
Trying to use “match and patterns” in date processor of s3-log-pipeline as per below snippet, but getting error. Not sure how exactly to configure the match and patterns as I didn’t find any example reference. Appreciate if someone suggest the correct way of using the match and patterns .

Doc reference: date - OpenSearch Documentation

processor:
- date:
destination: “@timestamp”
match:
- key: “recordtimestamp”
patterns: [ “epoch_milli”, “epoch_second” ]
- date:
destination: “recordtimestamp”
from_time_received: true
- delete_entries:
with_keys: [ “s3” ]

Thanks,
Bishan

Configuration:

Relevant Logs or Screenshots:

2

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.