# \[Data Prepper\] - S3 Source Error

**URL:** <https://forum.opensearch.org/t/data-prepper-s3-source-error/12517>\
**Category:** Data Prepper\
**Created:** [February 15, 2023, 1:17pm UTC](https://forum.opensearch.org/t/data-prepper-s3-source-error/12517 "2023-02-15T13:17:40Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![mann](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@mann](https://forum.opensearch.org/u/mann)\
**Post date:** [February 15, 2023, 1:17pm UTC](https://forum.opensearch.org/t/data-prepper-s3-source-error/12517/1 "2023-02-15T13:17:40Z")

</div>

Hi,

I am using data prepper with S3 data source, where I have configure SNS queue to read logs from aws cloudtrail but it’s throwing an error related to parsing. It seems the event which is consumed from the SNS queue is not parsable.

I tried with all possible combination of Codec and Compression listed in the documentation, but the error didn’t solve.

 ![image](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/5/5c5a5f28cec42cccc49aae3527d8a37a1987b328.png)

---

<div class="post-metadata">

**Author:** ![shuklash](https://avatars.discourse-cdn.com/v4/letter/s/f17d59/32.png) [@shuklash](https://forum.opensearch.org/u/shuklash)\
**Post date:** [February 21, 2023, 5:29am UTC](https://forum.opensearch.org/t/data-prepper-s3-source-error/12517/2 "2023-02-21T05:29:12Z")

</div>

Hi @mann

Based on the error, it looks like the JSON string is invalid. Can you please share your pipeline configuration?

---

<div class="post-metadata">

**Author:** ![asif](https://avatars.discourse-cdn.com/v4/letter/a/c37758/32.png) [@asif](https://forum.opensearch.org/u/asif)\
**Post date:** [February 21, 2023, 9:47pm UTC](https://forum.opensearch.org/t/data-prepper-s3-source-error/12517/3 "2023-02-21T21:47:32Z")

</div>

Hi @mann

Looks like you have configured SNS topic, we only support SQS queue in S3 source. Please try to modify your S3 bucket to send events to SQS queue and try again.

---

<div class="post-metadata">

**Author:** ![mann](https://avatars.discourse-cdn.com/v4/letter/m/91b2a8/32.png) [@mann](https://forum.opensearch.org/u/mann)\
**Post date:** [February 22, 2023, 8:11am UTC](https://forum.opensearch.org/t/data-prepper-s3-source-error/12517/4 "2023-02-22T08:11:26Z")

</div>

Thanks @asif I see, so it seems we can configure data prepper to support any kind of log collection like AWS Cloudtrail, Cloudwatch, VPC Flow Logs etc. Which can be collected via S3 bucket through SQS queue.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/3/33547ea01a5b12dcca2958411d3edd97ae2ea8c1.png) [@system](https://forum.opensearch.org/u/system)\
**Post date:** [April 23, 2023, 8:11am UTC](https://forum.opensearch.org/t/data-prepper-s3-source-error/12517/5 "2023-04-23T08:11:51Z")

</div>

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.