Data Prepper ECS deployment

Data Prepper
1

Hi Team - I have an AWS ECS cluster with multiple microservices. All services are instrumented with otel and have a sidecar otel collector. My question is should I launch data prepper as another ECS services, or should I launch an ec2 with data prepper separately?. Launching data prepper as part of the cluster seems to have a challenge with ALB and target groups.

Regards

2

Hi jocheinfa,

It is best practice to run Data Prepper separately from your other services. I would recommend giving that a try and seeing if the problem goes away.

Thanks,
–David

1 Like
3

I have to agree with @ddpowers here. The idea is that if something goes wrong with your microservices, you’d still want data prepper to be able to collect whatever is left.