Data Prepper ECS deployment

Hi Team - I have an AWS ECS cluster with multiple microservices. All services are instrumented with otel and have a sidecar otel collector. My question is should I launch data prepper as another ECS services, or should I launch an ec2 with data prepper separately?. Launching data prepper as part of the cluster seems to have a challenge with ALB and target groups.


Hi jocheinfa,

It is best practice to run Data Prepper separately from your other services. I would recommend giving that a try and seeing if the problem goes away.


I have to agree with @ddpowers here. The idea is that if something goes wrong with your microservices, you’d still want data prepper to be able to collect whatever is left.