Data masking options on open search

[Adwait]

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):

Describe the issue:
I am new to OpenSearch and have a large volume of API manager logs, which sometimes include sensitive Personally Identifiable Information (PII). I am performing data masking operations before ingesting this data into OpenSearch. I wanted to inquire if there is a way to perform data masking using pipelines. I’ve come across information about field masking, which allows users to view relevant data only, but what I need is to ingest data after performing data masking.

Configuration:

Relevant Logs or Screenshots:

[Mantas]

Hi @Adwait,

Have you checked field masking here:

Field masking

Field masking works alongside field-level security on the same per-role, per-index basis.

more in field-level security here:

Field-level security

You might as well be interested in:

Document-level security

Best,
mj