If anyone experience same issues: I managed to adjust TTL on Azure side using https://learn.microsoft.com/en-us/entra/identity-platform/configure-token-lifetimes
Also, feature request is opened on project https://github.com/opensearch-project/OpenSearch-Dashboards/issues/7604 so lets see if it will go through because I think it would be easier to set TTL directly on opensearch app side then on azure.