@jaimie.livingston It is a known bug that duplicating kibana_user role doesn’t actually provide the same permissions under the hood. It would appears as though this role is hard-coded somewhere.
Is there any reason you can’t map this role to all uses, even for testing purposes?