# How can I find the index rate info

**URL:** <https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543>\
**Category:** OpenDistro\
**Tags:** troubleshoot\
**Created:** [February 6, 2022, 9:05pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543 "2022-02-06T21:05:14Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![siqideng](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@siqideng](https://forum.opensearch.org/u/siqideng)\
**Post date:** [February 6, 2022, 9:05pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/1 "2022-02-06T21:05:14Z")

</div>

Hi, it’s easy to check the index rate of each index in Elasticsearch/Kibana under `Stack Monitoring`. A screenshot is attached below.

 ![Screenshot from ES](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/b/b30023477b3d5a94e6c23731ebedfbc0eb92a703.png)

But I am having trouble finding the same info in opensearch-dashboard. Does opensearch provides it? If it requires user to create a query to find the index rate, could opensearch share the query, or even better, a visualization or dashboard.

Thank you

---

<div class="post-metadata">

**Author:** ![BlackMetalz](https://avatars.discourse-cdn.com/v4/letter/b/d6d6ee/32.png) [@BlackMetalz](https://forum.opensearch.org/u/BlackMetalz)\
**Post date:** [February 7, 2022, 10:45am UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/2 "2022-02-07T10:45:50Z")

</div>

Currently, it is not available, Stack Monitoring is a unique feature from Elasticsearch. But It would be great if Opensearch have the same 😗

---

<div class="post-metadata">

**Author:** ![jkowall](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/jkowall/32/1063_2.png) [@jkowall](https://forum.opensearch.org/u/jkowall)\
**Post date:** [February 7, 2022, 1:09pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/3 "2022-02-07T13:09:04Z")

</div>

We have a much more advanced dashboard we use which is based on Prometheus and Grafana to monitor our entire pipeline. I can probably share a copy, but it does require that you use a proper monitoring system (Prometheus) and you can generate alerts from alertmanager if you’d like.

Here is another example with directions on the exporter: [Monitoring Elasticsearch with Prometheus: Configuration, dashboards and alerts. (promcat.io)](https://promcat.io/apps/elasticsearch)

Another example too: [Monitoring ElasticSearch Cluster using Prometheus and Grafana - bidhankhatri.com.np](https://bidhankhatri.com.np/elk/monitoring-elasticsearch-cluster/)

---

<div class="post-metadata">

**Author:** ![siqideng](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@siqideng](https://forum.opensearch.org/u/siqideng)\
**Post date:** [February 7, 2022, 5:44pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/4 "2022-02-07T17:44:13Z")

</div>

Thank you @jkowall  
I have the elasticsearch-exporter deployed(image: [Quay](http://quay.io/prometheuscommunity/elasticsearch-exporter:latest)). It looks like it only collects ingest rate data on a node level, but not an index level. And all index related graphs are broken like the screenshot below

 ![Screenshot from 2022-02-07 09-41-01](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/0/00a14e7c708569c8b141b1365df79f92251f25dd.png)

It seems metrics like `elasticsearch_indices_docs_primary` doesn’t even exist in my prometheus database

---

<div class="post-metadata">

**Author:** ![siqideng](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@siqideng](https://forum.opensearch.org/u/siqideng)\
**Post date:** [February 7, 2022, 6:51pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/5 "2022-02-07T18:51:47Z")

</div>

> [@siqideng](#):
>
> elasticsearch\_indices

Confirmed that I have flags like ` --es.all --es.indices --es.shards` enabled in my exporter like below

```auto
[root@host-1 ~]# kubectl exec -it -n test-os elastic-exporter-5cf47f4545-2z8tr -- sh
/ $ 
/ $ ps |more
PID USER TIME COMMAND
    1 10000 0:00 /bin/elasticsearch_exporter --es.uri=https://USER:PASSWORD@test-os-master.test-os.svc:9200 --es.ssl-skip-verify --es.all --es.indices --es.shards
   14 10000 0:00 sh
   22 10000 0:00 ps
   23 10000 0:00 more
/ $ 

```

However, I can’t find the metric

```auto
[root@host-1 ~]# kubectl get svc -n test-os elastic-exporter
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
elastic-exporter ClusterIP 10.43.125.103 <none> 9114/TCP 11d
[root@host-1 ~]# 

```

```auto
[root@host2 ~]# curl -s 10.43.125.103:9114/metrics | wc -l
4169
[root@host2 ~]# curl -s 10.43.125.103:9114/metrics |grep elasticsearch_indices_docs_primary
[root@host2 ~]# curl -s 10.43.125.103:9114/metrics |grep elasticsearch_indices_store_size_bytes_primary
[root@host2 ~]# curl -s 10.43.125.103:9114/metrics |grep elasticsearch_indices_store_size_bytes_total
[root@host2 ~]# curl -s 10.43.125.103:9114/metrics |grep elasticsearch_indices_segment_doc_values_memory_bytes_primary
[root@host2 ~]# 

```

---

<div class="post-metadata">

**Author:** ![siqideng](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@siqideng](https://forum.opensearch.org/u/siqideng)\
**Post date:** [February 7, 2022, 7:06pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/6 "2022-02-07T19:06:43Z")

</div>

OK. I think it’s a permission issue. Checking what permissions are needed

```auto
level=warn ts=2022-02-07T19:01:30.190751746Z caller=indices.go:1096 msg="failed to fetch and decode index stats" err="HTTP Request failed with code 403"
level=warn ts=2022-02-07T19:01:40.190992731Z caller=indices.go:1096 msg="failed to fetch and decode index stats" err="HTTP Request failed with code 403"

```

---

<div class="post-metadata">

**Author:** ![siqideng](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@siqideng](https://forum.opensearch.org/u/siqideng)\
**Post date:** [February 7, 2022, 7:59pm UTC](https://forum.opensearch.org/t/how-can-i-find-the-index-rate-info/8543/7 "2022-02-07T19:59:40Z")

</div>

By adding `indices_monitor` permissions to my exporter account, index level data does show up. And I can get the index rate like `rate(elasticsearch_indices_docs_primary{exported_cluster="$cluster"}[1m])`  
Thank you for all the help
