Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
OpenSearch Dashboards version : 2.16.0
Browser : Firefox
Describe the issue:
I install OpenSearch Dashboard , Dataprepper and Opentelemetry use with Helm chart.
So i First of i install OpenSearch and OpenSearch Dashboard and for the automatic generate index in the Opensearch dashboard i install the “Dataprepper” with this configuration in value.yaml code.
Dataprepper configuration code in value.yaml:
config:
otel-metrics-pipeline:
workers: 8
delay: 3000
source:
otel_metrics_source:
health_check_service: true
ssl: false
processor:
- otel_metrics:
calculate_histogram_buckets: true
calculate_exponential_histogram_buckets: true
exponential_histogram_max_allowed_scale: 10
flatten_attributes: false
sink:
- opensearch:
hosts: ["https://opensearch-cluster-master.default.svc.cluster.local:9200"]
username: "admin"
password: "TadhakDev01"
insecure: true
index_type: custom
index: ss4o_metrics-otel-%{yyyy.MM.dd}
bulk_size: 4
there are automatic create an index in the Opensearch dashboard with this name “ss4o_metrics-otel-%{yyyy.MM.dd}”.
and i install Opentelemetry with this configuration in value.yaml code.
Opentelemetry configuration code in value.yaml:
config:
exporters:
otlp/data-prepper:
endpoint: my-data-prepper-release.default.svc.cluster.local:21891
tls:
insecure: true
debug: {}
extensions:
# The health_check extension is mandatory for this chart.
# Without the health_check extension the collector will fail the readiness and liveliness probes.
# The health_check extension can be modified, but should never be removed.
health_check:
endpoint: ${env:MY_POD_IP}:13133
processors:
batch: {}
# Default memory limiter configuration for the collector based on k8s resource limits.
memory_limiter:
check_interval: 5s
limit_mib: 512
spike_limit_percentage: 25
receivers:
kubeletstats:
insecure_skip_verify: true
# collection_interval: 30s
metrics:
container.cpu.time:
enabled: true
container.cpu.utilization:
enabled: true
container.memory.available:
enabled: true
container.memory.usage:
enabled: true
k8s.node.cpu.time:
enabled: true
k8s.node.cpu.usage:
enabled: true
k8s.node.memory.available:
enabled: true
k8s.node.memory.usage:
enabled: true
k8s.pod.cpu.time:
enabled: true
k8s.pod.cpu.usage:
enabled: true
k8s.pod.memory.available:
enabled: true
k8s.pod.memory.usage:
enabled: true
k8s_cluster:
node_conditions_to_report: [Ready, MemoryPressure]
allocatable_types_to_report: [cpu, memory]
metrics:
k8s.container.cpu_limit:
enabled: true
k8s.container.cpu_request:
enabled: true
k8s.container.memory_limit:
enabled: true
k8s.container.memory_request:
enabled: true
zipkin:
endpoint: ${env:MY_POD_IP}:9411
service:
telemetry:
metrics:
address: ${env:MY_POD_IP}:8888
extensions:
- health_check
pipelines:
logs:
exporters:
- debug
processors:
- memory_limiter
- batch
receivers:
- otlp
metrics:
receivers: [hostmetrics]
processors: []
exporters: [otlp/data-prepper]
when i install this Opentelemetry than my index “ss4o_metrics-otel-%{yyyy.MM.dd}” total size are automatically high.
this is the index image:
there are all metrics are show in the “Discover” in OpenSearch dashboard.
this is the “Discover” image :
but in the OpenSearch dashboard “Metrics” there are not any metrics are available in this “Metrics” form
this is the “Metrics” image :
Configuration:
So i want to all index metrics are get in the OpenSearch dashboard “Metrics”.