Observability logs missing from Dashboards in 3.0?

Plugins Observability
1

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
3.0

Describe the issue:

Trying to access Observability logs in OpenSearch 3.0 results in an error - https://playground.opensearch.org/app/observability-logs#/

It works in 2.19

Relevant Logs or Screenshots:

image
image1225×631 14.3 KB

2

@victor How did you deploy your cluster? The Observability → Logs is available in both 3.0.0 and 3.0.0-alpha1.

image
image458×245 17.1 KB

Are you referring to the OpenSearch playground deployment? Try local docker image, binary or service deployment instead.

3

Hey Pablo,

That is strange. I first discovered this in three different OpenSearch clusters deployed via the k8s-operator, all of them running 3.0.

If i spin up a new cluster running 2.19 i have Observability → Logs available but not in 3.0.

4

Hmm this is strange. I used the docker-compose example found here and i do have observability → Logs, but i don’t have it in the opensearch clusters that have been created by the k8s-operator. But both clusters (local and k8s created) are running image 3.0.0 for both opensearch and opensearch-dashboards.

I have compared the list of plugins as well and they do not differ.

5

@victor I’ve just deployed cluster with OpenSearch operator and Observability → Logs is present.

image
image1702×404 50.6 KB

This is my OpenSearchCluster manifest.

apiVersion: opensearch.opster.io/v1
kind: OpenSearchCluster
metadata:
  name: my-first-cluster
  namespace: default
spec:
  security:
    config:
    tls:
       http:
         generate: true
       transport:
         generate: true
         perNode: true
  general:
    httpPort: 9200
    serviceName: my-first-cluster
    version: 3.0.0
    pluginsList: ["repository-s3"]
    drainDataNodes: true
  dashboards:
    tls:
      enable: true
      generate: true
    version: 3.0.0
    enable: true
    replicas: 1
    resources:
      requests:
         memory: "512Mi"
         cpu: "200m"
      limits:
         memory: "512Mi"
         cpu: "200m"
  nodePools:
    - component: masters
      replicas: 3
      resources:
         requests:
            memory: "2Gi"
            cpu: "1000m"
         limits:
            memory: "2Gi"
            cpu: "1000m"
      roles:
        - "data"
        - "cluster_manager"
      persistence:
         emptyDir: {}

I accessed my cluster with admin user.

6

I think i’ve found a bug. I took your cluster spec and created a local cluster with kind and i was able to view Observability → Logs as you mention.

image
image334×267 7.69 KB

I then compared your cluster spec to ours, and i started looking at the dashboard section of the cluster spec more specifically. I noticed that we are using additionalConfig in our cluster spec as we want to utilize data sources. So i modified your cluster spec by adding the additionalConfig section to it, like this:

apiVersion: opensearch.opster.io/v1
kind: OpenSearchCluster
metadata:
  name: my-first-cluster
  namespace: default
spec:
  security:
    config:
    tls:
       http:
         generate: true
       transport:
         generate: true
         perNode: true
  general:
    httpPort: 9200
    serviceName: my-first-cluster
    version: 3.0.0
    pluginsList: ["repository-s3"]
    drainDataNodes: true
  dashboards:
    tls:
      enable: true
      generate: true
    version: 3.0.0
    enable: true
    replicas: 1
    resources:
      requests:
         memory: "512Mi"
         cpu: "200m"
      limits:
         memory: "512Mi"
         cpu: "200m"
    additionalConfig:
      data_source.enabled: "true"
      data_source.ssl.verificationMode: none
  nodePools:
    - component: masters
      replicas: 3
      resources:
         requests:
            memory: "2Gi"
            cpu: "1000m"
         limits:
            memory: "2Gi"
            cpu: "1000m"
      roles:
        - "data"
        - "cluster_manager"
      persistence:
         emptyDir: {}

I then accessed OpenSearch-dashboards and noticed that Observability → Logs is missing again:

image
image327×173 4.4 KB

Can you see if you can reproduce this? I think i will go ahead and create a issue on the opensearch-operator github as well.

Edit: This happens on a 2.19.1 cluster as well.

7

Link to issue on Github: [BUG] Enabling data-sources results in Observability Logs missing · Issue #9926 · opensearch-project/OpenSearch-Dashboards · GitHub

8

@victor Thank you for sharing the GitHub link. I’ve just shared my updated there.
I’ve got the same result. Also Logs are not the only item missing. Applications and Dashboards are also gone.

1 Like