How to minikube's system logs share in opensearch via fluentbit?

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
Opensearch version: 2.14
Opensearch Dashboard version: 2.14
Server OS: Ubuntu
Browser: Firefox Web Browser

Describe the issue:

so i have a three helm charts opensearch, opensearch dashboard and fluentbit

so when i try to minikube logs pass in the opensearch via fluentbit,
there are give me an error in the fluentbit logs and my fluentbit version is 3.0.7 .

The error is :

[2024/06/27 05:32:52] [error] [upstream] connection #68 to tcp://10.244.0.83:9600 timed out after 10 seconds (connection timeout)
[2024/06/27 05:32:52] [error] [upstream] connection #72 to tcp://10.244.0.83:9600 timed out after 10 seconds (connection timeout)
[2024/06/27 05:32:52] [ warn] [engine] failed to flush chunk ‘1-1719466229.993033463.flb’, retry in 87 seconds: task_id=601, input=cpu.0 > output=opensearch.0 (out_id=0)
[2024/06/27 05:32:52] [ warn] [engine] failed to flush chunk ‘1-1719466254.994056245.flb’, retry in 49 seconds: task_id=626, input=cpu.0 > output=opensearch.0 (out_id=0)

when i install fluentbit via helm i pass also this config code
The code is:

config:
inputs: |
[INPUT]
Name cpu
Tag cpu

outputs: |
[OUTPUT]
Name opensearch
Match *
Host opensearch-cluster-master-headless.default.svc.cluster.local
Port 9600
HTTP_User admin
HTTP_Passwd TadhakDev01
Suppress_Type_Name On
Trace_Error On
Trace_Output On
Logstash_Format On
Replace_Dots On
Retry_Limit 100
Index minikubelogs

And I edit this below code in my opensearch’s value.yaml file

ssl:
http: false

allow_unsafe_democertificates: true

Configuration:

So I want all logs are get from the minikube system and pass in the opensearch via fluentbit.

Relevant Logs or Screenshots:

This is the fluentbit logs:

[2024/06/27 05:32:52] [error] [upstream] connection #68 to tcp://10.244.0.83:9600 timed out after 10 seconds (connection timeout)
[2024/06/27 05:32:52] [error] [upstream] connection #72 to tcp://10.244.0.83:9600 timed out after 10 seconds (connection timeout)
[2024/06/27 05:32:52] [ warn] [engine] failed to flush chunk ‘1-1719466229.993033463.flb’, retry in 87 seconds: task_id=601, input=cpu.0 > output=opensearch.0 (out_id=0)
[2024/06/27 05:32:52] [ warn] [engine] failed to flush chunk ‘1-1719466254.994056245.flb’, retry in 49 seconds: task_id=626, input=cpu.0 > output=opensearch.0 (out_id=0)

Seems that the network is not reachable, could you check the OpenSearch endpoint manually in the fluentbit side?

when i try to use data prepper, so there are all logs get in opensearch dashboard through flyintbit

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.