Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
Opensearch 2.6.0
Debian 11 5.10.0-21-amd64
Describe the issue:
I followed this guide: Debian - OpenSearch documentation
After installing the deb package, I go to the next instruction, which is to start the systemd service.
It hangs for about 10 seconds, then exits with failure.
I must be missing something for this to failure so early into install.
I am new to opensearch, and am not very familiar with elasticsearch. Can someone help me?
Configuration:
# ======================== OpenSearch Configuration =========================
#
# NOTE: OpenSearch comes with reasonable defaults for most settings.
# Before you set out to tweak and tune the configuration, make sure you
# understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.opensearch.org
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: graylog
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
#node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /var/lib/opensearch
#
# Path to log files:
#
path.logs: /var/log/opensearch
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# OpenSearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
#network.host: 192.168.0.1
#
# Set a custom port for HTTP:
#
#http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
#discovery.seed_hosts: ["host1", "host2"]
#
# Bootstrap the cluster using an initial set of cluster-manager-eligible nodes:
#
#cluster.initial_cluster_manager_nodes: ["node-1", "node-2"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
#
# For more information, consult the gateway module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true
#
# ---------------------------------- Experimental Features -----------------------------------
#
# Gates the visibility of the index setting that allows changing of replication type.
# Once the feature is ready for production release, this feature flag can be removed.
#
#opensearch.experimental.feature.replication_type.enabled: false
#
#
# Gates the visibility of the index setting that allows persisting data to remote store along with local disk.
# Once the feature is ready for production release, this feature flag can be removed.
#
#opensearch.experimental.feature.remote_store.enabled: false
#
#
# Gates the functionality of a new parameter to the snapshot restore API
# that allows for creation of a new index type that searches a snapshot
# directly in a remote repository without restoring all index data to disk
# ahead of time.
#
#opensearch.experimental.feature.searchable_snapshot.enabled: false
#
#
# Bind OpenSearch to the correct network interface. Use 0.0.0.0
# to include all available interfaces or specify an IP address
# assigned to a specific interface.
network.host: 127.0.0.1
# Unless you have already configured a cluster, you should set
# discovery.type to single-node, or the bootstrap checks will
# fail when you try to start the service.
discovery.type: single-node
# If you previously disabled the security plugin in opensearch.yml,
# be sure to re-enable it. Otherwise you can skip this setting.
plugins.security.disabled: false
######## Start OpenSearch Security Demo Configuration ########
# WARNING: revise all the lines below before you go into production
plugins.security.ssl.transport.pemcert_filepath: esnode.pem
plugins.security.ssl.transport.pemkey_filepath: esnode-key.pem
plugins.security.ssl.transport.pemtrustedcas_filepath: root-ca.pem
plugins.security.ssl.transport.enforce_hostname_verification: false
plugins.security.ssl.http.enabled: true
plugins.security.ssl.http.pemcert_filepath: esnode.pem
plugins.security.ssl.http.pemkey_filepath: esnode-key.pem
plugins.security.ssl.http.pemtrustedcas_filepath: root-ca.pem
plugins.security.allow_unsafe_democertificates: true
plugins.security.allow_default_init_securityindex: true
plugins.security.authcz.admin_dn:
- CN=kirk,OU=client,O=client,L=test, C=de
plugins.security.audit.type: internal_opensearch
plugins.security.enable_snapshot_restore_privilege: true
plugins.security.check_snapshot_restore_write_privileges: true
plugins.security.restapi.roles_enabled: ["all_access", "security_rest_api_access"]
plugins.security.system_indices.enabled: true
plugins.security.system_indices.indices: [".plugins-ml-model", ".plugins-ml-task", ".opendistro-alerting-config", ".opendistro-alerting-alert*", ".opendistro-anomaly-results*", ".opendistro-anomaly-detector*", ".opendistro-anomaly-checkpoints", ".opendistro-anomaly-detection-state", ".opendistro-reports-*", ".opensearch-notifications-*", ".opensearch-notebooks", ".opensearch-observability", ".opendistro-asynchronous-search-response*", ".replication-metadata-store"]
node.max_local_storage_nodes: 3
######## End OpenSearch Security Demo Configuration ########
Relevant Logs or Screenshots:
Journal output:
Mar 13 20:42:00 hostname systemd[1]: Failed to start OpenSearch.
Mar 13 20:42:00 hostname systemd[1]: opensearch.service: Failed with result 'exit-code'.
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.cli.Command.main(Command.java:101)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:413)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.bootstrap.Bootstrap.start(Bootstrap.java:339)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.node.Node.start(Node.java:1331)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.systemd.SystemdPlugin.onNodeStarted(SystemdPlugin.java:137)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.systemd.SystemdPlugin.sd_notify(SystemdPlugin.java:126)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.systemd.Libsystemd.<clinit>(Libsystemd.java:46)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: at org.opensearch.systemd.Libsystemd.lambda$static$0(Libsystemd.java:47)
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: java.lang.NoClassDefFoundError: Could not initialize class com.sun.jna.Native
Mar 13 20:42:00 hostname systemd-entrypoint[191206]: fatal error in thread [main], exiting
Mar 13 20:41:50 hostname systemd-entrypoint[191206]: WARNING: System::setSecurityManager will be removed in a future release
Mar 13 20:41:50 hostname systemd-entrypoint[191206]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
Mar 13 20:41:50 hostname systemd-entrypoint[191206]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/opensearch/lib/opensearch-2.6.0.jar)
Mar 13 20:41:50 hostname systemd-entrypoint[191206]: WARNING: A terminally deprecated method in java.lang.System has been called
Mar 13 20:41:49 hostname systemd-entrypoint[191206]: WARNING: System::setSecurityManager will be removed in a future release
Mar 13 20:41:49 hostname systemd-entrypoint[191206]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
Mar 13 20:41:49 hostname systemd-entrypoint[191206]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/opensearch/lib/opensearch-2.6.0.jar)
Mar 13 20:41:49 hostname systemd-entrypoint[191206]: WARNING: A terminally deprecated method in java.lang.System has been called
/var/log/opensearch/opensearch.log
[2023-03-13T20:24:07,911][INFO ][o.o.t.NettyAllocator ] [hostname] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=1gb}]
[2023-03-13T20:24:08,011][INFO ][o.o.d.DiscoveryModule ] [hostname] using discovery type [zen] and seed hosts providers [settings]
[2023-03-13T20:24:08,506][WARN ][o.o.g.DanglingIndicesState] [hostname] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2023-03-13T20:24:09,079][INFO ][o.o.p.h.c.PerformanceAnalyzerConfigAction] [hostname] PerformanceAnalyzer Enabled: true
[2023-03-13T20:24:09,110][INFO ][o.o.n.Node ] [hostname] initialized
[2023-03-13T20:24:09,110][INFO ][o.o.n.Node ] [hostname] starting ...
[2023-03-13T20:24:09,227][INFO ][o.o.t.TransportService ] [hostname] publish_address {127.0.0.1:9301}, bound_addresses {127.0.0.1:9301}
[2023-03-13T20:24:09,380][WARN ][o.o.b.BootstrapChecks ] [hostname] system call filters failed to install; check the logs and fix your configuration or disable system call filters at your own risk
[2023-03-13T20:24:09,380][WARN ][o.o.b.BootstrapChecks ] [hostname] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_cluster_manager_nodes / cluster.initial_master_nodes] must be configured
[2023-03-13T20:24:09,382][INFO ][o.o.c.c.Coordinator ] [hostname] cluster UUID [sEIZl4OQTjSwOZROBtZ25w]
[2023-03-13T20:24:09,391][INFO ][o.o.c.c.ClusterBootstrapService] [hostname] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing cluster-manager is discovered
[2023-03-13T20:24:09,466][INFO ][o.o.c.s.MasterService ] [hostname] elected-as-cluster-manager ([1] nodes joined)[{hostname}{4ATyVf2ETtyBcw5M3ENN8g}{9_WXMuiNRUyFxwEB0xVYfw}{127.0.0.1}{127.0.0.1:9301}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_CLUSTER_MANAGER_TASK_, _FINISH_ELECTION_], term: 2, version: 3, delta: cluster-manager node changed {previous [], current [{hostname}{4ATyVf2ETtyBcw5M3ENN8g}{9_WXMuiNRUyFxwEB0xVYfw}{127.0.0.1}{127.0.0.1:9301}{dimr}{shard_indexing_pressure_enabled=true}]}
[2023-03-13T20:24:09,508][INFO ][o.o.c.s.ClusterApplierService] [hostname] cluster-manager node changed {previous [], current [{hostname}{4ATyVf2ETtyBcw5M3ENN8g}{9_WXMuiNRUyFxwEB0xVYfw}{127.0.0.1}{127.0.0.1:9301}{dimr}{shard_indexing_pressure_enabled=true}]}, term: 2, version: 3, reason: Publication{term=2, version=3}
[2023-03-13T20:24:09,518][INFO ][o.o.a.c.ADClusterEventListener] [hostname] Cluster is not recovered yet.
[2023-03-13T20:24:09,525][INFO ][o.o.a.u.d.DestinationMigrationCoordinator] [hostname] Detected cluster change event for destination migration
[2023-03-13T20:24:09,543][INFO ][o.o.i.i.ManagedIndexCoordinator] [hostname] Cache cluster manager node onClusterManager time: 1678753449543
[2023-03-13T20:24:09,554][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [hostname] Config override setting update called with empty string. Ignoring.
[2023-03-13T20:24:09,564][INFO ][o.o.d.PeerFinder ] [hostname] setting findPeersInterval to [1s] as node commission status = [true] for local node [{hostname}{4ATyVf2ETtyBcw5M3ENN8g}{9_WXMuiNRUyFxwEB0xVYfw}{127.0.0.1}{127.0.0.1:9301}{dimr}{shard_indexing_pressure_enabled=true}]
[2023-03-13T20:24:09,567][INFO ][o.o.h.AbstractHttpServerTransport] [hostname] publish_address {127.0.0.1:9201}, bound_addresses {127.0.0.1:9201}
[2023-03-13T20:24:09,568][INFO ][o.o.n.Node ] [hostname] started
[2023-03-13T20:24:09,570][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [hostname] fatal error in thread [main], exiting
java.lang.NoClassDefFoundError: Could not initialize class com.sun.jna.Native
at org.opensearch.systemd.Libsystemd.lambda$static$0(Libsystemd.java:47) ~[?:?]
at java.security.AccessController.doPrivileged(AccessController.java:318) ~[?:?]
at org.opensearch.systemd.Libsystemd.<clinit>(Libsystemd.java:46) ~[?:?]
at org.opensearch.systemd.SystemdPlugin.sd_notify(SystemdPlugin.java:126) ~[?:?]
at org.opensearch.systemd.SystemdPlugin.onNodeStarted(SystemdPlugin.java:137) ~[?:?]
at java.util.ArrayList.forEach(ArrayList.java:1511) ~[?:?]
at org.opensearch.node.Node.start(Node.java:1331) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.bootstrap.Bootstrap.start(Bootstrap.java:339) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:413) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-2.6.0.jar:2.6.0]
at org.opensearch.cli.Command.main(Command.java:101) ~[opensearch-cli-2.6.0.jar:2.6.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137) ~[opensearch-2.6.0.jar:2.6.0]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103) ~[opensearch-2.6.0.jar:2.6.0]