Error when running OpenSearch

OlzhasB · March 9, 2023, 5:19am

Versions (relevant - OpenSearch/Dashboard/Server OS/Browser):
OpenSearch 2.6.0
MacOS Ventura 13.0 (M1 Silicon Chip)

Describe the issue:
I was trying to follow the following steps from Developer’s Guide

opensearch-project/OpenSearch/blob/main/DEVELOPER_GUIDE.md#run-opensearch

- [Developer Guide](#developer-guide)
  - [Getting Started](#getting-started)
    - [Git Clone OpenSearch Repo](#git-clone-opensearch-repo)
    - [Install Prerequisites](#install-prerequisites)
      - [JDK 11](#jdk-11)
      - [JDK 14](#jdk-14)
      - [JDK 17](#jdk-17)
      - [Custom Runtime JDK](#custom-runtime-jdk)
      - [Windows](#windows)
      - [Docker](#docker)
    - [Build](#build)
      - [Generated Code](#generated-code)
    - [Run Tests](#run-tests)
    - [Run OpenSearch](#run-opensearch)
  - [Use an Editor](#use-an-editor)
    - [IntelliJ IDEA](#intellij-idea)
      - [Remote development using JetBrains Gateway](#remote-development-using-jetbrains-gateway)
    - [Visual Studio Code](#visual-studio-code)
    - [Eclipse](#eclipse)
  - [Project Layout](#project-layout)

This file has been truncated. show original

It seemed that I installed all necessary prerequisites and built OpenSearch. But when I tried to use ./gradlew run command, it always failed to build it. Also I tried to use ./gradlew test to make sure if it is working, but it also failed to build this command. Please could you help me with this issue.

Relevant Logs or Screenshots:

Configure project :qa:os
Cannot add task ‘destructiveDistroTest.docker’ as a task with that name already exists.
=======================================
OpenSearch Build Hamster says Hello!
Gradle Version : 8.0.2
OS Info : Mac OS X 13.0 (aarch64)
JDK Version : 18 (Oracle JDK)
JAVA_HOME : /Library/Java/JavaVirtualMachines/jdk-18.0.1.1.jdk/Contents/Home
Random Testing Seed : 3062CC00F729CF23
In FIPS 140 mode : false
=======================================

Task :run
[2023-03-09T05:13:15.504548Z] [BUILD] Copying additional config files from distro [/Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT/config/jvm.options.d, /Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT/config/opensearch.yml, /Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT/config/log4j2.properties, /Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT/config/jvm.options]
[2023-03-09T05:13:15.513412Z] [BUILD] Creating opensearch keystore with password set to
[2023-03-09T05:13:16.293827Z] [BUILD] Starting OpenSearch process
[2023-03-09T11:13:17,366][WARN ][o.o.b.Natives ] [runTask-0] unable to load JNA native support library, native methods will be disabled.
java.lang.UnsatisfiedLinkError: Can’t load library: /Users/olzhas/Library/Caches/JNA/temp/jna5306938776174509980.tmp
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:2398) ~[?:?]
at java.lang.Runtime.load0(Runtime.java:785) ~[?:?]
at java.lang.System.load(System.java:1979) ~[?:?]
at com.sun.jna.Native.loadNativeDispatchLibraryFromClasspath(Native.java:1018) ~[jna-5.5.0.jar:5.5.0 (b0)]
at com.sun.jna.Native.loadNativeDispatchLibrary(Native.java:988) ~[jna-5.5.0.jar:5.5.0 (b0)]
at com.sun.jna.Native.(Native.java:195) ~[jna-5.5.0.jar:5.5.0 (b0)]
at java.lang.Class.forName0(Native Method) ~[?:?]
at java.lang.Class.forName(Class.java:383) ~[?:?]
at java.lang.Class.forName(Class.java:376) ~[?:?]
at org.opensearch.bootstrap.Natives.(Natives.java:60) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:123) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:191) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) [opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.cli.Command.main(Command.java:101) [opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
[2023-03-09T11:13:17,370][WARN ][o.o.b.Natives ] [runTask-0] cannot check if running as root because JNA is not available
[2023-03-09T11:13:17,370][WARN ][o.o.b.Natives ] [runTask-0] cannot install system call filter because JNA is not available
[2023-03-09T11:13:17,370][WARN ][o.o.b.Natives ] [runTask-0] cannot register console handler because JNA is not available
[2023-03-09T11:13:17,371][WARN ][o.o.b.Natives ] [runTask-0] cannot getrlimit RLIMIT_NPROC because JNA is not available
[2023-03-09T11:13:17,371][WARN ][o.o.b.Natives ] [runTask-0] cannot getrlimit RLIMIT_AS because JNA is not available
[2023-03-09T11:13:17,371][WARN ][o.o.b.Natives ] [runTask-0] cannot getrlimit RLIMIT_FSIZE because JNA is not available
[2023-03-09T11:13:17,421][INFO ][o.o.n.Node ] [runTask-0] version[3.0.0-SNAPSHOT], pid[7118], build[tar/47a86c4f2a48f15c72529e397e517ffabab424cc/2023-03-08T14:07:47.596398Z], OS[Mac OS X/13.0/aarch64], JVM[Oracle Corporation/Java HotSpot™ 64-Bit Server VM/18.0.1.1/18.0.1.1+2-6]
[2023-03-09T11:13:17,422][INFO ][o.o.n.Node ] [runTask-0] JVM home [/Library/Java/JavaVirtualMachines/jdk-18.0.1.1.jdk/Contents/Home], using bundled JDK [false]
[2023-03-09T11:13:17,422][INFO ][o.o.n.Node ] [runTask-0] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.security.manager=allow, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/Users/olzhas/OpenSearch/build/testclusters/runTask-0/tmp, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=logs, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.security.manager=allow, -Xms512m, -Xmx512m, -ea, -esa, -XX:TieredStopAtLevel=1, -XX:ReservedCodeCacheSize=64m, -XX:MaxDirectMemorySize=268435456, -Dopensearch.path.home=/Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT, -Dopensearch.path.conf=/Users/olzhas/OpenSearch/build/testclusters/runTask-0/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
[2023-03-09T11:13:17,422][WARN ][o.o.n.Node ] [runTask-0] version [3.0.0-SNAPSHOT] is a pre-release version of OpenSearch and is not suitable for production
[2023-03-09T11:13:17,831][INFO ][o.o.i.r.ReindexModulePlugin] [runTask-0] ReindexPlugin reloadSPI called
[2023-03-09T11:13:17,832][INFO ][o.o.i.r.ReindexModulePlugin] [runTask-0] Unable to find any implementation for RemoteReindexExtension
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [aggs-matrix-stats]
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [analysis-common]
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [geo]
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [ingest-common]
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [ingest-geoip]
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [ingest-user-agent]
[2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [lang-expression]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [lang-mustache]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [lang-painless]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [mapper-extras]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [opensearch-dashboards]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [parent-join]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [percolator]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [rank-eval]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [reindex]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [repository-url]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [test-delayed-aggs]
[2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [transport-netty4]
[2023-03-09T11:13:17,839][INFO ][o.o.p.PluginsService ] [runTask-0] no plugins loaded
[2023-03-09T11:13:17,858][INFO ][o.o.e.NodeEnvironment ] [runTask-0] using [1] data paths, mounts [[/System/Volumes/Data (/dev/disk3s5)]], net usable_space [170.5gb], net total_space [460.4gb], types [apfs]
[2023-03-09T11:13:17,859][INFO ][o.o.e.NodeEnvironment ] [runTask-0] heap size [512mb], compressed ordinary object pointers [true]
[2023-03-09T11:13:17,882][INFO ][o.o.n.Node ] [runTask-0] node name [runTask-0], node ID [JvUR3nyzSpOPgzuaSU43Wg], cluster name [runTask], roles [ingest, remote_cluster_client, data, cluster_manager]
[2023-03-09T11:13:19,214][INFO ][o.o.t.NettyAllocator ] [runTask-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=512mb}]
[2023-03-09T11:13:19,238][INFO ][o.o.d.DiscoveryModule ] [runTask-0] using discovery type [zen] and seed hosts providers [settings, file]
[2023-03-09T11:13:19,343][WARN ][o.o.g.DanglingIndicesState] [runTask-0] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2023-03-09T11:13:19,423][INFO ][o.o.n.Node ] [runTask-0] initialized
[2023-03-09T11:13:19,423][INFO ][o.o.n.Node ] [runTask-0] starting …
[2023-03-09T11:13:19,477][ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [runTask-0] uncaught exception in thread [main]
org.opensearch.bootstrap.StartupException: BindTransportException[Failed to bind to [::1]:9300]; nested: BindException[Address already in use];
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:184) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.cli.Command.main(Command.java:101) ~[opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
Caused by: org.opensearch.transport.BindTransportException: Failed to bind to [::1]:9300
at org.opensearch.transport.TcpTransport.bindToPort(TcpTransport.java:468) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.transport.TcpTransport.bindServer(TcpTransport.java:432) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.transport.netty4.Netty4Transport.doStart(Netty4Transport.java:163) ~[?:?]
at org.opensearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:77) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.transport.TransportService.doStart(TransportService.java:280) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:77) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.node.Node.start(Node.java:1218) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.Bootstrap.start(Bootstrap.java:339) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:413) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
… 6 more
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method) ~[?:?]
at sun.nio.ch.Net.bind(Net.java:555) ~[?:?]
at sun.nio.ch.ServerSocketChannelImpl.netBind(ServerSocketChannelImpl.java:337) ~[?:?]
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:294) ~[?:?]
at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:141) ~[?:?]
at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:562) ~[?:?]
at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1334) ~[?:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:600) ~[?:?]
at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:579) ~[?:?]
at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:973) ~[?:?]
at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:260) ~[?:?]
at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:356) ~[?:?]
at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174) ~[?:?]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167) ~[?:?]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470) ~[?:?]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569) ~[?:?]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) ~[?:?]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
at java.lang.Thread.run(Thread.java:833) [?:?]
[2023-03-09T11:13:20,437][INFO ][o.o.n.Node ] [runTask-0] stopping …
[2023-03-09T11:13:20,440][INFO ][o.o.n.Node ] [runTask-0] stopped
[2023-03-09T11:13:20,440][INFO ][o.o.n.Node ] [runTask-0] closing …
[2023-03-09T11:13:20,448][INFO ][o.o.n.Node ] [runTask-0] closed

=== Standard output of node node{::runTask-0} ===

» ↓ errors and warnings from /Users/olzhas/OpenSearch/build/testclusters/runTask-0/logs/opensearch.stdout.log ↓
» WARN ][o.o.b.Natives ] [runTask-0] unable to load JNA native support library, native methods will be disabled.
» java.lang.UnsatisfiedLinkError: Can’t load library: /Users/olzhas/Library/Caches/JNA/temp/jna5306938776174509980.tmp
» at java.lang.ClassLoader.loadLibrary(ClassLoader.java:2398) ~[?:?]
» at java.lang.Runtime.load0(Runtime.java:785) ~[?:?]
» at java.lang.System.load(System.java:1979) ~[?:?]
» at com.sun.jna.Native.loadNativeDispatchLibraryFromClasspath(Native.java:1018) ~[jna-5.5.0.jar:5.5.0 (b0)]
» at com.sun.jna.Native.loadNativeDispatchLibrary(Native.java:988) ~[jna-5.5.0.jar:5.5.0 (b0)]
» at com.sun.jna.Native.(Native.java:195) ~[jna-5.5.0.jar:5.5.0 (b0)]
» at java.lang.Class.forName0(Native Method) ~[?:?]
» at java.lang.Class.forName(Class.java:383) ~[?:?]
» at java.lang.Class.forName(Class.java:376) ~[?:?]
» at org.opensearch.bootstrap.Natives.(Natives.java:60) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:123) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.Bootstrap.setup(Bootstrap.java:191) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:404) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) [opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.cli.Command.main(Command.java:101) [opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103) [opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» WARN ][o.o.b.Natives ] [runTask-0] cannot check if running as root because JNA is not available
» WARN ][o.o.b.Natives ] [runTask-0] cannot install system call filter because JNA is not available
» WARN ][o.o.b.Natives ] [runTask-0] cannot register console handler because JNA is not available
» WARN ][o.o.b.Natives ] [runTask-0] cannot getrlimit RLIMIT_NPROC because JNA is not available
» WARN ][o.o.b.Natives ] [runTask-0] cannot getrlimit RLIMIT_AS because JNA is not available
» WARN ][o.o.b.Natives ] [runTask-0] cannot getrlimit RLIMIT_FSIZE because JNA is not available
» WARN ][o.o.g.DanglingIndicesState] [runTask-0] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
» ERROR][o.o.b.OpenSearchUncaughtExceptionHandler] [runTask-0] uncaught exception in thread [main]
» org.opensearch.bootstrap.StartupException: BindTransportException[Failed to bind to [::1]:9300]; nested: BindException[Address already in use];
» at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:184) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.execute(OpenSearch.java:171) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:104) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.cli.Command.mainWithoutErrorHandling(Command.java:138) ~[opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.cli.Command.main(Command.java:101) ~[opensearch-cli-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:137) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.main(OpenSearch.java:103) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» Caused by: org.opensearch.transport.BindTransportException: Failed to bind to [::1]:9300
» at org.opensearch.transport.TcpTransport.bindToPort(TcpTransport.java:468) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.transport.TcpTransport.bindServer(TcpTransport.java:432) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.transport.netty4.Netty4Transport.doStart(Netty4Transport.java:163) ~[?:?]
» at org.opensearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:77) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.transport.TransportService.doStart(TransportService.java:280) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:77) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.node.Node.start(Node.java:1218) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.Bootstrap.start(Bootstrap.java:339) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.Bootstrap.init(Bootstrap.java:413) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» at org.opensearch.bootstrap.OpenSearch.init(OpenSearch.java:180) ~[opensearch-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
» … 6 more
» Caused by: java.net.BindException: Address already in use
» at sun.nio.ch.Net.bind0(Native Method) ~[?:?]
» at sun.nio.ch.Net.bind(Net.java:555) ~[?:?]
» at sun.nio.ch.ServerSocketChannelImpl.netBind(ServerSocketChannelImpl.java:337) ~[?:?]
» at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:294) ~[?:?]
» at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:141) ~[?:?]
» at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:562) ~[?:?]
» at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1334) ~[?:?]
» at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:600) ~[?:?]
» at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:579) ~[?:?]
» at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:973) ~[?:?]
» at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:260) ~[?:?]
» at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:356) ~[?:?]
» at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174) ~[?:?]
» at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167) ~[?:?]
» at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470) ~[?:?]
» at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569) ~[?:?]
» at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) ~[?:?]
» at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
» at java.lang.Thread.run(Thread.java:833) [?:?]
» ↓ last 40 non error or warning messages from /Users/olzhas/OpenSearch/build/testclusters/runTask-0/logs/opensearch.stdout.log ↓
» [2023-03-09T11:13:17,421][INFO ][o.o.n.Node ] [runTask-0] version[3.0.0-SNAPSHOT], pid[7118], build[tar/47a86c4f2a48f15c72529e397e517ffabab424cc/2023-03-08T14:07:47.596398Z], OS[Mac OS X/13.0/aarch64], JVM[Oracle Corporation/Java HotSpot™ 64-Bit Server VM/18.0.1.1/18.0.1.1+2-6]
» [2023-03-09T11:13:17,422][INFO ][o.o.n.Node ] [runTask-0] JVM home [/Library/Java/JavaVirtualMachines/jdk-18.0.1.1.jdk/Contents/Home], using bundled JDK [false]
» [2023-03-09T11:13:17,422][INFO ][o.o.n.Node ] [runTask-0] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.security.manager=allow, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/Users/olzhas/OpenSearch/build/testclusters/runTask-0/tmp, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=logs, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.security.manager=allow, -Xms512m, -Xmx512m, -ea, -esa, -XX:TieredStopAtLevel=1, -XX:ReservedCodeCacheSize=64m, -XX:MaxDirectMemorySize=268435456, -Dopensearch.path.home=/Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT, -Dopensearch.path.conf=/Users/olzhas/OpenSearch/build/testclusters/runTask-0/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
» [2023-03-09T11:13:17,831][INFO ][o.o.i.r.ReindexModulePlugin] [runTask-0] ReindexPlugin reloadSPI called
» [2023-03-09T11:13:17,832][INFO ][o.o.i.r.ReindexModulePlugin] [runTask-0] Unable to find any implementation for RemoteReindexExtension
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [aggs-matrix-stats]
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [analysis-common]
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [geo]
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [ingest-common]
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [ingest-geoip]
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [ingest-user-agent]
» [2023-03-09T11:13:17,837][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [lang-expression]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [lang-mustache]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [lang-painless]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [mapper-extras]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [opensearch-dashboards]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [parent-join]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [percolator]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [rank-eval]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [reindex]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [repository-url]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [test-delayed-aggs]
» [2023-03-09T11:13:17,838][INFO ][o.o.p.PluginsService ] [runTask-0] loaded module [transport-netty4]
» [2023-03-09T11:13:17,839][INFO ][o.o.p.PluginsService ] [runTask-0] no plugins loaded
» [2023-03-09T11:13:17,858][INFO ][o.o.e.NodeEnvironment ] [runTask-0] using [1] data paths, mounts [[/System/Volumes/Data (/dev/disk3s5)]], net usable_space [170.5gb], net total_space [460.4gb], types [apfs]
» [2023-03-09T11:13:17,859][INFO ][o.o.e.NodeEnvironment ] [runTask-0] heap size [512mb], compressed ordinary object pointers [true]
» [2023-03-09T11:13:17,882][INFO ][o.o.n.Node ] [runTask-0] node name [runTask-0], node ID [JvUR3nyzSpOPgzuaSU43Wg], cluster name [runTask], roles [ingest, remote_cluster_client, data, cluster_manager]
» [2023-03-09T11:13:19,214][INFO ][o.o.t.NettyAllocator ] [runTask-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=256kb, factors={opensearch.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=1mb, heap_size=512mb}]
» [2023-03-09T11:13:19,238][INFO ][o.o.d.DiscoveryModule ] [runTask-0] using discovery type [zen] and seed hosts providers [settings, file]
» [2023-03-09T11:13:19,423][INFO ][o.o.n.Node ] [runTask-0] initialized
» [2023-03-09T11:13:19,423][INFO ][o.o.n.Node ] [runTask-0] starting …
» [2023-03-09T11:13:20,437][INFO ][o.o.n.Node ] [runTask-0] stopping …
» [2023-03-09T11:13:20,440][INFO ][o.o.n.Node ] [runTask-0] stopped
» [2023-03-09T11:13:20,440][INFO ][o.o.n.Node ] [runTask-0] closing …
» [2023-03-09T11:13:20,448][INFO ][o.o.n.Node ] [runTask-0] closed
» [2023-03-09T05:13:20.559432Z] [BUILD] Stopping node

=== Standard error of node node{::runTask-0} ===
» ↓ last 40 non error or warning messages from /Users/olzhas/OpenSearch/build/testclusters/runTask-0/logs/opensearch.stderr.log ↓
» WARNING: A terminally deprecated method in java.lang.System has been called
» WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT/lib/opensearch-3.0.0-SNAPSHOT.jar)
» WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
» WARNING: System::setSecurityManager will be removed in a future release
» WARNING: A terminally deprecated method in java.lang.System has been called
» WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/Users/olzhas/OpenSearch/distribution/archives/darwin-arm64-tar/build/install/opensearch-3.0.0-SNAPSHOT/lib/opensearch-3.0.0-SNAPSHOT.jar)
» WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
» WARNING: System::setSecurityManager will be removed in a future release
» uncaught exception in thread [main]
» BindTransportException[Failed to bind to [::1]:9300]; nested: BindException[Address already in use];
» Likely root cause: java.net.BindException: Address already in use
» at java.base/sun.nio.ch.Net.bind0(Native Method)
» at java.base/sun.nio.ch.Net.bind(Net.java:555)
» at java.base/sun.nio.ch.ServerSocketChannelImpl.netBind(ServerSocketChannelImpl.java:337)
» at java.base/sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:294)
» at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:141)
» at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:562)
» at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1334)
» at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:600)
» at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:579)
» at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:973)
» at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:260)
» at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:356)
» at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174)
» at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167)
» at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470)
» at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569)
» at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
» at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
» at java.base/java.lang.Thread.run(Thread.java:833)
» For complete error details, refer to the log at /Users/olzhas/OpenSearch/build/testclusters/runTask-0/logs/runTask.log

Task :run FAILED

FAILURE: Build failed with an exception.

What went wrong:
Execution failed for task ‘:run’.

OpenSearch cluster died

Try:

Run with --stacktrace option to get the stack trace.
Run with --info or --debug option to get more log output.

Get more help at https://help.gradle.org

BUILD FAILED in 7s
159 actionable tasks: 4 executed, 155 up-to-date

Orbulon · March 9, 2023, 5:30am

Likely root cause: java.net.BindException: Address already in use
Check address, mb address is already taken. kill terminals with running app

before build cluster, try ./gradlew check, this should complete without errors

OlzhasB · March 9, 2023, 5:47am

I tried to use ./gradlew check command, but it also failed. I received this log with the following

Configure project :qa:os
Cannot add task ‘destructiveDistroTest.docker’ as a task with that name already exists.

FAILURE: Build failed with an exception.

What went wrong:
Could not determine the dependencies of task ‘:qa:full-cluster-restart:v2.6.1#upgradedClusterTest’.

Could not resolve all task dependencies for configuration ‘:qa:full-cluster-restart:opensearch_distro_extracted_testclusters-qa-full-cluster-restart-v2.6.1-1-2.6.1-’.
Could not resolve project :distribution:bwc:bugfix.
Required by:
project :qa:full-cluster-restart
Project :qa:full-cluster-restart declares a dependency from configuration ‘opensearch_distro_extracted_testclusters-qa-full-cluster-restart-v2.6.1-1-2.6.1-’ to configuration ‘expanded-darwin-arm64-tar’ which is not declared in the descriptor for project :distribution:bwc:bugfix.

Try:

Run with --stacktrace option to get the stack trace.
Run with --info or --debug option to get more log output.

Get more help at https://help.gradle.org

BUILD FAILED in 6s
8 actionable tasks: 8 up-to-date

Orbulon · March 9, 2023, 5:59am

try
1 ./gradlew clean
2 ./gradlew check

Orbulon · March 9, 2023, 6:05am

I had a similar problem and solved it by updating the env variables JAVA_HOME and other jdk’s
check your env vars

OlzhasB · March 9, 2023, 6:09am

I tried ./gradlew clean and it built successfully

Configure project :qa:os
Cannot add task ‘destructiveDistroTest.docker’ as a task with that name already exists.
=======================================
OpenSearch Build Hamster says Hello!
Gradle Version : 8.0.2
OS Info : Mac OS X 13.0 (aarch64)
JDK Version : 18 (Oracle JDK)
JAVA_HOME : /Library/Java/JavaVirtualMachines/jdk-18.0.1.1.jdk/Contents/Home
Random Testing Seed : FE3000C59881E8A1
In FIPS 140 mode : false
=======================================

BUILD SUCCESSFUL in 4s
151 actionable tasks: 118 executed, 33 up-to-date

However when I tried ./gradlew check, it shows the same error

Orbulon · March 9, 2023, 10:20am

Is the project itself being launched?
As far as I know, docker is not needed to run via gradle builder, try stopping the image and running

OlzhasB · March 10, 2023, 1:17pm

I tried to run the project and even followed video-instruction here Introduction to the OpenSearchCore Install - YouTube
It seems that I didn’t set up the JAVA_HOME environment in correct environment, because everything else works pretty fine. I see this log in terminal
ERROR: JAVA_HOME is set to an invalid directory: /Library/Java/JavaVirtualMachines/jdk-11.0.18+10

Please set the JAVA_HOME variable in your environment to match the

location of your Java installation.

Orbulon · March 10, 2023, 1:25pm

if you use windows
set JAVA_HOME to

C:\Program Files\Java\jdk-11.0.17

you specify your own path,
For example, mine is like this

(need jdk 11)

OlzhasB · March 11, 2023, 6:08pm

I have corrected my mistake and OpenSearch Dashboards is running and OpenSearch Server is working. Thank you!!!

Orbulon · March 11, 2023, 6:13pm

You did a great job! Glad to have been of help!

Topic		Replies	Views
Build failed ./gradlew assemble OpenSearch	18	997	March 22, 2023
Run OpenSearh project and i got gradle.xml error Build	1	222	January 18, 2024
Getting error while bootstrapping opensearch dashboard OpenSearch troubleshoot , install	4	619	July 25, 2023
Problem launching opensearch dashboards OpenSearch Dashboards	4	567	November 17, 2023
2.13.1 compatible plugins Cross-Cluster Replication	3	131	June 24, 2024

Error when running OpenSearch

Related topics