Hello All,
I am working on the setup of new pods for ODES and once I apply my yaml files for OD Elasticsearch my deployment of masters fails with this error below.
Any help appreciated on this.
$ kubectl get pods -n monitoring-tools
NAME READY STATUS RESTARTS AGE
es-master-0 0/1 CrashLoopBackOff 5 7m46s
es-master-1 0/1 CrashLoopBackOff 5 7m42s
es-master-2 0/1 CrashLoopBackOff 5 7m38s
$ kubectl logs es-master-0 -n monitoring-tools
OpenDistro for Elasticsearch Security Demo Installer
** Warning: Do not use on production or public reachable systems **
Basedir: /usr/share/elasticsearch
Elasticsearch install type: rpm/deb on CentOS Linux release 7.8.2003 (Core)
Elasticsearch config dir: /usr/share/elasticsearch/config
Elasticsearch config file: /usr/share/elasticsearch/config/elasticsearch.yml
Elasticsearch bin dir: /usr/share/elasticsearch/bin
Elasticsearch plugins dir: /usr/share/elasticsearch/plugins
Elasticsearch lib dir: /usr/share/elasticsearch/lib
Detected Elasticsearch Version: x-content-7.8.0
Detected Open Distro Security Version: 1.9.0.0
/usr/share/elasticsearch/config/elasticsearch.yml seems to be already configured for Security. Quit.
[2020-08-28T18:43:53,468][WARN ][o.e.b.Natives ] [es-master-0] unable to load JNA native support library, native methods will be disabled.
java.lang.UnsatisfiedLinkError: /tmp/elasticsearch-4633489712139214511/jna–1985354563/jna6675842988628548432.tmp: /tmp/elasticsearch-4633489712139214511/jna–1985354563/jna6675842988628548432.tmp: cannot open shared object file: Operation not permitted
at java.lang.ClassLoader$NativeLibrary.load0(Native Method) ~[?:?]
at java.lang.ClassLoader$NativeLibrary.load(ClassLoader.java:2452) ~[?:?]
at java.lang.ClassLoader$NativeLibrary.loadLibrary(ClassLoader.java:2508) ~[?:?]
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:2704) ~[?:?]
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:2637) ~[?:?]
at java.lang.Runtime.load0(Runtime.java:745) ~[?:?]
at java.lang.System.load(System.java:1871) ~[?:?]
at com.sun.jna.Native.loadNativeDispatchLibraryFromClasspath(Native.java:947) ~[jna-4.5.1.jar:4.5.1 (b0)]
at com.sun.jna.Native.loadNativeDispatchLibrary(Native.java:922) ~[jna-4.5.1.jar:4.5.1 (b0)]
at com.sun.jna.Native.(Native.java:190) ~[jna-4.5.1.jar:4.5.1 (b0)]
at java.lang.Class.forName0(Native Method) ~[?:?]
at java.lang.Class.forName(Class.java:340) ~[?:?]
at org.elasticsearch.bootstrap.Natives.(Natives.java:45) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:110) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:178) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) [elasticsearch-cli-7.8.0.jar:7.8.0]
at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) [elasticsearch-7.8.0.jar:7.8.0]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) [elasticsearch-7.8.0.jar:7.8.0]
[2020-08-28T18:43:53,474][WARN ][o.e.b.Natives ] [es-master-0] cannot check if running as root because JNA is not available
[2020-08-28T18:43:53,474][WARN ][o.e.b.Natives ] [es-master-0] cannot install system call filter because JNA is not available
[2020-08-28T18:43:53,474][WARN ][o.e.b.Natives ] [es-master-0] cannot register console handler because JNA is not available
[2020-08-28T18:43:53,475][WARN ][o.e.b.Natives ] [es-master-0] cannot getrlimit RLIMIT_NPROC because JNA is not available
[2020-08-28T18:43:53,475][WARN ][o.e.b.Natives ] [es-master-0] cannot getrlimit RLIMIT_AS because JNA is not available
[2020-08-28T18:43:53,475][WARN ][o.e.b.Natives ] [es-master-0] cannot getrlimit RLIMIT_FSIZE because JNA is not available
[2020-08-28T18:43:53,928][INFO ][o.e.n.Node ] [es-master-0] version[7.8.0], pid[1], build[oss/tar/757314695644ea9a1dc2fecd26d1a43856725e65/2020-06-14T19:35:50.234439Z], OS[Linux/4.14.171-136.231.amzn2.x86_64/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/14.0.1/14.0.1+7]
[2020-08-28T18:43:53,928][INFO ][o.e.n.Node ] [es-master-0] JVM home [/opt/jdk]
[2020-08-28T18:43:53,928][INFO ][o.e.n.Node ] [es-master-0] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/elasticsearch-4633489712139214511, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.security.policy=file:///usr/share/elasticsearch/performance-analyzer-rca/pa_config/es_security.policy, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Des.cgroups.hierarchy.override=/, -Xms4g, -Xmx4g, -XX:MaxDirectMemorySize=2147483648, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true]
[2020-08-28T18:43:56,924][INFO ][c.a.o.e.p.c.PluginSettings] [es-master-0] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true
[2020-08-28T18:43:57,625][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [es-master-0] ES Config path is /usr/share/elasticsearch/config
[2020-08-28T18:43:57,933][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [es-master-0] JVM supports TLSv1.3
[2020-08-28T18:43:57,934][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [es-master-0] Config directory is /usr/share/elasticsearch/config/, from there the key- and truststore files are resolved relatively
Thanks in advance!
Freddie2020