MacOS (Darwin) - non-production-ready artifacts ready to test!

kris · September 8, 2022, 5:16pm

The team is pleased to announce minimum distribution now available to support plugin testing on MacOS

Please note: all of these zips non-production-ready artifacts, only available for testing purposes.

snapshot artifacts accessible via https://artifacts.opensearch.org/
-or-
Download links available here:

github.com/opensearch-project/opensearch-build

Build test Darwin version of min OpenSearch distribution to support plugin testing on MacOS.

opened 08:01PM - 20 Jun 22 UTC

closed 02:12PM - 01 Aug 22 UTC

prudhvigodithi

enhancement Meta

### Is your feature request related to a problem? Please describe For k-NN, to …run integ tests on Mac is not compatible. KNN uses lang painless to inject scripts. To test on MacOS right now the options are `INTEG_TEST`, which will bring up a cluster with plain and no modules (mainly lang painless) except [transportModulesFiles](https://github.com/opensearch-project/OpenSearch/blob/main/distribution/archives/build.gradle) Second option is to use `ARCHIVE` which will allow direct download of zip and test bringing up the cluster, which looks for darwin zip, which is not available for testing. https://github.com/opensearch-project/OpenSearch/issues/1676 ### Describe the solution you'd like - [x] Test the existing [build_workflow](https://github.com/opensearch-project/opensearch-build/tree/main/src/build_workflow) to run the OpenSearch build with platform as `darwin`. https://github.com/opensearch-project/opensearch-build/issues/2350 - [x] Run the existing [distribution build job](https://github.com/opensearch-project/opensearch-build/blob/main/jenkins/opensearch/distribution-build.jenkinsfile) on MacOS ec2 agent which outputs the min distribution of OpenSearch of type Darwin. https://github.com/opensearch-project/opensearch-build/issues/2361 - [x] Build a Mac ec2 AMI able to execute [build_workflow](https://github.com/opensearch-project/opensearch-build/tree/main/src/build_workflow) and [assemble_workflow](https://github.com/opensearch-project/opensearch-build/tree/main/src/assemble_workflow) that can generate OpenSrearch min distribution. https://github.com/opensearch-project/opensearch-ci/issues/163 - [x] Automate the Mac jenkins agents creation and add to [Public Jenkins](https://build.ci.opensearch.org/). https://github.com/opensearch-project/opensearch-ci/issues/157 - [x] Add required missing packages to MacOS agents, that support signing workflow, to sign and upload darwin artifacts https://github.com/opensearch-project/opensearch-build/issues/2375 - [x] MacOS agents support default `/bin/bash`, remove `nodeProperties` in CDK code and allow jenkins to use default `PATH` part of `AMI`. https://github.com/opensearch-project/opensearch-ci/issues/174 - [x] Validate the darwin artifacts built using the [distribution-build job](https://build.ci.opensearch.org/job/distribution-build-opensearch/). [Jenkins build Mac 2.2.0-SNAPSHOT](https://build.ci.opensearch.org/job/distribution-build-opensearch/5834/) ### Describe alternatives you've considered Other alternatives is to test on Linux, Docker but this requires developers with MacOs to setup alternative virtual machines to test the plugins. ### Additional context https://github.com/opensearch-project/opensearch-build/issues/38#issuecomment-944373452 ### Acceptance Criteria - Test using the existing assemble task from OpenSearch `distribution:archives:darwin-arm64-tar:assemble` to build the darwin min distribution, integrate with build workflow to automate the min distribution creation. - Test with cross compile framework to build darwin min distribution with existing build workflow. - Approach to be considered: directly run the build workflow on mac ec2 instance that has supported architecture `MACHTYPE=x86_64`

We welcome your feedback and suggestions.

Happy testing!

Topic		Replies	Views
Windows distribution (X64) - non-production-ready artifacts ready to test! Announcements releases	1	414	January 25, 2023
Next OpenSearch Distribution Support Build releases , discuss	3	799	December 6, 2022
Opensearch archive(zip/tar) for windows/non-windows OpenDistro	2	409	June 3, 2021
Prometheus exporter plugin 1.3.0.0 released! OpenSearch releases	6	1170	April 1, 2022
Prometheus exporter plugin 2.3.0.0 released! OpenSearch releases	1	288	March 2, 2023

MacOS (Darwin) - non-production-ready artifacts ready to test!

Related Topics