Spark write to OpenSearch

[manirudh78]

Hello all,
Hope you are well.

Can someone please tell me if we can write to opensearch using Spark? If yes what should be the Jar that need’s to be used.

Please help with the details.

Thanks

[wbeckler]

See if this works (read to the bottom):

Which Spark JAR use for Opensearch?

Hello, I use this version of spark connector : spark2/3.1.4.0-315/lib/elasticsearch-spark-20_2.11-7.9.1.jar On Dashboard, it’s ok for scroll. If i try with cli Spark (same user), i have error about permission… I don’t know what s the problem ? Thanks for help

If the above doesn’t work, there is work ongoing in this arena and a new OpenSearch Spark adapter is on its way.