Opensearch Hadoop/Apache Spark Elasticsearch connector

Hi,

Could I ask if there are still plans for a hadoop client as mentioned in this post ? I could not manage to find any update or roadmap where this client is mentioned.

Hey Matthew-

Yup, still planned. I can see the stub private repo, but it looks like there isn’t much activity on it yet. Each client maintains their own roadmap, so it wouldn’t show up in the main OpenSearch roadmap.

Full disclosure, I’m pretty sure this particular client was in the lower priority group, so getting the core clients done comes first. Do you have any interest in helping develop/maintain the hadoop client? I’m glad to connect you with the team if so.

Could we get another status update on how the progress for the hadoop client is going? Would be much appreciated, thanks!

@anirudha Do you know anything about hadoop/spark?

Any updates on this connector?

Hello,

Is there any update on the Spark connector with OS?

Thanks

Hi all,

We are tracking the work in Github. I’m working to get a repo setup for those who are willing to contribute.

2 Likes

This is the repo in which you can see the hadoop progress:
https://github.com/opensearch-project/opensearch-hadoop/pulls