How to deploy ibm-granite/granite-4.0-h-350m model in openseach

Plugins Machine Learning
1

Hi all,

I was wondering how to deploy ibm-granite/granite-4.0-h-350m (granite nano family) on OpenSearch ML nodes. Granite nano has shown remarkable results in both speed and accuracy at tasks such function calling and answering from context. Having such model inside OpenSearch will be a big step in making OpenSearch an end-to-end solution for agentic search, without the need for external heavy models.

Thanks