# How to deploy ibm-granite/granite-4.0-h-350m model in openseach

**URL:** <https://forum.opensearch.org/t/how-to-deploy-ibm-granite-granite-4-0-h-350m-model-in-openseach/27389>\
**Category:** Machine Learning\
**Created:** [October 30, 2025, 10:08am UTC](https://forum.opensearch.org/t/how-to-deploy-ibm-granite-granite-4-0-h-350m-model-in-openseach/27389 "2025-10-30T10:08:47Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![asfoorial](https://avatars.discourse-cdn.com/v4/letter/a/3da27b/32.png) [@asfoorial](https://forum.opensearch.org/u/asfoorial)\
**Post date:** [October 30, 2025, 10:08am UTC](https://forum.opensearch.org/t/how-to-deploy-ibm-granite-granite-4-0-h-350m-model-in-openseach/27389/1 "2025-10-30T10:08:47Z")

</div>

**Hi all,**

I was wondering how to deploy ibm-granite/granite-4.0-h-350m (granite nano family) on OpenSearch ML nodes. Granite nano has shown remarkable results in both speed and accuracy at tasks such function calling and answering from context. Having such model inside OpenSearch will be a big step in making OpenSearch an end-to-end solution for agentic search, without the need for external heavy models.

Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/3/33547ea01a5b12dcca2958411d3edd97ae2ea8c1.png) [@system](https://forum.opensearch.org/u/system)\
**Post date:** [December 29, 2025, 10:09am UTC](https://forum.opensearch.org/t/how-to-deploy-ibm-granite-granite-4-0-h-350m-model-in-openseach/27389/2 "2025-12-29T10:09:46Z")

</div>

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.