# Concept : Apply GPU acceleration to ML Node in k8s operator

**URL:** <https://forum.opensearch.org/t/concept-apply-gpu-acceleration-to-ml-node-in-k8s-operator/22435>\
**Category:** Machine Learning\
**Tags:** discuss, troubleshoot, configure, install, feature-request\
**Created:** [November 15, 2024, 4:51am UTC](https://forum.opensearch.org/t/concept-apply-gpu-acceleration-to-ml-node-in-k8s-operator/22435 "2024-11-15T04:51:23Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![yeonghyeonKo](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/yeonghyeonko/32/8202_2.png) [@yeonghyeonKo](https://forum.opensearch.org/u/yeonghyeonKo)\
**Post date:** [November 15, 2024, 4:51am UTC](https://forum.opensearch.org/t/concept-apply-gpu-acceleration-to-ml-node-in-k8s-operator/22435/1 "2024-11-15T04:51:23Z")

</div>

**Versions** (relevant - OpenSearch/Dashboard/Server OS/Browser):  
OpenSearch 2.17.1  
OpenSearch Operator 2.5

**Describe the issue** :

- [GPU acceleration - OpenSearch Documentation](https://opensearch.org/docs/latest/ml-commons-plugin/gpu-acceleration/)

1. Provision GPU-dedicated Worker Node(s) in the existing K8s cluster.
2. Deploy OpenSearch ml-node(s) using nodeSelector in opensearch k8s operator.

```auto
  nodePools:
    - component: ml
      replicas: 3
      diskSize: "10Gi"
      nodeSelector: # <- assign ml node(ie. Pod) to GPU Worker Node 
      roles:
        - "ml"
      resources:
        requests:
        limits:

```

1. Test whether ML Node does use GPU resource or not.

## → Is the above concept acceptable and valid ?

Actually, I can’t find any detailed reference about GPU acceleration for users who use k8s operator.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex019/uploads/mauve_hedgehog/original/2X/3/33547ea01a5b12dcca2958411d3edd97ae2ea8c1.png) [@system](https://forum.opensearch.org/u/system)\
**Post date:** [January 14, 2025, 4:51am UTC](https://forum.opensearch.org/t/concept-apply-gpu-acceleration-to-ml-node-in-k8s-operator/22435/2 "2025-01-14T04:51:25Z")

</div>

Closed on January 14, 2025, 4:51am UTC

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.
