# Agentic search runs so slow

**URL:** <https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337>\
**Category:** OpenSearch\
**Tags:** troubleshoot\
**Created:** [October 21, 2025, 5:50pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337 "2025-10-21T17:50:02Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![summerist.l](https://avatars.discourse-cdn.com/v4/letter/s/dfb087/32.png) [@summerist.l](https://forum.opensearch.org/u/summerist.l)\
**Post date:** [October 21, 2025, 5:50pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/1 "2025-10-21T17:50:02Z")

</div>

**Versions** (relevant - OpenSearch/Dashboard/Server OS/Browser): opensearch 3.3.0

**Describe the issue** :

I’m trying out this new agentic search thing with the GPT-5 model through the OpenAI API. The issue is it’s very slow – usually takes at least 25 seconds for a simple search on one text field (not even multiple ones). And it often hits the 30-second timeout. For comparison, my own RESTful API handles the same search (no LLM involved) in just over 100ms. I get that hitting the LLM, getting the DSL response, and running it on opensearch cluster all adds up, but is my 20+ seconds wait time typical? If so, I guess it is literally “experimental”.

---

<div class="post-metadata">

**Author:** ![pablo](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/pablo/32/10363_2.png) [@pablo](https://forum.opensearch.org/u/pablo)\
**Post date:** [October 21, 2025, 11:54pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/2 "2025-10-21T23:54:12Z")

</div>

@summerist.l I’ve tried that with AWS Bedrock `us.anthropic.claude-sonnet-4-20250514-v1:0` and openai.gpt-oss-120b-1:0, and they were running fine. (below 10 sec)

I was testing the Query Planning Tool.

> **[Query Planning tool](https://docs.opensearch.org/latest/ml-commons-plugin/agents-tools/tools/query-planning-tool/)**
>
> Query Planning tool Introduced 3.3

Could you share your agent configuration?

---

<div class="post-metadata">

**Author:** ![summerist.l](https://avatars.discourse-cdn.com/v4/letter/s/dfb087/32.png) [@summerist.l](https://forum.opensearch.org/u/summerist.l)\
**Post date:** [October 22, 2025, 12:22pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/3 "2025-10-22T12:22:04Z")

</div>

Hi @pablo, thanks for the response. For model creating, I used the demo code here:

> **[Agentic search](https://docs.opensearch.org/latest/vector-search/ai-search/agentic-search/index/)**
>
> Agentic search Introduced 3.2

Please check the json of the agent below (the 2 model\_ids are the same):

> {  
> “name”: “gpt-5-agent-test1”,  
> “type”: “conversational”,  
> “description”: “Use this for Agentic Search”,  
> “tools”: [  
> {  
> “description”: “”,  
> “include\_output\_in\_agent\_response”: false,  
> “type”: “QueryPlanningTool”,  
> “parameters”: {  
> “search\_templates”: “”,  
> “model\_id”: “xxxxxxxxxxxxx”,  
> “generation\_type”: “llmGenerated”  
> }  
> },  
> {  
> “description”: “”,  
> “include\_output\_in\_agent\_response”: false,  
> “type”: “SearchIndexTool”  
> },  
> {  
> “description”: “”,  
> “include\_output\_in\_agent\_response”: false,  
> “type”: “ListIndexTool”  
> },  
> {  
> “description”: “”,  
> “include\_output\_in\_agent\_response”: false,  
> “type”: “IndexMappingTool”  
> }  
> ],  
> “llm”: {  
> “model\_id”: “xxxxxxxxxxxxxxxxxx”,  
> “parameters”: {  
> “max\_iteration”: “15”  
> }  
> },  
> “memory”: {  
> “type”: “conversation\_index”  
> },  
> “parameters”: {  
> “\_llm\_interface”: “openai/v1/chat/completions”  
> }  
> }

---

<div class="post-metadata">

**Author:** ![owaiskazi19](https://avatars.discourse-cdn.com/v4/letter/o/b2d939/32.png) [@owaiskazi19](https://forum.opensearch.org/u/owaiskazi19)\
**Post date:** [October 24, 2025, 4:49pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/4 "2025-10-24T16:49:33Z")

</div>

Thanks for looking into agentic search @summerist.l .We are aware of the latency, this is expected, as it comes from the multiple LLM calls made by the conversation agent.

If your primary goal is intelligent retrieval with contextual understanding, we recommend using the conversation agent.

However, if lower latency is more important for your use case, you can use the flow agent with the query planning tool:  
[https://docs.opensearch.org/latest/vector-search/ai-search/agentic-search/flow-agent/](https://docs.opensearch.org/latest/vector-search/ai-search/agentic-search/flow-agent/)

Keep in mind that the flow agent is optimized for performance and won’t maintain conversational context like the conversation agent does.

Also, now from 3.3 you just need one model id for the agent and Query Planner Tool would use the same [Using conversational agents - OpenSearch Documentation](https://docs.opensearch.org/latest/vector-search/ai-search/agentic-search/agent-converse/#step-4-register-an-agent)

---

<div class="post-metadata">

**Author:** ![jakabasej5](https://avatars.discourse-cdn.com/v4/letter/j/4bbf92/32.png) [@jakabasej5](https://forum.opensearch.org/u/jakabasej5)\
**Post date:** [October 26, 2025, 9:57am UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/5 "2025-10-26T09:57:38Z")

</div>

That is a perfect

---

<div class="post-metadata">

**Author:** ![summerist.l](https://avatars.discourse-cdn.com/v4/letter/s/dfb087/32.png) [@summerist.l](https://forum.opensearch.org/u/summerist.l)\
**Post date:** [October 28, 2025, 12:30pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/6 "2025-10-28T12:30:02Z")

</div>

@owaiskazi19 Thank you so much for the clarification!

---

<div class="post-metadata">

**Author:** ![owaiskazi19](https://avatars.discourse-cdn.com/v4/letter/o/b2d939/32.png) [@owaiskazi19](https://forum.opensearch.org/u/owaiskazi19)\
**Post date:** [October 31, 2025, 5:37pm UTC](https://forum.opensearch.org/t/agentic-search-runs-so-slow/27337/7 "2025-10-31T17:37:26Z")

</div>

@summerist.l @pablo @jakabasej5 we are looking for gathering use cases for agentic search. If you can let us know your use cases for using the same would be really helpful. Thank you.
