We just wrapped up a great 2026 meetup of the Munich user group.
And it was all about AI agents:
The Agentic Stack: Relevance, Reliability & AI Agents in OpenSearch
I was thrilled at the opportunity to meet the local community, as I’m not local to Munich myself. I came to town for Cloud Native Summit Munich, and was happy we were able to pull off a meetup and bring the community together.
People were excited. We got 66 registrations and some 30 participants. Folks stuck around until after 21:00, for the talks and, no less important, the chats over pizza and beer.
I was honoured to give a talk together with Megha Goyal, AWS OpenSearch engineerg and OpenSearch project maintainer, about “Building Reliable AI Agents in Weeks, Not Months”:
How do you validate AI agents before production? Unlike traditional software with clear pass/fail tests, agents operate probabilistically across reasoning, tool selection, and multi-step decisions.
OpenSearch’s open source Eval-Driven Development tool brings Automatic Relevance Tuning (ART) to agent development. Define test suites, run benchmarks, and measure performance across reasoning quality, tool accuracy, and task completion.
We shared a compelling case study: one agent built this way and shipped in 6 weeks; another retrofitted later took 12 months.
Then search experts Aswath Srinivasan & Daniel Wrigley gave a talk about “Agentic Search and the Relevance Agent”:
Agentic search lets you ask questions in natural language and have OpenSearch plan and execute the retrieval automatically. A preconfigured agent reads the question, plans the search, and returns relevant results.
The OpenSearch relevance agent helps you identify and resolve search relevance issues through natural language conversation. Using a chat interface embedded in OpenSearch Dashboards, you can interactively diagnose problems, receive step-by-step tuning guidance, and execute complex workflows. The agent leverages the tools provided by the Search Relevance Workbench.
A big thanks to Aswath for leading the organization of the meetup, and to AWS for hosting and sponsoring the event.
Join the meetup group to follow future meetups. And if you have experience to share, feel free to suggest topics.
