OpenSearch Community Meeting - 2023-0131

OpenSearch Community Meeting - 2023-0131 - Hope we see you all there!

Agenda:

Event page
Meetup page

Meeting Link

Meeting ID: 871 2638 2784
Passcode: 076838

Would you like to present? Tag @kris @dtaivpp @nateynate and we’ll work to get you added to the agenda!

Feel free to comment on this agenda before the meeting if you want to add an item or have a question.

After the meeting, we will post the chat log and any meeting notes. We welcome you to keep the conversation going here on the forum.

========
By joining the OpenSearch Community Meeting, you grant OpenSearch, and our affiliates the right to record, film, photograph, and capture your voice and image during the OpenSearch Community Meeting (the “Recordings”). You grant to us an irrevocable, nonexclusive, perpetual, worldwide, royalty-free right and license to use, reproduce, modify, distribute, and translate, for any purpose, all or any part of the Recordings and Your Materials. For example, we may distribute Recordings or snippets of Recordings via our social media outlets.

Chat log - thank you all for the engaging discussion!!!

00:23:12 William Beckler: Two announcements: v2.5 released and AWS OpenSearch Serverless went to generally available
00:23:19 Ryan Paras: OpenSearch 2.5 is live! (from about a week ago)
00:23:51 Kris Freedain: Reminder - our friends at Open Source Connections are still still accepting talks for Haystack: orum.opensearch.org/t/haystack-us-2023-dates-call-for-presentations-we-need-your-talks/12236
00:23:59 Alexander Bunday: Hi everyone, first time joining. I’ve just started here at Instaclustr as Product Manager for OpenSearch. Looking forward to being part of this community.
00:24:01 Kris Freedain: Reacted to “Two announcements: v…” with :partying_face:
00:24:04 Kris Freedain: Reacted to “OpenSearch 2.5 is li…” with :partying_face:
00:24:08 Nate Boot: Welcome Alexander!
00:24:20 Ani ( OpenSearch ): Reacted to “Hi everyone, first t…” with :heart:
00:24:23 Kris Freedain: Welcome Alexander!!
00:24:28 Ani ( OpenSearch ): Reacted to “OpenSearch 2.5 is li…” with :partying_face:
00:24:36 lxuesong: Reacted to “Hi everyone, first t…” with :heart:
00:24:56 Ryan Paras: Reacted to “Hi everyone, first t…” with :heart:
00:24:57 Kris Freedain: Reacted to “Hi everyone, first t…” with :heart:
00:26:28 Kris Freedain: Multi-layer maps: [FEATURE] Maps Multi Layer framework with enriched visualization · Issue #15 · opensearch-project/dashboards-maps · GitHub
00:33:50 James McIntyre: Reacted to “OpenSearch 2.5 is li…” with :partying_face:
00:34:37 Ryan Paras: forgive me as i probably missed it - do these maps appear as a conventional visualization objects that can be added to conventional dashboards?
00:34:42 James McIntyre: Reacted to “Hi everyone, first t…” with :heart:
00:36:58 Amitai Stern: Ryan - yes they are conventional
00:37:31 Jeff Huss (AWS): Yes very cool functionality!
00:39:43 Eric Pugh: Folks interested in Learning to Rank, an update for 2.5 was released Release v2.1.0 · gsingers/opensearch-learning-to-rank-base · GitHub
00:40:24 Kris Freedain: Reacted to “Folks interested in …” with :+1:t2:
00:40:45 Josh Romero: I’m also excited to incorporate some of the new capabilities and concepts from maps into other visualization types
00:40:58 dtip: lol
00:41:01 Jeff Huss (AWS): Reacted to “I’m also excited to …” with :100:
00:42:01 Ryan Paras: does anyone know when https://playground.opensearch.org/ is expected back online?
00:42:04 Ani ( OpenSearch ): [FEATURE] OpenSearch and Apache Spark Integration · Issue #1116 · opensearch-project/sql · GitHub
00:42:12 Kris Freedain: Compute Federation: [FEATURE] OpenSearch and Apache Spark Integration · Issue #1116 · opensearch-project/sql · GitHub
00:42:30 Kris Freedain: Replying to “does anyone know whe…”

I’ll ask around Ryan.
00:42:46 Ryan Paras: Replying to “does anyone know whe…”

thanks
00:43:16 Kris Freedain: Replying to “does anyone know whe…”

Seems to be up - want to try again?
00:43:29 Jeff Huss (AWS): Replying to “does anyone know whe…”

“OpenSearch Dashboards did not load properly. Check the server output for more information.”
00:43:51 Kris Freedain: Replying to “does anyone know whe…”

Wild - loaded for me
00:44:42 Ryan Paras: Replying to “does anyone know whe…”

yeah i just keep getting “OpenSearch Dashboards did not load properly. Check the server output for more information.”
00:45:13 Amitai Stern: Me too. i gee same result as Ryan
00:45:17 Nate Boot: Does going in an anonymous browser session help?
00:45:43 Nate Boot: What’s Spark?
00:45:52 Sam Herman: Apache Spark
00:46:08 Nate Boot: Thanks. :sunglasses:
00:46:25 Amitai Stern: Nate, incognito works. Ryan maybe you have an ad blocker?
00:47:15 William Beckler: Can someone post the GitHub links for these issues/
00:47:56 Amitai Stern: [FEATURE] Materialized views (aka virtual indexes) on object stores · Issue #1080 · opensearch-project/sql · GitHub
00:48:04 Joshua Bright: [FEATURE] OpenSearch and Apache Spark Integration · Issue #1116 · opensearch-project/sql · GitHub
00:48:16 Joshua Bright: [FEATURE] Object Storage (S3) Data Ingestion through Streaming Query · Issue #948 · opensearch-project/sql · GitHub
00:48:26 Kris Freedain: Reacted to “o (Osman) · GitHub…” with :+1:t2:
00:48:29 Kris Freedain: Reacted to “o (Osman) · GitHub…” with :+1:t2:
00:48:32 Kris Freedain: Reacted to “o (Osman) · GitHub…” with :+1:t2:
00:49:20 Kris Freedain: Replying to “does anyone know whe…”

Ryan - do you have an ad blocker on? Can you try an incognito tab?
00:51:42 Ryan Paras: Replying to “does anyone know whe…”

incognito worked …. maybe i have an old session cookie or something
00:51:56 Kris Freedain: Reacted to “incognito worked …. …” with :partying_face:
00:53:13 Ryan Paras: Replying to “does anyone know whe…”

i had to disable ad blocker and clear cookies. loads now.
00:54:03 Tim Van Ash: Thanks Ani! Really appreciate you taking the time to walk through my question. Look forward to connecting.
00:54:59 Eric Pugh: Really interesting topics, thanks for sharing.
00:57:13 Daniel Doubrovkine: One thing that comes to mind is multi-pass aggreggation.
00:57:31 Nate Boot: Before the meeting started I thought we were joining ASF or something.
00:59:58 Arran Dengate: Just curious - how does the use-case for federated compute compare to searchable snapshots? ([META] Searchable Snapshot Tracking Issue · Issue #2919 · opensearch-project/OpenSearch · GitHub)

They can both be used to search data stored in s3. It sounds like federated compute would require more setup, but would be more flexible, right?
01:06:46 Joshua Bright: Anyone going to Security Con in Seattle this week. Stop by the OpenSearch booth!
01:06:56 Kris Freedain: Reacted to “Anyone going to Secu…” with :partying_face:
01:07:23 Ani ( OpenSearch ): https://playground.opensearch.org/app/home
01:07:27 Ani ( OpenSearch ): Try it here now!
01:07:29 Ryan Paras: exactly :slightly_smiling_face:
01:07:33 Alexander Bunday: I believe we are testing 2.5 this week
01:07:44 Jeff Huss (AWS): Reacted to “Anyone going to Secu…” with :tada:
01:07:47 Ryan Paras: clear your cookies and disable your ad blockers
01:08:06 Kris Freedain: Reacted to “clear your cookies a…” with :smile:
01:08:25 Kris Freedain: Debian!!!
01:09:06 James McIntyre: opensearch-build/opensearch-release-notes-2.5.0.md at main · opensearch-project/opensearch-build · GitHub
01:09:22 Kris Freedain: Reacted to “o (Osman) · GitHub…” with :partying_face:
01:15:47 Kris Freedain: niiiice
01:15:50 Joshua Bright: Clap clap clap
01:15:50 Cole: trombone sounds
01:15:57 James McIntyre: :tomato:
01:16:06 Kris Freedain: Reacted to “:tomato:” with :rofl:
01:16:17 William Beckler: This is an amazing set of ideas!
01:16:20 Ani ( OpenSearch ): thanks
01:16:24 Andriy Redko: Thank you guys!
01:16:25 William Beckler: Thank you Ani and Josh!!!
01:16:28 Cole: Thanks, y’all!
01:16:31 William Beckler: And everyone else as well

Slides:

Slide1
Slide5

Slide1
Slide2
Slide3
Slide4

Slide1
Slide2

Slide8
Slide8
Slide10