OpenSearch Community Meeting - 2023-0214

[kris]

OpenSearch Community Meeting - 2023-0214 - Hope we see you all there!

Agenda:

• Presentation / demo of StormCrawler + OpenSearch - Julien Nioche - DigitalPebble

Event page
Meetup page

Meeting Link

Meeting ID: 825 4872 7209
Passcode: 610831

Would you like to present? Tag @kris @dtaivpp @nateynate and we’ll work to get you added to the agenda!

Feel free to comment on this agenda before the meeting if you want to add an item or have a question.

After the meeting, we will post the chat log and any meeting notes. We welcome you to keep the conversation going here on the forum.

========
By joining the OpenSearch Community Meeting, you grant OpenSearch, and our affiliates the right to record, film, photograph, and capture your voice and image during the OpenSearch Community Meeting (the “Recordings”). You grant to us an irrevocable, nonexclusive, perpetual, worldwide, royalty-free right and license to use, reproduce, modify, distribute, and translate, for any purpose, all or any part of the Recordings and Your Materials. For example, we may distribute Recordings or snippets of Recordings via our social media outlets.

[kris]

If anyone would like to present - let us know!

[kris]

Chat log from today’s meeting

07:59:27 From Kris Freedain to Waiting Room Participants:
Welcome! We’ll get going in just a minute or two.
08:01:44 From Patti Juric to Everyone:
Good morning!
08:01:54 From Ariana to Everyone:
Hello!
08:01:57 From Ariana to Everyone:
NATE
08:01:57 From Jeff Huss to Everyone:

08:02:20 From Kris Freedain to Everyone:
Reacted to “Hello!” with
08:02:40 From Christine Keller to Everyone:
Good day from Germany
08:02:46 From Ariana to Everyone:
I’ll stay off chat because I sound like death haha
08:02:49 From Fernando Rejon Barrera to Everyone:
Hi there
08:02:53 From Ariana to Everyone:
mic*
08:04:04 From Kris Freedain to Everyone:
Reacted to “Hi there” with
08:05:38 From Kris Freedain to Everyone:
Reacted to “Good day from German…” with
08:06:44 From Kris Freedain to Everyone:
Opensearch 1.3.8 · OpenSearch
08:06:55 From Kris Freedain to Everyone:
Opensearch 2.5.0 · OpenSearch
08:09:05 From Kris Freedain to Everyone:
https://digitalpebble.com/
08:09:21 From Kris Freedain to Everyone:
http://stormcrawler.net/
08:10:16 From Nathan Boot to Everyone:
GitHub - DigitalPebble/storm-crawler: A scalable, mature and versatile web crawler based on Apache Storm
08:15:02 From Kris Freedain to Everyone:
Home · DigitalPebble/storm-crawler Wiki · GitHub
08:20:31 From Nathan Boot to Everyone:
Reacted to “Good day from German…” with
08:20:40 From Nathan Boot to Everyone:
Reacted to “NATE” with
08:20:43 From Nathan Boot to Everyone:
Reacted to “Hello!” with
08:28:44 From Sam Herman to Everyone:
How do you deduplicate records?
08:28:59 From Sam Herman to Everyone:
For URLs
08:30:03 From Fernando Rejon Barrera to Everyone:
(probably covered in the wiki) What are the strategies for dealing missing webpages? For example if a site was crawled but it’s no longer available
08:35:43 From Fernando Rejon Barrera to Everyone:
Regarding the extra processing applied to each webpage, does this logic have to be implemented in Storm to take advantage of the OpenSearch module?
08:40:16 From Kris Freedain to Everyone:
https://23.foss-backstage.de/
08:41:24 From Joel Martens to Everyone:
is there a list of these conferences?
08:41:38 From Olena Kutsenko to Everyone:
I will be at DevoxxUK in May talking about OpenSearch and Kafka and Mastodon
08:42:41 From Julien Nioche to Everyone:
Reacted to “I will be at Devox…” with
08:44:55 From Ryan Paras to Everyone:
have to get dropping - thanks everyone
08:45:02 From Andriy Redko to Everyone:
Thanks a lot guys!
08:45:55 From Christine Keller to Everyone:
Since I am new to These Meetings just a quick Question: for me from Germany attending is only possible if the Meetings are in your Mornings, do you have them in the Mornings regularly or on a specific schedule?
08:47:02 From Terry Q to Everyone:
[Feature Request] Support for FIPS 140-2 enforced mode. · Issue #1497 · opensearch-project/security · GitHub
08:47:16 From Terry Q to Everyone:
Make bouncycastle dependency abstracted · Issue #1500 · opensearch-project/security · GitHub
08:47:21 From Terry Q to Everyone:
FIPS 140-2 | Elasticsearch Guide [8.6] | Elastic
08:48:28 From Patti Juric to Everyone:
Here’s a listing of all OpenSearch Project events, including Community Meetings and Security Triage meetings: Upcoming Events · OpenSearch
08:49:26 From Kris Freedain to Everyone:
Replying to “Since I am new to Th…”

Hello Christine - we are glad you’re here! We tend to do them every other week. We alternate between 8AM PT & 3PM PT to try to make it an approachable time for different parts of the globe. All events are available on https://opensearch.org/events

08:49:34 From Christine Keller to Everyone:
thanks, great!
08:50:14 From Kris Freedain to Everyone:
Thank you all for attending - thank you Julien for the presentation!!
08:50:40 From Patti Juric to Everyone:
Thank you, Julien!
08:51:01 From Julien Nioche to Everyone:
Reacted to “Thank you, Julien!” with
08:51:10 From Christine Keller to Everyone:
thanks for the presentation, I’ll try to join the next Event that is possible for me, I’ll have to go now.
08:52:52 From Andriy Redko to Everyone:
Thank you!
08:52:54 From Terry Q to Everyone:
Thanks!
08:53:01 From Olena Kutsenko to Everyone:
Thank you!!!
08:53:04 From Fernando Rejon Barrera to Everyone:
thanks!
08:53:06 From Ariana to Everyone:
Thanks!
08:53:12 From Patti Juric to Everyone:
Happy Valentine’s Day!

[kris]

(note - the Dashboard survey discussion has moved to the 2/28 meeting - see you there!)

Powered By

StormCrawler

DigitalPebble