# OpenSearch Community Meeting - 2022-0201 Agenda: - Fluent Bit, Fluentd, and the OpenSearch connector by Calyptia - Remote Storage - OCI object storage repository plugin Feel free to comment on the agenda before the meeting if you want to add an item or have a question. During the meeting the agenda will be unlocked for collaborative editing / note taking. After the meeting the agenda will be set to read-only mode. Prior meeting: [OpenSearch Community Meeting - 2022-0124 - open office hour](https://hackmd.io/GpzMVLs7QViV_vazECfUtQ) ## Chat log 06:56:57 From Kyle Davis to Everyone: Hi Everyone! Welcome! 06:59:53 From Kris Freedain to Everyone: Today’s agenda: https://hackmd.io/@HmdZWaVnQU6M8icdvC5TwQ/ByKuRz8hK 07:04:49 From Dotan Horovits to Everyone: Anurag Eduardo great having you at OpenSearch community! 07:05:14 From Ryan Paras to Everyone: So happy to see you guys here :) 07:06:11 From Dotan Horovits to Everyone: Fluentd & fluentbit are favorite OSS shippers👍 07:08:20 From Sam Herman to Everyone: Brb, quitting zoom and rejoining 07:12:39 From Eduardo Silva to Everyone: thank you !, if you have any questions don't hesitate to share it here 07:13:32 From Erin Verbeck-Lane to Everyone: Can you explain the difference between fluentd vs fluent bit again? I haven’t heard of this so I probably glazed over it when you explained it at the start of call. 07:14:21 From Ryan Paras to Everyone: that might open a can of worms! that said - really appreciate what you guys are accomplishing! 07:16:01 From Dotan Horovits to Everyone: 😀 07:16:08 From Ryan Paras to Everyone: i will ask only 2. Do you expect in_kafka to make the fluentbit 1.9 release? Do you expect to support a concept like DLQ from logstash or error tagging from fluentd for mapping errors to opensearch. 07:16:54 From Ryan Paras to Everyone: thank you again guys! 07:16:55 From GSmith to Everyone: Can you tell us more about Calyptia? Are you part of a larger organization (I know Treasure Data went throw a few acquisitions)? Are you still the primary developers/maintainers of FluentD and Fluent Bit? 07:18:27 From Kyle Davis to Everyone: @gsmith - we’ll get to your question at the Q&A section. 07:27:08 From Erin Verbeck-Lane to Everyone: Can someone put that in URL chat? 07:27:45 From Rachit to Everyone: will it support common storages available like s3 based, NAS etc? 07:27:55 From Sokratis Papadopoulos to Everyone: https://github.com/opensearch-project/OpenSearch/issues/1968 07:28:28 From David Venable to Everyone: Are there any storages that OpenSearch will support out-of-the-box? 07:28:41 From bukhtawa to Everyone: In short yes, segment backups should support the usual stores 07:30:18 From Erin Verbeck-Lane to Everyone: When you said that the API would support PIT searching/retrieval - is that based on when the lucene segment gets created vs looking at the actual timestamps of the logs? 07:32:15 From Алексей Stekov to Everyone: Need agent on remote storage? 07:32:33 From Sachin to Everyone: No 07:33:25 From bukhtawa to Everyone: https://github.com/opensearch-project/OpenSearch/issues/1147 Point in time search 07:34:23 From David Venable to Everyone: Exciting feature. Thanks Sachin! 07:34:49 From Kris Freedain to Everyone: https://github.com/opensearch-project/OpenSearch/issues/1854 07:36:11 From Nate B to Everyone: Thanks Kris 07:41:54 From Nate B to Everyone: +1 07:43:47 From Erin Verbeck-Lane to Everyone: Does anyone have effective tips for searching through these boards? For example, if I’m interested in looking for updates to the reporting plugin, is there anything more sophisticated then just ctrl+F for “reporting?” 😄 07:44:03 From Erin Verbeck-Lane to Everyone: *than 07:46:38 From David Venable to Everyone: The “Filter cards” at the top is a powerful search. You can do free-text or include labels and other metadata. 07:47:21 From Kris Freedain to Kyle Davis(Direct Message): This one? https://github.com/orgs/opensearch-project/projects/13 07:47:35 From Kris Freedain to Everyone: https://github.com/orgs/opensearch-project/projects/13 07:53:32 From Ryan Paras to Everyone: Low priority question ... Not from today's presentation and quite specific .... As the roadmap and github can be a bit tricky to navigate... were these issues actually resolved in 1.2? From: https://github.com/opensearch-project/alerting/issues/202 https://github.com/opensearch-project/alerting/issues/139 Admin Users must be able to access all monitors Filter User object info (if any) in all the APIs 07:53:37 From Nate B to Everyone: I would really love to hear more about Calyptia - anything, really. 07:54:43 From Samuel Herman to Everyone: I have a question about the remote translog as part of the remote storage discussion 07:55:11 From Kyle Davis to Everyone: @Samuel - you want to ask it audio after Eduardo is done? 07:55:17 From Samuel Herman to Everyone: sure 07:56:06 From bukhtawa to Everyone: https://github.com/opensearch-project/OpenSearch/issues/1319 07:56:12 From Kyle Davis to Everyone: @Ryan - fixes aren’t represented on the roadmap. 07:56:23 From bukhtawa to Everyone: Feature Proposal : Pluggable Translog 07:58:03 From Ryan Paras to Everyone: @kyle - this actually was referenced in the roadmap - https://github.com/orgs/opensearch-project/projects/1?card_filter_query=202 07:58:03 From GSmith to Everyone: @eduardo Fluent Bit can output to OpenSearch today using the Elasticsearch filter. Will the new OpenSearch filter provide additional/different capabilities than the existing ES one? 07:58:22 From Kyle Davis to Everyone: Let me follow up, @Ryan. 07:58:27 From Ryan Paras to Everyone: thanks kyle 07:58:33 From Jordan Oliver (DMS) to Everyone: one other question. how does one get plugged in to help prioritized future work? I'd like to 'upvote' our customers asks to help with prioritization. 07:59:31 From Алексей Stekov to Everyone: guys if you look at this solution from the other side - you can close the problem with searcheable snapshots)) 07:59:35 From Ryan Paras to Everyone: I would like to share with folks that the already released fluenD opensearch output plugin has been working well in my tests :) 08:00:14 From lukas.vlcek to Everyone: Thank you! 08:00:28 From Ryan Paras to Everyone: *fleuntD 08:00:32 From Andriy Redko to Everyone: Thanks a lot everyone! 08:00:36 From Ryan Paras to Everyone: haha - i cannot type 08:00:39 From Paul Borgermans to Everyone: Thanks! Bye 08:00:40 From Ryan Paras to Everyone: **fluentD 08:00:41 From Samuel Herman to Everyone: Thank you 08:00:44 From Terry Q to Everyone: Thanks 08:00:44 From Ryan Paras to Everyone: thanks all! 08:00:46 From Madhan to Everyone: Thanks Kyle... 08:00:48 From Nate B to Everyone: Thanks to Calyptia! 08:00:53 From Anurag Gupta to Everyone: Thanks all! Looking forward to more with the community 😄 08:01:02 From Kyle Davis to Everyone: @Jordan - great question! Right now it’s a lot of paying attention to GitHub. We’re building a better system with a public web page to make it easier.