# OpenSearch Community Meeting - 2022-0411 Agenda: - [High Level Vision for Storage](https://github.com/opensearch-project/OpenSearch/issues/2578) - [Enable OpenSearch Dashboards to support multiple OpenSearch clusters](https://github.com/opensearch-project/OpenSearch-Dashboards/issues/1388) [Meeting Link](https://www.meetup.com/OpenSearch/events/284560530/) **Passcode:** - **055199** Feel free to comment on the agenda before the meeting if you want to add an item or have a question. During the meeting the agenda will be unlocked for collaborative editing / note taking. After the meeting the agenda will be set to read-only mode. ## Chat log 08:47:03 From Kyle Davis to Waiting Room Participants: We’re getting our presenters ready - sit tight! 08:56:00 From Kris Freedain to Everyone: Almost ready - hold tight and we’ll let people in very soon 08:59:49 From Kyle Davis to Waiting Room Participants: We will get started in just a few seconds! 09:01:44 From Kris Freedain to Everyone: https://hackmd.io/@HmdZWaVnQU6M8icdvC5TwQ/HJkXCUtbq 09:04:43 From Kris Freedain to Everyone: https://github.com/opensearch-project/OpenSearch/issues/2578 09:11:00 From tonys to Everyone: Will this look to improve the balancing of the sharding we have currently? We have a mixture of large indices (100gbs) and small indices (couple of mbs) and this can cause disk space imbalance due to a node holding lots of large shards compared to another holding lots of small. 09:12:22 From Ryan Paras to Everyone: do you believe these storage conversations would be apt for inclusion about optimizations for things like data streams in colder storage? 09:13:42 From Jonah Kowall to Everyone: @tonys we are working on a new shard balancer which aims to address hotspots automatically. I am not sure if we're going to open source it, but probably will. 09:13:55 From Ryan Paras to Everyone: can tell you - using ultra warm - the underlying 'skip' logic can cause searches against non applicable indexes/shards if not querying "correctly" 09:14:09 From tonys to Everyone: thanks 09:18:47 From Kris Freedain to Everyone: https://github.com/opensearch-project/OpenSearch-Dashboards/issues/1388 09:22:58 From tonys to Everyone: So could you run Dashboard locally on your laptop and configure it to connect to any of your clusters? Or do you need an opensearch cluster behind it? 09:25:47 From pakshi to Everyone: Great question Tony 09:27:18 From Kris Freedain to Everyone: https://github.com/opensearch-project/OpenSearch-Dashboards/issues/1405 09:28:44 From tonys to Everyone: That would be very helpful. 09:29:07 From pakshi to Everyone: Great idea… to configure one of the datastore as the metadata store. Perhaps a limited “run-level” where the only affordance is to register a metadata store…. and once that is there then one can do multiple data stores 09:29:37 From Julien EL KHIATI to Everyone: how will you manage security plugin on both clusters ? 09:34:38 From Jonah Kowall to Everyone: What about Kubecon, Kyle? I know some PMs are going. 09:35:14 From bromann to Everyone: We have a virtual keynote! 09:35:44 From Kris Freedain to Everyone: https://www.meetup.com/OpenSearch/events/285152025/ 09:36:12 From Nathan Boot to Everyone: It's a beautiful spot for it. 09:37:06 From tonys to Everyone: Would love to go but my company will not pay for it :( 09:37:28 From Kris Freedain to Everyone: https://twitter.com/OpenSearchProj 09:37:40 From Kris Freedain to Everyone: https://www.linkedin.com/company/opensearch-project/ https://www.facebook.com/OpenSearchProject https://github.com/orgs/opensearch-project/projects/1 09:40:44 From tonys to Everyone: I am in UK so much to expensive ;) 09:41:03 From bromann to Everyone: FREE! 09:41:23 From David Tippett to Everyone: Oooh I didn’t realize that 09:42:50 From GSmith to Everyone: Will OpenSearchCon be streamed? Or, will the presentations be available afterwards? 09:47:00 From tonys to Everyone: Are there any plans to build your own beats products? 09:47:48 From David Tippett to Everyone: https://fluentbit.io/ Here is the website for fluentbit 09:48:01 From Manoj Faria to Everyone: storage 09:48:17 From tonys to Everyone: Will have a look 09:48:22 From Manoj Faria to Everyone: Pls excuse & ignore wrong window 09:48:38 From Ryan Paras to Everyone: they would love comments here: https://github.com/fluent/fluent-bit/discussions/5211 09:50:04 From Kris Freedain to Everyone: https://github.com/Opster/opensearch-k8s-operator/releases/tag/v0.9 09:51:03 From Madison Zraick to Everyone: Thank you! 09:51:03 From pakshi to Everyone: Thanks. Substantive update. 09:51:08 From Ryan Paras to Everyone: thank you 09:51:29 From Nathan Boot to Everyone: 💯 09:53:01 From lukas.vlcek to Everyone: Thank you very much! Have a nice day. 09:53:03 From tonys to Everyone: Thanks all 09:53:08 From Kyle Davis to Everyone: Thanks!