---
# System prepended metadata

title: mycelial systems ideas and thoughts

---

# mycelial systems ideas and thoughts

## where we are right now
- Web system that finds spores files across an array of websites, and creating a search query based on those sites allowing you to search on sites that you and the people you are connected to find interesting

## what would be really sick
- Right now, this project relies on googles search index, and that leads to a point of centralization that would be nice to avoid
- this can be avoided by created micro search indexes that are hosted around the web, so instead of folks having a spores file, they would host an index file that could be fetched and searched on. 


## possible options of indexing
- Apache Lucene library, but what to do with static sites?
- Trafilatura python package could be used to extract text out of HTML page and convert that into plain text, which later could be converted into some kind of json-ish files with *index*

## Proof of Concept
- A group of sites
    - Each site needs
        - pages of static html
        - an index of that html
        - list of sites that they want to search
            - if you want others to be able to find your list, cors must be enabled
        - query maker, like a search box
        - query viewer, like a list of search results
- System to generate an index based on a url



https://www.algolia.com/docsearch