pangeo
      • Sharing URL Link copied
      • /edit
      • View mode
        • Edit mode
        • View mode
        • Book mode
        • Slide mode
        Edit mode View mode Book mode Slide mode
      • Customize slides
      • Note Permission
      • Read
        • Owners
        • Signed-in users
        • Everyone
        Owners Signed-in users Everyone
      • Write
        • Owners
        • Signed-in users
        • Everyone
        Owners Signed-in users Everyone
      • Engagement control Commenting, Suggest edit, Emoji Reply
    • Invite by email
      Invitee

      This note has no invitees

    • Publish Note

      Share your work with the world Congratulations! 🎉 Your note is out in the world Publish Note

      Your note will be visible on your profile and discoverable by anyone.
      Your note is now live.
      This note is visible on your profile and discoverable online.
      Everyone on the web can find and read all notes of this public team.
      See published notes
      Unpublish note
      Please check the box to agree to the Community Guidelines.
      View profile
    • Commenting
      Permission
      Disabled Forbidden Owners Signed-in users Everyone
    • Enable
    • Permission
      • Forbidden
      • Owners
      • Signed-in users
      • Everyone
    • Suggest edit
      Permission
      Disabled Forbidden Owners Signed-in users Everyone
    • Enable
    • Permission
      • Forbidden
      • Owners
      • Signed-in users
    • Emoji Reply
    • Enable
    • Versions and GitHub Sync
    • Note settings
    • Note Insights
    • Engagement control
    • Transfer ownership
    • Delete this note
    • Insert from template
    • Import from
      • Dropbox
      • Google Drive
      • Gist
      • Clipboard
    • Export to
      • Dropbox
      • Google Drive
      • Gist
    • Download
      • Markdown
      • HTML
      • Raw HTML
Menu Note settings Versions and GitHub Sync Note Insights Sharing URL Help
Menu
Options
Engagement control Transfer ownership Delete this note
Import from
Dropbox Google Drive Gist Clipboard
Export to
Dropbox Google Drive Gist
Download
Markdown HTML Raw HTML
Back
Sharing URL Link copied
/edit
View mode
  • Edit mode
  • View mode
  • Book mode
  • Slide mode
Edit mode View mode Book mode Slide mode
Customize slides
Note Permission
Read
Owners
  • Owners
  • Signed-in users
  • Everyone
Owners Signed-in users Everyone
Write
Owners
  • Owners
  • Signed-in users
  • Everyone
Owners Signed-in users Everyone
Engagement control Commenting, Suggest edit, Emoji Reply
  • Invite by email
    Invitee

    This note has no invitees

  • Publish Note

    Share your work with the world Congratulations! 🎉 Your note is out in the world Publish Note

    Your note will be visible on your profile and discoverable by anyone.
    Your note is now live.
    This note is visible on your profile and discoverable online.
    Everyone on the web can find and read all notes of this public team.
    See published notes
    Unpublish note
    Please check the box to agree to the Community Guidelines.
    View profile
    Engagement control
    Commenting
    Permission
    Disabled Forbidden Owners Signed-in users Everyone
    Enable
    Permission
    • Forbidden
    • Owners
    • Signed-in users
    • Everyone
    Suggest edit
    Permission
    Disabled Forbidden Owners Signed-in users Everyone
    Enable
    Permission
    • Forbidden
    • Owners
    • Signed-in users
    Emoji Reply
    Enable
    Import from Dropbox Google Drive Gist Clipboard
       owned this note    owned this note      
    Published Linked with GitHub
    2
    Subscribed
    • Any changes
      Be notified of any changes
    • Mention me
      Be notified of mention me
    • Unsubscribe
    Subscribe
    --- title: 'Enhancing the image analysis community in Galaxy' title_short: 'Image Analysis with Galaxy' tags: - imaging - image analysis - image processing - galaxy authors: - name: Leonid Kostrykin affiliation: 1,2 orcid: 0000-0003-1323-3762 - name: Tatiana Woller affiliation: 3 orcid: 0000-0002-6958-6498 - name: Matus Kalas affiliation: 4 orcid: 0000-0002-1509-4981 - name: Bugra Özdemir affiliation: 5 orcid: 0000-0001-9823-0581 - name: Rafael Andrade Buono affiliation: 3 orcid: 0000-0002-6675-3836 - name: Yi Sun affiliation: 6 orcid: 0000-0002-7636-0200 - name: Anup Kumar affiliation: 7 orcid: 0000-0002-2068-4695 - name: Nadia Goué affiliation: 8 orcid: 0000-0003-2750-1473 - name: Bjoern Gruening affiliation: 7 orcid: 0000-0002-3079-6586 - name: Beatriz Serrano-Solano affiliation: 5 orcid: 0000-0002-5862-6132 - name: Anne Fouilloux affiliation: 9 orcid: 0000-0002-1784-2920 affiliations: - name: Biomedical Computer Vision Group, Heidelberg University, BioQuant, IPMB, 69120 Heidelberg, Germany index: 1 - name: ELIXIR Germany, Institute of Bio- and Geosciences (IBG-5) – Computational Metagenomics, Forschungszentrum Jülich GmbH, 52425 Jülich, Germany index: 2 - name: Vlaams Instituut voor Biotechnologie, Datacore, Technologiepark-Zwijnaarde 75, 9052 Gent; ELIXIR Belgium index: 3 - name: ELIXIR Norway, and Department of Informatics, University of Bergen, Norway index: 4 - name: Euro-BioImaging ERIC Bio-Hub, European Molecular Biology Laboratory (EMBL) Heidelberg, Meyerhofstraße 1, 69117 Heidelberg, Germany index: 5 - name: index: 6 - name: index: 7 - name: index: 8 - name: Université Clermont Auvergne, AuBi platform, F-63000 Clermont-Ferrand, France index: 9 date: 13 December 2023 cito-bibliography: paper.bib event: BioHackathonn2023 biohackathon_name: "BioHackathon 2023" biohackathon_url: "https://biohackathon-europe.org/" biohackathon_location: "Barcelona, Spain, 2023" group: project 16 / Enhancing the image analysis community in Galaxy # URL to project git repo --- should contain the actual paper.md: git_url: https://github.com/elixir-europe/biohackathon-projects-2023/tree/main/16 # This is the short authors description that is used at the # bottom of the generated paper (typically the first two authors): authors_short: --- <!-- The paper.md, bibtex and figure file can be found in this repo: https://github.com/journal-of-research-objects/Example-BioHackrXiv-Paper To modify, please clone the repo. You can generate PDF of the paper by pasting above link (or yours) in http://biohackrxiv.genenetwork.org/ --> # Introduction The [BioHackathon Europe](https://biohackathon-europe.org/) took place in Barcelona in November 2023, where a group of people interested in image data analysis gathered around the project **_"Enhancing the image analysis community in Galaxy"_**. Although the [Galaxy platform](http://galaxyproject.org) [@Galaxy] has a strong presence in omics fields like genomics and proteomics, it has yet to fully establish itself in the imaging community. At the moment, **efforts** to integrate tools and create workflows for image analysis in Galaxy **are scattered** across research fields and locations. The vision of this project is not only to join those efforts but also to go beyond by creating **cross-discipline image analysis resources**. By fostering collaboration among scientists and enthusiasts from different fields we aim to create a dynamic community around image data management and analysis. The initiative started in summer 2023 when the group gathered around a newly-created **Expert Group on _FAIR Image Data Workflows_** within [Euro-BioImaging](https://www.eurobioimaging.eu/), the European Research Infrastructure offering open access to imaging technologies, training, and data services. Additionally, it aims to tap into the capabilities of [Simula Research Laboratory](https://www.simula.no/), a Norwegian non-profit research organization that addresses crucial scientific and engineering problems with a societal impact, focusing on five primary ICT research areas: Communication Systems, Cryptography, Scientific Computing, Software Engineering, and Machine Learning. Together, these entities will foster the development of a community dedicated to crafting FAIR computational workflows specifically tailored for image analysis. ### Project goals For the BioHackathon 2023, we set a number of multifaceted goals: - Gather all the existing resources for image data management and analysis in Galaxy (e.g., tools available in the [Galaxy ToolShed](https://toolshed.g2.bx.psu.edu/), training materials published in the [Galaxy Training Network](https://training.galaxyproject.org/) [@gtn], and workflows collected in the [WorkflowHub](https://workflowhub.eu/) [@workflowhub]). - Create a list of tools widely used in the image analysis field that are not yet integrated into Galaxy. - Annotate the existing image analysis tools that are lacking annotations with the [EDAM Bioimaging ontology](https://bioportal.bioontology.org/ontologies/EDAM-BIOIMAGING). - Create a community of practice page in the [Galaxy Community Hub](https://galaxyproject.org/). - Establish community practices and decide on regular interactions. # Results In this section, we discuss the achievements within the BioHackathon aligning them with the project goals. We explore the progress made addressing conventions, tool renaming, tool annotation, the identification of tools not available in Galaxy, together with image data management and image analysis tools. ```mermaid graph TD; Landscape_Analysis[Landscape analysis] --> Tools_available_in_Galaxy[Tools available in Galaxy]; Tools_available_in_Galaxy --> Tool_Renaming[Tool renaming]; Tools_available_in_Galaxy --> Tool_Annotation[Tool annotation]; Landscape_Analysis --> Tools_not_available_in_Galaxy[Tools NOT available in Galaxy]; Tools_not_available_in_Galaxy --> Image_Data_Management_Tools[Image data management Tools]; Tools_not_available_in_Galaxy --> Image_Analysis_Tools[Image analysis tools]; ``` ## Landscape analysis of image analysis and image processing tools in Galaxy The current state of image analysis and image processing tools within Galaxy, as of October 13, 2023, reveals a landscape that is both extensive and diverse. A comprehensive overview provides valuable insights into the existing ecosystem and areas that need to be enhanced. ### Tool Statistics ![Distribution of tools across repositories](https://hackmd.io/_uploads/B1RQLDUHT.png) - **Tool count**: The _"Imaging"_ category on Galaxy Europe lists 101 tools. - **Contributors**: Approximately 23 contributors have been involved in adding and maintaining these tools. - **Repositories**: The tools are distributed across 5 different GitHub repositories, presenting a need for structuration and organization. - **Categorization challenges**: Some tools with relevance to image analysis are found in the "Interactive" category, indicating a potential need for reclassification and structure clarification. ### Big pile of tools — needing structure Following the gathering and identification of this extensive number of tools, we identified potential obstacles that could be hindering their FAIRness. #### Example 1: Inconsistent tool naming schemes Within the tool repository, there was a noticeable diversity in naming styles, with tools adopting various conventions such as the title case, sometimes capitalized, abbreviated, using camel case, etc. Some examples of this diversity are listed below: - Title Case: _Anisotropic Diffusion_, _Count Objects_, … - Capitalized: _Binary To Points_, … - Abbreviated: _Binary 2 Label_, … - Camel Case: _ColorToGray_, _ConvertObjectsToImage_, … - Regular: _Convert image_, _Find edges_, _Filter segmentation_, … - Verb-forms vs. Nouns: _Split objects_, _Mahotas-features_, … During the BioHackathon, we reached an agreement on a recommended naming scheme for tools, to facilitate finding these tools (see section [Conventions](#Conventions)). #### Example 2: Low-level vs. high-level tools The distinction between low-level and high-level tools highlights the diverse needs in the Galaxy user community. Advanced users, with a good understanding of image analysis, benefit from the flexibility and control offered by low-level tools. On the other hand, users with varying levels of expertise, including those less familiar with image analysis, find high-level tools to be easier and efficient. This duality in tool design acknowledges the heterogeneous user base within the Galaxy community. #### Example 3: Tools with unclear goals The purpose of some tools can be unclear (e.g. _Gate Finder_, _Concatenate images_, _Compose two raw transformations_, _Add shadow effect_, ...), have typos in their documentation (_labeled_ vs. _labled_) or are unrelated to imaging (_GeneSeqToFamily preparation_), emphasizing the importance of defining the purpose of each tool clearly in its metadata. Enhancing consistency in tool names and descriptions will contribute to a more user-friendly experience. #### Example 4: Duplicated or similar tools Some tools within the Galaxy ecosystem have similar purposes but often originate from different tool suites (e.g. _CellProfiler_ or _ImageJ_). Using prefixes or other consistent schemes for indication of the tool suites should facilitate identification and enhance user navigation. #### Example 5: Lack of tool interoperability Incompatibilities between tools, particularly concerning input formats and inconsistent tool IDs, were identified. For example, tools like _Count Objects_ historically accepted only TIFF inputs while others, like _Concatenate images_ exclusively accepted binary images without apparent justification. To enhance user experience and interoperability, a suggestion was made for tools to universally support formats such as TIFF and PNG. #### Example 6: Different versions of the same tool Occasionally, the Galaxy tool panel may feature duplicated versions of the same tool, even if their functionalities have undergone alterations. There are different reasons for this, from typos to the way tool names are displayed in the tool panel. ## Conventions We acknowledge the existence of the IUC recommendations for tool names but decided for a somewhat different pattern, 1. to avoid too long tool names due to the inclusion of tool suits, 2. to comply with the fact that many Galaxy tools in our community are thin tool wrappers around established tools (e.g., tool suites or other Conda packages), while 3. many others implement their main functionality directly within the wrapper. The conventions described below have a few limitations (see section [Discussion](#Discussion)). ### Naming Generally, the name of Galaxy tools in our community should be expressive and concise, while stating the purpose of the tool as precisely as possible. Consistency of the namings of Galaxy tools is important to ensure that they can be found easily. To maintain consistency, we consider phrasing names as imperatives a good practice, like for example “Analyze particles” or “Perform segmentation using watershed transformation”. An acknowledged exception from this rule are the names of tool wrappers of major tool suites, where the name of a tool wrapper should be chosen identically to the module or function of the tool which is wrapped (e.g., “MaskImage” in CellProfiler). ### Tool description If a Galaxy tool is a thin tool wrapper (e.g, part of a major tool suite), then the name of the wrapped tool (and only the name of the wrapped tool, subsequent to the term “with” as in “with Bioformats”) should be used as the description of the tool (further examples include “with CellProfiler”, “with ImageJ2”, “with ImageMagick”, “with SpyBOAT”, “with SuperDSM”). This ensures that the tool is found by typing the name of the wrapped tool into the “Search” field on Galaxy EU. The tool description should be empty if a tool is either not part of a major tool suite, or the main functionality of the tool is implemented in the wrapper. ### Annotations We point out that there is a global list of precedential [Bio.tools](https://bio.tools/) annotations in Galaxy which outweighs the annotations made in the XML specification of a Galaxy tool (and thus the annotations of a tool reported within the web interface of Galaxy might be divergent). However, since the precedential annotations are subject to possible changes and to avoid redundant work, we do not aim to reflect those in our specifications (those which we make in the XML specifications of Galaxy tools). ## Tool annotation The annotations of tools within the Galaxy Image Community involves the use of the EDAM ontology and [Bio.tools](https://bio.tools/). To recognize the role of [BIII](https://biii.eu/) in the imaging tool landscape, we agreed to use [BIII](https://biii.eu/), considering its integration with EDAM-Bioimaging. To fully reflect this decision, we included a new metadata field in the Galaxy tool wrappers that enables the annotation of tools using [BIII](https://biii.eu/) (see [PR](https://github.com/galaxyproject/galaxy/pull/16952)). We annotated all the tools with [Bio.tools](https://bio.tools/), EDAM and [BIII](https://biii.eu/) and adhered to the agreed conventions in the following pull requests: - https://github.com/BMCV/galaxy-image-analysis/pull/71 - https://github.com/bgruening/galaxytools/pull/1346 - https://github.com/goeckslab/tools-mti/pull/53 - https://github.com/galaxyproject/tools-iuc/pull/5572 - https://github.com/usegalaxy-eu/usegalaxy-eu-tools/pull/641 Thanks to these annotations and in collaboration with Project 25 _" Increasing the findability, visibility, and impact of Galaxy tools for specialised scientific Communities"_, we gathered a list of tools that are of interest for the imaging community. We also started the discussion to facilitate the [bio.tools](https://bio.tools/) [@biotools] annotations when wrapping a tool for Galaxy using the [Galaxy Language Server](https://github.com/galaxyproject/galaxy-language-server) (see [issue](https://github.com/galaxyproject/galaxy-language-server/issues/250)). ## Data management tools Improving data management is crucial when it comes to improving the image analysis experience in Galaxy. During the BioHackathon, we worked on adding support for Zarr ([PR](https://github.com/usegalaxy-eu/galaxy/pull/203)) and a beta version of OME-Zarr ([PR](https://github.com/galaxyproject/galaxy/issues/16862)) [@OMEzarr], with plans for adding metadata information and checks in the future. This would also facilitate adding support for other community-driven standards such as NCZarr support. Tools to convert NetCDF to NCZarr and various proprietary image file formats to OME-Zarr were added ([PR](https://github.com/NordicESMhub/galaxy-tools/pull/64)), addressing specific image analysis data formats for better data handling in Galaxy. In addition, a tool to fetch image data directly from the [BioImage Archive (BIA)](https://www.ebi.ac.uk/bioimage-archive/) has been implemented ([PR](https://github.com/bgruening/galaxytools/pull/1345)), and tools for data conversion have been included ([PR](https://github.com/BMCV/galaxy-image-analysis/pull/72 )). ## AI-powered image analysis The integration of AI-powered image analysis in Galaxy involved leveraging models from the [BioImage Model Zoo (BMZ)](https://bioimage.io/#/) [@BMZ] and conducting an analysis of [ZeroCostDL4Mic](https://github.com/HenriquesLab/ZeroCostDL4Mic) dependencies. We explored the possibility to consume models from the [BMZ](https://bioimage.io/#/) in Galaxy, with specific examples for live cell segmentation and nucleus segmentation boundary models. ## Community We updated the Galaxy subdomain (https://imaging.usegalaxy.eu) to contain the list of training materials related to imaging ([PR](https://github.com/usegalaxy-eu/website/pull/1165)). We also agreed on renaming our community to “image community”, thus also renaming the subdomain to image.usegalaxy.eu. # Discussion The project has made good progress in gathering existing image analysis tools, creating a list of tools to integrate, and adding annotations to tools that needed them. ## Future work Looking ahead, we plan to continue this work by collaborating closely with the Galaxy, EDAM-Bioimaging and BioImage Model Zoo communities. The long-term goal is to create a solid community that supports the creation of reproducible and FAIR image analysis workflows. ### Community development We welcome anyone interested, from experienced Galaxy tool developers and image analysts to those who are new to the field, to join our community and monthly meetings. ### Improving conventions We are aware of the following limitations of our conventions for tool naming, tool descriptions, tool and annotation (see section [Conventions](#Conventions)), which we seek to possibly address in the future: 1. If a Galaxy tool has a [Bio.tools](https://bio.tools/) identifier included in its XML specification, then its EDAM operation annotation can be inherited from the Bio.tools annotation. The EDAM operations in Bio.tools might be precedential over the EDAM operations given in the XML specification of a Galaxy tool. 2. Our main motivation for prominently exposing the name of the wrapped tool in the tool description has been to account for the fact that tools with similar functionality (and hence similar names) exist across different tool suites. However, they can also exist across different plugins within the same tool suite (such as ImageJ2). To also account for that, we might want to take the suggested scheme one step further and to also include the name of the corresponding plugin in the tool description (as in “with ImageJ2, bUnwrapJ”). # Acknowledgements We thank the contributions from Project 25. The authors utilised the language model ChatGPT developed by OpenAI for assistance in the structuring and drafting of this text. # References - [Galaxy project](https://galaxyproject.org) - [Euro-BioImaging](https://www.eurobioimaging.eu/) - [BioImage Model Zoo (BMZ)](https://bioimage.io/#/) - [EDAM Bioimaging](https://bioportal.bioontology.org/ontologies/EDAM-BIOIMAGING) - [Zarr](https://zarr.readthedocs.io/en/stable/spec.html#specifications) - [OME-Zarr](https://ngff.openmicroscopy.org/latest/) - [NCZarr](https://www.unidata.ucar.edu/blogs/developer/en/entry/netcdf-zarr-data-model-specification) - [GeoZarr](https://github.com/zarr-developers/geozarr-spec)

    Import from clipboard

    Paste your markdown or webpage here...

    Advanced permission required

    Your current role can only read. Ask the system administrator to acquire write and comment permission.

    This team is disabled

    Sorry, this team is disabled. You can't edit this note.

    This note is locked

    Sorry, only owner can edit this note.

    Reach the limit

    Sorry, you've reached the max length this note can be.
    Please reduce the content or divide it to more notes, thank you!

    Import from Gist

    Import from Snippet

    or

    Export to Snippet

    Are you sure?

    Do you really want to delete this note?
    All users will lose their connection.

    Create a note from template

    Create a note from template

    Oops...
    This template has been removed or transferred.
    Upgrade
    All
    • All
    • Team
    No template.

    Create a template

    Upgrade

    Delete template

    Do you really want to delete this template?
    Turn this template into a regular note and keep its content, versions, and comments.

    This page need refresh

    You have an incompatible client version.
    Refresh to update.
    New version available!
    See releases notes here
    Refresh to enjoy new features.
    Your user state has changed.
    Refresh to load new user state.

    Sign in

    Forgot password

    or

    By clicking below, you agree to our terms of service.

    Sign in via Facebook Sign in via Twitter Sign in via GitHub Sign in via Dropbox Sign in with Wallet
    Wallet ( )
    Connect another wallet

    New to HackMD? Sign up

    Help

    • English
    • 中文
    • Français
    • Deutsch
    • 日本語
    • Español
    • Català
    • Ελληνικά
    • Português
    • italiano
    • Türkçe
    • Русский
    • Nederlands
    • hrvatski jezik
    • język polski
    • Українська
    • हिन्दी
    • svenska
    • Esperanto
    • dansk

    Documents

    Help & Tutorial

    How to use Book mode

    Slide Example

    API Docs

    Edit in VSCode

    Install browser extension

    Contacts

    Feedback

    Discord

    Send us email

    Resources

    Releases

    Pricing

    Blog

    Policy

    Terms

    Privacy

    Cheatsheet

    Syntax Example Reference
    # Header Header 基本排版
    - Unordered List
    • Unordered List
    1. Ordered List
    1. Ordered List
    - [ ] Todo List
    • Todo List
    > Blockquote
    Blockquote
    **Bold font** Bold font
    *Italics font* Italics font
    ~~Strikethrough~~ Strikethrough
    19^th^ 19th
    H~2~O H2O
    ++Inserted text++ Inserted text
    ==Marked text== Marked text
    [link text](https:// "title") Link
    ![image alt](https:// "title") Image
    `Code` Code 在筆記中貼入程式碼
    ```javascript
    var i = 0;
    ```
    var i = 0;
    :smile: :smile: Emoji list
    {%youtube youtube_id %} Externals
    $L^aT_eX$ LaTeX
    :::info
    This is a alert area.
    :::

    This is a alert area.

    Versions and GitHub Sync
    Get Full History Access

    • Edit version name
    • Delete

    revision author avatar     named on  

    More Less

    Note content is identical to the latest version.
    Compare
      Choose a version
      No search result
      Version not found
    Sign in to link this note to GitHub
    Learn more
    This note is not linked with GitHub
     

    Feedback

    Submission failed, please try again

    Thanks for your support.

    On a scale of 0-10, how likely is it that you would recommend HackMD to your friends, family or business associates?

    Please give us some advice and help us improve HackMD.

     

    Thanks for your feedback

    Remove version name

    Do you want to remove this version name and description?

    Transfer ownership

    Transfer to
      Warning: is a public team. If you transfer note to this team, everyone on the web can find and read this note.

        Link with GitHub

        Please authorize HackMD on GitHub
        • Please sign in to GitHub and install the HackMD app on your GitHub repo.
        • HackMD links with GitHub through a GitHub App. You can choose which repo to install our App.
        Learn more  Sign in to GitHub

        Push the note to GitHub Push to GitHub Pull a file from GitHub

          Authorize again
         

        Choose which file to push to

        Select repo
        Refresh Authorize more repos
        Select branch
        Select file
        Select branch
        Choose version(s) to push
        • Save a new version and push
        • Choose from existing versions
        Include title and tags
        Available push count

        Pull from GitHub

         
        File from GitHub
        File from HackMD

        GitHub Link Settings

        File linked

        Linked by
        File path
        Last synced branch
        Available push count

        Danger Zone

        Unlink
        You will no longer receive notification when GitHub file changes after unlink.

        Syncing

        Push failed

        Push successfully