owned this note
owned this note
Published
Linked with GitHub
---
title: 'Interview: Ultrasound pulse-echo device'
author:
- Open make interview team
- Luc Jonveaux
date: '2024-05-20'
slug: interview-ultrasound
categories: [interview]
banner: img/banners/ultrasoundmap.jpg
tags:
- technology
- open hardware
- personal story
---
# Interview: Ultrasound device
Luc Jonveaux has been developing open-source ultrasound devices in his spare time for several years. His motivations have been to have fun and give back to the commons. Different devices were created in his lab/flat in Paris, and they are used by quite a large community of enthusiasts.
*by the Open make team, Luc Jonveaux. Copyright to the authors, distributed under a CC-BY 4.0 licence.*
**Sections:**
- [The project](#the-project)
- [The hardware](#the-hardware)
- [The research outputs](#research-outputs)
- [The participants](#participants)
*Banner image: fixme, By CERN, distributed under a CC-BY-SA 4.0*
>Interviewee: Luc Jonveaux
>
>Interviewers: Robert Mies (TU Berlin) & Moritz Maxeiner (FU Berlin)
>
>Transcription and editing: Diana Paola Americano Guerrero, Robert Mies, Fabio Reeh, Moritz Maxeiner & Julien Colomb
<img src="images/Screenshot.png" alt="screenshot of the interview" width="60%"/>
*Screenshot of the interview.*
{{< card "The un0rick in a nutshell">}}
<img src="images/lit3rick.jpg" alt="The Lit3rick board." width="60%"/>
*Photos of FIXME*
- Main website: http://un0rick.cc
- Project start: 2018
- Core development team size: 1-5
### Hardware products
The un0rick has is a fpga-based pulse-echo device. Its smaller, lighter alternative is the lit3rick board, the size of a Pi Zero.
The pic0rick, a rp2040-based, modular device is under development.
### Hardware maturity
The boards are shared on the market
### Rebuilds
There are known users who built their own hardware through fabs or produced it themselve across the globe, maybe 20% of the devices in existence.
{{< /card >}}
## The project
{{< card2 "Project start">}}
I started my career as a research engineer at Philips in medical imaging. We were working on simple, low-cost medical imaging device at the time.
In 2014, Mehdi Benchoufi, Olivier de Fresnoye, Paul Bourrier and I started echOpen as an association, officializing the objective of developing an open source ultrasound device.
I continued on a parallel path in 2016: echOpen aiming for a medical device, when I wanted to focus on opening the technology itself, to give people access to an Arduino of ultrasound.
{{< /card2 >}}
> How did the open source ultrasound project start?
{{< expand "Show answer">}}
The project is about providing an 'Arduino of ultrasound' to researchers, academics and makers, simply because nothing existed in the market.
I was a research engineer at Philips in medical imaging around 15 years ago. It was a great opportunity to work on low cost medical imaging devices, where we got to a proof of concept working with an OLPC.
A few years passed, and in 2014 I met with Mehdi Benchoufi and we had an initial discussions for what became echOpen afterwards.
Mehdi, Pierre, Olivier and I, started a project, which became the echOpen association to post the technical project of having open source with ultrasound. I spent less time with the association in 2016 or 2017 because I wanted to focus on something that would be used by makers, hackers and layman - and not necessarily the medical itself itself.
At this time, I started to experiment more on the hardware components. This was initially a functional block approach, where each block captures a function, allowing one to swap modules and try different approaches.
That worked relatively well, and confirmed the interest from a couple of individuals, the core of the community. Along with this initial pitch, the design got more mature and more integrated, leading to the first product. The un0rick board is interesting as an approach, as I am not an electrical engineer, and knew very little about electronics design. It was about getting the right people to help with the toughest electronic parts, and we got to a design that is far from perfect but still in use today.
This went well until.. the pandemic in 2020 and the during supply shortage the project could not move forward, as I could not try new designs or build new boards. Therefore I stopped developing the product. Then we started a smaller version of the board - smaller, but also cheaper and has a bit more performance. Today, it's about making the most of new parts like the raspberry pico chips, opening exciting doors.
What was done for Ultrasound can theorically be replicated in the MRI space. If we look purely at the technology, we are talking about signals in the megahertz range. What we're discussing right now is to what extent we could build a common tool, a basic Arduino, that could be used for both technologies, ultrasound or MRI.
{{< /expand >}}
{{< card2 "Project process">}}
The project process is quite organic. I simply started with documenting what I was doing, for my reference. When you build stuff during evening and weekends, then take a break, you can't always remember where you were you come back to experiment. Documentation helps with this.
Then, people have reached out with email, and we opened a Slack channel to allow people to talk to a wider community.
A good consequence of working on free time, is that hardware takes time. I could put everything on hold for two months and just maintain communication in the community, and then pick up work again.
There is no roadmap. Developments are more organic, the interesting experiments usually get priority.
{{< /card2 >}}
> What was the core benefit of the project?
{{< expand "Show answer">}}
The core benefit is to provide an arduino of ultrasound. And for me, to have a blast and learn while contributing to the commons.
The side benefit is to generate something you don't keep under lock and key. I see the value in the commons, and egoistically also benefit to know that you made benefits others. Apart from this, the greatest benefit is that I like to believe my users are getting access to technology that they wouldn't have access to normally. Users are academics who want to have a system to test ideas. I have also seen startups using that to develop proof of concepts, teachers to have a demo tool for their courses, institutional organization collaborating to build customized solution.
{{< /expand >}}
{{< card2 "Funding">}}
Funding is mostly out of pocket. The community helps by sharing costs when producing a batch, which helps keep the cost down.
Being an individual, without a "research home", makes things a bit more difficult, for example to get funding, institutional support even simply to to have a 'official mail' when registering to events, or online services.
{{< /card2 >}}
> Is the project funded in some way?
{{< expand "Show answer">}}
It's funded by me as an individual, and as mentioned, costs shared when doing a new batch of boards. Remember, this is a side project, and it has no official structure.
Funding is a good question. I have tried publishing articles about the open hardware, methodologies and sources I'm using, but I'm not affiliated with any lab, which makes classical publication less easy. Hopefully, this is something recognized by the open source imaging community, and I am sure there will be initiatives to tackle this challenge.
{{< /expand >}}
> How much money have you put in yourself?
{{< expand "Show answer">}}
That's a good question. I spent maybe between 5 and 10k out of my pocket over the past few years, in getting batches out, but I'm not necessarily keeping track of the ad-hoc, smaller parts bought for tests and experiments. Part of the larger batches do help keeping the cost of prototypes acceptable.
{{< /expand >}}
{{< card2 "Work Coordination">}}
This project is a side project, and I don't want to be a bottleneck in the community communication. Most of the interactions are through slack. A few physical interactions occur spontaneously. The base coordination itself It's pretty much organic and defined in the long term.
When it comes to specific activities, for example for teams with specific needs, these teams take the lead for their tasks, and drive the development of their needs.
{{< /card2 >}}
> Could you describe the overall process?
{{< expand "Show answer">}}
I guess an open source starts with documentating an idea. I just started with documenting what I was doing. When you progress on a side project, on some evenings, weekends, from time to time, .. you usually come back to the table with no memory of the details of what you were doing. It is definitely helpful to keep a lab log, for you first, but also to 'build in public'.
The documentation brought the interests of some people and publications. I've done a couple of publications since, on, for example, the Journal of Open Hardware. That helped raise the profile of the project. There are communication channels for interested individuals to come in and discuss.
The main topic in terms of organisation would be community, and in particular that I don't want to be a bottleneck. If I were to be hit by a bus tomorrow, I still want the community to organize itself. Moreover, there are always opportunities to meet with the wider open communities, for example through the ultrasound with echOpen, as well as the wider open imaging wider. The community is also lucky enough to have a couple of people who want to drive the topic forward. The activist circle would be five to ten people. We got an academic paper with a small core community group.
{{< /expand >}}
{{< card2 "Major issues">}}
One could say there are no real issue because this is a side project. Nobody's life depend on it. As a side project, it progresses when people want to, and have the time to.
Still, issues like components shortage over the last year(s) significantly slow down the development of the project.
Another minor challenge is having no lab. For me, the lab is home, in Paris, and you can only squeeze that much development before things get cramped. But electronics and hardware can be developed on a simple, minimalistic bench.
{{< /card2 >}}
> What major issues have you come across during the project and how did you resolve them?
{{< expand "Show answer">}}
One could say there are no real issue because this is a side project. Nobody's life depend on it. If someone is rude, they get ignored. If there are no resources, development is put on hold. The major bottleneck is time. As a side project, it progresses when people want to, and have the time to.
There is a minor bottleneck which has been the components shortage over the last years and it froze the project's development. No new boards could be shared.
Another challenge usually is that building hardware takes time. But in this case, it is a benefit. As a side project, if you have to wait two months for a board and you can't do anything, well, just freeze for two months, just doing some community management. And because it's a side project, there is no added stress.
{{< /expand >}}
{{< card2 "Core team and community">}}
Our community is around 300 individuals when checking our Slack channel, with maybe a rotating 20 active members. There are also representatives from startups, researchers or teachers. Most of the active contributors have this willingness to share back to the community.
{{< /card2 >}}
> Do you have to make decisions in the project or how are they made?
{{< expand "Show answer">}}
As this is an informal community, there is virtually no governance nor governance processes. From a technical perspective, people making the decisions are people doing. They make decisions based on their requirements.
Even on collaborating with, for example, organisations. The process is that these organisations drive their requirement, and we discuss opportunities and past learnings. To some extent, they drive the decision of the joint project. I then bring back to the community what can be shared back.
Coming back to the decisions, the project does not have a specific roadmap. It's just what is interesting to pursue at the moment. The perfect example is what we'd like to do with open MRI initiative: there is definitely a good intellectual challenge to learn from both modalities to build something new, hopefully better.
{{< /expand >}}
## The hardware
{{< card2 "Hardware components">}}
The project hardware started as a series of bricks that could be assembled together to become effectively a pulse-echo device. It evolved towards a more integrated system and more efficient system.
A lesson is that a project reflects the technical knowledge of its key developers. It started very simple, and the more we learnt, the more the hardware evolved and matured. The path started with off-the-shelf bricks, then we started integrating FPGAs as the technology opened, and now are exploring specific capabilities of the new raspberry pico chips.
{{< /card2 >}}
> What hardware products have you developed?
{{< expand "Show answer">}}
The first was the Murgen board, which was a BeagleBoard add-on, similar to the 'hats' on the Raspberry. We came back to a module-based concept where the different functional blocks of the hardware split into individual physical elements, named as 'echomods' project. The next iteration was to integrated lessons from the modules into the 'un0rick', an integrated, slightly overspecced design, and its 'lit3rick' counterpart, which are smaller, approximately the size of a Pi Zero. Today, i'm still working on the smaller raspberry pico chips.
{{< /expand >}}
> How would you classify the product? Is it mainly a board, or are there other components, like mechanical or software, that you had to develop?
{{< expand "Show answer">}}
The device is electronics at heart. I do not have the space or resources to go into more - say building the board physical transducers (or sensors) or the mechanical aspects.
{{< /expand >}}
> I see that the board has FPGAs on it. Did you develop any gateware, or is that up to the end user?
{{< expand "Show answer">}}
The device has its own gateware. FPGAs have been historically under proprietary tools. Fantastic work was done by Claire Wolf and team on developing an open source tool chain for a specific family of FPGA. This work was fundamental for the integration of the modules design in a single board, to allow users do things but also make it user-friendly. This in turn helps the end user, not me, to get the gateware they need. A very good example of that is my work with a non destructive testing (NDT) team. The team did not know anything about FPGAs, but with the visual editor interface, it was easier for them to get their own gateware, by tweaking variables.
There are both VHDL and Verilog designs, but I must say the open-source toolchain has been a game-changer.
{{< /expand >}}
> Where would you rate the maturity of the product in terms of prototype, demonstrator or market ready?
{{< expand "Show answer">}}
The lit3rick is market ready. It's to some extent due to the collaboration with professionals in the sector. The un0rick has been around for a while so that would make it too market ready.
{{< /expand >}}
> Has the hardware been built or produced by others independently?
{{< expand "Show answer">}}
All the source files are shared and are openly accessible. Most of the electronic files are Altium or Kicad, and we're trying to move more towards KiCad.
Some users did their own batches through fabs and produced it on their end. I know of people who have used the designs for their own purpose and they have reused parts completely and did some slight adjustments to the way before sending it for production. I also spotted forks of my designs for tangent purposes, namely tomography, which is a good way to check your designs are evolve independently!
{{< /expand >}}
> Did these people modify it as well?
{{< expand "Show answer">}}
Absolutely. And the great thing is that they also come back with more questions about your initial design and that helps cross-pollinate both projects!
{{< /expand >}}
## Research outputs
{{< card2 "Academic outputs">}}
The community as a core team of maybe five to ten persons. We recently have published a community paper together.
There are also two other papers on the Journal of Open Hardware about the project, and I have published a couple of other less mature notes on Zenodo.
{{< /card2 >}}
> What were the envision envisaged outputs of the hardware development in terms of publications, the hardware itself and documents?
{{< expand "Show answer">}}
The initial objectives was to get something like an arduino of ultrasound in the public space. And then I realized that the documentation was really needed to achieve that.
The documentation itself became a priority, seen as a lab log, which was supported by a series of script to help classify and manage the information and data generated during experiments.
The data itself of the experiments is tagged with metadata that allows to find back what were the conditions of the experiment. The same applies to pictures, using for example the EXIF tags. I have been running the scripts since 2016, and they are still used in generating the documentation. It’s been real helpful not only for me, but also for example to onboard people: I can point them to a session where I tried tomography and where we would find the gateware for the FPGA. They would find the corresponding scripts , and reuse them relatively easily. That became the primary output.
{{< /expand >}}
{{< card2 "Hardware importance">}}
I think, the board and documentation have been the focused outputs. The publications and community are outcomes.
{{< /card2 >}}
> Did you publish your project findings in relation to the hardware somewhere?
{{< expand "Show answer">}}
There are a couple of papers that are not exceptional, to be honest, but at least the knowledge is out. There are two papers in the Journal of Open Hardware, plus a couple notes on Zenodo. These note usually are PDF that double as zip files: you get access the source files by renaming and unzipping the PDF. The rest of materials, more day to day related, is archived on GitHub.
{{< /expand >}}
{{< card2 "Publication strategy">}}
There were couple of publications on, for example, the Journal of Open Hardware, which helped raise the profile of the project. The core content ar eonline material, which would be in GitHub and Zenodo, and the rest is published on GitHub.
{{< /card2 >}}
> What kind of information have you shared regarding the bill of materials, CAD files and assembly instructions?
{{< expand "Show answer">}}
Project is mostly electronics so you will find the usual gerbers, BOMs, and kicad or altium files. There are no mechanical elements, so we have no CAD files
{{< /expand >}}
> How did you publish the hardware besides in journals? Did you publish the hardware overall?
{{< expand "Show answer">}}
Hardware files and documentation in general lives mostly in GitHub. The core publications are online material, which would be in GitHub and Zenodo. I think we used arXiv for preprints, too.
{{< /expand >}}
> Why did you choose these platforms?
{{< expand "Show answer">}}
GitHub is an easy one - because that's an easy to use and universal documentation and version control platform. Zenodo, for the same reasons, in terms of documentation release.
{{< /expand >}}
> Were there any barriers in using these platforms?
{{< expand "Show answer">}}
The learning curve for GitHub is low if you're doing software already. Zenodo is also straightforward.
I experimented with a platform called upverter, which is an online hardware editor. Some designs are still available there but not maintained, as I'm trying to keep the constraint of using open, commonly used tools.
{{< /expand >}}
> Is there anything you didn't publish?
{{< expand "Show answer">}}
Apart from holiday pictures, I believe most topics are documented, even things that might be less relevant for users. When it comes to the hardware, everything is published.
{{< /expand >}}
{{< card2 "Successes and failures">}}
I have no objectives unless having fun. It was successful in having fun. And failure to adapt to components availability can cost a lot of resources.
{{< /card2 >}}
> What was successful about the project and what wasn't successful?
{{< expand "Show answer">}}
That's another good question! You can be successful if you know your objectives - and I have no objectives apart from having fun. It was successful for this, this and meeting a dedicated community.
Less successfull.. managing components supply chain - it is a skill we don't all have.
{{< /expand >}}
{{< card2 "Local production">}}
Most of the most complex, mature boards are in collaboration with a professional fab. Because the community is global, we have a global preferred fab. Apart from ready-made devices, community members also produced their own devices, and devices variants, based on the shared documentation.
{{< /card2 >}}
## Participants
> How did you end up working on the project?
{{< expand "Show answer">}}
That is mostly due to the frustration of not contribution to open source. I do believe that giving back to the commons and being open are some of the ethics when you're into technology. It's about how can we, as individuals and organizations, safely contribute and give back to the commons.
{{< /expand >}}
> How many members have worked on the project and hardware?
{{< expand "Show answer">}}
It depends on your metrics. I've done a bit of publication on Hackaday at the beginning, where the project has close to 2800 followers. Our slack has around 300 users, which is my only metric for the moment. Say 2800 interested, 300 talking members, 10 to 20 doing actual development, and possibly 10 to 20 papers or theses using the hardware.
{{< /expand >}}
> Do you know anything about the occupations of the people that have worked on the project with you?
{{< expand "Show answer">}}
Most of them are ultrasound professionals, researchers, or start ups. Startups usually seek hardware, equipment and advisors. There are also teachers who use the devices for their courses.
If you look at the map of the purchases, there is a higher density, for example, in east Asia, with a very strong medical imagery ecosystem as well. In the States or Europe, the orders come from mostly universities, a few startups and individuals.
{{< /expand >}}
> Have all these different groups contributed to your project? How many people have contributed?
{{< expand "Show answer">}}
Maybe to 10 to 20 people have regularly contributed and 5 to 10 have rarely contributed.
{{< /expand >}}
> How did you find suitable project members to contribute?
{{< expand "Show answer">}}
I'm not finding them, they are finding me. I'm currently not really active, but maintain a room open for discussion. People drop by and some stay, and contribute if that aligns with their needs and aspirations.
{{< /expand >}}
> How did you coordinate the work between the members?
{{< expand "Show answer">}}
Our communication channel is open about what is happening at a given point: the community members have their own projects and talk about them, and what they're doing. I can coordinate by saying here is X and they are doing Y.
{{< /expand >}}
> Can you say how the members or the contributors have benefited from their work on the project?
{{< expand "Show answer">}}
Users in general benefit because they have access to dedicated, simple hardware. Contributers are usually curious people. They are looking to learn and try things. Maybe that's a bias in selecting and engaging with the community. Most of the active contributors have this willingness to share back. A couple of professionals wanted to have tools and are stuck because they found a cool place to share. One of the categories of the contributors would be academics and researchers with an obligation to publish. With that respect, they've shared, for example, a master thesis or their research work.
{{< /expand >}}
{{< card2 "Personal gain">}}
The main benefit is, to be honest, that I have a blast learning and connecting with a community of like-minded makers.
Also, having a meaningfull challenge can be fun, asI see value in providing something to others. The users are getting access to a technology that they wouldn't have access to normally.
I do believe that giving back to the commons and being open are key values when you're into technology.
{{< /card2 >}}
> How did you benefit from the project?
{{< expand "Show answer">}}
I benefited by learning and talking to people with great ideas: people that came in are amazing. It's also about this intellectual challenge. I am not an electrical engineer, but a research engineer and having a physics or electronics challenge is refreshing.
{{< /expand >}}
> Would you do it again if you if you think back?
{{< expand "Show answer">}}
Yes, definitely. Hardware takes time and you need to take time. That allows you to reflect on what you do. I also like this process because it give me a different perspective on software development. Definitely would do it again.
We are discussing the same adventure in a different space right now with an opportunity in the open MRI space. Right now, talking with the community (mostly in Berlin) is opening a door to the next challenge. I'd definitely love to access to an MRI machine, better understand how it works, and work on the open-hardware magic!
{{< /expand >}}