**Breath by Breath an exsplortation of the power of breathing**

Considering the challenges raised by the complexities of modern technology, personal data capture, algorithms, and AI, I set myself the challenge of designing a wellness app based on Qigong meditation techniques that effectively attempts to create calm in our endlessly busy and overwhelming world. How can such an app mitigate the constant manipulation and nudging by powerful algorithms and promote authentic well-being and mindful behaviour amidst the pervasive influence of these technologies, while leveraging these very same technologies to achieve its goals?**

Joe Wicks Body Coach app screenshot
Qigong meditation youtube screenshot

**Introduction the problem**

'The cultivation of mindfullness is ultimatley a matter of life and death, not in a scary way, but in the sense that we are always at risk, in every moment, for missing what is deepest and richest in our lives, the texture of the tapestry inself. We might say {every pun intended} that the richness lies right beneath our noses in any and every moment.

Forward from brath by breath Jon Kabat-Zinn

**Project Objective:**

In an era where technology and the digital world dominate our daily lives, creating a sanctuary for calm and focus has become increasingly crucial. The project aims to develop a virtual reality (VR) experience centred on Qigong practices, providing relaxation and comfort to users experiencing anxiety and distress. By leveraging the immersive capabilities of VR, this wellness app aspires to transcend the traditional fitness programs available on the internet, taking user engagement and effectiveness to the next level. This app, designed for platforms like the Meta Quest, seeks to offer a truly immersive, mindful experience that could be accessed from the comfort of one's home.

Engaging in a daily exercise regimen, such as Joe Wicks' fitness program, coupled with a consistent meditation practice, can significantly enhance one's focus and calmness throughout the day. However, these activities typically occur in the confines of one's living room or bedroom, potentially limiting their transformative potential. By bringing users into a shared virtual space with their instructor, the VR Qigong app can foster a more intimate and impactful experience. This virtual proximity can mimic the benefits of in-person sessions, making users feel more connected and engaged.

A walk in nature is inherently healing, and the breathing techniques and fluid movements of Qigong amplify this sense of calm and alignment. However, many people today find themselves increasingly detached from the natural world, living in a fragmented digital existence characterised by constant screen time. This disconnection contributes to heightened anxiety and a sense of disorientation. Ironically, while it may seem counterintuitive to use yet another screen-based device, VR headsets offer a unique opportunity to escape the complexities of reality and enter a serene, controlled environment conducive to healing and mindfulness.

For those unable to retreat into nature, whether due to health issues, disabilities, or other constraints, the VR Qigong app can serve as an invaluable tool. It offers the therapeutic benefits of a natural retreat without the need to leave one's current surroundings. In hospital settings or for individuals with limited mobility, the app can provide a much-needed respite and a means to cultivate inner peace and well-being. This innovative approach harnesses the very technologies often blamed for increasing stress and anxiety, repurposing them to foster a sense of tranquillity and mental clarity.

**A Brief History of Breathing and Qigong**

In today's world, where stress, anxiety, and depression are increasingly prevalent, prioritising our health and well-being is paramount. Embracing a virtual Qigong experience offers a transformative opportunity to nurture ourselves amidst life's demands. Rooted in ancient Chinese medicine, Qigong serves as a powerful tool to realign the body's vital energy, known as Qi or Chi. Through mindful breathwork and gentle movements, participants harmonize their inner energy, fostering both physical and mental well-being. Unlike more physically demanding practices like yoga, Qigong's approachable nature invites individuals of all fitness levels to engage in a holistic journey toward better health. By embracing the principles of Qigong, we embark on a path of self-care and inner balance, essential for navigating the complexities of modern life.
With the ease of a VR headset, users can quickly learn basic Qigong exercises and integrate them into their daily routines. The burgeoning landscape of virtual reality (VR) games includes notable titles like Tripp VR and Greener Games, which have ventured into creating immersive VR meditation experiences. These platforms facilitate meditation sessions within the virtual realm, offering an intriguing and accessible means to practice mindfulness and enhance overall well-being.

**Artists creating minful experience**

**Project Components First Phase**
1. User Experience Design:
Create an immersive, calming environment from the outset
Ensure the interface is intuitive and visually appealing.
2. Visual Design:
I based the initial concept on a Chinese vase from the Manchester Museum I imagined the vase would appear to be floating in space, allowing users to interact with it.
3. Interactive Features:
Enable users to examine the painting on the vase before entering the environment.
Implement a smooth transition from the vase painting to the immersive environment.
4. Guided Sessions:
Introduce a Guru character via a butterfly particle system.
Guide users through Qigong movements in a tranquil setting.

The primary objective of this project is to create an application that places users in an environment that is immediately calm and peaceful. This environment will allow them to feel comfortable enough to follow along with each Qigong movement, ultimately leaving the app feeling more centred and in touch with themselves.

The initial user experience is designed to be both visually captivating and soothing. Upon launching the app, users would see the vase floating gracefully in space. They would have the opportunity to examine the intricate painting on the vase by interacting with it. This interaction will trigger a seamless transition into an immersive environment inspired by the artwork on the vase.

Once inside this environment, users will encounter a Guru character, introduced via a butterfly particle system. This system will gently guide users through a series of Qigong movements, enhancing their sense of tranquillity and mindfulness. The goal is for users to feel a profound sense of calm and self-awareness after each session, fostering a deeper connection with themselves.

**Retreats and inspiration**

padmaloka retreat centre

adhisthana retreat centre

**Practical work**

**Concept Art**







Concept art for enviroment

**Design Elements:**

Designing the Hero Asset: The Qigong Guru

Addressing technical challenges, the decision was made to keep the Qigong guru unclothed due to the complexity of implementing cloth simulation within the animation framework. Despite this limitation, the focus remains on ensuring the guru embodies the essence of Qigong wisdom and serenity.

Originally, the experience centred around interaction with a Chinese vase, with imagery appearing around the player upon interaction. However, revisions to the VR experience have led to a narrative shift. Users now embark on a journey within the VR garden, encountering a stone Buddha that animates upon interaction, initiating the meditation process.

A vision of studio Ghibli magic infuses the world, inviting players to immerse themselves in a captivating garden lost in time—a Zen Garden adorned with overgrown stone structures, invoking a sense of enchantment and tranquillity. The gaze of the user is carefully structured to enhance their experience, drawing inspiration from early concept art based on retreat centre gardens and incorporating Zen elements to create a serene atmosphere.

The creation of a beautiful matte painting serves as the cornerstone of the virtual environment, with meticulous attention paid to ensuring the guru remains the focal point, radiating wisdom and guidance. Drawing upon references such as the Hokusai Manga for landscape inspiration, the painting process combines traditional painting techniques with photo bashing and 3D elements, resulting in a visually stunning and immersive world worthy of exploration and introspection.

**First Storyboard Initial Drafts**


Stripped down storyboard
The storyboard was initially too complex and technically challenging, so it was simplified to its essential elements.

**Guru design**


Screenshots

**Exploration of Virtual Reality and Qigong**

The project idea initially emerged from a bursary application focused on fostering cultural friendship between China and the West. I was tasked with writing a proposal for a project that would bridge this friendship through art practice. My interest in meditation, wellbeing, and Chinese practices such as Tai Chi and Qigong inspired my proposal.

Having recently engaged with several VR games and completed an AR project, I ambitiously proposed creating a virtual reality experience, despite my lack of experience in developing VR interfaces or practicing Qigong.

By harnessing the power of VR technology, this project aims to transport users to serene and tranquil environments, fostering mindfulness and relaxation. Tripp VR, for example, offers an immersive journey into meditation through captivating visuals and immersive soundscapes, prioritizing user experience with a diverse array of environments and meditation techniques. Similarly, Greener Games focuses on creating environmentally conscious content, resonating with users seeking mindful engagement while advocating for sustainability. Their VR meditation offerings provide users with experiences designed to harmonise mind, body, and environment.

The concept for this project stems from personal experiences during Buddhist retreats, which transcend mere breaks from daily life. These retreats involve extended periods of meditation and silence, allowing thoughts and ideas to naturally emerge as the mind settles, akin to sediment settling in a river stream. The VR Qigong demo represents an intersection of interests in CGI and Buddhism, with the setting inspired by Zen Buddhist gardens and the exercises taking place beside a tranquil Koi Pond.

To enhance the VR experience, integrating elements of nature is pivotal. Nature and human connection have been shown to significantly benefit well-being by reducing stress and anxiety. By drawing inspiration from nature and incorporating its soothing elements into the virtual environment, the VR experience can evoke a sense of calmness and serenity.

One proposed approach involves creating a large matte painting featuring images projected onto a 2D plane with lower resolution. This painting can serve as the backdrop for the VR experience, offering participants a visually immersive environment reminiscent of natural landscapes. By leveraging VR video rendering techniques in software like Maya and Premiere Pro, the virtual nature scenes can be brought to life, further enhancing the sense of presence and immersion for users.
To ensure the VR Qigong experience is optimised for user engagement and well-being benefits, implementing a questionnaire for players to provide feedback is essential. This feedback mechanism enables continuous improvement and refinement based on user insights and preferences.
Conducting comprehensive research is imperative for informed development. This includes exploring current studios creating VR meditation experiences, studying their methodologies, and drawing upon relevant research. Investigating university labs conducting VR health and well-being studies offers valuable insights into emerging trends and best practices. Furthermore, conducting primary research through playtesting and engaging with industry professionals, alongside secondary research involving literature reviews and video essays, provides a holistic understanding of the landscape and informs decision-making throughout the project's development lifecycle.

The project is a blend of personal experiences, interests, and aspirations. Drawing inspiration from Buddhist retreats and my interest in CGI and Buddhism, my aim is to craft a serene virtual environment reminiscent of a Zen Buddhism Garden, where participants can engage in Qigong exercises for their well-being. Incorporating elements from Joe Wicks' fitness app, The Body Coach, I envision the Qigong guru as a similar figure but tailored to meditation and mindfulness. This AI health and wellness influencer concept adds an innovative dimension to the project, offering users guidance and support in their meditation journey within the virtual space.

The London Buddhist Centre has a wealth of guided meditations, an aspect I intend to integrate into my work. Additionally, I hope to bring in a Buddhist to do the voice-over for the VR experience, enhancing authenticity and connection.

This project serves as a platform for advancing technical skills and exploring AI techniques. A comprehensive skills acquisition plan will be devised, with clear skill goals and deadlines, integrating industry-relevant practices and visual aesthetics. Maya and ZBrush will be utilized for asset creation, while Unity will be employed for VR development. Additionally, Nuke will be utilized for post-production and composition, with a focus on creating a cohesive and impactful visual experience.
Due to time constraints, it wasn’t possible to paint and make everything for the environment, so all the trees are on 2D planes, rigged and animated to sway in the wind. Originally rendered as a 360 video in Maya with only the guru being animated for the China exhibition, technical issues necessitated multiple iterations and reorganizations. The final product required meticulous organization and collaboration, highlighting the importance of these skills in completing the project successfully.

**Conclusion**

Overall, the project aims to merge technical expertise with creative vision, culminating in a virtual reality experience that transcends boundaries and fosters mindfulness and well-being. Through meticulous planning, research, and skill acquisition, it endeavours to create a harmonious blend of ancient wisdom and modern technology, enriching the lives of its users.

Maya hypershade

A 2d world in 3d space


Learning how to organise my workflow and the project effectively is crucial; everything must be well-structured for success.


The initial plan was never for the guru to be gold and naked. The 3D figure is an avatar from CLO 3D, used due to significant technical issues and difficulties in outfitting the guru. One attempted solution was to apply mocap to a CLO 3D avatar, hoping the outfit would stay on. Although it almost worked, the result was too laggy and the outfit did not fit properly. As a compromise, the guru was textured gold and left without clothing.


I selected four moves that I thought would be easiest for a player wearing a bulky VR headset. I practiced the moves myself using my iPad, and it took about four takes to get the best motion capture for the figure.



I didn't follow the moves I initially planned on the storyboard. Instead, I adapted them to find the right sequence that fit better. The project was then taken into Unity, where the experience was enhanced by the power of the game engine.

**Unity**


**Conclusion of the China Bursary Qigong Project: Versions 1 & 2 and the Unity Version**

Initially, I set out with an overly ambitious vision, underestimating the time required to complete everything. The tight timeline for the exhibition forced me to make significant cuts and simplify the project to its fundamental aspects.

From a learning perspective, this project transitioned me from feeling overwhelmed by Maya and ZBrush to becoming comfortable and proficient with these software tools and the digital art world. I navigated through many stages of the production pipeline, gaining valuable experience with Maya, ZBrush, and Photoshop to complete the initial versions of the project.

Despite the challenges, exhibiting the project was a fun and exciting experience, showcasing the culmination of my efforts and learning.


In the right-hand corner, where the TV is displayed, there's a large blue square where I'm showcasing the Qigong. A film also demonstrates the Qigong movements for those who prefer not to wear the headset.

**Elevating the Project: Integrating Zen VR and Qigong**

After a hiatus from Qigong, I explored an idea inspired by it—a Zen VR meditation garden. Now, I am returning to Qigong, aiming to incorporate the aesthetics and principles of Zen VR. This integration will unify both experiences within the same cohesive world.

**Qigong Two - An exploration into the mythical power of the breath**

Add story of the breath from breath by breath

---

The aim of my research is centred on designing a system that enables users to learn and practice meditation breathing techniques and exercise routines, fostering habits that enhance overall well-being. It prompts reflection on why so many individuals experience poor health and neglect the fundamental practice of breathing, a cornerstone of vitality and strength.
In today's world, there is no shortage of exercise apps, diets, and gyms, yet many fail to achieve sustainable strength or health. Society seems increasingly detached from reality, engrossed in virtual realms and facing the encroachment of artificial intelligence. This prompts critical questions: How do we plan and design for long-term health? How can we relearn the basics of health and breathing effectively?

Exploring the potential of breath within a VR interface and leveraging immersive technologies opens new avenues. How do we design a VR health program that integrates all aspects essential for robust health and vitality? Beyond conventional methods like Qigong and high-intensity workouts, envision a virtual health and wellness bootcamp. Here, individuals explore their own anatomy and biochemistry, guided by the breath to unlock the full potential of mind and body.
What routines will optimize health and strength? What virtual environments will facilitate these transformative experiences? Addressing pressing health issues such as cancer, obesity, and sedentary lifestyles, this program aims to reverse the trend of muscle loss and energy depletion in the population.

Central to this vision are diverse virtual gurus, each offering unique approaches to health and wellness. These guides will lead users through personalized journeys, educating and empowering them to discover their physical and mental capabilities through mindful breathing and exercise.
In conclusion, this research aims to pioneer a holistic approach to health and strength through innovative VR technology, integrating ancient wisdom and cutting-edge science to foster lasting well-being in an increasingly virtual world.

**New Ideas and concept art**
One compelling way to experience Qigong could involve immersing the viewer within a virtual Chinese Jade forest, where the environment dynamically responds to their movements and breath as they engage in Qigong practice.


New storyboard


Avaloketishvara the gardener


Based on the work of artist Arsen Asyrankulov

II aim to transport you from the familiar reality of everyday life into a captivating fantasy. For me, embarking on a retreat means departing from the mundane and immersing oneself in a profound, enriched experience. As the silence takes hold, it gently unearths thoughts buried deep within the mind. Everything begins to settle.

In this tranquil environment, the world seems to glow with intensified clarity and vitality. Your ability to concentrate sharpens, fostering a deeper sense of focus and inner strength.

Guillermo del Toro worlds are deep and saturated with fantastical elements.


With fantastic creatures to lead and guide, he creates worlds that captivate those who inhabit his films.

**Avalokiteśvara development **


Male and female anatomy studies in progress


The jade assets, once abandoned, are now being repurposed. They will be integrated with a shader to simulate movement around the user, appearing as though they are gently swaying in the wind. This includes the guru, also rendered in jade.




Adding detail develpment



It went wrong going down the rabit hole of trying to fix the eyes and making everything else much worse. To fix this went back to an older save.


Maya backdrop ideas

**Unreal**
Due to my extensive experience and comfort level with Unreal Engine, having previously developed a similar VR experience using this software for another project, I decided to integrate this new project into the same universe.

Screen shots of early progress

This environment blends together elements from various concept art pieces. It draws inspiration from my initial Qigong concept drawing, which I couldn't fully realise due to my limited knowledge at the time. With my newfound expertise in Unreal Engine, I can now bring this vision to life.


I am redeveloping the environment in Unreal Engine, expanding it significantly and populating the space with assets from Qixula Bridge.


The wilderness is intended to be an extension of the XR Zen garden game, where users can now participate in Qigong exercises.


Colour Studys


Maya modeling is currently underway to create assets for populating the world.


Large lilly pad constuction in maya


This verison will not take place in China you will enter into an entirely new realm.


Moving forward, I aim to transform the guru from a golden figure into a representation of the interconnectedness of the universe. My plan is to develop a galaxy shader to overlay onto the guru avatar.

**Jewel**
From the preable of the jewel









**APPENDIX**

Project Progress:
Test Animation
https://youtu.be/4VrBnOkMyIU
Test Clo-3D-Fail
https://youtu.be/ne4fMf823yk
Test 01-First Render
https://youtu.be/txi6okUOf0A?si=PNKRsCunr8wyjKma
Test 02-Second Render
https://youtu.be/EXV6o0YfUSs?si=jRFdS8r50wgw5GTy
Test 03-Unity VR Test’s
https://youtu.be/bO1winy3Glg

VR Videos: Versions 01 and 02 were both rendered in Maya and presented as VR videos due to the exhibition deadline. Version 02 is heavily animation-focused, with the entire world animated, while in Version 01, only the guru exhibits animation.

Testing and Development: As I move forward, Test 04 in Unreal Engine will focus on identifying the most engaging elements for players. Testing in Unity will help me understand how users experience the game. Test 05 will then refine the experience based on audience engagement, incorporating new elements.

Project Foundation: Currently, I have established a solid foundation upon which to build the full experience.

Project Reinvention: I am reinventing the project by revitalizing all key elements from the initial Qigong concept, breathing new life into them.

Test 04 in Unreal Engine: Test 04 will be conducted using Unreal Engine to further refine and enhance the project.

**Notes**

**Bibliography**

Mind (2021) How Nature Benefits Mental Health. www.mind.org.uk. [Online] https://www.mind.org.uk/information-support/tips-for-everyday-living/nature-and-mental-health/how-nature-benefits-mental-health/.

‌TRIPP: Fitness for your Inner Self (n.d.) TRIPP. [Online] https://www.tripp.com/.

‌Greener Games (n.d.) www.greenergames.net. [Online] https://www.greenergames.net/.

‌Medina, T. (2023) What Are AI Influencers? A Complete Guide. NEWMAN MEDIA. [Online] [Accessed on 19th June 2024] https://newman-media.com/lets-talk-about-ai-influencers/.

‌London Buddhist Centre (2020) Metta Bhavana - A guided meditation | Ksantikara. YouTube. [Online] [Accessed on 19th June 2024] https://youtu.be/AEhPZpwxAyU?si=Jsx0UowF0pVt6GMJ.

‌Headspace (2023) Meditation and Mindfulness Made Simple - Headspace. Headspace. [Online] https://www.headspace.com/.

admin (2014) Qi Gong...You know, that exercise thingie you see people doing in the Park. Stream Point Wellness. [Online] [Accessed on 19th June 2024] https://www.streampointacupuncture.com/qi-gong-you-know-that-exercise-thingie-you-see-people-doing-in-the-park/.

‌Nguyen, T. (2018) ‘Can Virtual Reality Change Your Mind? | Thong Nguyen | TEDxMinneapolis.’ YouTube.

‌For the curious and interested | British Museum (n.d.) www.britishmuseum.org. [Online] [Accessed on 19th June 2024] https://www.britishmuseum.org/our-work/national/uk-touring-exhibitions-and-loans/current-tours/curious-and-interested.

**Books**
‌
Nestor, J. (2020) Breath : the new science of a lost art. Uk: Penguin Life, An Imprint Of Penguin Books.

Rosenberg, L. (2007) Breath by breath : the liberating practice of insight meditation. Boston, Mass.: Shambhala ; Enfield.

‌Sandeman, S. (2022) Breathe In, Breathe Out. Harlequin.

‌Attia, P. (2023) Outlive. Harmony.

‌Mustafa Suleyman (2023) The Coming Wave. Crown.

‌Lieberman, D. (2020) Exercised : the science of physical activity, rest and health. London: Allen Lane, . Copyright.

‌Narula, H. () Virtual society.

‌van der Kolk, B. (2015) The body keeps the score: Brain, mind, and body in the healing of trauma. London: Penguin Books.

‌Fisher, R. (2023) The Long View. Wildfire.

‌Culadasa, Immergut, M. and Graves, J. (2017) The mind illuminated : a complete meditation guide integrating Buddhist wisdom and brain science for greater mindfulness. Carlsbad, California: Hay House.

‌Easter, M. (2021) The Comfort Crisis. Rodale Books.

‌Haidt, J. (2024) The Anxious Generation. Penguin.

‌Wim Hof (2022) WIM HOF METHOD : activate your potential, transcend your limits. S.L.: Rider.

‌Bryson, B. (2019) The Body. Anchor.

‌Sapolsky, R. M. (2017) Behave : the biology of humans at our best and worst. New York, New York: Penguin Books.

‌Chris van Tulleken (2023) Ultra-Processed People. Random House.

‌Legaspi, C. (2016) Anatomy for 3D artists : the essential guide for CG professionals. Worcester: 3Dtotal Publishing.

Journals

‌Yuan, S., Tao, F. and Li, Y. (2022) ‘The Restorative Effects of Virtual Reality Forests on Elderly Individuals During the COVID-19 Lockdown.’ Journal of Organizational and End User Computing, 34(6) pp. 1–22.

BICHLER, MELANIE. and Bichler, L. (2023) Hiroshige. One Hundred Famous Views of Edo. Taschen.

‌

Websites

https://www.facebook.com/learn.religions (2019) Meet Avalokiteshvara, Buddhism’s Bodhisattva of Infinite Compassion. Learn Religions. [Online] https://www.learnreligions.com/avalokiteshvara-bodhisattva-450135.

http://buddhism.org/Sutras/DHARMA/Tripitaka/ShurangamaSutra2.html
‌
Gallagher, L. (n.d.) Learn. Outgang. [Online] https://outgang.studio/learn/.

‌giant lily pads (n.d.) Stockarch.com. [Online] [Accessed on 28th July 2024] https://stockarch.com/images/nature/plants/giant-lily-pads-3605.

‌
‌
‌