---
title: Virtual Virtual Production
description: Hollywood is slipping into the cloud; Consumer VR hardware, AI, and real-time game engines is democratizing filmmaking at exponential speed.
image: https://i.imgur.com/b1dAL36.jpg
robots: index, follow
lang: en
dir: ltr
breaks: true
disqus: xrdevlog
---

# Virtual Virtual Production Studios

###### tags: `devlog` `metafactory` `m3` `vrchat`

{%hackmd theme-dark %}

- https://webaverse.ghost.io/storyweaving-with-ai/
- [Internet Cinematic Universe](https://twitter.com/dankvr/status/1426955962804494338)
- [ICU avatars](https://twitter.com/dankvr/status/1434657133707075587)
- https://substance3d.adobe.com/magazine/digital-backlots/

**Virtual production DAO proposals**

- https://gov.metafactory.ai/t/proposal-mf-content-production/317
- https://gov.metafactory.ai/t/proposal-vr-fashion-shoots/362/2

**Background**

We've been building VR studios in VR for years and have used them to record podcasts, music videos, shows, and other forms of content.

{%youtube WaTeheSCbgI %}
Watch on Youtube: https://www.youtube.com/watch?v=WaTeheSCbgI

---

## Physical Vprod Studios

Still costs millions


The the cost of filmmaking has gone down thx to consumer VR hardware, AI, and realtime game engines.




{%youtube Ufp8weYYDE8 %}
Watch on Youtube: https://youtu.be/Ufp8weYYDE8

https://www.youtube.com/watch?v=Hjb-AqMD-a4&t=125s


---

## Metaverse Studios

Github: https://github.com/gm3/vTuber-SDK3
Twitter: https://twitter.com/boomboxheads

We want to tell stories from the metaverse that is about the metaverse. Human actors not needed in this case.



### End of green screen


https://twitter.com/vr_hai/status/1493731994769010689
Visit in VRChat: https://vrchat.com/home/world/wrld_532efaae-2f40-4f1d-a060-1d75719f5c2d

Optimized plug-and-play realtime area lighting using the linearly transformed cosine algorithm for Unity/VRChat. Free to use with [attribution](https://github.com/pimaker/ltcgi#Attribution).
https://github.com/pimaker/ltcgi

Video player used: https://github.com/MerlinVR/USharpVideo/releases/tag/v1.0.0






### Coldie shoot





#### Studio tests



### Photo studio mode

Few more behind the scenes shots in the studio. We're used to building VR studios in public and want to make virtual production radically accessible for indies. This means not needing much besides a VR headset




---

### Improvements

area lit shader
https://www.youtube.com/watch?v=DRXKeS-uvcY
https://lox9973.booth.pm/items/3661829

Shadermotion / Udonmotion

- https://gitlab.com/lox9973/ShaderMotion
- https://gitlab.com/lox9973/UdonMotion


---

## NFT NYC

### Lume Studios

### TV Tower / Wall






f



#### Video screens







---

## Indie Vprod Gear

Vicon Optical Motion Capture system: You can think of this as a VERY high end Steam VR system for tracking humans, props, and cameras.

PRICING: this "INDIE" Vicon system is ball park **$50K** US. There are smaller configurations as well.

Watch on Youtube: https://youtu.be/oCXVdTjN5Lw

- Xsens for body suit (from $3800)
- Manus gloves for hands ($5200)
- HMC + ARkit for face tracking

Must see channel: Xanadu https://www.youtube.com/channel/UCd7Sf-HvhwirCnBpADqAr5A

Twitter: https://twitter.com/pwnelon

{%youtube wSx472esQps %}
Watch on YouTube: https://www.youtube.com/watch?v=wSx472esQps


### Head Mounted Camera

This "entry-level" HMC indie helmet costs **$30k**: https://facewaretech.com/pricing


FaceCam iphone HMC costs **$1250**

DIY setup: for more stability add a counterweight.

{%youtube yhcMOn996hs %}
https://www.youtube.com/watch?v=yhcMOn996hs

### Facecap Software



---

### VRChat OSC

- https://booth.pm/en/items/3670870
- https://booth.pm/en/items/3663253
- https://booth.pm/en/items/3837150
- https://booth.pm/en/items/3694697
- https://booth.pm/en/items/2301835
- https://booth.pm/en/items/3480610
- https://booth.pm/en/items/3687658
- https://booth.pm/en/items/3686598
- https://booth.pm/en/items/3667516

---

## Unreal engine


fbx/gltf export that, bring into vrchat, multiplayer there with udonmotion / openvr recorder
then export animation to bring back into unreal


### Shop Design




### Shop NPC



---

## Issues

Disappearing builder menu for VRChat SDK

---

## Notes

matrix awakens ue5: https://www.youtube.com/watch?v=WU0gvPcc3jQ

vprod unreal engine, live geo sculpting: https://www.youtube.com/watch?v=gUnxzVOs3rk

Virtual Production: Are You Game? | Produced by the Academy's Science and Technology Council
https://www.youtube.com/watch?v=FRc1HvSqjpg

https://youtu.be/FRc1HvSqjpg?t=922

Virtual Production Sizzle Reel 2022 | Unreal Engine
https://www.youtube.com/watch?v=_oMH_gy7r60

Reminds me of The Sandbox world in VRChat by splinks

Filming in a Virtual Environment w/ Matt Workman (Lighting + Parallax effect)
https://youtu.be/Hjb-AqMD-a4?t=125

https://github.com/Foorack/UdonXML
https://architechvr.booth.pm/items/2536209
https://labthe3rd.gumroad.com/l/ThePartyZoneVideoPlayer

https://plask.ai/