Virtual Virtual Production Studios

tags: devlog metafactory m3 vrchat

• https://webaverse.ghost.io/storyweaving-with-ai/
• Internet Cinematic Universe
  • ICU avatars
• https://substance3d.adobe.com/magazine/digital-backlots/

Virtual production DAO proposals

• https://gov.metafactory.ai/t/proposal-mf-content-production/317
  • https://gov.metafactory.ai/t/proposal-vr-fashion-shoots/362/2

Background

We've been building VR studios in VR for years and have used them to record podcasts, music videos, shows, and other forms of content.

Physical Vprod Studios

Still costs millions

The the cost of filmmaking has gone down thx to consumer VR hardware, AI, and realtime game engines.

https://www.youtube.com/watch?v=Hjb-AqMD-a4&t=125s

Metaverse Studios

Github: https://github.com/gm3/vTuber-SDK3
Twitter: https://twitter.com/boomboxheads

We want to tell stories from the metaverse that is about the metaverse. Human actors not needed in this case.

End of green screen

https://twitter.com/vr_hai/status/1493731994769010689
Visit in VRChat: https://vrchat.com/home/world/wrld_532efaae-2f40-4f1d-a060-1d75719f5c2d

Optimized plug-and-play realtime area lighting using the linearly transformed cosine algorithm for Unity/VRChat. Free to use with attribution.
https://github.com/pimaker/ltcgi

Video player used: https://github.com/MerlinVR/USharpVideo/releases/tag/v1.0.0

Coldie shoot

Studio tests

Photo studio mode

Few more behind the scenes shots in the studio. We're used to building VR studios in public and want to make virtual production radically accessible for indies. This means not needing much besides a VR headset

Improvements

area lit shader

Shadermotion / Udonmotion

• https://gitlab.com/lox9973/ShaderMotion
• https://gitlab.com/lox9973/UdonMotion

NFT NYC

Lume Studios

TV Tower / Wall

f

Video screens

Indie Vprod Gear

Vicon Optical Motion Capture system: You can think of this as a VERY high end Steam VR system for tracking humans, props, and cameras.

PRICING: this "INDIE" Vicon system is ball park $50K US. There are smaller configurations as well.

Watch on Youtube: https://youtu.be/oCXVdTjN5Lw

• Xsens for body suit (from $3800)
• Manus gloves for hands ($5200)
• HMC + ARkit for face tracking

Must see channel: Xanadu https://www.youtube.com/channel/UCd7Sf-HvhwirCnBpADqAr5A

Twitter: https://twitter.com/pwnelon

Head Mounted Camera

This "entry-level" HMC indie helmet costs $30k: https://facewaretech.com/pricing

FaceCam iphone HMC costs $1250

DIY setup: for more stability add a counterweight.

Facecap Software

VRChat OSC

• https://booth.pm/en/items/3670870
• https://booth.pm/en/items/3663253
• https://booth.pm/en/items/3837150
• https://booth.pm/en/items/3694697
• https://booth.pm/en/items/2301835
• https://booth.pm/en/items/3480610
• https://booth.pm/en/items/3687658
• https://booth.pm/en/items/3686598
• https://booth.pm/en/items/3667516

Unreal engine

fbx/gltf export that, bring into vrchat, multiplayer there with udonmotion / openvr recorder
then export animation to bring back into unreal

Shop Design

Shop NPC

Issues

Disappearing builder menu for VRChat SDK

Notes

matrix awakens ue5: https://www.youtube.com/watch?v=WU0gvPcc3jQ

vprod unreal engine, live geo sculpting: https://www.youtube.com/watch?v=gUnxzVOs3rk

Virtual Production: Are You Game? | Produced by the Academy's Science and Technology Council
https://www.youtube.com/watch?v=FRc1HvSqjpg

https://youtu.be/FRc1HvSqjpg?t=922

Virtual Production Sizzle Reel 2022 | Unreal Engine
https://www.youtube.com/watch?v=_oMH_gy7r60

Reminds me of The Sandbox world in VRChat by splinks

Filming in a Virtual Environment w/ Matt Workman (Lighting + Parallax effect)
https://youtu.be/Hjb-AqMD-a4?t=125

https://github.com/Foorack/UdonXML
https://architechvr.booth.pm/items/2536209
https://labthe3rd.gumroad.com/l/ThePartyZoneVideoPlayer

https://plask.ai/