Try   HackMD

WebXR Workflows

tags: m3

Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →
UNDER CONSTRUCTION
Image Not Showing Possible Reasons
  • The image file may be corrupted
  • The server hosting the image is unavailable
  • The image path is incorrect
  • The image format is not supported
Learn More →

Build the open metaverse map from the creator perspective

Twitter Spaces Notes

Intro

  • Jin (@dankvr): A lot of interesting/fun ways to create
  • Twitter Spaces wil be recorded
  • @raribledao Rarible Protocol DAO (Marianna?) Introduction:
    • Today will focus on producing in VR and WEB XR workflow
  • Jin: The main drive for building on WEBXR optimizing assets for performance
    • Pain points and higher friction exist when bringing creations to the web, vs bringing assets from the web to other platforms which is less difficult
    • Creating for the web - possible for anyone to get involved
    • Many ways to create experiences on the web
    • Tried a lot of tools- some are more efficient and fun than other
    • Collaborative worldbuilding will be a gamechanger
    • How to make a truly unique environments?
    • Multiplayer VR creation tools are the future (hangout and paint and create together)
    • Picking up blender from scratch is hardmode

What tools are being used?

  • Sketchfab
  • Blender (plugin saves a lot of steps)
  • Unity Platter Exporter (gltf exporter)
  • Tilt brush
  • Open brush (@openbrushapp) - awesome roadmap
    • Sketchfab upload

Discussion

  • @yinch
    • WEBXR tools exist that are more fun than Blender
  • Jin
    • #VARTISTE "the GIMP of VR"
    • NEOS VR worklfows between NEOS Blender and WEBVR
    • Timelapse video links- creating out a collaborative world in VR
    • Creating in VR is a great way to view source
    • AV/ AUDIO reactive
  • @yinch
    • Mentioned Castle builder- an example Unity exporting to 3JS
    • Closed source to open source
    • Multi User Avatar Support
    • WEBXR tools - Spray Space, Graffiti art utility
      • Start with a wall and you spray onto it
      • A very physical experience
      • No Undo (realistic experience)
      • Just fun to interact with
    • Vartiste allows to import URL
    • Closed loops are very powerful
    • WEBXR creation tools could eventually be like a factory line of creation
  • Jin
    • Castlebuilder Needle Tools- Fun audience experience
    • Watching a world being built around them
  • @yinch
    • VR streaming will be big like video streaming in the future
    • VR Chat is getting close but not exactly
  • Jin
    • VR Chat wrist chat stream hologram creates a connection from Twitch streaming to VR experiencing
  • @yinch
    • Immersive storytelling needs are not yet a natural skill for screen designers, but bringing in more people like Live action role playing,
    • OnboardXR - Twitter link
  • Jin
    • Webaverse integrated GPT3
    • Can connect to 3JS
    • Seeing the code can help accelerate learning code languages
  • @yinch
    • Codepen is a good example of viewing code and the output creation (side by side) as a learning tool
    • Recreating that learning experience in VR - you can see the code and the experience at the same time
    • Hoping the metaverse can be open by design so people can help produce a shareable and open ecosystem
  • Jin
    • NEOS - viewing source through a node graph - easy to understand logic flow
    • Like schematics
    • Just as important as "view source" is for the web
    • If there is a program that could export to different platforms
    • Spoke opensource 3D editor Avatar creation platform
    • Spoke has been forked to export to a number of different platforms
    • Would be great if a tool like Spoke to export to a number of different platforms (like how photoshop can save to a large number of different file formats
  • yinch
    • Is the solution being able to export to different formats? or to find an agreed upon standard?
    • GLTF/GLB are good standards
    • But what are the missing pieces for a cohesive standard that all platforms can support?
  • Jin
    • Extensions discussed by a working group (missed the name)
    • Currently working on an audio extension into GLTF
    • Particle extensions etc are possible
    • These can emerge from a making community building off of file format standards
    • GLTF is still not supported by game engines like Unity
  • yinch
    • Unreal engine builds have all the assets in the build package but won't reach communicate with external assets
    • Are some of these engines being built for the metaverse designed for consoles?
    • Creators in community need the right tools
    • Interested in tools in "web by nature/design"
  • Jin
    • working on a 1.0 spec for VRM
    • Adoption on VRM has been wonderful for the space
    • VRM benefits the ecosystem because the metadata is packed into the file itself (rights/useage)
    • Useage rights are important and can be packed into VRM files directly
  • Marianna
    • Interested in castlebuilder spacerace
  • Jin
    • Foley (audio creation) will be important for VR experiences moving forward
  • yinch
    • Side feature of (framevr.io) has a spectator mode
    • Allows a view without a viewable avatar
    • Like a zoom for WEBXR
    • Used for educational purposes
    • framevri.io is built for people that are less familiar with opensource quirks
    • need to be aware of as early adopters- conventions are built into our thinking, but in order to reach more people it needs a visible paradigm that most people understand
  • Jin
    • Decorating buildings/ having a collection of 3D assets
    • Frame/ Hubs/ Oculus Home have assets
    • Metaverse Architects will create assets that people
  • yinch
    • As technolgoy becomes effective it will be used for what people do regularly alread, entertainment, work etc
    • Why did myspace fail vs FB? What will become the metaverse?
  • @Steveorevo Stephen Carnum
    • There will not be a singular platform that is the metaverse
    • Difficulties in WEBXR - Playcanvas (powerful engine)
    • native app is a huge hurdle

Asset Gathering

Textures

Vartiste

https://twitter.com/zach_geek

import from URL if low poly

Space Race

WebXR, Florine making it multiuser
Spray can on wall, multi-user coming soon
Can drag crates on wall
No undo

Blender

Many use blender. There have been blender exporters to janusvr, aframe, and webaverse.

Blender -> VR -> VRChat
https://twitter.com/Maebbie/status/1268294663204753408

Blender Sketchfab import

Spoke

Primarily used for exporting to Hubs, can be used for exporting to other platforms too.

Hubs can be great for brainstorming and check-ins

Spoke to Webaverse

https://twitter.com/dankvr/status/1360060322850217986

Unity

Castle sandbox demo
https://twitter.com/marcel_wiessler/status/1484980712889589768

Spline curve camera movement from unity -> threejs website
https://twitter.com/marcel_wiessler/status/1481295852836642816
https://twitter.com/marcel_wiessler/status/1481253623686381570

De-Panther Unity -> WebXR exporter

Janus

Export to JML, json, glb, aframe, DCL typescript

Get some cool videos

VRChat

VRChat world -> Unity engine
Lyuma RT

Neos

Test 1

  • gather assets (models, textures, sounds)
    • can use blender to make custom stuff
  • import into neosvr by drag n' drop
  • position / scale / rotate / duplicate in world
    • this can be multiplayer + VR
  • optional: can export PBR mesh gltf out of Neos

Test 2

  • make avatars / worlds together in
    @neos_vr
  • export from Neos into gltf, webxr, blender
  • tweak / share / sync from a webxr site or in blender
  • export from blender to webxr / glb / vrm / Neos

Timelapses

https://twitter.com/Frooxius/status/1187585331496927232

https://twitter.com/jasonmo_/status/1237853004839055360

https://twitter.com/Hamadori_vrq/status/1336334557595881479

Anarchy Arcade

One of the best 2D editor experiences

Playcanvas: fully online editor, hosting and playback

Open source engine / UI
Multi-player unity like engine

SpraySpace: Spray Painter

SpraySpace: WebXR Spray painting simluator https://sprayspace.art/

FrameVR

https://framevr.io

100 participants
3rd person view coming soon

Creator Highlights

Maebbie

Blender -> VR -> VRChat / Webaverse
https://twitter.com/dankvr/status/1371227298989494275

Marc-0-Matic

https://twitter.com/marc0matic


portals of webxr creation tools next to each other
castle builder | vartiste | space race

real time world building entertainment stream
neosvr performance art

ppl learning javascript
webaverse gpt-3 integration
code-pen + gpt3

spirit of sharing how to make stuff
open source schematics
view-source