2024 Hacking Noisbridge Notes - March 19th
FEELING UNSAFE UX is horribleBad UX
Goes to a channel of 200 people on Slack
Could use a redesignWho owns safespace.noisebridge.net?
Moon will take this
Onboarding Sign
FrameVR Agents are fully embodied, autonomous, self-simulating and live outside of the frame content. They can connect to frames just like users, and have access to voice and video streams. Agents are fully programmable and customizable, and are decoupled from the FrameVR runtime so that they can run continuously, even when there are no users around, and can connect to other platforms such as Discord and Slack to make the transition from FrameVR to user's standard communication tools as seamless as possible.
Features
Agent Console: Manage agents through a console, enabling teleportation, direct communication, and real-time monitoring.
Task Management: Agents can be programmed with specific tasks and goals, allowing dynamic management by users.
Skill Enhancement: Upgrade agents with new skills through customizable or purchasable code packets.
Home World: Agents have their own home frame, serving as a default location and a space where users can visit them.
Memory: Agents possess an extensive memory, allowing them to recall information from individual rooms and across all agent memories, utilizing advanced vector search and RAG techniques.
Social Media Integration: FrameVR agents can have other accounts. Users can interact with their agent via Discord, Slack, Twitter, Telegram, WhatsApp or SMS.
Billing: Agents can operate in different quality settings, with costs transparently passed on to users and estimated hourly rates provided.
Our friend Diego created Aframe, a framework for making 3D experiences in the web. He wants a documentation bot that lives in their Discord which is aware of all Aframe documentation.
This is a fairly open ended project in terms of specific deliverables: our goal is to make something that gives Aframe users real value and serves as a use case broadly for what we are doing with AI agents.
Research
Aframe - https://aframe.io/
Perplexity.ai - https://www.perplexity.ai/ - Like ChatGPT, but adds sources to responses
We're not using Perplexity but something along the lines of showing a link to the right documentation source would be useful
Cloudflare Discord bot - https://github.com/discord/cloudflare-sample-app
RAG Explanation: https://www.youtube.com/watch?v=u47GtXwePms
// add type to memories
// add type filter to get memories
// add type to all memories database entries
set up stripe
lore manager - priroitize this
update profile evaluator examples
update profile conditions checkeruser has sent more than 10 messages
In the research paper "ChatWorld: Embodied Multi-Agent Simulation For Extensible Synthesis of Hypermedia" we propose a multi-agent simulation application we colloquially name the "Jedi Council", or simply The Council.
The idea of The Council is that we create a governance mechanism for decentralized organizations where users can create proposals and have them assessed and reviewed by an AI simulated version of the real leadership council of the organization.
Our goal with this project is to do the following:
Create a fully realized embodiment of The Jedi Council from the ChatWorld paper
Deploy this embodiment to the web on behalf of M3, with prominent members of M3 present in The Council
Release The Jedi Council as an example project utilizing the Upstreet SDK
Announce and market the project as a collaboration between M3 and Upstreet
Cojourney is about making strong connections that lead to high investment relationships. It's a powerful life coach and friend when you need it, but it also has the ability to connect you to people it thinks would be great for you.
Cojourney is powered by ChatGPT and a powerful autonomous social graph agent. The app is available on the web and on all native platforms, and for programmers you can even give it a try right from your console!
Tech Stack
Node.js
React + Vite
Supabase + PostgreSQL
capacitor, electron and electron-vite
Cloudflare Workers
Welcome to-- wait, I've never seen you before. I can't remember the last time that happened. So, are you a noob? Sorry, I mean, is this your first time? Don't worry, we'll go slow.
HYACINTH: First, turn on your mic. It's that button down there.
USER: Hey, can you hear me?
HYACINTH: I'll be honest, you sound like a nerd.
USER: Uhhhhh-- interrupted
The website is for Upstreet Corporation, who makes Upstreet Engine, Upstreet.chat and The Street. We have a main lander and the rest of the pages don't need much design. We have an art team who can provide renders and art assets of the main characters.
Current deployment of website: https://site-bay-theta.vercel.app/
We'd love a very visual, video game feel, even though it is a corporate site with a couple of products (Chat and Metaverse, as well as an infinite TV show creation platform coming soon!)
Background
The background video is a temp mockup, in place we will have a whole high-end video for parallax scroll effect.
Product Cards
We are looking to make a slick, fresh design for our new app, Upstreet.chat
Overall guidelines
We want to have our own brand identity and do something bold. Something for the Tik Tok generation but NOT Tik Tok.
Current Figma File:
https://www.figma.com/file/w7XUxmvpnvoHhiFBbu25rK/Upstreet
Current App:
https://upstreet.tv/chat
Asset Cache Generation Task
Step 1
Write down a bunch of ideas for characters, with a name and visual description.
50 characters
i.e.
Grimble Greenleef
https://www.npmjs.com/package/react-faq-component
FAQ
What does a free account get me?
You can do anything in Upstreet, but you get a limited number of monthly credits to create content and run the AI playback.
What does a subscription get me?
You'll get a bunch of credits to generate new worlds, characters, props, etc. and play back episodes. You can also disable content censoring, if you'd like. Certain features like streaming are only available to subscribers.
The community we have today is excited and active. Upstreet is a beautiful place in the Metaverse where we can meet, show off our avatars and, soon, so much more.
The initial demo is impressive. But I’m talking to a lot of people who are outside of the crypto community and are looking at this like-- why would you take something so cool and attach all this baggage to it?
As one investor said to me, why crypto?
Why DAO? Why now?
We need to be clear-eyed in our thinking and our actions.
This proposal is to allocate land to the dev team and partner organization, M3.
The dev team did not receive any of the initial allocation of the Webaverse Genesis Pass mint, and only have a few passes themselves. This proposal is to allocate some deeds, with the community's permission, for the purpose of giving the dev team some voting power, skin the game, and tools to build partnerships and trust.
400 Title Deeds for Upstreet dev team (Avaer, Moon and other team members)
- These will be held by the dev team for voting power in the DAO and not sold
- These deeds will only be claimed if the location is used for something to be built there, otherwise deeds will remain unclaimed
100 Title Deeds for partnerships, marketing and other growth opportunities
- These deeds will be given out per the team's discretion primarily to build partnerships with creators we love and win back support from folks who helped us in the past but may have felt disappointed with how things went.
The Overton Window has shifted. We are no longer in a world of Zapier plus Chat GPT. We are no longer automating simple problems.
The birth of fully autonomous AI is upon us.
https://www.kdnuggets.com/2023/04/baby-agi-birth-fully-autonomous-ai.html
We are an AI company building tools for AI companies. To that end, we should be looking at our entire process, end to end, and thinking-- "how can AI make this better?"
We're not the only ones feeling the pain. Remote teams everywhere are trying to keep up with endless information feeds, stay on top of every loose thread, react quickly without spinning in circles and coordinate with partners. We can make better tools, use them and share them.
What is Magick?
Magick is a visual IDE for building AI supercharged apps
Our goal is to lower the bar to accessing models and services so that they can be used in everyday applications by anyone-- not just developers
[picture of magick]
Magick runs locally and enables maximal user sovereignty and ownership. You own your data. You choose what services to run. Magick is open source and built in the open on Discord by our core team as well as members of other teams. If we're going to get there, we have to do it together.
Here is an example of an app powered by Magick. This is a collaboration with Webaverse, an open source AI metaverse project.
[Video of collaboration with Webaverse]
Freescape Todo
We are generating 10,000 NFTs.
That's 10k PFPs, 10k GLBs (un-optimized), 10k GLBs (optimzed), 10k VRMs. These will be on Opensea and available at mint.freescape.io
TEAM
moon - created much of the stuff, helping with DNS, admin things, client interfacing
hedera - wrote the smart contracts and made most of the mint page
daniel - works on the freescape team, responsible for making sure things are good
The following covers all of the AI systems that are running and required for Webaverse to run properly.
Domains
Text Generation
-- Dialog
-- Quests
-- Descriptions
-- Lore
-- Ongoing Story
Working
Voice
Local player voice sends to other remote players
Mouth moves on the avatar on all clients
Chat
Opens up "CharacterHup" (src/CharacterHups.jsx) showing player who is speaking chat