# Upstreet Technical Overview

## AI meeting summary

{%youtube xPEhUnfDFmU %}
Watch: https://www.youtube.com/watch?v=xPEhUnfDFmU

Avaer, one of the founders of M3, talks about Upstreet AI and its features including a multiplayer demo, single player demo, generative age units SDK, and in-world beta apps. The multiplayer tech is scalable and runs on cloud player workers. Avaer also discusses the potential of the metaverse for AGI development and expresses dissatisfaction with current corporate implementations. They express their vision for building a game world called Upstreet where humans and AIS can interact together. Avaer mentions various ideas such as land claims, wearables pets, vehicles, NPCs, gameplay, and integrating AI personalities into the game world. They also mention Moon Shaw's Agent SDK that allows users to run their own private agents in the game world. Avaer highlights other projects they have worked on related to generative AI and expresses excitement about future possibilities in this field. They invite people to join their Discord community for further discussions and share contact information for Twitter followers.

The speaker hopes for an open implementation of AGI agents and expresses a desire to contribute. They are open to questions and suggest using Discord as a platform for discussion. When asked about plans for a VR version, they mention the possibility and state that WebXR works well with some minor crashes. As a single developer, they prioritize different features but hope to implement a token mechanism for user input in the future.

## Action items

Based on the transcript, here are the follow-ups and action items:

- Avaer mentions that the latest incarnation of their work is called Upstreet. The demo for Upstreet is available at Upstreet AI.
- Avaer mentions that Upstreet is a multiplayer demo with a single-player demo, a generative age units SDK, and an in-development build for testing new features.
- Avaer explains that in Upstreet, players can run around, see other people's avatars, and wear their own VRM by dragging and dropping it.
- Avaer mentions that voice chat is now working in Upstreet, and there are in-world beta apps that players can interact with.
- Avaer discusses the multiplayer technology behind Upstreet, explaining that it is an infinitely scalable multiplayer server instance running on cloud player workers. It is sharded based on the chunks of the world players are in, allowing for both local and remote play.
- Avaer expresses the intention to release the multiplayer technology as open source so that others can use it in their own implementations.
- Avaer mentions that text chat is currently being fixed and integrated with all the AI systems in the world.
- Avaer discusses the potential of the metaverse as a path to AGI and mentions OpenAI's recent acquisition of Global Illumination, indicating that OpenAI is likely involved in metaverse research.
- Avaer expresses the desire to build a metaverse that is not corporate and locked down, focusing on creating something fun and community-driven.
- Avaer mentions the plans for Upstreet, including land claims, releasing wearable items, pets, vehicles, mobs, mining, NPCs, and more. The goal is to create an MMO-like experience.
- Avaer discusses the potential for players to inject their own personalities into the game world by using AI agents and mentions the availability of an Agent SDK on GitHub.
- Avaer mentions other features that have been developed, such as companion systems, training AIS on M Three data, and real-time AI perception.
- Avaer mentions the willingness to listen to suggestions and the importance of community involvement.
- Avaer expresses the intention to work on land claims, feature voting, and ensuring a proper multi-signal wallet to avoid issues encountered in previous projects.
- Avaer expresses the desire to include content from other creators and the availability of drag and drop VRMs.
- Avaer expresses the interest in gameplay and creating a game that can be played with others, similar to VGC.
- Avaer mentions ongoing streams and discussions in the M Three discord and invites people to join and provide suggestions.
- Avaer discusses the potential for the game to learn and the availability of AI-based systems for coding and providing advice.
- Avaer mentions the possibilities of generative AI for various aspects of game development, such as audio, 3D art, scenes, and characters.
- Avaer expresses the hope for an open implementation of AGI and the desire to contribute in some way.
- Avaer mentions the possibility of a VR version of Upstreet in the future, but it depends on prioritizing features and resources.

Please note that this is not an exhaustive list, but it covers the main follow-ups and action items mentioned in the transcript.

## Outline

Chapter 1: Introduction to Upstreet and its Features
Timestamp: 00:47-02:58
Overview of Upstreet and its latest incarnation
Mention of the Upstreet AI demo and voice chat functionality
Description of multiplayer and single-player demos
Introduction to the generative age units SDK
In-world voice chat and beta apps for interacting with AI
Explanation of the cloud player workers and sharding system
Chapter 2: Future Plans and Vision for Upstreet
Timestamp: 03:24-06:59
Importance of multiple agents and human interactions in the game world
Comparison to single agent systems and large language models
Mentions of Mark and his own metaverse project
Similarities with other platforms like Cyber and DCL
Focus on community involvement and building with user input
Discussion of land claims and potential for feature voting
Desire to avoid issues faced by previous projects like web verse
Potential for user-generated content and gameplay elements
Chapter 3: Agent SDK and AI Integration
Timestamp: 07:12-09:26
Introduction to the Agent SDK for running private agents in the game world
Availability of JS and Python versions
Desire for more languages and open-source contributions
Mention of companion features and training AIS on M Three data
Possibility of seeking advice from AI through a Jedi Council-like system
Examples of coding AI and exploration of generative AI capabilities
Chapter 4: Excitement for the Future of Generative AI
Timestamp: 09:47-11:40
Acknowledgment of the potential for generative AI in various aspects of game development
Mention of audio, 3D art, scenes, and characters as examples
Integration of real-time AIS and their perception capabilities
Reference to the research on generic agents and AGI development
Excitement about the future of generative AI, but no promises made
Chapter 5: Community Engagement and Future Directions
Timestamp: 11:55-12:38
Appreciation for community suggestions and ideas on land minting and content deployment
Mention of the Discord community and invitation for questions or discussions
Interest in exploring the possibility of a VR version of Upstreet
Desire for an open implementation and potential contribution to the project
Chapter 6: Conclusion and Call to Action
Timestamp: 12:42-13:02
Final remarks on the future direction of Upstreet
Mention of the potential for token mechanisms and weighted voting for features
Desire to contribute to Dwork, Adao, and Webex projects
Open invitation for questions and further engagement

Please note that the chapter titles are inferred based on the content of the transcript and may not fully capture the intended structure or organization.

## Notes

- Upstreet AI is the latest project that Avaer has been working on.
- Upstreet AI is a multiplayer demo with in-world voice chat and beta apps.
- The multiplayer tech runs on cloud player workers and is sharded based on the chunks of the world.
- Voice chat works over WebSockets and text chat is being fixed.
- Text chat is integrated with all the AIS (Artificial Intelligences) in the world.
- Upstreet AI is a game world where humans and AIS can interact and work together.
- Users can chat with AI characters and select from options or use text-to-speech and speech-to-text.
- There are plans to add land claims, deploy user-generated content, and incorporate gameplay.
- Moon Shaw has created an Agent SDK that allows users to run their own private agents in the game world.
- AIs are trained on M3 data and can provide advice on various topics.
- Generative AI can be used to create different aspects of the game, such as audio, 3D art, and characters.
- AIS now have the ability to perceive their surroundings and perform actions based on that perception.
- The future of generative AI and AGI (Artificial General Intelligence) is promising, but no promises are made.
- There are plans to put these games on the blockchain and open implementation is desired.
- There is interest in creating a VR version of Upstreet AI, which is currently in the works.

---

{%youtube tnYf2547QdU %}
https://www.youtube.com/watch?v=tnYf2547QdU

The Metaverse is one of the most important technologies of our lifetime.

It’s already seeded two industries: VR and Crypto.

But the most profound application of the metaverse might be in human-AI symbiosis and the birth of AGI.

The latest research points toward multi-agent embodied simulation as the state of the art technique in AI performance and human-AI alignment.

We wrote a paper on it.

ChatWorld is the system architecture that powers Upstreet.

---

The next phase is only for those who have been with us since the Origin.

Each (1) Genesis Pass held since August 6th, 2023 can be burned for Two (2) Upstreet Title Deeds.

There is no fee to redeem your Title Deeds. Only gas.

Each Title Deed entitles the bearer to claim one (1) plot of land in the Upstreet AI metaverse.

In addition, each Title Deed gives one vote in the Upstreet DAO that decides the direction of the game.

There are 2671 addresses eligible for redemption. Other tokens are not eligible.

There is no way to buy in at this time. You can only REDEEM.


---