# Why Cooperative AI and Blockchain Researchers Should Collaborate **TL;DR:** AI coordination and alignment are *necessary*. Traditional social technologies like policies and regulation are *inadequate for coordinating games with AI agents*. Crypto-economic commitments can provide a key technology for the cooperation among AI agents and help to overcome some of the shortcomings of traditional social technologies. **The crypto sandbox offers a real-world environment for experimenting with AI coordination, while the study of commitments in crypto provides a pragmatic framework for understanding commitment devices and their limitations.** After making the above arguments, we illustrate the synergy between *crypto infrastructure* and *AI agents* via a few relevant examples: 1. Congestion Games 2. Credibility of Commitments 3. Limits of Real-world Commitments 4. Competing Commitments 5. Conditional Commitments 6. Parallels with Decision Theories --- ## Background Crypto-economic systems such as the Ethereum blockchain are [commitment devices](https://medium.com/@virgilgr/ethereum-is-game-changing-technology-literally-d67e01a01cf8) on which *humans and bots play real-world coordination games* at [large scale](https://defillama.com/dexs) and high frequency. The [outcomes of these coordination games](https://explore.flashbots.net/) depend crucially on the design of the commitment device. The area that studies how the design of commitment devices change the values and incentives of the commitment games being played on top of the blockchain is called *Maximal Extractable Value* (MEV). For more information, readers can refer to the References at the end of this document. ## AI Coordination is Necessary The current state of AI, coupled with its future potential for increased sophistication and possible misuse in an unrestricted action space, endows it with the ability to cause great harm. For example, recommender systems in the attention economy have already [impacted](https://www.annualreviews.org/doi/abs/10.1146/annurev-anthro-101819-110356) large scale [political campaigns](https://www.pbs.org/newshour/politics/ai-generated-disinformation-poses-threat-of-misleading-voters-in-2024-election), created an increasingly [fractionalized society](https://cacm.acm.org/opinion/articles/272570-ai-and-politics-how-will-we-know-whatand-whois-real/fulltext) where the *common knowledge of contextual semantics is lost*. This crisis is exacerbated by the generation and [dissemitation](https://www.pbs.org/newshour/politics/ai-generated-disinformation-poses-threat-of-misleading-voters-in-2024-election) of misinformation where humans are *"[eclipse attacked](https://www.geeksforgeeks.org/what-is-an-eclipse-attack/)" by AIs with siloed information echo chambers*. This capability to mislead humans poses a substantial threat to vital societal structures that we rely on for coordination such as trust, corporations, and governments. Why? Because common knowledge, which is the [base of coordination](https://mitpress.mit.edu/9780262562003/reasoning-about-knowledge/), is lost. Moreover, huge negative externalities often arise from the unrestricted empowerment of algorithmic agents, leading to far-reaching effects due to their lack of coordinated interaction. Examples include: 1. **Traditional financial system** - The infamous flash crash events are a prime example. Here, algorithmic trading bots, acting independently, induce economic turbulence by amplifying market volatility. This leads to dramatic price fluctuations that bear no resemblance to the underlying asset's true value. 3. **Online marketplaces** - We also witness these effects in eBay auctions. Sniper bots, operating without coordination, drive the price of commonplace goods to ludicrous levels due to uncontrolled recursive behavior. - Market health suffers when individually trained models, acting without coordination, engage in collusive pricing. In this scenario, the models set prices that disadvantage the majority of market participants. 5. **Onchain economies** - [Adversarial](https://www.forbes.com/sites/jeffkauflin/2022/10/11/the-secretive-world-of-mev-where-crypto-bots-scalp-investors-for-big-profits/?sh=1b1324f22d8d) Player vs. Player (PvP) ["bot wars"](https://arxiv.org/abs/1904.05234) bring about substantial negative externalities for regular users of the commitment device. These uncoordinated activities exacerbate congestion fees, causing ordinary users to [pay more than necessary](https://blogs.cornell.edu/info2040/2022/09/22/priority-gas-auctions-on-ethereum-and-flashbots/). The credibility of the system is also undermined through [time-bandit attacks](https://www.coindesk.com/podcasts/mapping-out-eth-2-0/time-bandit-attacks-on-ethereum-what-they-are-and-how-they-work/) and [reorgs](http://reorg.wtf/). Furthermore, the very existence of the commitment device is threatened due to the [centralization](https://ethereum.org/en/developers/docs/mev/) of the validator set and vertical integration, reducing the pool of disinterested parties maintaining the commitment device (i.e., the mediator/auctioneers collude or [deviate](https://arxiv.org/abs/2301.12532)). ## Inadequacies of Traditional Coordination Tools for Cooperative AI In face of this crisis, our traditional tools for coordination and alignment, like regulation or policies, are not sufficient for the task of coordinating games where participants include algorithmic agents. Moreover, they often impede innovation by restricting growth and experiments, and entrench centralized players who has political capital or is in a previledged position to play power dynamics. For example, despite numerous attempts, governments and regulators worldwide have struggled to effectively control tech giants, evidenced by challenges in areas such as data privacy (Facebook's Cambridge Analytica scandal), antitrust enforcement (Big Tech dominance), content moderation (misinformation on social media), encryption dilemmas (conflicts with law enforcement), labor laws (gig economy issues), and AI regulation (ethical use of AI). The **complexity** and **rapid evolution** of these technologies, coupled with their **global reach**, further exacerbate these regulatory hurdles. The instability of US politics will make the regulation landscape and policy for AI coordination especially hard for the years ahead: political polarization and frequent changes in administrations often cause regulatory lags. But we need to make progress with coordination games of algorithmic agents ASAP, not only for bounding the worst case (safety) but also in enabling the best case (efficiency). ## The Choice is Obvious The ability to form binding, credible commitments efficiently and flexibly offers a wealth of of possibilities for the development of more cooperative AI systems. It forms an important complement to other abilities, such as improved communication, better modelling of other agents, and the creation of norms and for AI systems. These technical approaches in turn form a complement to the traditional social technologies of policy and regulation, which, as argued above, are insufficient for ensuring coordination in the context of sophisticated AI agents. Without an effort to imbue our AI agents with improved cooperative capabilities, such as crypto-economic commitment devices, we risk facing crises and/or power imbalances at an unprecedented scale. We therefore advocate for the development of an AI-compatible crypto-economic infrastructure of permissionless credible commitment devices. ## The Inevitable Evolution of Market Structures <!-- $$$$$ <span style="color:blue">point of this section: i) the adoption of AI turns slow/local games into fast/global games, and traditional technology of coordination was designed for slow/local games, to coordinate fast/global games, we need crypto-economic commitments. ii) there are also many slow games that we need to coordinate to achieve cooperative ai, but slow games are especially hard to study, due to fundamental uncertainty and unknown unknowns (elaborated in https://hackmd.io/@sxysun/crypto-ai as well), so not only are fast games more prevalent, but also more tractable to solve. This adds another reason to study crypto-economic commitments. </span>. <span style="color:blue">need elaboration on point ii)</span>. --> The majority of coordination games currently being played are slow/local games (e.g., a group of oil drillers deciding on their respective share). However, with the rise of AI algorithmic agents, an increasing number of games will be played at a high-frequency setting on a global scale, i.e., they will be fast/global games (e.g., two bots bidding in some auction). We can anticipate an ultra-refined service/labor market where ad-hoc agreements can be made from time to time with various parties who are better suited for the task at hand, eliminating the need for long-term commitments with familiar parties. These games predominantly occur in high-frequency, low-latency environments, necessitating a coordination technology capable of handling rapid and global dynamics. Traditional methods such as trust or violence enforcements are ill-equipped to meet these demands due to their inherently slower monitoring speed and the added burden of extensive monitoring that entrench centralized parties. In other words, the coordination technology we had before is tailored for slow and local games, not for **fast and global games**. As we advance in the field of AI, we foresee an era of **ubiquitous high-frequency trading (HFT) and [hyper-financialization](https://fortune.com/2023/05/18/how-will-ai-chatgpt-change-stock-markets-high-frequency-trading-crashes/)**. AI, in its quest for efficiency, will lead to the creation of markets for nearly every conceivable service or commodity. The coordination games associated with these markets are subject to frequent structural changes, making it infeasible and inefficient to coordinate them by imposing restrictive structures. As demand and supply interact in real-time, new games are constantly being generated. In this dynamic landscape, mechanisms are transient, and millions of bots operate momentarily to achieve a Turing-complete market. Such games are optimally coordinated via commitments that shape agents' incentives on an ad-hoc basis. These commitments can be effectively managed with low verification costs, facilitated by low-latency cryptography and programmable privacy, providing a solution that is as agile as it is efficient. Moreover, studying the coordination of those [fast and global games](https://tinyurl.com/ai-pccd) (e.g., searchers bots [backrunning each other](https://twitter.com/SheaKetsdever/status/1658557697078317064?s=20)) is where we should start, because they are more technical and therefore easier to scrutinize due to their relatively certain structure (uncertainty tends to increase with game duration). We have a reasonable understanding of how to coordinate fast games because they can be structured, allowing us to apply our knowledge from mechanism design and game theory. In contrast, slow games carry so much uncertainty that it often proves counterproductive or even harmful to attempt to structure them. This is why the coordination of slow games frequently devolves into power struggles and politics, which makes it hard to make concrete progress on the AI coordination problem. **For these reasons, crypto presents a tractable path forward for AI coordination and alignment.** We should start experiments in AI coordination with crypto-economic games because the game is far more manageable and certain - and we know how to solve it. After accumulating sufficient data or experience on how AIs behave or coordinate in these fast games, we can progress to extend the game's duration. The argument here is that slow games bear more resemblance to single-agent alignment due to the uncertain game structure. It's always possible for someone to discover an uncoordinated game with a payoff correlated to your existing coordinated game, causing the existing incentive Rube Goldberg machine to collapse. Fast games, however, are more akin to multi-agent alignment because their shorter duration makes them more certain. In essence, when coordinating a slow game, you aim to engineer player incentives in the right direction robustly, to new dynamics and new games being played. This is often impractical to do programmatically, explaining why slow game commitments (e.g., laws, policies) often retain a human discretion element. These commitments need to confront unknown unknowns or fundamental uncertainties, which can only be effectively handled by human intelligence. Alternatively, the commitment can choose to sacrifice efficiency for robustness, meaning it deliberately reduces game structure uncertainty via constraining the action space. But for fast games, the action space is usually limited, so algorithmic agents (commitments) don't have to deal with much uncertainty. As such, there's significantly less demand for increasing the robustness of the commitments. Furthermore, these commitments don't need to be complex because they are expected to expire shortly after the fast game concludes. ## The Dual Value Prop There are two major value adds of crypto (and especially the field of MEV) to AI: 1. a **pragmatic framework for understanding commitments** and the intricacies of commitment devices 2. a **rigorous real-world sandbox with incentivized and hyper-adversarial agents**, with automated symbolic behavior on a massive scale, that is perfect for testing the limit of AI coordination. ### Prop 1: Pragmatic Framework for Programmatic Commitments Crypto is familiar with the study of commitments and how various designs of different commitment devices could impose unexpected outcomes to the games being coordinated on top of those devices, both from the practical side and the theoretical side. For example, due to the specific design of blockchain as a commitment device (blocktime, fee schedule, inter-temporal monopoly by commitment device mediator, credibility coming from anonymous set of validators and sometimes centralized offchain systems that are blackboxes), the mediators of blockchain commitment devices is able to extract value from the games that is being played on top of the commitment device. And this value extraction process causes huge negative externalities. The study and mitigation of such negative externalities caused by different commitment device design is MEV, which focuses on the study of commitments in adversarial environments with high-frequency games. **Ultimately, as long as we are trying to make an impact and actually implement any AI commitment system, we will run into problems that involve design choices of what substrate those commitment games are played on, and those design choices entail the study of MEV.** ### Prop 2: The Adversarial Sandbox Crypto has already implemented usable and battle-tested commitment devices where there exists many adversarial attackers who operate beyond the scope of the commitment device that interact with well defined agents. It is exactly akin to the problem of ["how can a dumb reasoner protect itself against smart intelligences"](https://medium.com/@VitalikButerin/why-cryptoeconomics-and-x-risk-researchers-should-listen-to-each-other-more-a2db72b3e86b) where the "dumb reasoner" are transactions that are not expressive (i.e., a shallow copy of the user's intent), and yet it has to interact with MEV searcher bots who are way more "intelligent." And in crypto, the way we mitigate the adversarial environment is via conditional commitments (i.e., the weaker party only interacts conditional on a voluntary restriction of the stronger party). Moreover, the study of those commitment devices in crypto is already about algorithmic agents that look like AIs that we care about: **many activities on blockchain are driven by trading firms whose entire goal is to optimize a scalar, and their systems are largely uninterpretable**, and yet we can successfully coordinate their behavior to some extent (this is contrary to many AI alignment belief that one cannot align intelligences that one don't understand, we don't understand humans and yet we've achieved many coordinated outcomes). Such adversarial behavior against commitment and algorithmic agent coordination games on the blockchain are very prevalent and at scale (current lower bound estimate of a billion of USD per year), so there are enough incentive and space to test the robustness of existing alignment and cooperative AI studies. ## Examples ### Example I: Congestion Games Congestion games have been a major area of interest for computational game theory and multi-agent systems for the past two decades. They are a canonical example of a mixed-interest game in which there are both competitive and cooperative motives at play. Recent studies in artificial intelligence have focused on algorithms for learning equilibria and welfare effects, in different subclasses of games that make different assumptions on the information available to agents. Despite the compelling example and theoretical interest, currently we lack a concrete environment in which to test AI agents playing such games. Real world AI agents such as self driving cars are only starting to be slowly and selectively deployed, and they constitute a small fraction of the players in a routing game dominated by human drivers. We argue that blockchains offer a unique environment to test how self-interested agents behave in a special but representative class of congestion games: financial orders routing. In particular, the Decentralized Finance (DeFi) infrastructure on Ethereum offers an ideal environment for such tests where: (1) users submit orders in real-time 24/7, (2) costs/incentives are real and substantial, (3) all agents routing orders across the financial network of exchanges/counterparties are bots, (4) the system is a permissionless API so new AI bots can be tested, (5) data is mostly public so it can be used for analysis, training, and simulation. ![](https://hackmd.io/_uploads/H1e7pNnSn.png =400x230) > Cartoon DeFi network with 4 assets and routes between them. (Full lines are smart contract exchanges and dotted line is a (potential) direct swap.) Moreover, such an environment has: a rich evolving topology with new nodes (assets) and new routes (liquidity pools, exchanges, blockchain bridges) being added, a differential set of more and less sophisticated/informed agents that create and route orders. On the infrastructure side, there is a lot of research at the intersection of MEV and routing, see [cross-domain MEV](https://arxiv.org/abs/2112.01472) or [routing games with MEV extraction](https://arxiv.org/abs/2207.11835). Complex behaviors have emerged such as sophisticated strategies for frontrunning or backrunning orders that are routed suboptimally, from an ecosystem of self-interested agents and organizations. The blockchain environment also allows to deploy new mechanisms/commitment devices through which more sophisticated orders can be expressed to improve coordination. <!-- <span style="color:orange">Crypto provides better motivational examples than AI, while the crypto example captures all of the core spirit.</span> --> <!-- <span style="color:orange">Many examples (motivational problems) that cooperative AI people study include self-driving cars (https://youtu.be/rcC7pjLxhPE?t=273) or self-organizing drones, etc,. and the congestion games on top. We argue that crypto studies an almost isomorphic example but on CFMM routing. Compared with the example of self-driving cars (we present the CFMM routing problem and the self-driving car problem in detail semi-formally, and then demonstrate the correspondence), the CFMM example provides i) a more realistic application that is actually grounded and played at scale ii) more data from real world adversarial algorithmic agents that we can study. </span> --> <!-- One concrete example is that the field of cooperative AI has been using self-driving cars and the congestion game caused by individually trained agents as an example to study AI coordination. But self-driving cars are very far away from being widely adopted and the example is not grounded. On the other hand, in crypto, we have the same problem where transactions on Ethereum that trades Constant Function Market Makers (CFMMs) have a congestion game because each of them individually computes the optimal routing for their trades in an uncoordinated way. There has been numerous studies on the congestion games in Decentralized Finance, and mostly on CFMMs. The problem here is that users delegate their actions to smart contracts (Uniswap's router) that optimize for the user's transaction's own trade routing without coordinating with other transactions. In crypto, such congestion games are played at scale (billions of USD per day) and complex behaviors emerge from it (e.g., backrunning the sandwicher of the suboptimal routing agent statistically or by delegated commitments). Compared with self-driving cars that are still far away from implementation, we can observe the same cooperative games playing out in crypto every day at scale, with real incentives. --> ### Example II. Conditional Commitments The crypto infrastructure really shines in its ability to implement, via smart contracts, practical commitment devices that are neutral, programmable, and credible. Conditional commitments have been widely studied at the intersection of game theory and cooperative AI (commitment games and program equilibria). In blockchain, there are several projects that are implementing intent-centric architectures that have conditional commitments as primitives, to enable a set of principals to express rich preferences that allow them to coordinate. For example, [Flashbot's SUAVE](https://writings.flashbots.net/the-future-of-mev-is-suave/) and [Anoma](https://hackmd.io/@heliax/SyLyo6xr2#/) are two projects that are tackling the engineering challenges with building such systems. Let me be more explicit, **intents are programs and these cryptoeconomic protocols implement the program equilibria studied in AI**. Moreover, these protocols have cryptographic gadgets that allow to handle the incomplete/asymmetric information cases as well. As a concrete example we use the DeFi order routing game discussed above to illustrate how these intents work. A user intent could be the following ``` if exists swap $D -> $A at rate $A/$D <= 1000: swap 500 $A -> $D else: do nothing ``` This is a simple intent that checks if there is an intent from a user willing to swap in the reverse direction at acceptable price, which creates an additional direct route `$A -> $D` in the DeFi network, in which case it will resolve in a pair of mutual swap actions, otherwise the intent does nothing or reverts. Note that another option could be to specify that, in the `else` case when there is no matching swap, the order could be routed along the most efficient exchange route between `$A -> $B -> $D` and `$A -> $C -> $D`. We can easily immagine scenarios where this architecture unlocks more efficiency than the "blind orders" that are used today where each user sends a transaction to the network to swap on a fixed route, without conditioning on what others are simultaneously doing. Another example which is slightly more sophisticated is for the principal/user to submit intents that allow routers/agents to coordinate on pareto-superior equilibria, for example with a program that encodes the following: *I commit to change route if the other agents commit to transferring me a fraction of the surplus they will get as a result of my action*. <!-- $$$$$ <span style="color:orange">We give a teaser peek into other things intents corresponds with, e.g., conditional information disclosure (https://arxiv.org/abs/2204.03484) and programmable privacy in MEV-share, walrasian auction. We can end by asking how fail-safes (https://drive.google.com/file/d/1qxJJf2Jsz3LJ3l__x4GVNBui6TvfJoYh/view) can be applied to crypto intents and real-time negotiations between users. </span> --> <!-- <span style="color:orange">Because crypto and AI has similar motivational examples, the solutions that we come up with are also naturally isomorphic: intents in crypto are essentially program equilibria in AI.</span> <span style="color:orange">We illustrate how intents solve the crypto CFMM routing problem (by turning a normal form game of deciding the routing in your txn into sending an intent that verifies the coordinator's commitment to providing a global-view calculated routing). </span> <span style="color:orange">We illustrate how intents in this example is highly similar to how program equilibia is used to solve the congestion problem in self-driving cars. </span> One example of such a test in the crypto sandbox is the settlement process of intents: intents in crypto are defined as transactions that are conditional on each other, which corresponds to Program Equilibrium in cooperative AI. One example is that now, instead of each user sending their transactions individually (i.e., decide on their commitments individually), they now can coordinate on how to use the commitment device. In the CFMM congestion game example, now, users, instead of directly deciding their routing independently, is able to express the preferences that they like would like to coordinate with other users on and redistribute the profit by saying "I commit to change to the other path if the other agents commit to transferring me the surplus utility they are now getting to compensate for my loss." Other examples include users committing to "if there exists another commitment wanting to swap asset A and B, check if the commitment wants to swap in the opposite direction as I want to, if so, then I commit to directly settle/transfer my assets with the other user and then batch our trades together to settle against the market maker." Those kind of intents (inter-dependent commitments) are prune to predatory behavior from sophisticated algorithmic agents as well, for example, in some schemes, one could sybil (create false-names) by splitting up existing commitments into more commitments for a profit gain. A more direct example would be toxic-flow trade privacy in frequent batch auctions, where a user's intent might be "I commit to trade if my trade settles at the same price as all other trades in this time slot," but a sophisticated actor, upon observing the user's intent, gains a free option in deciding if she should market make this intent or not depending on the type of the user (retail or toxic-flow). Walrasian auction style conditional commitments has also been proposed for blockchain systems, it would be interesting to deploy and see how agents interact in such an environment. --> ### Example III. Decision Theories Crypto commitment devices also offer interesting thought frameworks for thinking about decision theory problems in cooperative AI. For example, flashloans in crypto are commitments that have a decision/action in the logical-time past depending on a decision/action in the logical-time future, this is possible because of the atomicity of transaction semantics on blockchains. Specifically, one could say: "I commit to lending you all my money if there exists a commitment in future from you that returns all my money." Smart transactions is a generalization of flashloans that expand the semantics of blockchain transactions to native support such "time-travelling" behavior natively by allowing interdependent commitments at a larger scale. Basically, flashloans are a way to generalize "causality" in the distributed systems logical time sense to "correlation." One could observe a striking similarity between flashloans and classical problems in decision theory, such as newcomb's paradox, where Omega is essentially instantiating a structure like a flashloan when making the prediction of user's choice (Omega's decision in the past depends on the user's choice in the future). And the way blockchain transaction semantics are defined corresponds with many ideas in evidental decision theory or functional decision theory, where "causality" is weakened and "correlation" (or, commitments that depend on commitments that exists in "future" logical time) is emphasized in resolution and settlement of commitments. ### Example IV. Competing Commitments Another interesting aspect of commitment devices is how they live in the presence of competing commitment devices. For example, one strategy that was observed from algorithmic trading bots is that they "commit" to not being able to commit to anything, which therefore makes other agents' commitments (credible threats) obsolete. Another example is that one commitment device can attack another commitment device by providing a commitment that releases a bounty if the other device breaks the credibility of previously settled commitments (i.e., reorg-as-a-service). ### Example V. Limits of Real-world Commitments Another example is that implementing commitments takes time and resources (e.g., implementing common knowledge via consensus protocols takes significant time if we seek geographical decentralization and credibility of finalized commitments), and this time might be too long to coordinate some games (e.g., financial markets move 24-7 and the game played there is continuous and way faster than the commitment implementation time), and the lack of coordination of those games could cause ripple effects in the coordination of other games (e.g., the market marker structure may need to change to accomodate for the fact that fast games cannot be coordinated, like giving unsophisticated liquidity providers more fees, or that sophisticated agents could frontrun or sandwich unsophisticated agent's commitments). Or, if the commitment device gives mediators the power of inter-temporal monopoly, then the mediator is able to extract the full surplus from coordination games that are played within the commitment credibility window, making the agents indifferent between using the device or not. ### Example VI: Credibility of Commitments <!-- $$$$$ <span style="color:orange">we talk about how in cooperative AI, the commitments are usually assumed to be perfectly credible, we demonstrate what kind of credibility issues, if we actually want to implement the AI coordination tools in reality, we would run into.</span> <span style="color:orange">we start by demonstrating how AI literature justifies its program equilibria concept: two AIs can read each others' code. This is impractical because i) they cannot verify the other person is actually running the code (their actions correspond with the computer programs they send to each other), ii) cannot verify that they will not change their code after making the commitment, iii) cannot verify that the AI didn't form some wierd coalition to make the commitments meaningless (e.g., sybiling or bidding-ringing).</span> <span style="color:orange">We demonstrate how blockchain commitments solve those issues. We discuss how crypto-economic commitment devices solve the three problems with different flavors of commitments (e.g., collateral, zk-proofs, SGX, MPC, committee-based delegation)</span> <span style="color:orange">We then argue that there are some issues with the credibility of commitment devices as well, even if we use those for AIs. We use the example of [bribery attacks](https://blog.ethereum.org/2015/01/28/p-epsilon-attack) on blockchains to illustrate. We can tap into Tarun's paper on MEV redistribution a bit to argue that if the mediator reward is not porpotional to the amount of value of the coordination games that is being played on top of the commitment device, we can expect mediators to start colluding/vertically integrating.</span> --> Another example is that many cooperative AI or AI alignment literature doesn't justify the assumption of the commitment credibility, while in reality if we implement those coordination techniques, the design choices of the commitment device vastly impacts the credibility of the commitment and how the commitment games are played out (e.g., agents exhibit vastly different behavior when the commitment devices are designed differently, and they may cause second-order coordination difficulties). Aside from not directly addressing commitment designs, in cooperative AI, it is often directly assumed that the commitments that AI make will be credible and the settlement of those commitments are perfect and robust with respect to other competing commitments. Also, AI literature tends to assume AIs open-sourcing their own source code as a form of credible commitment, this is basically saying the AI model needs to be committed on-chain, because otherwise in an adversarial asynchronous network environment, just broadcasting one's source code is not credible as for example other AIs could simply pretend to have never received the package. All of those assumptions needs to be justified. And crypto provides the place for studying the justification of those and study how would such AI coordination proposals stand the test of adversarial attackers. For example, if the commitment device orders commitments in a first-come-first-serve way, then agents have an incentive to vertically integrate with the mediators, which causes the credibility of the commitments to go down and loses its initial purpose of pursuading the other agents that the commitment is subgame-perfect and therefore can shift equilibria. Moreover, in order to keep the commitments credible, there needs to be an incentive for the mediators (or else running the commitment device becomes a public good) that is roughly poportionate to the amount of economic value that is generated from the commitment games that is being played on top. And the economics (both supply, how do we charge fees for those incentives, and demand, how do we distribute the collected profits to mediators who provide differentiated services) of mediator incentives turn out to be non-trivial, and, if not well-designed, causes huge negative externality and can completely misalign the commitment games played on top. ## Why Blockchain? Previously we argued that the only technology that is suitable for implementing AI coordination is using blockchains. But why blockchains? Why can't a consortium of AI labs just build a non-crypto protocol that operates a semi-permissionless commitment device for coordination games with algorithmic agents? Afterall, in this way, the commitment device design can be updated agilely as there is less social coordination cost, and that the system can be more efficient because now only entities that are relevant to playing the game have to provide the mediation service. For example, the commitment device will have lower fees and fewer MEV, and it will still be able to coordinate high-frequency fast/global games, and is free to use as long as people trust the consortium. The reason is because those systems are not robust. If the commitment device is not truly decentralized, then it is hard for new entrants to compete with existing players. This is bad not only because the existing players could extract rent (and sometimes this rent is [undiscoverable](https://arxiv.org/abs/2301.12532)), but more importantly, those existing players are entrenched despite they don't have the most up-to-date mechanism that adapts to the rapid evoluting market structures. For example, in such a consortium system, new entrants have to first play political games to gain trust from the consortium of AI labs before they can enter the market to compete, and political games are hugely centralizing in that they encourage nepotism and entrench previledged players. So even if a new market participant has a better mechanism in mind, she cannot compete with existing players because the acquisition of trust, a centralized resource, is hard and a gatekeeping process. Ultimately, high welfare can only be achieved if we have decentralization in the sense of [Hayekian “use of knowledge in society.” ](https://www.coordinationproblem.org/2016/05/hayeks-the-use-of-knowledge-in-society-a-summary.html) In the face of fundamental uncertainty in the world, no centralized consortiums can possibly have confidence in “the mechanism we have at hand is the best mechanism for implementing AI coordination and commitment games and is robust in face of future changes,” especially when the market structure is constantly changing and each morphism could possibly break the alignment and coordination of existing games because they bring in uncoordinated new games that have correlated interests with existing games. Therefore we must design the market in a way such that cooperative AI mechanism designers can and are incentivized to freely compete. Robustness in cooperative AI solutions can only be achieved via free market competition in the commitment mechanism market. And free market competition can only be achieved via decentralization. ## Conclusion In conclusion, crypto is the only way to implement cooperative AI. Crypto commitments provide a superior technology for coordination and alignment of AI agents compared to traditional social technologies like policies and regulation. The crypto sandbox offers a rigorous, real-world environment for testing the limits of AI coordination, while the study of commitments in crypto provides a pragmatic framework for understanding commitment devices and their limitations. As we advance in the field of AI, it is important to recognize the role that crypto commitments can play in addressing the challenges of coordination and alignment. ## References Blockchain commitment devices (also called *permissionless credible commitment devices* or PCCDs) - [Ethereum is game-changing technology, literally.](https://medium.com/@virgilgr/ethereum-is-game-changing-technology-literally-d67e01a01cf8) - [Game Mining: How to Make Money from those about to Play a Game](https://www.microsoft.com/en-us/research/publication/game-mining-how-to-make-money-from-those-about-to-play-a-game/) - [Stackelberg Attacks on Auctions and Blockchain Transaction Fee Mechanisms](https://arxiv.org/abs/2305.02178) - [Game theory on the blockchain: a model for games with smart contracts](https://arxiv.org/pdf/2107.04393.pdf) - [Blockchain Mediated Persuasion](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4300675) - [Credible, Optimal Auctions via Blockchains](https://arxiv.org/abs/2301.12532) - [Costs of Sybils, Credible Commitments, and False-Name Proof Mechanisms](https://arxiv.org/pdf/2301.12813.pdf) - Video: [Designing Smart Contracts With Free Will](https://www.youtube.com/watch?v=yyb_uO7BKzg) MEV - [Flash Boys 2.0: Frontrunning, Transaction Reordering, and Consensus Instability in Decentralized Exchanges](https://arxiv.org/abs/1904.05234) - [Clockwork Finance: Automated Analysis of Economic Security in Smart Contracts](https://eprint.iacr.org/2021/1147.pdf) - [Towards a Theory of Maximal Extractable Value I: Constant Function Market Makers](https://people.eecs.berkeley.edu/~ksk/files/MEV_CFMM.pdf) - [Optimal Routing for Constant Function Market Makers](https://arxiv.org/pdf/2204.05238.pdf) - [Price of MEV: Towards a Game Theoretical Approach to MEV](https://arxiv.org/abs/2208.13464) Misc - Slides: [MEV and Credible Commitment Devices](https://tinyurl.com/mevccd) - Slides: [Intelligence Beyond Commitment Devices](https://tinyurl.com/ai-pccd) - Video: [An Overview of Permissionles Credible Commitment Devices](https://collective.flashbots.net/t/whiteboard-an-overview-of-credible-commitment-devices/926/1) - Blog: [Mutating Mempools and Programmable Transactions](https://simbro.medium.com/mutating-mempools-and-programmable-transactions-f96455f6cc63) - Video: [Smart Transactions](https://www.youtube.com/watch?v=dS3NRPu5L9s) - Blog: [SUAVE through the lens of game theory](https://hackmd.io/@sxysun/suavespec)