GoC Provider Halt

--- tags: game-of-chains --- # GoC Provider Halt Announcement: - Investigation status - What's next? ## Investigation status - CHain halt, does not appear to be an AppHash mismatch (validators stopped halfway through the block). - Still ongoing, we will share more info as we get it. - Members of the IBC, Cosmos SDK, Cosmos Hub, and Informal teams are attembpting to replay the blocks using the actual data and replicate in test environments. - We have uploaded some logs in the `ics-testnets` repo if you would like to take a deep dive: https://github.com/hyphacoop/ics-testnets/tree/goc-dec-halt-incident/game-of-chains-2022/incidents ## What's next? ### No more tasks pending for Game of Chains* - Task 31 will be removed from the list since no one was able to complete it. - Getting unjailed - Validators who had tasks left to complete - People running a relayer did not reach the 500 relayed packets due to the provider chain going down: we can assess each case - People were not able to assign keys to consumer chains but were planning to - We are assessing task 28 and will decide on how to assign points for it. - Feel free to take your consumer chains down, there will be no more consumer chains launched \* **Since the incentivized portion of Game of Chains has ended, the `provider` chain is now the persistent Interchain Security testnet. If you want to stick around to continue participating in it, please keep your provider nodes intact so we can run an updated binary once it becomes available.** ### Tallying - We will review the evidence and update the leaderboard as we continue verify submissions. Note that this will take some time, especially reviewing entries for testnet awards. - If we have any questions regarding your submissions, we will reach out for clarification. - Please let us know if you have any questions or concerns about your published tally! # For Discord: --- Hi @GoC! We have some more updates: **Provider Chain Status** - So far a review of the logs available point to it being a chain halt and does not appear to be an AppHash mismatch (validators stopped halfway through the block). - Investigation is still ongoing, and we will share more info as we find it. - Members of the IBC, Cosmos SDK, Cosmos Hub, and Informal teams are working on replaying the blocks using recorded data and replicating the scenario in test environments. - We have uploaded logs to the `ics-testnets` repo if you would like to review them: https://github.com/hyphacoop/ics-testnets/tree/goc-dec-halt-incident/game-of-chains-2022/incidents **What happens now?** - We have completed all three phases successfully, except for the unjailing task in phase 3. We expected the unjailing task to be the last one validators would be completing. From this perspective, we can consider Game of Chains to have met its goals of surfacing issues with ICS and helping validators to become experienced with the technology. - Since we are still unsure when the fixes will come and being so close to the holiday season, we are officially announcing the end of phase 3 of Game of Chains. **Tasks and tallying** - Task 31: no one was able to complete it, so it will be removed from the list. - We understand some people were caught halfway through completing a task when the slasher chain came online: - Task 21: If you were running a relayer and were not able to reach 500 packets, submit an evidence form anyway and we will review it. - Task 28: We will remove the key assignment task from the list due to the short window available to complete it. - We will continue to review the evidence and update the leaderboard as we verify submissions. Note that this will take time, especially evaluating entries for testnet awards. Please submit all the evidence you have available by December 12. - If we have any questions regarding your submissions, we will reach out for clarification. - Please let us know if you have any questions or concerns about your published tally! **What's next?** - The incentivized portion of Game of Chains has now ended. **The `provider` chain is now the persistent Interchain Security testnet. We would love for you to continue on this testnet. If you want to stick around to participate in it, please keep your provider nodes intact so you can run an updated binary once it becomes available.** - Feel free to take your consumer chains down now if you'd like to free up resources! Thank you so much for your participation and congratulations on making it this far! The past several weeks have been quite a ride on the coordinator side, we hope you had a good experience and you opt to to stay in the network. ---