v0.31.5 has a bug where the state machine returns an incorrect validator set update to the consensus machine.
The current network has progressed to block 42850, which halted due to the aformentioned problem. In order to fix it a majority of validator voting power must upgrade to v0.31.6.
In order to restart the network 2/3+1 of voting power needs to sync the chain from scratch.
ABOVE ALL ELSE, DON'T DELETE THE KEYS OR THE VALIDATOR STATE.
I would suggest the following steps to upgrade:
join-network
again (same steps as before) but on a new base directory<chain_id>/cometbft/data/priv_validator_state.json
) to the new directoryvim <base_dir>/shielded-expedition.88f17d1d14/config.toml
<chain_id>/config.toml
and not <chain_id>/cometbft/config.toml
- the latter gets overriden.masp-params
.