<style> .red { color:#c7254e } .light-red { color: #FF7F7F; } .i { font-style: italic; } </style> # Zombienet migration --- ## [PoC](https://github.com/paritytech/polkadot-sdk/pull/4140) --- ### Scafold the directory structure - Create a new dir <span class=red>zombienet-sdk-tests</span> at root level of the repo and excluded from the workspace. - Inner directories for each one (_polkadot/cumulus/subtrate_) and shared lib with helpers. --- ### Migration path - Migrate a few of each one (_polkadot/cumulus/substrate_) - Resolve custom implementations to test setups (e.g upgrades that needs older binaries, snapshots) - Use <span class=red>nextest</span> as runner, compiling the tests at build stage and use as artifact later. --- ### Assertions Currently in v1 we allow assertions to fail and we report all at the end, but for v2 this could be: - Use default assertions and panic on error. - Build a custom assertion and machinery to collect all the errors in a test. --- ### Benchmark and track regressions - Add metrics to compare with the current version: - Times* (network ready / test complete) - Number of retrys - Cluster usage (provided by GCP) - Run test in both version randomly (using jobId). - Collect results per version to ensure caught any bug.
{"title":"Zombienet migration","description":"Create a new dir zombienet-sdk-tests at root level of the repo and excluded from the workspace.","contributors":"[{\"id\":\"29b42f54-f390-45bd-95bf-cb6443d11eb6\",\"add\":1351,\"del\":0}]"}
    286 views