1. Recursively clone a test system: ``` # git clone --recursive https://github.com/a-v-medvedev/testsuite.git ``` 2. Bootstrap it for a target project: ``` # cd testsuite # ./bootstrap.sh https://$DNB_GITLAB_USERNAME:$DNB_GITLAB_ACCESS_TOKEN@earth.bsc.es/gitlab/ces/hpc-for-es-team/nemo-testsuite-conf.git nemo functest ``` 3. Set some environment vars to point at versions: ``` # export TESTSUITE_HWCONF=mn5-acc # export TESTSUITE_BRANCH=<NEMO_BRANCH_NAME> # export export TESTSUITE_VERSIONS=nemo-build:<HEAD or ee10c0e or some other> ``` 4. Download: ``` ./download.sh ``` 5. Run build: ``` ./testall_nemo.sh $TESTSUITE_BRANCH build_variations ``` 6. Run test: ``` ./testall_nemo.sh $TESTSUITE_BRANCH basic ``` 7. Explore results: ``` sandbox_basic/run/conf.CPU_X/output.yaml sandbox_basic/run/conf.GPU_X/output.yaml ``` 8. Re-run the tests: ``` cd sandbox_basic <replace or synlink to new binaries `nemo-gpu-repro` and/or `nemo-gpu-optim`> ./functional_massive_tests.sh ``` 9. Temporarely change the scope: ``` cd sandbox_basic vim params.inc >> export MASSIVE_TESTS_PCONFS="1:8:10 2:8:10 4:8:8 1:8:1 2:8:1 4:8:1 1:80:1 2:80:1 4:80:1" ```