RR 7 March 2022:

traceback-1: {{{
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tempest/common/waiters.py", line 312, in wait_for_volume_resource_status
    raise lib_exc.TimeoutException(message)
tempest.lib.exceptions.TimeoutException: Request timed out
Details: volume 1850310b-4cc4-40f6-a328-b7d7890599e1 failed to reach available status (current in-use) within the required time (300 s).
}}}

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tempest/common/waiters.py", line 380, in wait_for_volume_attachment_remove_from_server
    raise lib_exc.TimeoutException(message)
tempest.lib.exceptions.TimeoutException: Request timed out
Details: Volume 1850310b-4cc4-40f6-a328-b7d7890599e1 failed to detach from server 014313f8-8d24-4b76-a614-3bc43a8c643b within the required time (300 s) from the compute API perspective

AssertionError: Timed out waiting for 10.100.0.17 to become reachable from 10.9.122.72

2022-03-07 01:03:26.393807 |  The following node(s) had failures: undercloud
2022-03-07 01:03:26.393902 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Exception: Deployment failed
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1357, in _standalone_deploy
    raise exceptions.DeploymentError('Deployment failed')
tripleoclient.exceptions.DeploymentError: Deployment failed
None
** Found ansible errors for undercloud deployment! **
[
 [
  "Run tripleo-container-image-prepare logged to: /var/log/tripleo-container-image-prepare.log",
  {
   "msg": "non-zero return code",
   "cmd": "/usr/bin/tripleo-container-image-prepare --roles-file /tmp/ansible.ugxqp8ei-role-data --environment-file /tmp/ansible.kj4rj9m5-prepare-param --cleanup partial --log-file /var/log/tripleo-container-image-prepare.log  --debug  >/dev/null",
   "stdout": "",

    - tempest.lib.exceptions.ServerFault: Got server fault

    

2022-03-06 21:42:17 | fatal: [localhost]: FAILED! => {"changed": false, "msg": "login: HTTP Error 500: Internal Server Error"}

  Response - Headers: {'date': 'Mon, 07 Mar 2022 03:08:44 GMT', 'server': 'Apache', 'content-length': '111', 'openstack-api-version': 'compute 2.1', 'x-openstack-nova-api-version': '2.1', 'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', 'x-openstack-request-id': 'req-9db28f47-a191-40d2-97c7-618901830126', 'x-compute-request-id': 'req-9db28f47-a191-40d2-97c7-618901830126', 'content-type': 'application/json; charset=UTF-8', 'connection': 'close', 'status': '404', 'content-location': 'http://10.0.0.5:8774/v2.1/servers/b7bbe195-ea0a-4e97-bab0-87b14895b4e2'}
        Body: b'{"itemNotFound": {"code": 404, "message": "Instance b7bbe195-ea0a-4e97-bab0-87b14895b4e2 could not be found."}}'

FATAL | Install - IPA client test | undercloud | error={"changed": false, "msg": "Unable to discover domain, not provided on command line"}
2022-03-04 08:55:41.688103 | fa163e8f-fef8-2748-cb2e-0000000004b9 |     TIMING | ipaclient : Install - IPA client test | undercloud | 0:00:54.408165 | 0.81s

SK | Check containers status
2022-03-04 09:51:28 |  [ERROR]: Container(s) which failed to be created by podman_container module:
2022-03-04 09:51:28 | ['nova_db_sync']
2022-03-04 09:51:28 |  [ERROR]: Container(s) which did not finish after 300 minutes: ['nova_db_sync']
2022-03-04 09:51:28 | 2022-03-04 09:51:28.999785 | fa163e1f-30ca-4089-242a-00000000a05b |      FATAL | Check containers status | overcloud-controller-0 | error={"changed": false, "msg": "Failed container(s): ['nova_db_sync'], check logs in /var/log/containers/stdouts/"}
2022-03-04 09:51:28 | 2022-03-04 09:51:29.000873 | fa163e1f-30ca-4089-242a-00000000a05b |     TIMING | tripleo_container_manage : Check containers status | overcloud-controller-0 | 1:09:05.953041 | 461.26s

tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_instance_port_admin_state[compute,id-f5dfcc22-45fd-409f-954c-5bd500d7890b,network,slow]
tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_router_admin_state[compute,id-04b9fe4e-85e8-4aea-b937-ea93885ac59f,network,slow]
tearDownClass (tempest.scenario.test_network_basic_ops.TestNetworkBasicOps)
setUpClass (tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern)
setUpClass (keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest)

Error running playbook in directory: /tmp/tripleo-modify-image-playbook-1nir90xk
Playbook log information can be reviewed here: /var/log/tripleo-container-image-prepare-ansible.log
2022-03-04 10:29:39,817 61756 ERROR tripleo_common.image.image_uploader [  ] [192.168.24.1:8787/tripleomastercentos9/openstack-cron:afeb49ceb7917185b2d930aeb7a0785c-updated-20220304045521] Failed processing the target image
2022-03-04 10:29:39,849 61756 INFO tripleo_common.image.image_uploader [  ] [trunk.registry.rdoproject.org/tripleomastercentos9/openstack-memcached:afeb49ceb7917185b2d930aeb7a0785c] Starting upload image process
2022-03-04 10:29:39,850 61756 DEBUG urllib3.util.retry [  ] Converted retries value: 8 -> Retry(total=8, connect=None, read=None, redirect=None, status=None)
2022-03-04 10:29:39,853 61756 DEBUG urllib3.connectionpool [  ] Starting new HTTP connection (1): 192.168.24.1:8787
2022-03-04 10:29:39,855 61756 DEBUG urllib3.connectionpool [  ] http://192.168.24.1:8787 "GET /v2/ HTTP/1.1" 200 2
2022-03-04 10:29:39,856 61756 DEBUG tripleo_common.image.image_uploader [  ] http://192.168.24.1:8787/v2/ status code 200
2022-03-04 10:29:39,859 61756 DEBUG urllib3.connectionpool [  ] http://192.168.24.1:8787 "GET /v2/tripleomastercentos9/openstack-memcached/tags/list HTTP/1.1" 404 196
2022-03-04 10:29:39,859 61756 INFO tripleo_common.image.image_uploader [  ] Non-2xx: id 7e20929a3dcd948cc4cdbf250f7540fca1fcc895, status 404, reason Not Found, text <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">