# Setup VM # Friday 01-05-2024 ![messageImage_1709305201180](https://hackmd.io/_uploads/BkSHlKkpp.jpg) ![QEMU (teep-16c32gb-server) - noVNC - Google Chrome01_03_2024 22_26_12](https://hackmd.io/_uploads/B19SlK166.png) ![image](https://hackmd.io/_uploads/Hy3L-tJpp.png) ![image](https://hackmd.io/_uploads/BJuo-KJT6.png) ![QEMU (teep-16c32gb-server) - noVNC - Google Chrome 01_03_2024 23_32_08](https://hackmd.io/_uploads/BkprXtkTT.png) # Monday 05-03-2024 # install docker ```javascript= sudo apt install apt-transport-https ca-certificates software-properties-common -y curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add - sudo apt-key fingerprint 0EBFCD88 sudo add-apt-repository \ "deb [arch=amd64] https://download.docker.com/linux/ubuntu \ $(lsb_release -cs) \ stable" sudo apt update && sudo apt install docker-ce -y sudo pkill -SIGHUP dockerd sudo groupadd docker sudo usermod -aG docker $USER ``` **Result**: ![image](https://hackmd.io/_uploads/ryx8E5NTa.png) # 07/03/2024 ## ONAP - Based [I] SMO Deployment ### Prerequisite 1. Install Kubernetes with kubespray ```bash= python3 --version # Version should upper or equal to 3.9 apt install -y python3-pip git clone https://github.com/kubernetes-sigs/kubespray -b release-2.23 cd kubespray pip install -r requirements.txt sed -i 's/\(kube_version: \)[^"]*/\1v1.27.5/' inventory/local/group_vars/k8s_cluster/k8s-cluster.yml ansible-playbook -i inventory/local/hosts.ini --become --become-user=root cluster.yml mkdir ~/.kube/config sudo cp /etc/kubernetes/admin.conf ~/.kube/config ``` **Output:** ```bash= Processing triggers for gnome-menus (3.36.0-1ubuntu3) ... Processing triggers for libc-bin (2.35-0ubuntu3.1) ... Processing triggers for man-db (2.10.2-1) ... Processing triggers for mailcap (3.70+nmu1ubuntu1) ... ``` ```bash= root@teep32c32gb2204:~# git clone https://github.com/kubernetes-sigs/kubespray -b release-2.23 Cloning into 'kubespray'... remote: Enumerating objects: 73352, done. remote: Counting objects: 100% (850/850), done. remote: Compressing objects: 100% (558/558), done. remote: Total 73352 (delta 392), reused 605 (delta 239), pack-reused 72502 Receiving objects: 100% (73352/73352), 23.21 MiB | 13.30 MiB/s, done. Resolving deltas: 100% (41219/41219), done. ``` ```bash= Collecting pycparser Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 KB 24.5 MB/s eta 0:00:00 Installing collected packages: resolvelib, netaddr, ruamel.yaml.clib, pycparser, pbr, packaging, MarkupSafe, jmespath, ruamel.yaml, jinja2, cffi, cryptography, ansible-core, ansible Attempting uninstall: cryptography Found existing installation: cryptography 3.4.8 Not uninstalling cryptography at /usr/lib/python3/dist-packages, outside environment /usr Can't uninstall 'cryptography'. No files were found to uninstall. Successfully installed MarkupSafe-2.1.3 ansible-7.6.0 ansible-core-2.14.14 cffi-1.16.0 cryptography-41.0.1 jinja2-3.1.2 jmespath-1.0.1 netaddr-0.8.0 packaging-23.2 pbr-5.11.1 pycparser-2.21 resolvelib-0.8.1 ruamel.yaml-0.17.31 ruamel.yaml.clib-0.2.7 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv ``` ```bash= TASK [etcd : Check_certs | Register certs that have already been generated on first etcd node] ************************************************************* [WARNING]: Skipped '/etc/ssl/etcd/ssl' path due to this access issue: '/etc/ssl/etcd/ssl' is not a directory ok: [node1] Jumat 08 Maret 2024 21:44:04 +0700 (0:00:00.340) 0:17:48.421 *********** TASK [etcd : Get currently-deployed etcd version] ********************************************************************************************************** fatal: [node1]: FAILED! => {"changed": false, "cmd": "/usr/local/bin/etcd --version", "msg": "[Errno 2] No such file or directory: b'/usr/local/bin/etcd'", "rc": 2, "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring Jumat 08 Maret 2024 21:44:37 +0700 (0:00:00.344) 0:18:21.385 *********** TASK [kubernetes/node : Modprobe nf_conntrack_ipv4] ******************************************************************************************************** fatal: [node1]: FAILED! => {"changed": false, "msg": "modprobe: FATAL: Module nf_conntrack_ipv4 not found in directory /lib/modules/6.5.0-21-generic\n", "name": "nf_conntrack_ipv4", "params": "", "rc": 1, "state": "present", "stderr": "modprobe: FATAL: Module nf_conntrack_ipv4 not found in directory /lib/modules/6.5.0-21-generic\n", "stderr_lines": ["modprobe: FATAL: Module nf_conntrack_ipv4 not found in directory /lib/modules/6.5.0-21-generic"], "stdout": "", "stdout_lines": []} ...ignoring Jumat 08 Maret 2024 21:45:25 +0700 (0:00:00.342) 0:19:08.747 *********** TASK [kubernetes/control-plane : Check which kube-control nodes are already members of the cluster] ******************************************************** fatal: [node1]: FAILED! => {"changed": false, "cmd": ["/usr/local/bin/kubectl", "get", "nodes", "--selector=node-role.kubernetes.io/control-plane", "-o", "json"], "delta": "0:00:00.094164", "end": "2024-03-08 21:45:39.063560", "msg": "non-zero return code", "rc": 1, "start": "2024-03-08 21:45:38.969396", "stderr": "E0308 21:45:39.050052 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused\nE0308 21:45:39.050935 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused\nE0308 21:45:39.052321 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused\nE0308 21:45:39.054139 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused\nE0308 21:45:39.055729 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused\nThe connection to the server localhost:8080 was refused - did you specify the right host or port?", "stderr_lines": ["E0308 21:45:39.050052 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused", "E0308 21:45:39.050935 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused", "E0308 21:45:39.052321 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused", "E0308 21:45:39.054139 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused", "E0308 21:45:39.055729 30841 memcache.go:265] couldn't get current server API group list: Get \"http://localhost:8080/api?timeout=32s\": dial tcp 127.0.0.1:8080: connect: connection refused", "The connection to the server localhost:8080 was refused - did you specify the right host or port?"], "stdout": "", "stdout_lines": []} ...ignoring Jumat 08 Maret 2024 21:45:39 +0700 (0:00:00.431) 0:19:22.847 *********** Jumat 08 Maret 2024 21:45:39 +0700 (0:00:00.054) 0:19:22.902 *********** TASK [network_plugin/calico : Calico | Get existing FelixConfiguration] ************************************************************************************ fatal: [node1]: FAILED! => {"changed": false, "cmd": ["/usr/local/bin/calicoctl.sh", "get", "felixconfig", "default", "-o", "json"], "delta": "0:00:00.115129", "end": "2024-03-08 21:46:34.307054", "msg": "non-zero return code", "rc": 1, "start": "2024-03-08 21:46:34.191925", "stderr": "resource does not exist: FelixConfiguration(default) with error: felixconfigurations.crd.projectcalico.org \"default\" not found", "stderr_lines": ["resource does not exist: FelixConfiguration(default) with error: felixconfigurations.crd.projectcalico.org \"default\" not found"], "stdout": "null", "stdout_lines": ["null"]} ...ignoring Jumat 08 Maret 2024 21:46:34 +0700 (0:00:00.461) 0:20:18.089 *********** TASK [network_plugin/calico : Calico | Get existing calico network pool] *********************************************************************************** fatal: [node1]: FAILED! => {"changed": false, "cmd": ["/usr/local/bin/calicoctl.sh", "get", "ippool", "default-pool", "-o", "json"], "delta": "0:00:00.111836", "end": "2024-03-08 21:46:37.336306", "msg": "non-zero return code", "rc": 1, "start": "2024-03-08 21:46:37.224470", "stderr": "resource does not exist: IPPool(default-pool) with error: ippools.crd.projectcalico.org \"default-pool\" not found", "stderr_lines": ["resource does not exist: IPPool(default-pool) with error: ippools.crd.projectcalico.org \"default-pool\" not found"], "stdout": "null", "stdout_lines": ["null"]} ...ignoring Jumat 08 Maret 2024 21:46:37 +0700 (0:00:00.451) 0:20:21.114 *********** TASK [network_plugin/calico : Calico | Get existing BGP Configuration] ************************************************************************************* fatal: [node1]: FAILED! => {"changed": false, "cmd": ["/usr/local/bin/calicoctl.sh", "get", "bgpconfig", "default", "-o", "json"], "delta": "0:00:00.110031", "end": "2024-03-08 21:46:38.788493", "msg": "non-zero return code", "rc": 1, "start": "2024-03-08 21:46:38.678462", "stderr": "resource does not exist: BGPConfiguration(default) with error: bgpconfigurations.crd.projectcalico.org \"default\" not found", "stderr_lines": ["resource does not exist: BGPConfiguration(default) with error: bgpconfigurations.crd.projectcalico.org \"default\" not found"], "stdout": "null", "stdout_lines": ["null"]} ...ignoring Jumat 08 Maret 2024 21:46:38 +0700 (0:00:00.457) 0:20:22.566 *********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Register coredns deployment annotation `createdby`] ****************************************************** fatal: [node1]: FAILED! => {"changed": false, "cmd": ["/usr/local/bin/kubectl", "--kubeconfig", "/etc/kubernetes/admin.conf", "get", "deploy", "-n", "kube-system", "coredns", "-o", "jsonpath={ .spec.template.metadata.annotations.createdby }"], "delta": "0:00:00.118295", "end": "2024-03-08 21:47:09.835979", "msg": "non-zero return code", "rc": 1, "start": "2024-03-08 21:47:09.717684", "stderr": "Error from server (NotFound): deployments.apps \"coredns\" not found", "stderr_lines": ["Error from server (NotFound): deployments.apps \"coredns\" not found"], "stdout": "", "stdout_lines": []} ...ignoring Jumat 08 Maret 2024 21:47:09 +0700 (0:00:00.463) 0:20:53.616 *********** TASK [kubernetes-apps/ansible : Kubernetes Apps | Register coredns service annotation `createdby`] ********************************************************* fatal: [node1]: FAILED! => {"changed": false, "cmd": ["/usr/local/bin/kubectl", "--kubeconfig", "/etc/kubernetes/admin.conf", "get", "svc", "-n", "kube-system", "coredns", "-o", "jsonpath={ .metadata.annotations.createdby }"], "delta": "0:00:00.117153", "end": "2024-03-08 21:47:10.296165", "msg": "non-zero return code", "rc": 1, "start": "2024-03-08 21:47:10.179012", "stderr": "Error from server (NotFound): services \"coredns\" not found", "stderr_lines": ["Error from server (NotFound): services \"coredns\" not found"], "stdout": "", "stdout_lines": []} ...ignoring Jumat 08 Maret 2024 21:47:10 +0700 (0:00:00.462) 0:20:54.078 *********** ``` ```bash= PLAY RECAP ************************************************************************************************************************************************* localhost : ok=3 changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 node1 : ok=786 changed=162 unreachable=0 failed=0 skipped=1279 rescued=0 ignored=8 Jumat 08 Maret 2024 21:48:13 +0700 (0:00:00.124) 0:21:57.402 *********** =============================================================================== download : Download_container | Download image if required ---------------------------------------------------------------------------------------- 381.35s download : Download_file | Download item ---------------------------------------------------------------------------------------------------------- 141.61s download : Download_file | Download item ----------------------------------------------------------------------------------------------------------- 63.43s download : Download_file | Download item ----------------------------------------------------------------------------------------------------------- 60.94s kubernetes/preinstall : Install packages requirements ---------------------------------------------------------------------------------------------- 41.28s download : Download_file | Download item ----------------------------------------------------------------------------------------------------------- 21.96s kubernetes/control-plane : Kubeadm | Initialize first master --------------------------------------------------------------------------------------- 12.77s download : Download_container | Download image if required ----------------------------------------------------------------------------------------- 11.25s download : Download_container | Download image if required ----------------------------------------------------------------------------------------- 10.54s download : Download_container | Download image if required ----------------------------------------------------------------------------------------- 10.34s etcd : Reload etcd ---------------------------------------------------------------------------------------------------------------------------------- 9.42s kubernetes-apps/ansible : Kubernetes Apps | Start Resources ----------------------------------------------------------------------------------------- 9.01s download : Download_container | Download image if required ------------------------------------------------------------------------------------------ 8.63s download : Download_container | Download image if required ------------------------------------------------------------------------------------------ 7.46s download : Download_container | Download image if required ------------------------------------------------------------------------------------------ 7.37s container-engine/validate-container-engine : Populate service facts --------------------------------------------------------------------------------- 6.71s download : Download_container | Download image if required ------------------------------------------------------------------------------------------ 6.65s download : Download_container | Download image if required ------------------------------------------------------------------------------------------ 6.52s container-engine/containerd : Containerd | Unpack containerd archive -------------------------------------------------------------------------------- 6.31s download : Download_container | Download image if required ------------------------------------------------------------------------------------------ 6.28s ``` ### Deployment 1. Download the IT/dep repository from gerrit ```bash= # Latest version cd ~ git clone https://gerrit.o-ran-sc.org/r/it/dep.git -b master --recursive ``` **Output:** ```bash= Submodule path 'ranpm': checked out '696b3a4eb9eecf92b99e62e0081f7140c0294155' Submodule path 'ric-dep': checked out '0ce5f68bafe78470b1331284c47918c513173ad2' Submodule path 'smo-install/multicloud-k8s': checked out '2d9e8566cbd81e6feb7e3068f6ff089fdc3a93d9' Submodule path 'smo-install/onap_oom': checked out 'acb9fda1b15519023f5a46e93bee527a21aa316d' ``` 2. Setup Helm Charts Execute the following commands being logged as root. ```bash= cd dep ##Setup ChartMuseum ./smo-install/scripts/layer-0/0-setup-charts-museum.sh ##Setup HELM3 ./smo-install/scripts/layer-0/0-setup-helm3.sh ## Build ONAP/ORAN charts ./smo-install/scripts/layer-1/1-build-all-charts.sh ``` **Output:** ```bash= root@teep32c32gb2204:~/dep# ./smo-install/scripts/layer-0/0-setup-charts-museum.sh --2024-03-08 22:06:58-- https://get.helm.sh/chartmuseum-v0.13.1-linux-amd64.tar.gz Resolving get.helm.sh (get.helm.sh)... 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c Connecting to get.helm.sh (get.helm.sh)|152.199.39.108|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 15065895 (14M) [application/x-tar] Saving to: ‘chartmuseum-v0.13.1-linux-amd64.tar.gz’ chartmuseum-v0.13.1-linux-amd64.tar.gz 100%[============================================================================>] 14,37M 47,4MB/s in 0,3s 2024-03-08 22:07:00 (47,4 MB/s) - ‘chartmuseum-v0.13.1-linux-amd64.tar.gz’ saved [15065895/15065895] linux-amd64/ linux-amd64/chartmuseum linux-amd64/README.md linux-amd64/LICENSE root@teep32c32gb2204:~/dep# 2024-03-08T22:07:00.858+0700 INFO Starting ChartMuseum {"host": "0.0.0.0", "port": 18080} ``` ```bash= root@teep32c32gb2204:~/dep# ./smo-install/scripts/layer-0/0-setup-helm3.sh --2024-03-08 22:08:23-- https://get.helm.sh/helm-v3.12.3-linux-amd64.tar.gz Resolving get.helm.sh (get.helm.sh)... 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c Connecting to get.helm.sh (get.helm.sh)|152.199.39.108|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 16028423 (15M) [application/x-tar] Saving to: ‘helm-v3.12.3-linux-amd64.tar.gz’ helm-v3.12.3-linux-amd64.tar.gz 100%[============================================================================>] 15,29M 67,7MB/s in 0,2s 2024-03-08 22:08:24 (67,7 MB/s) - ‘helm-v3.12.3-linux-amd64.tar.gz’ saved [16028423/16028423] linux-amd64/ linux-amd64/LICENSE linux-amd64/README.md linux-amd64/helm Reading package lists... Done Building dependency tree... Done Reading state information... Done git is already the newest version (1:2.34.1-1ubuntu1.10). 0 upgraded, 0 newly installed, 0 to remove and 184 not upgraded. Checking HELM ... version.BuildInfo{Version:"v3.12.3", GitCommit:"3a31588ad33fe3b89af5a2a54ee1d25bfe6eaa5e", GitTreeState:"clean", GoVersion:"go1.20.7"} Downloading and installing helm-push v0.10.3 ... --2024-03-08 22:08:26-- https://nexus.o-ran-sc.org/content/repositories/thirdparty/chartmuseum/helm-push/v0.10.3/helm-push-v0.10.3.tar.gz Resolving nexus.o-ran-sc.org (nexus.o-ran-sc.org)... 38.108.68.158 Connecting to nexus.o-ran-sc.org (nexus.o-ran-sc.org)|38.108.68.158|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11109788 (11M) [application/x-gzip] Saving to: ‘helm-push-v0.10.3.tar.gz’ helm-push-v0.10.3.tar.gz 100%[============================================================================>] 10,59M 5,18MB/s in 2,0s 2024-03-08 22:08:29 (5,18 MB/s) - ‘helm-push-v0.10.3.tar.gz’ saved [11109788/11109788] Error: no repositories configured 2024-03-08T22:08:30.090+0700 INFO [1] Request served {"path": "/index.yaml", "comment": "", "clientIP": "127.0.0.1", "method": "GET", "statusCode": 200, "latency": "189.28µs", "reqID": "d7be74cb-811f-46a2-9dde-1db801c7636f"} "local" has been added to your repositories ``` ```bash= 1 chart(s) linted, 0 chart(s) failed Pushing ns-simulators-1.0.0.tgz to local... 2024-03-08T22:22:41.315+0700 INFO [998] Request served {"path": "/api/charts", "comment": "", "clientIP": "127.0.0.1", "method": "POST", "statusCode": 201, "latency": "5.516901ms", "reqID": "7ca343a9-d678-4605-83ac-59a4e813b476"} Done. make[1]: Leaving directory '/root/dep/smo-install/tests_oom' Hang tight while we grab the latest from your chart repositories... 2024-03-08T22:22:41.411+0700 INFO [999] Request served {"path": "/index.yaml", "comment": "", "clientIP": "127.0.0.1", "method": "GET", "statusCode": 200, "latency": "488.292µs", "reqID": "c9df1560-c81e-4f74-9da9-3d83a17f2fd5"} ...Successfully got an update from the "local" chart repository Update Complete. ⎈Happy Helming!⎈ ``` 3. Deploy components Execute the following commands being logged as root: ```bash= ./smo-install/scripts/layer-2/2-install-oran.sh ``` **Output:** ```bash= No helm override flavour supplied, going to default Starting ONAP & NONRTRIC namespaces ... Pushing strimzi-kafka-operator-0.36.1.tgz to local... 2024-03-08T22:23:57.069+0700 INFO [1000] Request served {"path": "/api/charts", "comment": "", "clientIP": "127.0.0.1", "method": "POST", "statusCode": 201, "latency": "43.508237ms", "reqID": "2a8801c3-db76-4a62-89cd-0e7ed85b5d89"} Done. Hang tight while we grab the latest from your chart repositories... 2024-03-08T22:23:57.168+0700 INFO [1001] Request served {"path": "/index.yaml", "comment": "", "clientIP": "127.0.0.1", "method": "GET", "statusCode": 200, "latency": "565.855µs", "reqID": "997d3c6f-820c-4db4-846b-333268ad8744"} ...Successfully got an update from the "local" chart repository Update Complete. ⎈Happy Helming!⎈ 2024-03-08T22:23:57.343+0700 INFO [1002] Request served {"path": "/charts/strimzi-kafka-operator-0.36.1.tgz", "comment": "", "clientIP": "127.0.0.1", "method": "GET", "statusCode": 200, "latency": "593.225µs", "reqID": "4a31c9ea-6bd5-4bf2-8f24-710f792900e9"} NAME: strimzi-kafka-operator LAST DEPLOYED: Fri Mar 8 22:24:00 2024 NAMESPACE: strimzi-system STATUS: deployed REVISION: 1 TEST SUITE: None NOTES: Thank you for installing strimzi-kafka-operator-0.36.1 To create a Kafka cluster refer to the following documentation. https://strimzi.io/docs/operators/latest/deploying.html#deploying-cluster-operator-helm-chart-str namespace/onap created ### Installing ONAP part ### v3.12.3 Use cache dir: /root/.local/share/helm/plugins/deploy/cache 0 0 0 0 fetching local/onap 2024-03-08T22:24:03.492+0700 INFO [1003] Request served {"path": "/charts/onap-13.0.0.tgz", "comment": "", "clientIP": "127.0.0.1", "method": "GET", "statusCode": 200, "latency": "43.222799ms", "reqID": "6334c986-9584-460c-9789-3fcd5351eb9f"} history.go:56: [debug] getting history for release onap install.go:200: [debug] Original chart version: "" install.go:217: [debug] CHART PATH: /root/.local/share/helm/plugins/deploy/cache/onap release "onap" deployed release "onap-strimzi" deployed waiting for onap-strimzi-entity-operator to be deployed onap-strimzi-entity-operator not found. Retry 1/60 ``` ```bash= release "onap" deployed release "onap-strimzi" deployed waiting for onap-strimzi-entity-operator to be deployed onap-strimzi-entity-operator not found. Retry 1/60 onap-strimzi-entity-operator not found. Retry 2/60 onap-strimzi-entity-operator not found. Retry 3/60 onap-strimzi-entity-operator not found. Retry 4/60 onap-strimzi-entity-operator not found. Retry 5/60 onap-strimzi-entity-operator not found. Retry 6/60 onap-strimzi-entity-operator not found. Retry 7/60 onap-strimzi-entity-operator not found. Retry 8/60 onap-strimzi-entity-operator not found. Retry 9/60 onap-strimzi-entity-operator not found. Retry 10/60 onap-strimzi-entity-operator found. Waiting for pod intialisation release "onap-strimzi" deployed release "onap-roles-wrapper" deployed release "onap-repository-wrapper" deployed release "onap-mariadb-galera" deployed release "onap-dcaegen2-services" deployed release "onap-dmaap" deployed release "onap-policy" deployed release "onap-repository-wrapper" deployed release "onap-roles-wrapper" deployed release "onap-sdnc" deployed namespace/nonrtric created ``` ```bash= NAME READY STATUS RESTARTS AGE onap-dcae-ves-collector-8b767f86f-h6bmd 0/1 Init:0/1 0 2m52s onap-mariadb-galera-0 0/2 PodInitializing 0 2m54s onap-message-router-0 0/2 ContainerCreating 0 2m50s onap-nengdb-init-config-job-r495f 0/1 Init:0/1 0 9s onap-network-name-gen-5cf7bdc944-ssnph 0/1 Init:0/1 0 9s onap-policy-apex-pdp-55694fc89-qzdx7 0/1 Init:0/2 0 87s onap-policy-api-6799979dd7-r6qmw 0/1 Init:0/2 0 87s onap-policy-clamp-ac-a1pms-ppnt-557bd5b778-grlkm 0/1 Init:0/1 0 87s onap-policy-clamp-ac-http-ppnt-99dc78cb7-qnfp4 0/1 Init:0/1 0 87s onap-policy-clamp-ac-k8s-ppnt-5599cf945b-99h56 0/1 Init:0/1 0 87s onap-policy-clamp-ac-kserve-ppnt-584c884bf8-hwgph 0/1 Init:0/1 0 87s onap-policy-clamp-ac-pf-ppnt-7f5b54df6d-dvkmg 0/1 Init:0/1 0 87s onap-policy-clamp-runtime-acm-c48d847f5-6l979 0/1 Init:0/2 0 87s onap-policy-galera-config-4pxn4 0/1 Init:0/1 0 87s onap-policy-galera-init-4kqrh 0/1 Init:0/1 0 87s onap-policy-mariadb-0 0/2 Init:0/1 0 87s onap-policy-pap-6c7b78f655-btvvt 0/1 Init:0/3 0 87s onap-sdnc-0 0/1 Init:0/3 0 9s onap-sdnc-ansible-server-78dd459b84-nxn2v 0/1 Init:0/2 0 9s onap-sdnc-dbinit-job-6lf5b 0/1 Init:0/2 0 9s onap-sdnc-dgbuilder-7bcf65ff78-hkkfl 0/1 Init:0/2 0 9s onap-sdnc-dmaap-listener-64cd9f4d5b-2wztk 0/1 Init:0/2 0 9s onap-sdnc-sdnrdb-init-job-7tf48 0/1 Init:0/1 0 9s onap-sdnc-web-5cd4697dc-fbl8h 0/1 Init:0/1 0 9s onap-sdnrdb-coordinating-only-567cf48d7-cmmsz 0/2 PodInitializing 0 9s onap-sdnrdb-master-0 0/1 PodInitializing 0 9s onap-strimzi-entity-operator-864cb5b89d-tdplx 2/3 Running 0 3m24s onap-strimzi-kafka-0 1/1 Running 0 3m47s onap-strimzi-zookeeper-0 1/1 Running 0 4m31s NAME READY STATUS RESTARTS AGE a1-sim-osc-0-7d8f49d4b8-cmdxt 0/1 ContainerCreating 0 1s a1-sim-osc-1-7b6dd4675c-s2n6v 0/1 ContainerCreating 0 1s a1-sim-std-1-f8778bf66-7npqx 0/1 ContainerCreating 0 1s a1-sim-std2-1-9fcdcbc9c-mzgvk 0/1 ContainerCreating 0 1s controlpanel-c4f5c58f8-rxwfc 0/1 ContainerCreating 0 0s dmaapadapterservice-0 0/1 ContainerCreating 0 1s dmaapmediatorservice-0 0/1 Init:0/1 0 1s helmmanager-0 0/1 Pending 0 1s informationservice-0 0/1 Pending 0 1s nonrtricgateway-d46cf479c-46qlv 0/1 ContainerCreating 0 1s odu-app-b7f7f9f56-6hjds 0/1 ContainerCreating 0 1s odu-app-ics-version-7df48b8d5d-2fqrt 0/1 ContainerCreating 0 0s policymanagementservice-0 0/1 Pending 0 1s rappcatalogueservice-7cc75f77dc-n225b 0/1 ContainerCreating 0 1s topology-7d78f99678-ghbk8 0/1 ContainerCreating 0 1s NAME STATUS AGE default Active 24m kube-node-lease Active 24m kube-public Active 24m kube-system Active 24m nonrtric Active 9s onap Active 5m2s strimzi-system Active 5m3s ``` 4. Wait for pod finished ```bash= kubectl get pods -A ``` **Output:** ```bash= root@node1:~# kubectl get pods -A NAMESPACE NAME READY STATUS RESTARTS AGE kube-system calico-kube-controllers-5d88dcd8d5-z9f2q 1/1 Running 0 45h kube-system calico-node-4qpwl 1/1 Running 2 (46h ago) 2d15h kube-system coredns-5c469774b8-svrbq 1/1 Running 2 (46h ago) 2d15h kube-system coredns-7d4f4cb6bb-mkz5x 0/1 Pending 0 45h kube-system dns-autoscaler-5cc59c689b-dr4tb 1/1 Running 2 (46h ago) 2d15h kube-system dns-autoscaler-775dbd5f55-87852 0/1 Pending 0 45h kube-system kube-apiserver-node1 1/1 Running 4 (46h ago) 2d15h kube-system kube-controller-manager-node1 1/1 Running 13 (78m ago) 2d15h kube-system kube-proxy-lz7zt 1/1 Running 2 (46h ago) 2d15h kube-system kube-scheduler-node1 1/1 Running 13 (78m ago) 2d15h kube-system nodelocaldns-nzdwd 0/1 CrashLoopBackOff 560 (66s ago) 2d15h nonrtric a1-sim-osc-0-86ccc7b84b-pzngj 1/1 Running 0 45h nonrtric a1-sim-osc-1-59666f7579-hmnjg 1/1 Running 0 45h nonrtric a1-sim-std-0-fd9456987-58vpr 1/1 Running 0 45h nonrtric a1-sim-std-1-77c74df84d-qx9xj 1/1 Running 0 45h nonrtric a1-sim-std2-0-5b64898fc8-8s56n 1/1 Running 0 45h nonrtric a1-sim-std2-1-7f89f77b4c-5k5m8 1/1 Running 0 45h nonrtric controlpanel-6d9bb85b5-22xql 0/1 CrashLoopBackOff 534 (3m21s ago) 45h nonrtric controlpanel-c4f5c58f8-rxwfc 0/1 CrashLoopBackOff 551 (71s ago) 2d15h nonrtric dmaapadapterservice-0 1/1 Running 2 (46h ago) 2d15h nonrtric dmaapmediatorservice-0 1/1 Running 2 (46h ago) 2d15h nonrtric helmmanager-0 1/1 Running 2 (46h ago) 2d15h nonrtric informationservice-0 1/1 Running 2 (46h ago) 2d15h nonrtric nonrtricgateway-676f4cc488-vrfq6 1/1 Running 0 45h nonrtric odu-app-6d7ff997-sdj8d 1/1 Running 0 45h nonrtric odu-app-ics-version-5968b856dc-qd6rx 1/1 Running 0 45h nonrtric oran-nonrtric-kong-5fcdcb4d74-czsxd 2/2 Running 2 (45h ago) 45h nonrtric oru-app-846b57dc49-tnfxh 1/1 Running 0 45h nonrtric policymanagementservice-0 1/1 Running 2 (46h ago) 2d15h nonrtric rappcatalogueservice-57b8c567fd-v9vrw 1/1 Running 0 45h nonrtric topology-5878bbf5c5-v84bl 1/1 Running 0 45h onap onap-dcae-ves-collector-7f8f497648-bnp8r 0/1 Init:0/1 266 (3m18s ago) 46h onap onap-dcae-ves-collector-8b767f86f-h6bmd 0/1 Init:0/1 271 (30s ago) 2d15h onap onap-mariadb-galera-0 2/2 Running 11 (46h ago) 2d15h onap onap-message-router-0 1/2 Running 80 (30m ago) 2d15h onap onap-nengdb-init-config-job-6p48q 0/1 Completed 0 2d14h onap onap-nengdb-init-config-job-lr62m 0/1 Init:Error 0 2d14h onap onap-nengdb-init-config-job-r495f 0/1 Init:Error 0 2d15h onap onap-network-name-gen-5bb77d7dcc-8wmwq 0/1 CrashLoopBackOff 532 (101s ago) 46h onap onap-policy-apex-pdp-55694fc89-qzdx7 0/1 Init:0/2 271 (2m36s ago) 2d15h onap onap-policy-apex-pdp-56d44599b4-d96g4 0/1 Init:0/2 266 (3m23s ago) 46h onap onap-policy-api-6799979dd7-r6qmw 0/1 CrashLoopBackOff 518 (3m21s ago) 2d15h onap onap-policy-api-f8c5bbcd8-6z9wl 0/1 Error 504 (5m37s ago) 46h onap onap-policy-clamp-ac-a1pms-ppnt-557bd5b778-grlkm 0/1 CrashLoopBackOff 532 (66s ago) 2d15h onap onap-policy-clamp-ac-a1pms-ppnt-7c6bc8c89c-gg6mw 0/1 CrashLoopBackOff 517 (3m35s ago) 46h onap onap-policy-clamp-ac-http-ppnt-5cfd4b486d-gbbsl 0/1 CrashLoopBackOff 517 (3m34s ago) 46h onap onap-policy-clamp-ac-http-ppnt-99dc78cb7-qnfp4 0/1 CrashLoopBackOff 532 (67s ago) 2d15h onap onap-policy-clamp-ac-k8s-ppnt-5599cf945b-99h56 0/1 CrashLoopBackOff 532 (3m31s ago) 2d15h onap onap-policy-clamp-ac-k8s-ppnt-576bb69f9f-fmv79 0/1 CrashLoopBackOff 516 (3m39s ago) 46h onap onap-policy-clamp-ac-kserve-ppnt-584c884bf8-hwgph 0/1 CrashLoopBackOff 530 (2m41s ago) 2d15h onap onap-policy-clamp-ac-kserve-ppnt-74bdb4c645-spzzs 0/1 CrashLoopBackOff 515 (55s ago) 46h onap onap-policy-clamp-ac-pf-ppnt-7f5b54df6d-dvkmg 0/1 CrashLoopBackOff 531 (3m54s ago) 2d15h onap onap-policy-clamp-ac-pf-ppnt-8456f8567-pks5k 0/1 CrashLoopBackOff 516 (3m49s ago) 46h onap onap-policy-clamp-runtime-acm-c48d847f5-6l979 0/1 CrashLoopBackOff 517 (4m40s ago) 2d15h onap onap-policy-clamp-runtime-acm-fbbcc898-vrz6w 0/1 Error 506 (5m37s ago) 46h onap onap-policy-galera-config-4pxn4 0/1 Init:Error 0 2d15h onap onap-policy-galera-config-877ng 0/1 Init:Error 0 2d14h onap onap-policy-galera-config-qxg9s 0/1 Init:Error 0 2d14h onap onap-policy-galera-config-vwm5v 0/1 Completed 0 2d14h onap onap-policy-galera-init-4kqrh 0/1 Init:Error 0 2d15h onap onap-policy-galera-init-d9x4t 0/1 Completed 0 2d14h onap onap-policy-galera-init-vvb5l 0/1 Init:Error 0 2d14h onap onap-policy-mariadb-0 2/2 Running 11 (46h ago) 2d15h onap onap-policy-pap-6c7b78f655-btvvt 0/1 Init:0/3 271 (116s ago) 2d15h onap onap-policy-pap-6f9b9fc846-x6vps 0/1 Init:0/3 266 (3m50s ago) 46h onap onap-sdnc-0 1/1 Running 2 (46h ago) 2d15h onap onap-sdnc-ansible-server-6bcc6f9bfc-l667c 1/1 Running 0 46h onap onap-sdnc-dbinit-job-67bzk 0/1 Completed 0 2d14h onap onap-sdnc-dbinit-job-6lf5b 0/1 Init:Error 0 2d15h onap onap-sdnc-dgbuilder-999fd5f4f-zmcrv 1/1 Running 0 46h onap onap-sdnc-dmaap-listener-64cd9f4d5b-2wztk 0/1 Init:1/2 2 2d15h onap onap-sdnc-dmaap-listener-767fc7fc7c-qfm89 0/1 Init:1/2 0 46h onap onap-sdnc-sdnrdb-init-job-76sl7 0/1 Init:Error 0 2d14h onap onap-sdnc-sdnrdb-init-job-7tf48 0/1 Init:Error 0 2d15h onap onap-sdnc-sdnrdb-init-job-q2dq6 0/1 Completed 0 2d14h onap onap-sdnc-web-546fd4d764-qdv5s 0/1 Running 545 (5m2s ago) 46h onap onap-sdnc-web-5cd4697dc-fbl8h 0/1 CrashLoopBackOff 560 (112s ago) 2d15h onap onap-sdnrdb-coordinating-only-78d8d45fdd-5gzq6 2/2 Running 0 46h onap onap-sdnrdb-master-0 1/1 Running 2 (46h ago) 2d15h onap onap-strimzi-entity-operator-6668d8f65b-hmd2k 1/3 CrashLoopBackOff 1130 (16s ago) 46h onap onap-strimzi-kafka-0 0/1 CrashLoopBackOff 742 (37s ago) 2d15h onap onap-strimzi-zookeeper-0 0/1 CreateContainerError 16 (46h ago) 2d15h strimzi-system strimzi-cluster-operator-64f9bf48c9-gx6n9 1/1 Running 5 (78m ago) 2d15rororroorr ```