[toc]

# Diagram

## Staging setup

### Global diagram


| Owner | Usage | Rack# | MGMT# | Device | VLAN | Subnet |
| -------- | ------- | ----- | ------- | ---------------------- | -------------- | ------ |
| Delivery | OOB | 0 | swp1 | pm0-rmc0/eth2 | 100 | |
| Delivery | OOB | 0 | swp2 | pm0-rmc1/eth2 | 100 | |
| Lenovo | OOB | 1 | swp3 | pm1-rmc0/eth2 | 200 | |
| Lenovo | OOB | 1 | swp4 | pm1-rmc1/eth2 | 200 | |
| R&D | OOB | 2 | swp5 | pm2-rmc0/eth2 | 100 | |
| R&D | OOB | 2 | swp6 | pm2-rmc1/eth2 | 100 | |
| R&D | OOB+INB | 2 | swp47 | pm2/W3AM0/D3* | 100 | |
| R&D | OOB+INB | 2 | swp48 | pm2/W3AM1/D3* | 100 | |
| Delivery | Data | 0 | swp49 | pm0/WEM/swp32 | <br/>1001/1002 | |
| R&D | Data | 2 | swp50 | pm2/WEM/swp32 | 1001 | |
| Delivery | All | 0 | swp51s0 | pm-mgt0/enp65s0f0np0 | Trunk | |
| Delivery | All | 0 | swp51s1 | pm-mgt0/enp65s0f1np1 | Trunk | |
| Lenovo | All | 1 | swp51s2 | bsc-login/enp65s0f0np0 | Trunk | |
| Lenovo | All | 1 | swp51s3 | bsc-login/enp65s0f1np1 | Trunk | |
| Delivery | OOB+INB | 0 | swp52s0 | pm0/W3AM0/U0 | 1000 | |
| Delivery | OOB+INB | 0 | swp52s1 | pm0/W3AM1/U0 | 1000 | |
| Lenovo | OOB+INB | 1 | swp52s2 | pm1/W3AM0/U0 | 1100 | |
| Lenovo | OOB+INB | 1 | swp52s3 | pm1/W3AM1/U0 | 1100 | |



## Theorical setup


## Switches interco


# Management host

## Remote access

`pm-mgt0/eno1 (10.106.62.94/23)`

## BMC

[root@pm-mgt0 ~]# ipmitool lan print

IP Address Source       : DHCP Address
IP Address              : 10.106.62.89
Subnet Mask             : 255.255.254.0
MAC Address             : b4:2e:99:7f:10:e2
Default Gateway IP      : 10.106.62.1
Default Gateway MAC     : 88:fc:5d:6b:a4:cd

## Repos

[AppStream]
async = 1
baseurl = http://oban/dist/RHEL/8.6/base/AppStream/
enabled = 1
gpgcheck = 0

[BaseOS]
async = 1
baseurl = http://oban/dist/RHEL/8.6/base/BaseOS/
enabled = 1
gpgcheck = 0

[epel8]
async = 1
baseurl = http://oban/dist/unsupported/Epel/8/Modular/x86_64/
enabled = 1
exclude = slurm* munge* ansible
gpgcheck = 0

## Network

Side_A                Side_A_IP            Side_B          Side_B_IP

pm-mgt0/eno1          10.106.62.94/23  =>  ACN             10.106.61.0/23
pm-mgt0/eno2          172.168.0.1/16   =>  sn2201/eth0     172.168.0.x/16
pm-mgt0/enp65s0f0np0  10.0.255.250/16  =>  sn2201/swp51s1

## XH3000 devices

pm0-bmc23       10.0.0.23
pm0-bmc24       10.0.0.24
pm0-nod23       10.1.0.23
pm0-nod24       10.1.0.24
...
pm0-hmc0        10.0.0.197
pm0-hmc1        10.0.0.198
#
pm0-pmc0        10.0.0.202
pm0-rmc0        10.0.0.170
pm0-rmc0-bis    10.0.0.171
pm0-rmc0-maint  192.168.0.1
pm0-rmc1        10.0.0.180
pm0-rmc1-bis    10.0.0.181
pm0-rmc1-maint  192.168.0.2

## Managements

H3MC (x2)
P3MC (x1)
RMC (x2)
RMC_ind (x2)
BCM_switches (x4 or x1)
W3E_MC (x1)
BMC (xN)

| Name | Interface | Device |
| -- | -- | -- |
| pm0-rmc1-maint | /dev/ttyS1 | Main |
| pm0-rmc1-maint | /dev/ttyS0 | Unit3 |
| pm0-rmc0-maint | /dev/ttySx | Unit2 |

| Name | Type | Interface | DHCP | MAC | dst_port | IP |
| -- | -- | -- | -- | -- | -- | -- |
| pm0-hmc0 | Hydro | eth0 | opt 61 | 08:00:38:ce:38:a6 | 1/0/56 | 10.0.0.197 |
| pm0-hmc1 | Hydro | eth0 | opt 61 | 08:00:38:ce:38:9e | 2/0/54 | 10.0.0.198 |
| pm0-pmc0 | PWR | eth0 | opt 61 | 08:00:38:ce:37:b3 | 1/0/55 | 10.0.0.202 |
| pm0-rmc0 | Rack | eth0 | opt 61? | 08:00:38:ce:3a:39 | 1/0/45 | 10.0.0.170 |
| pm0-rmc0-bis | Rack | eth1 | opt 61 | 08:00:38:ce:3a:38 | 2/0/53 | 10.0.0.171 |
| pm0-rmc0-mnt | Rack | eth2 | opt 61 | 08:00:38:ce:3a:37 | xxx | 10.0.3.1 |
| pm0-rmc1 | Rack | eth0 | opt 61? | 08:00:38:ce:3a:b2 | 3/0/45 | 10.0.0.180 |
| pm0-rmc1-bis | Rack | eth1 | opt 61 | 08:00:38:ce:3a:b1 | 4/0/53 | 10.0.0.181 |
| pm0-rmc1-mnt | Rack | eth2 | opt 61 | 08:00:38:ce:3a:b0 | xxx | 10.0.3.3 |
| pm0-bcm | BCM | xxx | opt 61 | 08:00:38:ce:3a:b8 | 0/5/1 | 10.0.3.2 |
| WEM | HSE | eth0 | opt 61 | 94:6d:ae:8d:64:a6 | 2/0/44 | 10.0.3.4 |
| pm0-nodxx | node | Int 25GbE | opt 82 | 08:00:38:ce:xx:xx | xxx | 10.0.0.x |
| pm0-bmcxx | BMC | eth0 | opt 61 | 08:00:38:ce:xx:xx | xxx | 10.0.0.x |
| pm0-bmc24 | BMC | eth0 | opt 61 | 08:00:38:ce:5b:d3 | 3/0/9 | 10.0.0.24 |
| pm0-bmc25 | BMC | eth0 | opt 61 | 08:00:38:ce:57:5f | 1/0/9 | 10.0.0.25 |
| pm0-bmc26 | BMC | eth0 | opt 61 | 08:00:38:ce:5b:3d | 3/0/23 | 10.0.0.26 |

VLAN ID  MAC Address         Interface              IfIndex  Status
-------  ------------------  ---------------------  -------  ------------
1        08:00:38:CE:37:B3   1/0/55                 55       Learned
1        08:00:38:CE:38:9E   2/0/54                 120      Learned
1        08:00:38:CE:38:A6   1/0/56                 56       Learned
1        08:00:38:CE:3A:38   2/0/53                 119      Learned
1        08:00:38:CE:3A:39   1/0/45                 45       Learned
1        08:00:38:CE:3A:B1   4/0/53                 251      Learned
1        08:00:38:CE:3A:B2   3/0/45                 177      Learned
1        08:00:38:CE:3A:B8   0/5/1                  265      Management
1        08:00:38:CE:57:5F   1/0/9                  9        Learned
1        08:00:38:CE:5B:3D   3/0/23                 155      Learned
1        90:0A:84:1E:C0:84   1/0/57                 57       Learned
1        90:0A:84:1E:C0:85   3/0/57                 189      Learned
1        94:6D:AE:8D:64:A6   2/0/44                 110      Learned
1        E8:EB:D3:CA:C6:94   1/0/57                 57       Learned

pm0-bmc24 => 3/0/9
pm0-bmc25 => 1/0/9
pm0-bmc26 => 3/0/23

sn2201/swp50s0 => pm0-bcm/1/0/57
sn2201/swp50s1 => pm0-bcm/3/0/57

Interface  RemID   Chassis ID            Port ID             System Name
--------- -------  --------------------  ------------------  ------------------
pm0-bcm => 2/0/44     1       94:6D:AE:8D:64:A6     eth0                cumulus
pm0-bcm => 3/0/57     2       90:0A:84:7C:67:80     swp50s1             cumulus
pm0-bcm => 1/0/57     3       90:0A:84:7C:67:80     swp50s0             cumulus

## Stack config

(Broadcom FASTPATH Switching)#show ru

!Current Configuration:
!
!System Description "Broadcom Quartz System - 56 GE + 4 XE + 2 HG, 8.10.1.7, Linux 5.4.2"
!System Software Version "8.10.1.7"
!System Up Time          "3 days 1 hrs 32 mins 11 secs"
!Additional Packages     FASTPATH QOS,FASTPATH IPv6 Management,FASTPATH Stacking
!Current System Time: Jan  4 01:32:11 1970
!
vlan database
exit

configure
stack
member 1 1
member 2 1
member 3 1
member 4 1
exit
slot 1/0 1
set slot power 1/0
no set slot disable 1/0
slot 2/0 1
set slot power 2/0
no set slot disable 2/0
slot 3/0 1
set slot power 3/0
no set slot disable 3/0
slot 4/0 1
set slot power 4/0
no set slot disable 4/0
username "admin" password 13115d7a7ec877c28c7c39d069c2935a6bc6a982311318dfbf41838fa1726d0d4267f3d42872b64ed2d667e0d309068c0528a2c7ee6762247133f2641652b883 encryption-type aes level 15 encrypted


line console
exit

line telnet
exit

line ssh
exit

!
dhcp l2relay vlan 1
dhcp l2relay circuit-id vlan 1
dhcp l2relay remote-id 0 vlan 1
exit