# lab Notes

requirement
---
- KVM
- container (lxc)
- redundacy
- container CoW (copy on write, overlayfs)
- better have shared storage
- VM live migration
- better have some cental controller for hypervisor
- fault torence (2nd priority)

need
---
- do some research on Ceph

for now we chose
---
- ceph for storage

hypervisor
---
- openstack
- UX limitation
- Proxmox VE
- AGPLv3
- lxc
- kvm
- no libvirt
- qemu patched

current
---
- 4yrs server
- debian 10
- ram: 256G
- 1 SSD for OS
- 1 HDD for data (1TB)
- full
- instance both kvm and container
- 10G

option1
---
- 3 compute node
- 1 shared storage (no redundacy)

option2
---
- 3 compute node
- 3 ceph node (performance issue)

option3
---
- 3 compute/ceph node HCI
- need SSD

structure cableing
---
- patching rack
- SMF (LC fanout)-MPO
- 24 pairs per rack (or 48 pairs in 1U)
- to IXIA
- to other rack for interconnect
- RJ45 x6
- CICT lab has this 24 port in 1U per rack
- x12 if we have money
- if possible, put RJ45 and SMF into 1U
- 1 slot for RJ45, up 3 slots for SMF

server
---
- 2U
- 12bays
- HBA card (raid card without hardware raid)
- SAS/SATA
- might need a PCIe slot
- rear panel has two harddisk slot
- better have it
- enough PCIe slot
- BMC is MUST
- interface
- 25G x2 for service and connect to other node's service
- 25G x2 for ceph
- E810 25Gx4 card
- DPDK for network
- SPDK for storage

console server
---
- 1 console server per rack
- 32 ports per console server
- need to use normal RJ45 cable and rollover cable both

PDU
---
- remote control is MUST
- 2 port per device for redundacy (importnat)
- ask PDU vendor for this if PDU mgmt is dead

switch
---
- need remote access to control it
- need some script to control vlan
- ToR switch mgmt port need to connect to patching rack directly
- AS7326-56X-F 2pcs for MC-LAG
- ecSONiC