---
# System prepended metadata

title: lab Notes

---

# lab Notes

requirement
---
- KVM
- container (lxc)
- redundacy
- container CoW (copy on write, overlayfs)
    - better have shared storage
- VM live migration
    - better have some cental controller for hypervisor
- fault torence (2nd priority)

need
---
- do some research on Ceph

for now we chose
---
- ceph for storage

hypervisor
---
- openstack
    - UX limitation
- Proxmox VE
    - AGPLv3
    - lxc
    - kvm
    - no libvirt
    - qemu patched


current
---
- 4yrs server
- debian 10
- ram: 256G
- 1 SSD for OS
- 1 HDD for data (1TB)
    - full
    - instance both kvm and container
- 10G

option1
---
- 3 compute node
- 1 shared storage (no redundacy)

option2
---
- 3 compute node
- 3 ceph node (performance issue)

option3
---
- 3 compute/ceph node HCI
    - need SSD


structure cableing
---
- patching rack
- SMF (LC fanout)-MPO
    - 24 pairs per rack (or 48 pairs in 1U)
    - to IXIA
    - to other rack for interconnect
- RJ45 x6
    - CICT lab has this 24 port in 1U per rack
    - x12 if we have money
- if possible, put RJ45 and SMF into 1U
    - 1 slot for RJ45, up 3 slots for SMF

server
---
- 2U
- 12bays
- HBA card (raid card without hardware raid)
    - SAS/SATA
    - might need a PCIe slot
- rear panel has two harddisk slot
    - better have it
- enough PCIe slot
- BMC is MUST
- interface
    - 25G x2 for service and connect to other node's service
    - 25G x2 for ceph
    - E810 25Gx4 card
        - DPDK for network
        - SPDK for storage


console server
---
- 1 console server per rack
- 32 ports per console server
- need to use normal RJ45 cable and rollover cable both

PDU
---
- remote control is MUST
- 2 port per device for redundacy (importnat)
- ask PDU vendor for this if PDU mgmt is dead

switch
---
- need remote access to control it
- need some script to control vlan
- ToR switch mgmt port need to connect to patching rack directly
- AS7326-56X-F 2pcs for MC-LAG
    - ecSONiC