160960000

Issue

• Node has no detail including Tag and iDRAC network after a MB replacement.
• Both iDRAC network settings and Tag are empty.

Concern

• EasyRestore didn't work properly.

Plan

1. Set iDRAC network > OK
2. Access iDRAC > OK
3. Do Personal Module update > OK
4. Upgrade iDRAC. > OK
5. Import iDRAC license > OK
6. Re-build/Edit fru 17 > OK
7. Configure Virtual Console, esure it works. > OK.
8. Check, Install, Config ISM + vmk1 > OK
9. Check ensure Platform Service is working properly with iDRAC. > OK
10. Compliance Status. > OK

Troubleshooting & Remediation

Node details

• Tag: 7RX8NX2
• Model: E560F
• VxRail: 7.0.401

Set iDRAC network

iDRAC Network need to meet:

Address=172.19.44.7
DHCPEnable=Disabled
DNS1=172.19.50.35
DNS2=172.19.215.135
DNSFromDHCP=Enabled
Enable=Enabled
Gateway=172.19.44.1
Netmask=255.255.255.192

Current iDRAC Network;

[root@tldcvxrail3:/opt/vxrail/tools] ./ipmitool lan print
Set in Progress         : Set Complete
Auth Type Support       : MD5
Auth Type Enable        : Callback : MD5
                        : User     : MD5
                        : Operator : MD5
                        : Admin    : MD5
                        : OEM      :
IP Address Source       : DHCP Address
IP Address              : 0.0.0.0
Subnet Mask             : 0.0.0.0
MAC Address             : b0:7b:25:ce:07:bc
SNMP Community String   : public
IP Header               : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10
BMC ARP Control         : ARP Responses Enabled, Gratuitous ARP Disabled
Gratituous ARP Intrvl   : 2.0 seconds
Default Gateway IP      : 0.0.0.0
Default Gateway MAC     : 00:00:00:00:00:00
Backup Gateway IP       : 0.0.0.0
Backup Gateway MAC      : 00:00:00:00:00:00
802.1q VLAN ID          : Disabled
802.1q VLAN Priority    : 0
RMCP+ Cipher Suites     : 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14
Cipher Suite Priv Max   : Xaaaaaaaaaaaaaa

Updated iDRAC Network:

[root@tldcvxrail3:/opt/vxrail/tools] ./ipmitool lan print 1
Set in Progress         : Set Complete
Auth Type Support       : MD5
Auth Type Enable        : Callback : MD5
                        : User     : MD5
                        : Operator : MD5
                        : Admin    : MD5
                        : OEM      :
IP Address Source       : Static Address
IP Address              : 172.19.44.7
Subnet Mask             : 255.255.255.192
MAC Address             : b0:7b:25:ce:07:bc
SNMP Community String   : public
IP Header               : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10
BMC ARP Control         : ARP Responses Enabled, Gratuitous ARP Disabled
Gratituous ARP Intrvl   : 2.0 seconds
Default Gateway IP      : 172.19.44.1

Access iDRAC

• Both fqdn and IP work.

Do Personal Module update

• Completed
• Tag and model are plotted.

Upgrade iDRAC

• Completed.
• 5.10.30.201

Import iDRAC license

• Completed.
• Exported from DEE.
• Enterprise.

Re-build/Edit fru 17

Current fru 0:

[root@tldcvxrail3:/opt/vxrail/tools] ./ipmitool fru print 0
 Board Mfg Date        : Tue May 11 16:23:00 2021
 Board Mfg             : DELL
 Board Product         : PowerEdge R640
 Board Serial          : CNIVC001321078
 Board Part Number     : 0X45NXA04
 Product Manufacturer  : DELL
 Product Name          : PowerEdge R640
 Product Version       : 01
 Product Serial        :
 Product Asset Tag     : PASS:12345

Current fru 17:

(Empty)

Updated fru 17:

[root@tldcvxrail3:~] /opt/vxrail/tools/ipmitool fru print 17
 Chassis Type          : Rack Mount Chassis
 Chassis Part Number   : VxRail E560F
 Chassis Serial        : 7RX8NX2
 Chassis Extra         : DE700192400149

• Completed.

Configure Virtual Console, esure it works

• Completed.
• eHTML5, port 5901

Check, Install, Config ISM + vmk1

• Completed.
• Both vmk1 + vSwitchiDRACvusb were not existing.
• Both have been created and functioning properly.

iSM:

iSM is active (not running)

iSM restarting removes standard SW.

vib:

dcism                          4.1.0.0.2410-DEL.700.0.0.15843807      DEL     VMwareAccepted    2021-11-22

vmk1 + vSwitchiDRACvusb svs have been re-created by ism/sfcbd

vmk1
   Name: vmk1
   MAC Address: 00:50:56:6b:bb:9f
   Enabled: true
   Portset: vSwitchiDRACvusb
   Portgroup: iDRAC Network
   Netstack Instance: defaultTcpipStack
   VDS Name: N/A
   VDS UUID: N/A
   VDS Port: N/A
   VDS Connection: -1
   Opaque Network ID: N/A
   Opaque Network Type: N/A
   External ID: N/A
   MTU: 1500
   TSO MSS: 65535
   RXDispQueue Size: 4
   Port ID: 134217792

Check ensure Platform Service is working properly with iDRAC

• vxpsvc has connected to iDRAC successfully.
• Platform Service has connected to iDRAC successfully.

2023-02-16T07:35:00Z platform_svc: [ThreadPoolExecutor-0_0] INFO - USB nic is ready
2023-02-16T07:35:00Z platform_svc: [ThreadPoolExecutor-0_0] INFO - wait iDrac... ,[Errno 111] Connection refused
2023-02-16T07:35:18Z platform_svc: [ThreadPoolExecutor-0_0] INFO - USB nic is ready
2023-02-16T07:35:18Z platform_svc: [ThreadPoolExecutor-0_0] INFO - wait iDrac... ,[Errno 111] Connection refused
2023-02-16T07:35:35Z platform_svc: [ThreadPoolExecutor-0_0] INFO - USB nic is ready
2023-02-16T07:35:35Z platform_svc: [ThreadPoolExecutor-0_0] INFO - iSM is ready
2023-02-16T07:35:36Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Found service acccount in slot 15
2023-02-16T07:35:36Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Refresh Password
2023-02-16T07:35:37Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Enable the account
2023-02-16T07:35:38Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Setting up the public key for the service account
2023-02-16T07:35:49Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Service account setup successfully
2023-02-16T07:35:49Z platform_svc: [MainThread] INFO - the Idrac is ready.
2023-02-16T07:35:49Z platform_svc: [MainThread] INFO - Add sticky bit for PS config file
2023-02-16T07:35:49Z platform_svc: [MainThread] INFO - started the restful API service.
2023-02-16T07:35:52Z platform_svc: [ThreadPoolExecutor-0_0] INFO - The updateable firmware info collected
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - PTAgent Account setup done
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - ConfigSetting: agent_backend='auto'
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Detected Agent Backend: 'none'
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Bypass the firmware inventory initialization
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Start PSAPI service thread
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - resistered api list: /node/discoveryinfo$ /node/info$ /node/apis$ /node/fw$ /node/fwupgrade/staging$ /node/fwupgrade/apply$ /node/idrac/reset$ /node/inventory/hard_refresh$ /node/tasks$ /node/tasks/(?P<taskid>[\w-]+)$ /node/agent/status$
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Registering "dell.idrac_account"
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Registering "techsuprep"
2023-02-16T07:35:54Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Registering "dell.esxi_tmp_account"
2023-02-16T07:35:57Z platform_svc: [ThreadPoolExecutor-0_0] INFO - Platform initialized

VxRail Manager can gather host 03 details from Platform Service:

2023-02-16 07:36:53.851+0000 WARN  [myScheduler-3] com.emc.mystic.manager.commons.vmware.VimOperator VimOperator.checkHost:2762 - In maintenance mode: tldcvxrail3.nus.edu.sg

• Physical View was plotted correctly.

Compliance Status

• 1 non-compliant case detected ESXI_HOST tldcvxrail3.nus.edu.sg
• Non-Compliant BIOS for VxRail E560F 2.9.4
• Expected BIOS: 2.14.2
• Consider to upgrade BIOS manually.
• Upgraded BIOS manually for the host 03.
• Current BIOS: 2.14.2
• Regenerate Compliance Report: Outcome: Compliant

Completed.