Hi Folks,
We have an ESXi host that is running a single VM, piloting a VM for a phone system. A few days ago the whole system crashed host and VM were unavailable and had to be powered off to restore any connectivity to it. We've gone through all the VMWare logs had a look in the HP iLO and cannot find any obvious reasons.
The only log that has some sort of indication of something up is the syslog.log file, but there are so many errors in this, as below, are these actual errors being reported?
Thanks in advance
Alex
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# In Failed Array'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Rebuild/Remap in progress'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Rebuild/Remap Aborted (was not completed normally)'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Correctable ECC/Other Correctable Memory Error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Post Memory Resize'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:14:*:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:14:*:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# System Firmware Progress'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Uncorrectable ECC/Other Uncorrectable Memory Error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Parity'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Memory Scrub Failed (stuck bit)'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Memory Device Disabled '
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:12:4:1::15'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# System Firmware Error (Post Error)'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# System Firmware Hang'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# System Firmware Progress'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:15:2:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:15:2:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Correctable ECC/Other Correctable Memory Error Logging Limit Reached'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Presence Detected'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Event Logging Disabled'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Correctable Memory Error Logging Disabled'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Event 'Type' Logging Disabled'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Log Area Reset/Cleared'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:12:6:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:16:2:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:12:6:1::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:16:2:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Controller access degraded or unavailable'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# All Event Logging Disabled'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# SEL Full'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# SEL Almost Full'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Management controller off-line'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Watchdog 1'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Management controller unavailable'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Sensor Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# FRU Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Config error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Battery'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Spare'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Battery low (predicitive failure)'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Battery failed'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:12:8:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Battery presence detected'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:41:2:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:41:2:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Redundancy degraded from non-redundant'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# session audit'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Session activated'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Discrete'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:42:0:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# D0 power state'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:42:0:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Session deactivated'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:0:0::2'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:42:1:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:0:1::2'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:42:1:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# D1 power state'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:1:0::18'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Version Change'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:1:1::18'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:43:*:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# D2 power state'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:43:*:1::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:2:0::18'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:2:1::18'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# FRU state'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# D3 power state'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Not installed'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:3:0::10'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:0:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='12:*:3:1::10'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:0:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Inactive'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='#'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:1:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Sensor specific events follow - event reading type: 0x6f == 111'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:1:1::15'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='#'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# activation requested'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:2:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Temperature'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:2:1::8'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:1:*:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# activation in progress'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:1:*:1::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:3:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:3:1::8'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Voltage'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# active'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:2:*:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:4:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:2:*:1::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:4:1::2'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# deactivation requested'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Current'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:5:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:3:*:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:5:1::9'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:3:*:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# deactivation in progress'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:6:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Fan'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:6:1::9'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:4:*:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:12:8:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Automatically Throttled'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:17:*:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:17:*:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# System Event'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:4:*:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Physical Security'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Platform Security'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# lost communication'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Processor'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# IERR'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Thermal Trip'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# FRB1/BIST Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# FRB2/Hang in POST Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Undetermined System Hardware Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# FRB3/Processor Startup/Initialization Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Configuration Error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# SM BIOS 'Uncorrectable CPU-complex Error''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Processor Presence'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:7:7:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Critical Interrupt'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:7:7:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Front Panel NMI/Diagnostic Interrupt'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Processor Disabled'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:7:0::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Critical overtemp'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Bus Timeout'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:44:7:1::13'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Drive Slot (Bay)'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# I/O Channel Check NMI'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Software NMI'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# PCI PERR'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# PCI SERR'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# EISA Fail Safe Timeout'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Bus Correctable Error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Drive Presence'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Bus Uncorrectable Error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Fatal NMI (port 61h, bit 7)'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:13:0:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:13:0:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Drive Fault'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Predictive Failure'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Bus fatal error'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Hot Spare'
2018-10-01T08:58:11Z localcli: omc-ipmi: Read 754 lines from /etc/sfcb/omc/sensor_health, total entries 251
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Bus degraded'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line='# Button'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:20:*:0::'
2018-10-01T08:58:11Z localcli: Missing healthState value to report, line='111:20:*:1::'
2018-10-01T08:58:11Z localcli: Missing expected value to check for, line=''