mlx4 failure error on k8s-haosu-19.sdsc.optiputer.net
This node was having networking issues. Updating bios/bmc and it started working again. Mellanox firmware was on latest version. Still getting this failed error however. Lower priority because it seems to be working, but probably needs addressed at some point.