The whole card, you mean, not just a single port?
Well, you'd lose all access to your storage, and eventually the IOs on the VMs would stop and timeout. How the guest OS response to this varies 
.
Note: HA doesn't view this as a failure scenario....