the VM exit latency time for privileged instructions plays from a performance view an important role as well
The performance impact of EPT always depends on the applications running in your VMs. In some applications (tlb-miss sensitive, many random access) the software-mmu mode is sometimes preferable over the EPT mode.