There's no point in wasting GPU resources on VMs when LXCs can share the same card ...
Get the most out of your GPU by enabling some of its best features (and maybe disabling a few).