It seems, it's not a vfio issue. There are (possibly) some firmware/hw problems, as it happens also on bare metal Windows (at least on my machine): https://community.amd.com/thread/204651