Comment # 6 on bug 98276 from Alex Deucher

You can also unbind the console before unloading the module.

sudo bash -c "echo 0 > /sys/class/vtconsole/vtcon1/bind"
sudo modprobe -r amdgpu