The following helped me

apt-get remove virtualbox

Which removed virtualbox but it did not remove virtualbox-ose-dkms which was giving me the same error as OP.

apt-get remove...