Had the same problem.

Disabled USB2 under Setttings>Ports>USB>Enable USB2 EHCI

It then worked a sometimes but lagged a bit.

Moved to Vmware Fusion v4 and all fixed works perfectly.
Will...