Your mileage may vary: I was able to keep this from occurring by the following: toggling the ehci_hcd by unbinding and rebinding.

The device in particular that I think was messing me was a card...