@ssolie:
Indeed
@alaban:
I did the test with hid.usbfd running first. Its all ok if I plug in the Xero mouse (its detected, recognized and used), but still: right with unplugging it, the system freezes. Again, if I dectivate hid.usbfd, there are absolutely no problems (besides EHCI driven ports).
I did another test and used my two mice in Early Startup simultaneously, and there is absolutely no interference (besides the interferences of my hands

). I reconnect both mice several times within Early Startup, and there is still no problem at all. The system boots fine after this.
I would say, the driver is quite clean now. Expunge is ok, so this was not the culprit.
Regarding the comparison with your tablet: Does it establish TWO devices of the same kind? The Xero does (I dont know what it is good for, but I see it in USBInspector and it is unused as long as the mouse is connected to an OHCI port). Maybe there is something going wrong with the "second device" and hid.usbfd.
Regarding the serial debug output: I have to search for the cable first, and if Im forced to alter UBoot settings, I have to wait for a new FlashROM first. My SAM is equipped with a rather strange UBoot, I cant use any keyboard with it and its missing any version information. Might be a beta version (the SAM is a used one...)