Do you have the PID and the VID for that USB device ?
If yes, include that in the autoconnect pattern, together with the HostId, in the VirtualUSBUSBBackingInfo spec.
Add the device in this way to the desired VM, and ESXi will connect the correct USB device (when it finds it).
You could also wait for Conrad's session and see how he did it 