xhci: Clean up work to xhci_add_endpoint().