xhci: remove conversion from generic to pci device in xhci_mem.c