Revert "usb: dwc3: gadget: always decrement by 1"