IPoIB: Make the carrier_on_task race aware