drm/omap: remove extra manager checks on disconnect