arm64: unify idmap removal