xfrm: Only add l3mdev oif to dst lookups