perf/core: Fix time tracking bug with multiplexing