arm64: kernel: drop use of x24 from primary boot path