xfs: stop holding ILOCK over filldir callbacks