Barnaby Joyce addresses new rumours