Pakistan blow as Sarfraz leaves Australia tour