PM wanted to come for meeting, claims Imran