Irrfan Khan is been asked to compromise for work