CJ has freedom to make changes in ToRs: PM