Chelsea boss says it “won’t be the end of the world” if he leaves as he insists it’s not just up to owners if he stays