The party can still get rid of him as PM with a vote of no confidence in parliament. Folloed by a vote of confidence in the chosen successor.
I expect that if he thought that would actually happen he would be willing to step down as leader to avoid it. The trouble wold be getting him to believe, before the revolt destroys the party.