Paul Scully was dropped from the role following Rishi Sunak’s Cabinet reshuffle last month.
The Conservative says the news was not expected and he cannot deny he is disappointed.
But at the same time, Mr Scully says he can leave the position with pride.