The expression “come off your perch” means: come down a peg or two; don’t be too conceited, haughty, or arrogant.
The allusion is to the twig serving as a resting place for a bird; hence, a point of vantage from which one may take a superior view.
The present expression is American of some fifty years’ standing.