“This form of hereditary privilege started as a favour, soon became a custom, and finally a necessity; but it never became law.”