First Annual Message to Congress, 1829 (Excerpt)
In a country where offices are created solely for the benefit of the people no one man has any more intrinsic right to official station than another. Offices were not established to give support to particular men at the public expense. No individual wrong is, therefore, done by removal, since neither appointment to nor continuance in office is matter of right. The incumbent became an officer with a view to public benefits, and when these require his removal they are not to be sacrificed to private interests. It is the people, and they alone, who have a right to complain when a bad officer is substituted for a good one. He who is removed has the same means of obtaining a living that are enjoyed by the millions who never held office. The proposed limitation would destroy the idea of property now so generally connected with official station, and although individual distress may be sometimes produced, it would, by promoting that rotation which constitutes a leading principle in the republican creed, give healthful action to the system.
From First Annual Message to Congress, 1829, in Andrew Jackson, Annual Messages, Veto Messages, Proclamations, etc.