" Benjamin Franklin wrote little about race, but had a sense of racial loyalty. “[T]he Number of purely white People in the World is proportionably [sic] very small,” he observed. “ . . . I could wish their Numbers were increased.”
James Madison, like Jefferson, believed the only solution to the problem of racial friction was to free the slaves and send them away. He proposed that the federal government sell off public lands in order to raise the money to buy the entire slave population and transport it overseas. He favored a Constitutional amendment to establish a colonization society to be run by the President. After two terms in office, Madison served as chief executive of the American Colonization Society, to which he devoted much time and energy. At the inaugural meeting of the society in 1816, Henry Clay described its purpose: to “rid our country of a useless and pernicious, if not dangerous portion of the population.”
The following prominent Americans were not merely members but served as officers of the society: Andrew Jackson, Daniel Webster, Stephen Douglas, William Seward, Francis Scott Key, Winfield Scott, and two Chief Justices of the Supreme Court, John Marshall and Roger Taney. All opposed the presence of blacks in the United States and thought expatriation was the only long-term solution.
James Monroe was such an ardent champion of colonization that the capital of Liberia is named Monrovia in gratitude for his efforts. As for Roger Taney, as chief justice he wrote in the Dred Scott decision of 1857 what may be the harshest federal government pronouncement on blacks ever written: Negroes were “beings of an inferior order, and altogether unfit to associate with the White race, either in social or political relations; and so far inferior that they have no rights which a White man is bound to respect.”
Abraham Lincoln considered blacks to be—in his words—“a troublesome presence” in the United States. During the Lincoln-Douglas debates he expressed himself unambiguously: “I am not nor ever have been in favor of making voters or jurors of negroes, nor of qualifying them to hold office, nor to intermarry with white people; and I will say in addition to this that there is a physical difference between the white and black races which I believe will for ever forbid the two races living together on terms of social and political equality.”
His opponent, Stephen Douglas, was even more outspoken, and made his position clear in the very first debate: “For one, I am opposed to negro citizenship in any form. I believe that this government was made on the white basis. I believe it was made by white men for the benefit of white men and their posterity forever, and I am in favor of confining the citizenship to white men—men of European birth and European descent, instead of conferring it upon negroes and Indians, and other inferior races. "

― Jared Taylor , White Identity: Racial Consciousness in the 21st Century