James Madison, the "Father of the ... In 1814 the British went so far as to burn the White House and Capitol Building as a fleeing Madison watched from across the Potomac. By 1815 the American ...