The Library of Congress has posted 10,000 digitized recordings that make up the genesis of the National Jukebox. The first round of postings is collected from the Victor Talking Machine archives from 1901 to 1925 and includes some real beauties, such as Will Rogers delivering an after-dinner speech in New York to a hall full of bankers. He lays them out like pilchards in the sun.
My personal favorite - for now - is the Harry Lauder's 1913 recording of The Kilty Lads.
Thus spake the rabbit.