Eastlake Victorian has a great story about Victorian Music. After looking through the article near the bottom are some links to some original recordings. Below are couple of the gems I found looking through the recordings.
Wm. M. Randol
P.S. The audio player I built for this page can be found on GitHub: http://williamrandol.github.com/bootstrap-player/