Hot Cross Buns Song History . One a penny, two a penny. After the long lenten fast, the feast of scented buns, loaves, and cakes that marks the arrival of easter comes as sweet relief. The history of the hot cross bun Country Life Hot cross buns, Bun, Eat from www.pinterest.com The history of hot cross buns is a bit fuzzy, but they likely date back to the middle ages when it was a cultural institution to share sweet sacrifices with. Farmers began to place hot cross buns in their stored grain to distract mice and other pests, much the way shoofly pie was used by american housewives. Good friday comes this month, the old woman runs, with one or two a penny hot cross bunns. the fact that the words of the famous song appear in this reference does rather suggest that the term may have been around a while.