It appears that there is evidence to back up my theory that the magical relics were passed down by patriarchs, beginning with Joseph Smith, Sr.:
The Smith family parchments were handed down through the provenance of Hyrum Smith's relatives. A 1963 authorized biography of Hyrum Smith identified the magical parchments as his "Emblematic parchments" (Pearson Corbett, Hyrum Smith, Patriarch, SLC, Deseret Book, 1963, p. 453). Eldred G. Smith, whose great-great-grandfather was Hyrum Smith, admitted that the chain of ownership for the parchments began with Joe Smith, Sr (Quinn, p. 103). In 1969, Hyrum F. Smith's daughter recalled the provenance of the parchments as passing from Joe Smith's brother to patriarchs in the family (Evaline Smith Haws to Robert Haws, 11 November 1969, Archives, Historical Department, Church of Jesus Christ of Latter-day Saints, SLC).
I am drawing this bit of text, admittedly, from a Christian anti-Mormon website, that appears to be in poor upkeep. The sources, however, are not anti-Mormon.
To see the website, visit
http://www.conchisle.com/magic.htm
"Petition wasn’t meant to start a witch hunt as I’ve said 6000 times." ~ Hanna Seariac, LDS apologist