The legacy of the Museum begins in 1798 When Eli Whitney first chose a site on the Mill River to build his Armory. Chosen for its access to a strong current of water, Whitney intended to use this as a power source for the machines he would use to produce the parts of his contract musket. Whitney, however, was not the first to see the potential of this site as a grist mill had been located on the grounds previously. Over time the site has taken on new residencies and has physically changed as well.