Among the many historical items seen are an iron maiden and a guillotine, though the latter was not invented until 1792.
Pinky portrays a Robin Hood like character here, named the Merry Man (likely a nod to Robin of Sherwood and his Merry Men). In the final scene, Pinky joins an actual Robin Hood-esque character in jail. Both of them were traditional hats attributed to Robin of Sherwood.
The miniature hourglass timepiece is a wink at the new models of watches that were becoming popular at the time of this short. The hourglass itself dates back to 14th century Europe