Frank's hats read "Former Cyclops" and "Horny". Liz asks him to change the trucker cap saying "Horny", because she's worried it gives a bad impression. Though she clearly meant the slogan, when we next see Frank, he is instead wearing a bowler hat with exactly the same word written on it.
Alec Baldwin previously worked with Megan Mullally on Will & Grace as her love interest
Actress Megan Mullally previously starred on Will & Grace (1998). The exterior of Liz Lemon's apartment on Riverside Drive is across the street from the building used as Will and Grace's apartment. Additionally, her co-star Sean Hayes previously made a guest appearance on this show as Kenneth Parcell's cousin in Hiatus (2007).
Pete says he was in anger management for shooting a co-worker with an arrow. This is a reference to the prior episode, season 2 finale "Cooter" when he shoots an arrow at Donny so that Kenneth can get his Olympic application in on time.