“He thought it was a hat”

RORY: We talked about Fez.
LORELAI: And he thought it was a hat.

A fez is a short cylindrical felt hat or cap, usually red, and often decorated with a tassel. It is named after the Moroccan city. Worn in the Middle East since medieval times, it was popularised by the Ottomans in the 19^th century.