A swan song is the final performance or activity in a person’s career, because according to folklore, swans sing beautifully just before they die.
Although this episode does have swans in it, they don’t sing, nor does it involve anyone dying, doing a performance, or ending their career. However, this is the source of the episode title.
The Annotated Gilmore Girls 