This is the song Dave’s band sing at Mrs Kim’s prayer meeting.
“Amazing Grace” is a 1779 Christian hymn by English Anglican clergyman John Newton. It is an immensely popular hymn, particularly in the United States, where it is used for both religious and secular purposes.
The Annotated Gilmore Girls 