Schwartz describes the song's mood as melancholy and wistful. "'On the Willows' is a song about loss, both in the original psalm and here," he explains. "In Godspell the group is losing their leader—this person that they all love, so it's a song of advanced mourning."