We love to read the statements in the Bible that describe God rejoicing over His rescued heritage with singing (Zephaniah 3), but the Bible also teaches that God is a moral governor as well as a father. He is displeased when His professed people go directly contrary to His counsel.