Maybe Ruben was genuinely peeved at being the butt of so many jokes, and Al decided that consideration for a friend, fellow musician and fellow tourbus inhabitant took precedence over comedic value.
"Weird Al" has a charisma that's all his own. The awkward, the misshapen, the socially inept flock to his banner.