I enjoyed almost all of the covers on Nirvana's Unplugged album. I don't understand their fascinations with the Meat Puppets, but every song they covered by them was great.
As far as a guilty pleasure cover that I like goes... it would have to be Kelly Osbourne's cover of Papa Don't Preach. Between that and Shut Up I actually thought and still do think that Kelly Osbourne has potential.