We're almost in post-modern times with words like that I reckon, everyone knows so deeply that it should never be used as an insult that it's now fine to use it as a joke. Pretty sure that's the Gervais view too, he obviously isn't trying to insult anyone.
Not sure about 'retard', that's more American I suppose, never really heard it used over here.