Should referees get abuse?

Was just thinking about it, and is it right?

I've dished it out and so does my dad. But not sure, if I think about it, if I'm that comfortable with it.

Crap poll above.