Completely understandable, and I'll readily admit to doing the same. But it's appropriate to consider the rights and wrongs of the situation:
1. If you're playing in a rec league with refs, it's simply a play on the edge of the rules. If you go too far, you sit for two minutes. Even so, it might be a good penalty -- just as it is at the more serious levels of play. It's not a cheap shot.
2. In a friendly pick-up game, however, it's a bad play. This is especially true if the target is a weaker player who rarely gets scoring chances. You've taken a small liberty, knowing there's no price. There'll be bit of grumbling, then play resumes. Better to play clean D, or just let the guy take his shot.
3. If the two players involved are buddies, and are mutually horsing around, #2 doesn't apply.
IMHO.