It sounds like you've been listening to somebody from the alt-right who doesn't like groups that confront the alt-right on their bullsh-t.
Have some
Knowledge Sauce.
Not everybody who believes in direct action believes in violence. They believe that when the brownshirts are in the streets it's a good idea to have people oppose them rather than just let them run around bashing in people's heads. Some Antifa people surround alt-righters who, as cowards, typically stop their nonsense. Sometimes there's a Nazi who foolishly wants to fight and Antifa at that point shocks them by actually fighting. The right is used to screaming their invective and pushing and punching people who are non-violent and don't punch back. They react like a scalded baby when they get punched back. The right is the glass-jawed bully who screams to mommy when he picks on the small kid and some other kid steps in.
But it is a broad category for a belief system whose central premise -- to push the fascists back into their caves -- I 100% endorse.