File a complaint. He threatened you, and he beat her brother. The smart thing is to file a complaint.
The dumb thing to do (which I would be guilty of) is beating the shit out of that guy and threatening to cut his balls off (Done that before, don’t be dumb like me).