The way i see it, there's defensive and offensive force (violence is a form of force). Using force to suppress, exploit or dominate others classifies as offensive, while protecting yourself against this by fighting back (with violence or other types of force) classifies as defensive.

Defensive force is justified. Offensive force is not.