Yes I do believe that a single person could violated the safety of a larger group. For example say someone had a protest for something they  believed and were killing a bunch of people for their right or they were something threatening, they could get their human rights taken away from that. I do believe that if you do something threatening or harmful for somebody else on purpose you should loose some or even all of your rights!