Speaking up isn't going to do anything. It's like walking up to your bully and politely asking them to stop hurting you.
Take a wild guess what ICE, MAGA, and fascists respect? If you answered anything other than "violence" you are part of the reason why this is allowed to happen.