The context in the OP outright states anger at any use of spanish, period. This has nothing to do with "politeness," and is always some form of racism or worker control. If OP had stated that this was only the case when said charge was involved in the conversations and felt left out, then this is a different context from the one OP provided.
You came in here trying to invent a situation that is, at its fundamentals, unique from what OP described.