I could be wrong but I've only ever heard it used to refer to black people (not all poc's) acting violent or loudly.
Like how they imagine a chimpanzee would act, I assume.
Im not expecting great depth of thought from people using this phrase knowing it's origin.