The people who yammer about that are the ones donning ICE gear.
My Dad was a huge 2A nut, specifically because he thought the government will come get him. But he was explicitly afraid of brown people - terrified of Obama and the 'radical leftists'. He prophesied that the Gummit was gonna let "illegals" take over the country, and "regular folk" wouldn't have a home left (ie, a white christian ethnostate, which he believed the US should be)