Yes.

https://www.visaverge.com/legal/crime-rates-lower-among-undocumented-immigrants-than-us-natives/

Evidence shows both undocumented and legal immigrants in the U.S. consistently have much lower crime and incarceration rates than natives across crime categories. This trend challenges popular beliefs and highlights the importance of accurate data for fair immigration and criminal justice policies, emphasizing immigrant contributions to safety.

So, its literally true that if you deported all native born citizens and left only immigrants, the crime rate would go down.

Thus, if you deport a subset of native born citizens, the same still applies.

So this also means that mass deporting all immigrants, regardless of their actual criminal record... well that would necessarily increase the crime rate overall.