The whistling guy was Omar, a stick up man. His scene while on the stand getting cross examined by the dirty lawyer was one of the most memorable scenes of the whole series. https://youtu.be/P3i36ybA8Ms
The actor unfortunately died a few years ago but was excellent in The Wire and also excellent in Boardwalk Empire.