I actually just found a quote from Boyle specifically saying that Jimmy's gang are like "a replacement for the family he loses at the beginning", which is how I originally interpreted that scene.