Doesn't matter. Has nothing to do with online.
You can run OpenCV on an RPi, it's just super slow, and you could probably use a cheap GPU chip to do it faster. You store the pretrained model on the device.
You may even get away with an asic designed for the model, though with that one I'm talking out my ass.