Container peppers can be tricky. The only thing I've found that works is constant fertilization with compost tea or fish fertilizer from seedlings to fruiting, but don't overdo it with the water. Let the soil in the container completely dry out before watering, give it a bit of water then, but one big gulp once a week. That seems to work for me.
Lots of people keep the soil hydrated which isn't what all pepper varieties want. These small chilies are also used to hotter climates.