It's not really a difference in English, either. "Venom" is a specific term, but "poison" is general, so too with poisonous.

I think it's specific in some scientific areas, but insisting on that is like insisting on calling a tomato a fruit, or a banana a berry.