I’m pretty sure “zoophilia” is more about being into animals rather than actual sex with them

I wasn't sure about this, due to the common link with sexuality - but it looks like - at a semantic level - you're right.

From the original Greek via Aristotle;

philia is commonly translated as friendship or affection. Its conceptual opposite is phobia

Continued today with Bibliophilia, Dendrophilia, Thalassophilia etc (Books, trees, the sea) - all non-sexual, and there are hundreds of other examples "used in everyday language to describe completely normal, passionate hobbies and aesthetic appreciation"