IT department really wanted to use their snake oil antivirus enterprise super secure hackproof™ software everywhere.
So it was installed on the CI servers.
Fastforward a few months and we were wondering why one build agent was no longer picking up jobs.
After a day of debugging we found out that a certain snake oil sofware tampered with a single machine internal TCP conncetion and somehow fucked it up in a way that all packets in one direction just vanished.
Disabling the snake oil software magically fixed the problem.