Since posting this I started to think more about what was actually happening.
So basically he only acts strange when I sit in a particular spot in the hoose.
I ruled out all of the basic needs so unless it's something medical it doesn't seem to be related to a need.
Thus I have to consider the area itself. I think he simply doesn't want me to be there.
I then considered why. What type of activities did I engage in when I sat at my desk?
One of the activities that I only engage in at my desk is attend work meetings.
I wonder if that is the cause. He doesn't like it when he hears the voices of strangers. Furthermore I've observed him getting annoyed whenever I'm on the phone with anyone, even off loud speaker.
This is my best theory so far.