It's very much an acquired taste kinda thing. I feel that most people use it wrong; spreading it way to thick or eating it out of the jar (good god). I think Vegemite is too strong/overpowering on its own and really meant to almost be a garnish.
I'm German, so not really certified to talk about it but I do like Vegemite. You toast some toast, spread butter on it, then a thin layer of Vegemite and then add a slice of cheese.