The "for dummies" take-away I've heard is that the big mix-up is in confusion about the term "observer". Normal people use it to mean a person's attention, while physicists use the specific concept of an observer of a particle to mean another interacting particle.