Don't disturb baby deer (not accusing you op). Mama deer know exactly where they put baby and baby stays put until mama comes back
The baby's coat and instincts are their camouflage. Unless you notice the baby abandoned for multiple days it's fine. They hunker down until retrieved by mom while she forages