you'd know because the sun would have appeared to move laterally wrt the horizon throughout the year and you know what time it is each day based on the sun's apparent vertical movement.