The point has never been about the actual pixel color codes. It's about how human perception doesn't follow those objective metrics.

Distilled down, we perceive color and brightness in comparison to the surrounding scene. The checker shadow illusion is a clear example of the same color looking different.

So the color perception on the dress depends on how the brain decides to color correct the white balance of the scene.