I don't consider black or white, or gray, to be "colors", there's no hue, so, it's just the brightness value. White is all the frequencies of visible light together. If it's all colors, then it's no one color, so it's not a color, it's just light with no color. Gray, and black are just less light with no color.

Black, gray, and white are not colors.