I'm sure you're right, but the text of the constitution is very clear
Each State shall appoint, in such Manner as the Legislature thereof may direct, a Number of Electors, equal to the whole Number of Senators and Representatives to which the State may be entitled in the Congress; but no Senator or Representative, or person holding an Office of Trust or Profit under the United States shall be appointed an Elector.
The Congress may determine the Time of chusing the Electors, and the Day on which they shall give their Votes; which Day shall be the same throughout the United States.
It doesn't mean the Supreme Court as constituted would uphold it, but it's pretty clearly constitutional.