Yes, I use tinfoil for hot weather. Bubble wrap and blankets over the window are also good insulation. This is a good one.
Weather stripping is also quite cheap and easy to put on windows and doors. (I’ve only done my doors)
And a rolled up towel or door snake under the door