What you're thinking of is called district heating

District heating (also known as heat networks) is a system for distributing heat generated in a centralized location through a system of insulated pipes for residential and commercial heating requirements such as space heating and water heating. The heat is often obtained from a cogeneration plant burning fossil fuels or biomass, but heat-only boiler stations, geothermal heating, heat pumps and central solar heating are also used, as well as heat waste from factories and nuclear power electricity generation. District heating plants can provide higher efficiencies and better pollution control than localized boilers. According to some research, district heating with combined heat and power (CHPDH) is the cheapest method of cutting carbon emissions, and has one of the lowest carbon footprints of all fossil generation plants.