Buy used.

I picked up a Dell Small Form Factor desktop for $50.

Or pickup an old business Mini for a similar price.

From a power perspective, they're in the same wattage range as a Pi (under 20w), but have much more performance if needed.