It does support it, you just have to add it to dnsmasq. I have it Setup under misc.dnsmasq_lines like so:

address=/proxy.example.com/192.0.0.100
local=/proxy.example.com/

Then I have my proxied service reachable under service.proxy.example.com