There's a big difference between desktop environment needs and headless server needs.
Anything with user interaction will require an enormous number of additional services, which consumes resources.
I expect to run simple headless software on 256-512 MB of RAM. For example.