See if your CPU has integrated graphics - you could use that.

I was going to say that you could get a low end graphics card like an RX550, but even those have gone up in price. They originally sold for $70 for the 4GB model and were around $30-35 second-hand before everything went up.

Avoid low-end Nvidia on Linux, as they become VRAM-constrained. Nvidia's Linux driver doesn't let GPUs swap to system RAM like AMD's and Intel's do.