Immich came out in '22 and I don't think makes much use of LLMs, at least it doesn't feel like it does.
For resource usage did you disable all the search, face recognition, and transcoding modules? Those will have heavy resource usage on CPU if you didn't set up hardware acceleration for them.
I find it very fast overall and the heavier resource usage is only when photos are initially added.