415
Nvidia's DLSS 5 Is a Slap in the Face to the Art of Video Game Design (www.ign.com)
submitted 7 months ago by to c/games@lemmy.world
78 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 7 months ago (10 children)

Unforunately the latest stuff I've seen is all about keeping character consistency, which is basically having a fixed frame of reference for every generation. What I don't get not knowing much about the details is how LLM generation is faster than actual 3D modeling with more details? Perhaps overall it is faster per frame to generate a 2D image vs. tracking all the polys.

Not saying which is right to do, there's lots of baggage with discussing AI stuff, just wondering about the actual tech itself.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 10 child comments
    •
  • [–] 35 points 7 months ago* (last edited 7 months ago) (1 child)

    What I don't get not knowing much about the details is how LLM generation is faster than actual 3D modeling with more details?

    It's not, DLSS5 takes a frame as rendered normally by your GPU and feeds it into a second $3k GPU to run the AI image transformer.

    There is no performance benefit, in fact it adds a bit of latency to the process.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 8 points 7 months ago (2 children)

    Polys is not where expensive computation is. The bottleneck is raytracing and volumetric fog etc. All those things that make a game look more real and natural.

    I think this dlss stuff could potentially substitute raytracing and other light/shadow/reflections/transparency things that are very expensive to both program correctly and calculate every frame.

    My two cents

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 9 points 7 months ago (1 child)

    Lighting is the space image gen struggles in most now. Individual areas will show convincing shadows, atmosphere, etc, but motivation and consistency is lacking. The shots from Hogwarts Legacy show that really clearly. Slice out a random 10%x10% chunk of the frame and the lighting looks more realistic, but the overall frame loses the directional lighting driven by real things in the scene.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 4 points 7 months ago*

    I’m curious how well it handles lighting from unseen light sources that otherwise didn’t contribute as much to the scene as they should have. In other words, off screen lights that shine into the scene but are not fully rendered by traditional means. Same thing goes for reflections.

    I expect a lot of nonsense being hallucinated in those areas.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 7 months ago (4 children)

    It's not an 'LLM' (large language model). 🤦

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 7 months ago (3 children)

    I try to avoid the overhyped and wrongly used term AI, so what's the proper term? Related to diffusion models? Something different?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 9 points 7 months ago (1 child)

    Neural network would be the most technically accurate given what they've announced so far.

    There's no information on if it's a diffusion or transformer architecture. Though given DLSS 4.5 introduced a transformer for lighting, my guess would be that it's the same thing just being more widely applied. But the technical details haven't been released from anything I've seen, so for the time being it's being described as "neural rendering" using an unspecified neural network.

    https://www.nvidia.com/en-us/geforce/news/dlss-4-5-dynamic-multi-frame-gen-6x-2nd-gen-transformer-super-res/

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 7 months ago

    Generative AI is a decent catch-all that I think would apply to this.

    Another good option is "machine learning" or ML, but that's fallen out of favor cause it doesn't sound as impressive as AI. But really it's teaching a machine to do a specific task. It's not intelligent, it's just that we don't understand how it learns.

  • permalink
  • fedilink
  • source
  • parent