you are viewing a single comment's thread
view the rest of the comments
[–] 57 points 1 year ago (12 children)

Literally not how any of this works. You don't let AI check your work, at best you use AI and check it's work, and at worst you have to do everything by hand anyway.

  • source
  • hideshow 12 child comments
  • [–] 25 points 1 year ago* (last edited 1 year ago) (8 children)

    You don’t let AI check your work

    From a game dev perspective, user Q&A QA is often annoying and repetitive labor. Endlessly criss-crossing terran hitting different buttons to make sure you don't snag a corner or click objects in a sequence that triggers a state freeze. Hooking a PS controller to Roomba logic and having a digital tool rapidly rerun routes and explore button combos over and over, looking for failed states, is significantly better for you than hoping an overworked team of dummy players can recreate the failed state by tripping into it manually.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 15 points 1 year ago (6 children)

    There's plenty of room for sophisticated automation without any need to involve AI.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 7 points 1 year ago (1 child)
  • [–] 1 point 8 hours ago

    In this case however, it explicitly is:

    The project, which is titled Joint Development of Game QA Automation Technology Using Generative AI, is being tackled by “a joint research team of more than ten members”, including researchers from the University of Tokyo and engineers from the Square Enix group.

    The goal, according to the report, is to “automate 70% of QA and debugging tasks in game development by the end of 2027”.

  • source
  • parent
  • [–] 8 points 1 year ago (1 child)

    I mean, as a branding exercise, every form of sophisticated automation is getting the "AI" label.

    Past that, advanced pathing algorithms are what Q&A systems need to validate all possible actions within a space. That's the bread-and-butter of AI. Its also generally how you'd describe simulated end-users on a test system.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -1 points 1 year ago* (last edited 1 year ago)

    I mean, as a branding exercise, every form of sophisticated automation is getting the "AI" label.

    The article is specifically talking about generative AI. I think we need to find new terminology to describe the kind of automation that was colloquially referred to as AI before chatgpt et al. came into existence.

    The important distinction, I think, is that these things are still purpose-built and (mostly) explainable. When you have a bunch of nails, you design a hammer. An "AI bot" QA tester the way Booty describes in the article isn't going to be an advanced algorithm that carries out specific tests. That exists already and has for years. He's asking for something that will figure out specific tests that are worth doing when given a vague or nonexistent test plan, most likely. You need a human, or an actual AGI, for something on that level, not generative AI.

    And explicitly with generative AI, as pertains to Square Enix's initiative in the article, there are the typical huge risks of verifiability and hallucination. However unpleasant you may think a QA worker's job is now, I guarantee you it will be even more unpleasant when the job consists of fact-checking AI bug reports all day instead of actually doing the testing.

  • source
  • parent
  • [–] 6 points 1 year ago (2 children)

    its *

    Ironically, that’s definitely something AI could check for.

  • source
  • parent
  • hideshow 2 child comments