you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 7 months ago (1 child)

It seems like the kind of thing that could eventually be useful for helping to survey companies figure out how to word surveys and which surveys are even worth doing for a given group, rather than replacing the surveys themselves. Unfortunately it seems like the companies currently just want to replace the actually useful product with ai slop, as per usual

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 7 months ago

    Yes, it can obviously never entirely replace real surveys. I would assume that survey results forming a part of the training set is a big part of why they're able to get good results in the first place, and as I said I think its a significant risk that the evaluation is done it performs well because the data being evaluated against are (unbeknownst to the researcher) present in the training set.

  • source
  • parent