120
Shoppers falsely identified by facial recognition system struggle to clear their names (www.theguardian.com)
submitted 6 months ago by to c/privacy@programming.dev
16 comments fedilink hide all child comments
 

As facial recognition spreads across police forces and retail stores, UK biometrics commissioners are warning that national oversight is lagging far behind the technology’s rapid expansion.

Last year, the Home Office admitted facial recognition cameras were more likely to incorrectly identify black and Asian people than their white counterparts, and women more than men, and there have been conflicting studies on their overall accuracy.

you are viewing a single comment's thread
view the rest of the comments
[–] 19 points 6 months ago (1 child)

The company’s website claims that its system has a 99.98% accuracy rate

99.98% accuracy of the people it flags as shoplifters or 99.98% accuracy overall? And if the latter then what proportion of the population are even shoplifters? Could you achieve similar levels of "accuracy" by saying nobody is a shoplifter? Maybe throw in a few positives here and there to make it look like your product does something other than harass the public?

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] 9 points 6 months ago

    You're right to question this.

    In machine learning Accuracy means the correct % of overall classifications. There's some other terms like:

    • Precision which is the % of correctly identified positives divided by the number of positive classifications. A high precision score would mean that of everyone who flagged as a match you had relatively few who were not actual shoplifters.
    • Recall (true positive rate) which is the % of correctly identified positives divided by all actual positives. A high recall score measures how many shoplifters you caught and would minimize false negatives, but at the cost of more false positives.

    So in the case of classification of shoplifters ideally you would focus on Precision as false positives are undesired, but if a company doesn't care about false positives as much as getting the shoplifters they'd focus on Recall. In either event, Accuracy is a poor metric to use or advertise in an imbalanced data set like shoplifting as most customers are not shoplifters so even if the model didn't classify anyone as a shoplifter they'd still be 99+% accurate.

  • permalink
  • fedilink
  • source
  • parent