Communications of the ACM
Does This AI Think Like a Human?
Said MIT's Angie Boggust, “In developing Shared Interest, our goal is to be able to scale up this analysis process so that you could understand on a more global level what your model’s behavior is.”
Credit: MIT News
Massachusetts Institute of Technology (MIT) and IBM Research scientists have developed the Shared Interest method for rapidly analyzing a machine learning model's behavior by evaluating its individual explanations.
The technique uses saliency methods to highlight how the model made specific decisions, comparing them to ground-truth data.
Shared Interest then applies quantifiable metrics that compare the model's reasoning to that of a human by measuring the alignment between its decisions and the ground truth, then classifying those decisions into eight categories.
The method can be used for image and text classification.
MIT's Angie Boggust warned that the technique is only as good as the saliency methods on which it is based; if those techniques are biased or contain inaccuracies, the technique will inherit those limitations.
From MIT News
View Full Article
Abstracts Copyright © 2022 SmithBucklin, Washington, DC, USA
No entries found