Communications of the ACM
Researchers Share seful Lessons Learned in Evaluating Emerging Technologies
A NIST-designed framework for evaluating emerging technologies helped to focus and further efforts to develop two-way speech-translation systems to aid U.S. soldiers and Marines serving in Iraq and Afghanistan. In this trial, a Marine and a speaker of Pas
Photo courtesy of U.S. NIST
U.S. National Institute of Standards and Technology (NIST) researchers have developed the System, Component, and Operationally Relevant Evaluations (SCORE) framework, which is designed to judge the performance of a system and its components as well as the utility of the technology for the intended user.
SCORE is a unified set of criteria and software tools for evaluating emerging technologies from different perspectives and levels of detail. SCORE was developed for assessing intelligent systems.
"Intelligent systems can respond to conditions in an uncertain environment--be it a battlefield, a factory floor, or an urban highway system--in ways that help the technology accomplish its intended purpose," says NIST's Craig Schlenoff.
SCORE was used to evaluate two U.S. Defense Advanced Research Projects Agency projects known as ASSIST and TRANSTAC. ASSIST involves equipping soldiers with wearable sensors, such as video cameras, microphones, and global positioning systems. TRANSTAC involves the development of a two-way speech translation system that enables speakers of different languages to communicate with each other in real time. "The main lesson is that the extra effort devoted to evaluation planning can have a huge effect on how successful the evaluation will be," Schlenoff says.
From NIST News
View Full Article
Abstracts Copyright © 2011 Information Inc. 
, Bethesda, Maryland, USA
No entries found