Communications of the ACM
Scientists Develop AI That Can Turn Brain Activity Into Text
Credit: Getty Images
Scientists have developed artificial intelligence that can turn brain activity into text.
While the system currently works on neural patterns detected while someone is speaking aloud, experts say it could eventually aid communication for patients who are unable to speak or type.
"We are not there yet but we think this could be the basis of a speech prosthesis," says Joseph Makin, co-author of the research from the University of California, San Francisco.
In "Machine Translation of Cortical Activity to Text With an Encoder-Decoder Framework," published in the journal Nature Neuroscience, Makin and colleagues reveal how they developed their system by recruiting four participants who had electrode arrays implanted in their brain to monitor epileptic seizures.
These participants were asked to read aloud from 50 set sentences multiple times. The team tracked their neural activity while they were speaking. This data was then fed into a machine-learning algorithm, a type of artificial intelligence system that converted the brain activity data for each spoken sentence into a string of numbers.
The team found the accuracy of the new system was far higher than previous approaches.
From The Guardian
View Full Article
No entries found