Communications of the ACM
Team Says AI Can Translate Brainwaves Into Written Text
The DeWave model matched brain signals with specific sentences.
Credit: University of Technology Sydney
Using a sensor-filled helmet combined with artificial intelligence, a team of scientists has announced they can turn a person's thoughts into written words.
In a study, participants read passages of text while wearing a cap that recorded electrical brain activity through their scalp. These electroencephalogram (EEG) recordings were then converted into text using an AI model called DeWave. The work was presented at the NeurIPS 2023 conference.
The DeWave model was trained by looking at lots of examples where brain signals match up with specific sentences, says team member Charles Zhou at the University of Technology Sydney, Australia. Once DeWave understood the brain signals well, the team connected it to an open-source large language model that used signals from DeWave as a guide to create sentences.
The researchers say that with refinement the system could enable communication for people who have lost speech.
From New Scientist
View Full Article
No entries found