Communications of the ACM
Expect Deeper and Cheaper Machine Learning
Credit: Edmon de Haro
Machine-learning technologies are undergoing a transformation with appearances in products and systems that experts predict will be less expensive and more focused on deep-learning calculations. "Everybody is doing deep learning today," says Stanford University professor William Dally.
One popular method in this area is the use of application-specific integrated circuits (ASICs), which is Google's approach with its Tensor Processing Unit. Field-programmable gate arrays are another tool being used; they have the benefit of reconfigurability with changing computing requirements. However, the most common technique in use involves graphics-processing units for parallel execution of mathematical operations.
Dally cites three distinct deep-learning hardware application areas, including "training in the data center," where many neuronal links are adjusted so an artificial neural network can perform an assigned task. Another area is "inference at the data center," which entails the continuous operation of cloud-based neural networks that have previously been taught to execute some other task. Dally says the third core deep-learning operation is "inference in embedded devices" such as smartphones, tablets, and cameras, which will likely be handled by low-power ASICs as smartphone apps are increasingly augmented by deep-learning software.
Dally, recipient in 2010 of the ACM/IEEE Eckert-Mauchly Award, notes software advances can quickly make hardware obsolete. "The algorithms are changing at an enormous rate," he says. "Everybody who is building these things is trying to cover their bets."
From IEEE Spectrum
View Full Article
Abstracts Copyright © 2016 Information Inc., Bethesda, Maryland, USA
No entries found