Communications of the ACM
Driverless Cars? Not So Fast
Credit: iStockPhoto.com
Followers of technology news know that numerous companies have been trying to develop driverless cars for a decade or more. These fully automated vehicles could potentially be safer than regular cars, and might add various efficiencies to roads, like smoother-flowing traffic.
Or so it is often claimed. But the promise of artificial intelligence, advanced sensors, and self-driving cars could be achieved without full autonomy, argue scholars with deep expertise in automation and technology — including David Mindell, an MIT professor and author of a new book on the subject.
If robotics in extreme environments are any guide, Mindell says, self-driving cars should not be fully self-driving. That idea, he notes, is belied by decades of examples involving spacecraft, underwater exploration, air travel, and more. In each of those spheres, fully automated vehicles have frequently been promised, yet the most state-of-the-art products still have a driver or pilot somewhere in the network. This is one reason Mindell thinks cars are not on the road to complete automation.
"That's just proven to be a loser of an approach in a lot of other domains," Mindell says. "I'm not arguing this from first principles. There are 40 years' worth of examples."
Now Mindell, the Frances and David Dibner Professor of the History of Engineering and Manufacturing in MIT's Program in Science, Technology, and Society, and also a professor in MIT's Department of Aeronautics and Astronautics, has detailed the history in his new book, "Our Robots, Ourselves," published by Viking Books.
To be clear, Mindell thinks that "it's reasonable to hope" that technology will help cars "reduce the workload" of drivers in incremental ways in the future. But total automation, he thinks, is not the logical endpoint of vehicle development.
"The book is about a different idea of progress," Mindell says. "There's an idea that progress in robotics leads to full autonomy. That may be a valuable idea to guide research . . . but when automated and autonomous systems get into the real world, that's not the direction they head. We need to rethink the notion of progress, not as progress toward full autonomy, but as progress toward trusted, transparent, reliable, safe autonomy that is fully interactive: The car does what I want it to do, and only when I want it to do it."
Not an Endpoint
To see why Mindell thinks history shows us that automation is not the endpoint of vehicular development, consider the case of undersea exploration. For decades, engineers and scientists thought that fully automated submersibles would be a step forward from the seemingly risky work of deep-sea journeys.
Instead, something unexpected happened with submersibles: Technological progress, including improved communications technologies, made it less useful to have fully automated vehicles sweeping across the sea floor. Instead, Mindell notes, submersibles "are more effective when they have even a little communication" with people monitoring and controlling them.
Or consider the Apollo program, which put U.S. astronauts on the moon six different times. Originally, Mindell notes, the expectation was that moon missions would be fully automated, with astronauts nothing more than passengers. But in the end — and partly due to the feedback of the astronauts themselves — astronauts handled many critical functions, including the moon landings.
"The sophistication of the computer and the software was used not to push people out, but to give them true control over the landing," Mindell says.
And then there are airplanes. Commercial airliners do have many automated systems, such as cruise control-type features and even systems that can automate landings in certain circumstances. But it still takes highly trained pilots to manage those systems, make critical decisions in the cockpit — and, yes, frequently to steer the planes.
"Commercial aviation is incredibly safe," says Mindell, himself a qualified civil aviation pilot with more than 1,000 hours of flying time to his credit. "Part of the reason is there are a lot of highly technical systems, but those systems are all imperfect, and the people are the glue that hold the system together. Airline pilots are constantly making small corrections, picking up mistakes, correcting the air traffic controllers."
Drawing on a concept developed by MIT professor of mechanical engineering Tom Sheridan, Mindell notes that the level of automation in a project can be judged on a scale from 1 to 10 — and aiming for 10, he contends, does not necessarily lead to more success in any given endeavor, compared to a happy medium of technology and person. In the space program, Mindell says, "The digital computer in Apollo allowed them to make a less automated spacecraft that was closer to the perfect 5."
Dated Narrative
So why, in the case of cars, are we back to a point where many people are envisioning a driverless future? In a way, Mindell says, this vision of the future belongs squarely to the past.
"I think the narrative of full autonomy is a 20th-century narrative," Mindell says. "It's a narrative of industrial mechanization that's kind of filtered its way through the 20th century, supported by 20th-century science fiction. These narratives can and should change."
Still, the idea of total automation is the approach taken by Google, most notably, in its development of self-driving cars. Yet as Mindell also observes, there are many challenges to the Google model: Its cars must identify all nearby objects correctly, need perfectly updated mapping systems, and must avoid all software glitches.
Ultimately, Mindell writes, "Google's utopian autonomy is a more brittle, less functional solution than a rich, human-centered automation." He predicts that the fully driverless model will not be the most successful, both for technical and social reasons.
"The notion of ceding control of something as fundamental to life as driving to a big, opaque corporation — people are not comfortable with that," he says. Additionally, other companies and research groups looking at automating cars are "very clearly not going for the Google approach to fully driverless cars."
Other scholars have found "Our Robots, Ourselves" to be valuable. Ian Bogost, a professor of media studies and interactive computing at Georgia Tech, calls the book "a lucid, hype-free exploration of how robotic automation really works" in tandem with human design and operation.
Mindell says he is eager to see how technologists, especially robotics engineers, react to the book. Among the places where Mindell is scheduled to speak on his current book tour are Microsoft and, yes, Google. In time, Mindell says, he believes his perspective will come to be more widely accepted, and that full automation on the roads will not seem as desirable a goal.
"I think the public discourse is slowly coming around to there is another way to do it," Mindell concludes.
No entries found