acm-header
Sign In

Communications of the ACM

ACM TechNews

Using Computers to View the Unseen


View as: Print Mobile App Share:
In the top row, researchers used their technique to recreate visual elements in an out-of-view video; the original elements are shown in the bottom row.

Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory researchers have advanced a technique to envision scenes outside a line of sight without special gear.

Credit: Miika Aittala et al

Scientists at the Massachusetts Institute of Technology (MIT)'s Computer Science and Artificial Intelligence Laboratory have advanced a technique to envision scenes outside a line of sight without special gear.

The passive method can reconstruct concealed images from subtle shadows and reflections. An algorithm monitors how shadow and geometry interact to predict the path light travels in a scene, then calculates what is unseen from the observed shadows—and can build a silhouette of a live-action performance.

The algorithm concurrently trains two neural networks specialized for a single target: one creates the scrambling pattern, while the other estimates the hidden video.

The networks are rewarded when the blended factors replicate the video recorded from the clutter, driving them to explain their observations with plausible concealed data.

From MIT News
View Full Article

 

Abstracts Copyright © 2019 SmithBucklin, Washington, DC, USA


 

No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account