Augmented photography with projection mapping

A kinedioscope (animated“kínēma” dimensional“diastáseis” view“scope”), is a technique we invented to create animated depth effects on static photographs.

The process to create the effect is reverse-engineering the technology of photogrammetry.
In photogrammetry multiple photographs are used to compute a 3D model. In order to create this model, an algorithm defines each photograph’s camera location, view direction and focal length. This information is used in the kinedioscope in order to perfectly align the photography with the perspective of the 3D model. Once the 3D model and the photography camera view match it is possible to create depth and masking effects.

For our first experiment with the technique we printed a photograph and used a projector to overlay the dimensional light effects. The scene we chose is from Muir Woods near San Francisco, we were interested in the topic of the woods and the contrast of contemplation and melancholy, with this new medium and custom generative light effects we aim to translate the eerie, spooky and surreal beauty of the woods. Other source of inspirations were the serie Twin Peaks and Hitchcock’s Muir Woods in Vertigo.

Find more info about the project and source code from the instructables
This project was made with the support of Autodesk, during a residency at Pier 9.

The custom software to create effects and “augment” the photography is made in openFrameworks. Light effects we have been using are from the addons https://github.com/yasuhirohoshino/oF-MultiShadowE… by Yasuhiro Hoshino, some of the code from the example was inspired by ofxBundle by Patricio Gonzalez Vivo. The 3D photogrammetry and mesh reconstruction were made using Autodesk Recap, Autodesk Meshmixer and meshlab.