SIGGRAPH Asia 2008

Deep Photo: Model-Based Photograph Enhancement and Viewing

Johannes Kopf
University of Konstanz


Boris Neubert
University of Konstanz


Billy Chen


Michael F. Cohen
Microsoft Research

Daniel Cohen-Or
Tel Aviv University


Oliver Deussen
University of Konstanz


Matt Uyttendaele
Microsoft Research


Dani Lischinski
The Hebrew University

Some applications of the Deep Photo system.


In this paper, we introduce a novel system for browsing, enhancing, and manipulating casual outdoor photographs by combining them with already existing georeferenced digital terrain and urban models. A simple interactive registration process is used to align a photograph with such a model. Once the photograph and the model have been registered, an abundance of information, such as depth, texture, and GIS data, becomes immediately available to our system. This information, in turn, enables a variety of operations, ranging from dehazing and relighting the photograph, to novel view synthesis, and overlaying with geographic information. We describe the implementation of a number of these applications and discuss possible extensions. Our results show that augmenting photographs with already available 3D models of the world supports a wide variety of new ways for us to experience and interact with our everyday snapshots.
    author  = {Johannes Kopf and Boris Neubert and Billy Chen and
               Michael F. Cohen and Daniel Cohen-Or and Oliver Deussen and
               Matt Uyttendaele and Dani Lischinski},
    title   = {Deep Photo: Model-Based Photograph Enhancement and Viewing},
    journal = {ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2008)},
    year    = {2008},
    volume  = {27},
    number  = {5},
    pages   = {116:1--116:10},
Paper (22.8 MB)
Divx (66.5 MB)