Laying the foundations for an information system dedicated to heritage building degradation monitoring based on the 2D/3D semantic annotation of photographs

Abstract

In the last decade many 3D digitization techniques have emerged allowing the generation of dense and precise digital representations of historical building. However, regardless their level of geometric accuracy or visual realism, 3D models are not yet fully adapted to the conservation analysis purposes. In fact, even if a 3D model can be considered an efficient way to accurately record the state of a building, its potentiality in terms of semantic annotation and spatial distribution of heterogeneous data still remain almost unexplored today. Since several years, photographs appear to be a flexible and well diffused portable support for the heritage documentation. They are a natural medium to annotate and compare temporal states. Thanks to the recent advances in photogrammetry computer vision and augmented reality, photographs can be also considered as an excellent support for accurate spatial localization. This article presents the first principles for the development of an information system to monitor the historic building degradation based on three main components: a high dynamic range (HDR) imagebased automatic pipeline, an hybrid (2D/3D) semantic annotation method and a domain ontology describing knowledge related to degradation phenomena. The innovative integration of these main components allows us to introduce the notion of ”informative continuum” as a key for interconnecting spatialized and semanticallyenriched photographs to populate a knowledge base on the building degradation. The first steps of this on-going project are illustrated by an experimentation carried out on the Caromb church in the south of France.