Semantic annotation of heritage building photos based on 3D spatial referencing

Abstract

Throughout this article, we present the principles of a semantic annotation using 3D model as a support to transfer the semantic layers to images. The approach could be used as an essential tool for the documentation of buildings of historical importance. Our research focused on the analysis and the implementation of tools and techniques for semantic annotation of photo, on its storage and retrieval from a database and on the manipulation of information in a real time 3D scene. Our approach, divided in three connected steps (semantic annotation of 3D model, spatial referencing of image and semantic annotation of image using 3D object’s silhouette projection), has been finalized and tested on different archaeological sites. We have used these principles to develop an implementation model of a management and consultation system for data gathered from the Internet.