<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Smart Heritage: Challenges in Digitisation and Spatial Information Modelling of Historical Buildings</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Digital Object Identifier</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>© Kourosh Khoshelham;
2nd Workshop On Computing Techniques For Spatio-Temporal Data in Archaeology And Cultural Heritage.
Editors: A. Belussi, R. Billen, P. Hallot, S. Migliorini</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kourosh Khoshelham Department of Infrastructure Engineering, University of Melbourne</institution>
          ,
          <addr-line>Australia https://orcid.org/0000-0001-6639-1727</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>7</fpage>
      <lpage>12</lpage>
      <abstract>
        <p>Spatial data and building information modelling are indispensable for smart decision making on the use and management of heritage buildings. This short paper provides an overview on technologies and methodologies for spatial data acquisition and information modelling of heritage buildings. It identifies challenges in smart heritage through a case study of the Royal Exhibition Building in Melbourne, and provides recommendations for future research in this area.</p>
      </abstract>
      <kwd-group>
        <kwd>Information systems →</kwd>
        <kwd>Information systems applications</kwd>
        <kwd>and phrases Cultural heritage</kwd>
        <kwd>Spatial data</kwd>
        <kwd>Laser scanning</kwd>
        <kwd>Photogrammetry</kwd>
        <kwd>3D modelling</kwd>
        <kwd>BIM</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Category Invited paper
Funding This work is part of the Royal Exhibition Building Living Lab initiative supported by
Melbourne School of Engineering.</p>
    </sec>
    <sec id="sec-2">
      <title>Introduction</title>
      <p>Heritage buildings form part of our history and culture, and their protection is important for
the current and future generations. Continuous degradation caused by various natural and
human factors underpins the importance of preservation and restoration of heritage buildings.
Smart heritage refers to the use of technology to optimise decision making on the use and
management of heritage buildings.</p>
      <p>Spatial information plays a key role in smart heritage. Digitisation is often the first step
in the documentation and preservation of heritage buildings. Non-contact data acquisition
techniques such as photogrammetry and laser scanning enable accurate recording of the as-is
state of heritage buildings. The resulting digital spatial data facilitate the planning and
execution of preservation and restoration works. Online visualisations and virtual tours make
it possible to access heritage buildings remotely, and use these for interactive teaching and
learning purposes.</p>
      <p>While smart heritage is digital, the opposite is not necessarily true. To make informed
decisions on the use and management of heritage buildings, digital spatial data are necessary
but not sufficient. Complex tasks such as structural health monitoring and assessment of
environmental effects such as weathering require integrating spatial data with rich semantic
information (e.g. from historical records) and topological relations into a building information
model (BIM). A heritage BIM facilitates the documentation of all preservation and restoration
works on a continuous basis, as well as management and exchange of building information
between various stakeholders. Using a heritage BIM, heritage experts can perform complex
spatial analyses, ask what-if questions, run simulations and predict the results to inform the
preservation and restoration projects.</p>
      <p>This short paper provides an overview on technologies and methodologies for spatial data
acquisition and information modelling of heritage buildings. It identifies challenges in smart
heritage through a case study of the Royal Exhibition Building in Melbourne, and provides
recommendations for future research in this area.
2</p>
    </sec>
    <sec id="sec-3">
      <title>Digitisation of heritage buildings</title>
      <p>Photogrammetry and laser scanning are the main data acquisition techniques for digitising
heritage buildings. In both techniques, data can be acquired from aerial or terrestrial
platforms. Aerial photogrammetry, e.g. using Unmanned Aerial Systems (UAS), is the most
convenient method for capturing the roof structure of large buildings. For the facades and the
interiors, close range photogrammetry using a hand-held camera is more commonly used. The
photogrammetric processing of the acquired imagery to generate a 3D reconstruction of the
building is largely automated thanks to recent developments in Structure from Motion (SfM)
[7] and dense matching [8] methods. Nonetheless, the process is usually done off-line as it is
time-consuming and might require human interaction. The challenge of the photogrammetric
reconstruction is the matching failure in poorly textured areas, which results in gaps in the
reconstructed surfaces.</p>
      <p>Laser scanning on board a UAS can provide dense and complete data covering the exterior
of large buildings. Compared to commercial laser scanning systems on board manned aircrafts,
UAS laser scanner data are less accurate due to the use of cheaper Inertial Measurement
Units (IMU) integrated with the laser scanner. Terrestrial laser scanning on a stationary
tripod provides the most accurate data, and is the preferred technique for capturing building
interiors. Most terrestrial laser scanners are integrated with a camera, and the acquired point
cloud can be readily augmented with colour information from the images. The advantage
of terrestrial laser scanning compared to photogrammetry is the higher accuracy of the
data (millimetre level), and that the data are readily available after the scanning thanks to
automated registration tools. The disadvantage of terrestrial laser scanning is the time- and
labour-intensiveness of the scanning process. In particular, for large and complex buildings a
large number of scans must be acquired to ensure a reasonably complete coverage, which is a
slow and laborious process.</p>
      <p>Hand-held scanners such as Zeb [3] are more flexible and efficient for scanning than
the stationary laser scanners. These scanners use Simultaneous Localisation and Mapping
(SLAM) algorithms to estimate the pose of the sensor while creating a map of the environment.
Using a hand-held scanner, the interior and exterior of the building can be scanned in one
seamless point cloud, which is a challenge for terrestrial laser scanning due to the limited
overlap at the entrances/exits. However, current SLAM algorithms require frequent loops in
the scanning trajectory to correct for the accumulated errors, and the resulting data are less
accurate than the terretsrial laser scanner data (centimetre level accuracy).</p>
      <p>SLAM approaches using depth cameras such as the Kinect have also been studied for
mapping indoor environments [11, 5]. However, the application of depth cameras to mapping
large heritage buildings is limited due to their short range (5-10 m) and the low accuracy
and resolution of depth measurements (centimetre level).
3</p>
    </sec>
    <sec id="sec-4">
      <title>Heritage BIM</title>
      <p>Early approaches to building modelling from imagery and point cloud data focus on geometric
reconstruction of roofs [12, 9] and facades [18, 2]. The more recent concept of building
information modelling involves the reconstruction of interior and exterior geometric elements,
but also the inclusion of semantic attributes and topological relations between building
elements [10, 19]. The reconstruction of geometric elements usually involves fitting parametric
solids to 3D points [15]. A number of software packages have been developed [14] to facilitate
the reconstruction of building elements in accordance with standard data models such as the
Industry Foundation Classes (IFC) [13]. The challenge in heritage BIM is the generation of
parametric models that best fit the actual data representing complex elements such as domes
or sculptures. For such complex elements, flexible parametric surfaces such as NURBS have
been found more suitable [16, 1].</p>
      <p>The real power of heritage BIM is in the wide range of semantic attributes augmenting
geometric elements, which enable complex analyses and what-if scenarios and simulations,
such as energy efficiency analysis, air flow modelling, cost estimation of preservation and
restoration works, and analysis of environmental effects such as weathering. Example
applications of heritage BIM for such analyses can be found in [4] and [17].
4</p>
    </sec>
    <sec id="sec-5">
      <title>Case study of the Royal Exhibition Building</title>
      <p>The Royal Exhibition Building (REB) is the first building in Australia to achieve World
Heritage listing1. Built in 1880, the building served as a great exhibition hall, and is still being
used for exhibitions and events. Figure 1 (left) shows a bird’s eye view of the Royal Exhibition
Building. In December 2017, a team of researchers from the University of Melbourne carried
out a data acquisition campaign to capture data of the interior and exterior of the building
and generate a heritage BIM. The data acquisition included aerial laser scanning, terrestrial
laser scanning, Zeb scanning, and photogrammetric image capture.</p>
      <p>A Phoenix lidar system on board a large UAS was used to record a dataset of 105 million
points covering the roof of the building and the surrounding gardens. To capture overlapping
images of the roof and the facades, a small DJI drone carrying a consumer-grade camera
was used. Figure 1 shows the aerial laser scanner data (middle) and the photogrammetric
reconstruction (right) of the exterior of the REB. For the interior, a Faro terrestrial laser
scanner integrated with a camera was used to record over 40 scans on the ground floor
and the first floor. Spherical targets were used to allow automatic registration of the scans
resulting in a point cloud of over 1 billion points with colour. A Zeb-1 hand-held scanner
was also used to capture data of the interior and the exterior. The Zeb dataset contained 78
million points without colour. Figure 2 shows the terrestrial laser scanner data (left) and
Zeb data (middle) of the interior of the REB.</p>
      <p>A preliminary analysis of the data captured by different scanners revealed that the
terrestrial laser scanner point cloud was the most accurate with a mean accuracy of 4.4 mm
in individual scans and a mean registration accuracy of 3.4 mm. The accuracy in individual
scans was measured as the average root mean squared (RMS) point-plane distances obtained
by plane fitting over a number of planar surfaces. The accuracy of the Zeb point cloud as
measured by the average RMS plane fitting error was 17.7 mm. The main limitation of the
Zeb sensor, however, was the limited range of the sensor (30 m), which resulted in the dome
1 https://museumsvictoria.com.au/website/reb/history/
of the building being completely missed in the data (Figure 2 middle). The accuracy of the
UAS laser scanner data as measured by the average RMS plane fitting error was 54.5 mm.
As for the photogrammetrically generated point cloud, the main issue was completeness,
since the data contained many gaps due to matching failure in poorly textured surfaces.</p>
      <p>Using the terrestrial laser scanner data of the interior, a baseline BIM was generated
in Autodesk Revit software. Only the main structural elements were reconstructed using
the existing Revit families. The workflow consisted of first placing levels guided by vertical
sections of the point cloud, followed by placing parametric solids corresponding to building
elements within each level guided by horizontal sections. The resulting model contains the
reconstructed elements in a hierarchical structure in accordance with the standard IFC data
model. Figure 2 (right) shows a perspective view of the inside of the BIM.
5</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusions</title>
      <p>This paper provided an overview of technologies and methodologies for data acquisition
and spatial information modelling of heritage buildings. Based on the experience of the
REB case study, the main challenge in digitisation and information modelling of heritage
buildings is efficiency. Data acquisition using terrestrial laser scanning, while accurate, is
very inefficient. Scanning the interior of the REB took over 40 scans and more than 20 hours
of work. Hand-held scanners based on SLAM are far more efficient, but the resulting data
are less accurate. Developing more accurate SLAM algorithms, e.g. based on optimal pose
estimation from plane correspondences [6], is an interesting topic of future research, which
can lead to new ways of digitising heritage buildings accurately and more efficiently.</p>
      <p>The process of building information modelling is also largely manual and therefore
inefficient. Another challenge in heritage BIM is the faithfulness of the model to the acquired
data representing the true geometry of the building elements. Existing BIM elements only
provide an approximation to the true gemetry of heritage buildings. Developing methods
for efficient yet accurate reconstruction and modelling of heritage building elements is a
topic deserving further research. Another direction for future research is the development of
procedures based on BIM for continuous documentation of all preservation and restoration
works and life cycle management of heritage buildings.</p>
      <p>1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>Advanced</given-names>
            <surname>Engineering Informatics</surname>
          </string-name>
          ,
          <volume>30</volume>
          (
          <issue>3</issue>
          ):
          <fpage>298</fpage>
          -
          <lpage>311</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>Susanne</given-names>
            <surname>Becker</surname>
          </string-name>
          and
          <string-name>
            <given-names>Norbert</given-names>
            <surname>Haala</surname>
          </string-name>
          .
          <article-title>Grammar supported facade reconstruction from mobile lidar mapping</article-title>
          .
          <source>In ISPRS Workshop</source>
          , CMRT09-City
          <string-name>
            <surname>Models</surname>
          </string-name>
          ,
          <source>Roads and Traffic</source>
          , volume
          <volume>38</volume>
          , page 13,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <given-names>Michael</given-names>
            <surname>Bosse</surname>
          </string-name>
          , Robert Zlot, and
          <string-name>
            <given-names>Paul</given-names>
            <surname>Flick</surname>
          </string-name>
          . Zebedee:
          <article-title>Design of a spring-mounted 3-d range sensor with application to mobile mapping</article-title>
          .
          <source>IEEE Transactions on Robotics</source>
          ,
          <volume>28</volume>
          (
          <issue>5</issue>
          ):
          <fpage>1104</fpage>
          -
          <lpage>1119</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>Raffaella</given-names>
            <surname>Brumana</surname>
          </string-name>
          , Daniela Oreni, Anna Raimondi, Andreas Georgopoulos, and
          <string-name>
            <given-names>Angeliki</given-names>
            <surname>Bregianni</surname>
          </string-name>
          .
          <article-title>From survey to HBIM for documentation, dissemination and management of built heritage</article-title>
          .
          <source>In Proceedings of Digital Heritage International Congress</source>
          <year>2013</year>
          , volume
          <volume>1</volume>
          , pages
          <fpage>497</fpage>
          -
          <lpage>504</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Daniel R dos Santos</surname>
            , Marcos A Basso, Kourosh Khoshelham, Elizeu de Oliveira, Nadisson L Pavan, and
            <given-names>George</given-names>
          </string-name>
          <string-name>
            <surname>Vosselman</surname>
          </string-name>
          .
          <article-title>Mapping indoor spaces by adaptive coarse-to-fine registration of RGB-D data</article-title>
          .
          <source>IEEE geoscience and remote sensing letters</source>
          ,
          <volume>13</volume>
          (
          <issue>2</issue>
          ):
          <fpage>262</fpage>
          -
          <lpage>266</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>Wolfgang</given-names>
            <surname>Förstner</surname>
          </string-name>
          and
          <string-name>
            <given-names>Kourosh</given-names>
            <surname>Khoshelham</surname>
          </string-name>
          .
          <article-title>Efficient and accurate registration of point clouds with plane to plane correspondences</article-title>
          . In Computer Vision Workshop (ICCVW),
          <year>2017</year>
          IEEE International Conference on, pages
          <fpage>2165</fpage>
          -
          <lpage>2173</lpage>
          . IEEE,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <source>IEEE transactions on pattern analysis and machine intelligence</source>
          ,
          <volume>32</volume>
          (
          <issue>8</issue>
          ):
          <fpage>1362</fpage>
          -
          <lpage>1376</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <source>IEEE Transactions on pattern analysis and machine intelligence</source>
          ,
          <volume>30</volume>
          (
          <issue>2</issue>
          ):
          <fpage>328</fpage>
          -
          <lpage>341</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>Kourosh</given-names>
            <surname>Khoshelham</surname>
          </string-name>
          .
          <article-title>Building extraction from multiple data sources: A data fusion framework for reconstruction of generic models</article-title>
          .
          <source>International Archives of the Photogrammetry, Remote Sensing &amp; Spatial Information Sciences</source>
          ,
          <volume>35</volume>
          (
          <issue>B3</issue>
          ):
          <fpage>980</fpage>
          -
          <lpage>986</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>Kourosh</given-names>
            <surname>Khoshelham</surname>
          </string-name>
          , Lucia Díaz Vilariño, Michael Peter,
          <string-name>
            <given-names>Zhizhong</given-names>
            <surname>Kang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Debaditya</given-names>
            <surname>Acharya</surname>
          </string-name>
          .
          <article-title>The ISPRS benchmark on indoor modelling</article-title>
          .
          <source>International Archives of the Photogrammetry, Remote Sensing &amp; Spatial Information Sciences</source>
          ,
          <volume>42</volume>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Kourosh</surname>
            <given-names>Khoshelham</given-names>
          </string-name>
          , Daniel Dos Santos, and
          <string-name>
            <given-names>George</given-names>
            <surname>Vosselman</surname>
          </string-name>
          .
          <article-title>Generation and weighting of 3d point correspondences for improved registration of RGB-D data</article-title>
          .
          <source>Proc. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci</source>
          ,
          <volume>5</volume>
          :
          <fpage>W2</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>Kourosh</given-names>
            <surname>Khoshelham</surname>
          </string-name>
          and
          <string-name>
            <given-names>Zhilin</given-names>
            <surname>Li</surname>
          </string-name>
          .
          <article-title>A model-based approach to semi-automated reconstruction of buildings from aerial images</article-title>
          .
          <source>The photogrammetric record</source>
          ,
          <volume>19</volume>
          (
          <issue>108</issue>
          ):
          <fpage>342</fpage>
          -
          <lpage>359</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <given-names>Thomas</given-names>
            <surname>Liebich</surname>
          </string-name>
          .
          <source>IFC 2x Edition 3 model implementation guide version 2</source>
          .0. Dresden: Building SMART International Modeling Support Group,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <given-names>Facundo</given-names>
            <surname>José</surname>
          </string-name>
          <string-name>
            <surname>López</surname>
          </string-name>
          , Pedro M Lerones,
          <string-name>
            <given-names>José</given-names>
            <surname>Llamas</surname>
          </string-name>
          ,
          <article-title>Jaime Gómez-García-</article-title>
          <string-name>
            <surname>Bermejo</surname>
            , and
            <given-names>Eduardo</given-names>
          </string-name>
          <string-name>
            <surname>Zalama</surname>
          </string-name>
          .
          <article-title>A review of heritage building information modeling (H-BIM)</article-title>
          .
          <source>Multimodal Technologies and Interaction</source>
          ,
          <volume>2</volume>
          (
          <issue>2</issue>
          ):
          <fpage>21</fpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <given-names>Maurice</given-names>
            <surname>Murphy</surname>
          </string-name>
          ,
          <string-name>
            <surname>Eugene McGovern</surname>
            ,
            <given-names>and Sara</given-names>
          </string-name>
          <string-name>
            <surname>Pavia</surname>
          </string-name>
          .
          <article-title>Historic building information modelling (HBIM)</article-title>
          .
          <source>Structural Survey</source>
          ,
          <volume>27</volume>
          (
          <issue>4</issue>
          ):
          <fpage>311</fpage>
          -
          <lpage>327</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <given-names>Daniela</given-names>
            <surname>Oreni</surname>
          </string-name>
          , Raffaella Brumana, Fabrizio Banfi, Luca Bertola, Luigi Barazzetti, Branka Cuca, Mattia Previtali, and
          <string-name>
            <given-names>Fabio</given-names>
            <surname>Roncoroni</surname>
          </string-name>
          .
          <article-title>Beyond crude 3d models: from point clouds to historical building information modeling via NURBS</article-title>
          . In Euro-Mediterranean Conference, pages
          <fpage>166</fpage>
          -
          <lpage>175</lpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <given-names>D</given-names>
            <surname>Ph Pocobelli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J</given-names>
            <surname>Boehm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P</given-names>
            <surname>Bryan</surname>
          </string-name>
          , J Still, and
          <string-name>
            <given-names>J</given-names>
            <surname>Grau-Bové</surname>
          </string-name>
          .
          <article-title>Building information models for monitoring and simulation data in heritage buildings</article-title>
          .
          <source>International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences</source>
          ,
          <volume>422</volume>
          :
          <fpage>909</fpage>
          -
          <lpage>916</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <given-names>Nora</given-names>
            <surname>Ripperda</surname>
          </string-name>
          and
          <string-name>
            <given-names>Claus</given-names>
            <surname>Brenner</surname>
          </string-name>
          .
          <article-title>Application of a formal grammar to facade reconstruction in semiautomatic and automatic environments</article-title>
          .
          <source>In Proc. of the 12th AGILE Conference on GIScience</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <given-names>Ha</given-names>
            <surname>Tran</surname>
          </string-name>
          , Kourosh Khoshelham, Allison Kealy, and
          <string-name>
            <surname>Lucia</surname>
          </string-name>
          Díaz-Vilariño.
          <article-title>Extracting topological relations between indoor spaces from point clouds</article-title>
          .
          <source>ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences</source>
          ,
          <volume>4</volume>
          :
          <fpage>401</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>