=Paper=
{{Paper
|id=Vol-2543/spaper09
|storemode=property
|title=The Use of 3D Visualization Technology Web-Collections for the Formation of Virtual Exhibitions
|pdfUrl=https://ceur-ws.org/Vol-2543/spaper09.pdf
|volume=Vol-2543
|authors=Nikolay Kalenov,Irina Sobolevskaya,Alexander Sotnikov,Sergey Kirillov
|dblpUrl=https://dblp.org/rec/conf/ssi/KalenovSSK19
}}
==The Use of 3D Visualization Technology Web-Collections for the Formation of Virtual Exhibitions==
https://ceur-ws.org/Vol-2543/spaper09.pdf
The use of 3D Visualization Technology Web-collections
for the Formation of Virtual Exhibitions
N. Kalenov1[0000-0001-5269-0988], I. Sobolevskaya1[0000-0002-9461-3750], A. Sotnikov1[0000-0002-
0137-1255]
, S. Kirillov1[0000-0001-7560-0041]
1 Joint Supercomputer Center of the Russian Academy of Sciences - Branch of Federal State
Institution "Scientific Research Institute for System Analysis of the Russian Academy of Sci-
ences" (JSCC RAS — Branch of SRISA), 119334, Moscow, Leninsky av., 32 a, Russia
asotnikov@jscc.ru
Abstract. The paper is presents approaches to solving the problem of creat-
ing realistic interactive 3D web-collections of museum exhibits. It is shown
how electronic copies of library, archival and museum storage objects, present-
ed in the form of texts, graphic images, and audio-video objects, including 3D-
models, can be integrated by means of an electronic library. The presentation of
3D-models of objects based on oriented polygonal structures is considered. The
method of creating a virtual collection of 3D-models using interactive anima-
tion technology is described. It is also shown how a full-fledged 3D-model is
constructed on the basis of individual exposure frames using photogrammetry
methods. The paper assesses the computational complexity of constructing real-
istic 3D-models. For the creation of 3D-models in order to provide them to a
wide range of users via the Internet, the socalled interactive animation technol-
ogy is used. The paper presents the differences between the representations of
full-fledged 3D-models and 3D-models presented in the form of interactive
multiplication. The technology of creating 3D-models of objects from the funds
of the State Biological Museum. K.A Timiryazev and the formation on their ba-
sis of the electronic library “Scientific Heritage of Russia” of a virtual exhibi-
tion dedicated to the scientific activities of M.M. Gerasimov and his anthropo-
logical reconstructions, and vividly demonstrating the possibility of integrating
information resources by means of an electronic library. The format of virtual
exhibitions allows you to combine the resources of partners to provide a wide
range of users with collections stored in museum, archival and library collec-
tions.
Keywords: Photogrammetry, 3D-modeling, Interactive Animation, Web-
Design, Polygonal Modeling.
1 Introduction
One way to represent interdisciplinary collections in a distributed digital library envi-
ronment is to form a virtual exhibition. A virtual exhibition is a multimedia infor-
mation resource that shows users heterogeneous information (digital copies of printed
Copyright © 2020 for this paper by its authors.
Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
2
materials, archival documents, museum objects, etc.), combined according to speci-
fied characteristics. In addition to the presentation of various types of materials in the
process of forming digital science collections, there is a need for multimedia objects,
namely 3D digital models of museum objects and virtual reality objects [1]. Virtual
exhibitions can be presented not only on the Internet, but also become part or even the
main element of a real museum exposition.
In recent years, visualization methods based on photogrammetric images and fur-
ther construction of three-dimensional structures from sequences of two-dimensional
images that can be combined with local motion signals are widely used. This method
is called Structure from motion (SfM) [2–4]. In biological visual perception, a SfM is
an "apparatus" whereby humans (and other living beings) can recover a three-
dimensional structure from a 2D motion field of a moving object or scene projected
on the retina of the eye. This method is applied in the field of computer modeling
related to visual perception modeling. The basic idea of SfM method is following
(Figure 1):
Given: 𝑚 images of 𝑛 fixed 3𝐷 points
𝑥𝑖𝑗 = 𝑃𝑖 𝑋𝑗 , 𝑖 = 1 ⋯ 𝑚, 𝑗 = 1 ⋯ 𝑛
The problem is: estimate 𝑚 projection matrices 𝑃𝑖 and 𝑛 fixed 3𝐷 points 𝑋𝑗 from the
𝑚𝑛 correspondences 𝑥𝑖𝑗 (Figure 1).
Fig. 1. The basic idea of SfM method.
However, there are such boundary conditions under which this method "does not
work," for example, in the presence of glass and reflecting surfaces.
For creation of 3D models and elements of virtual exhibition various software and
technological solutions are used, in particular, technologies of laser and optical 3D-
scanning, computer modeling, photogrammetry, animation 360 0, etc. [5].
3
2 Laser and optical 3d scanning technologies
Laser and optical 3D scanning technologies allow to create a digital copy of the ob-
ject, for example, museum, using a 3D scanner [5].
Optical 3D scanners use structured light technology (Figure 2). A projection of
the light grid is directed to the object to be scanned. Analysis of the deformation of
the grid light lines and allows to calculate the shape of the surface of the scanned
object [6].
Fig. 2. Optical 3D Scanner Operation Diagram.
Optical 3D scanners are used to quickly digitize various small and medium objects, as
they can digitize multiple dots or all of the scanner 's "field of view" at the same time.
And the use of special white or blue lamps as a light source allows you to digitize
geometry and capture texture in low light. In our project we used hand-held optical
scanners from Artec and Creaform. 3D models of museum objects of various nature
were obtained: gypsum sculptures, ceramic and glass objects, museum objects of
plant and animal origin.
Figure 3 shows a 3D model of a stuffed rattlesnake in the reserves of the State Bio-
logical Museum named after K.A. Timiryazev. This stuffed model was chosen as a
prototype for creating a 3D model of an object whose surface consists of glossy light-
absorbing materials [7]. Figure 4 shows the 3D model of the stuffed duck, also locat-
4
ed in the reserves of the State Biological Museum named after K.A. Timiryazev. It
was chosen as a prototype to create a 3D model of an object whose surface consists of
light-transmitting materials (in this case, feathers).
Fig. 3. Stuffed rattlesnake
Fig. 4. Stuffed ducks
In general, we have received high-quality, finished polygon models that can be
used to form realistic interactive 3D collections of museum exhibits. However, some
3D models of museum objects had many noises and errors caused by the transparency
or gloss of the material. In particular, feather and wool cover in stuffed birds and
mammals do not look very realistic. Therefore, it was decided to carry out additional
scanning with a laser 3D scanner.
Laser 3D scanners (Figure 5) provide the most precision and detail when digitizing
objects, they are equipped with a specialized laser, which is classified as Class II. This
type of laser is safe enough for human vision. A feature of this type of scanner is the
use of special markers, which are attached in close proximity to the object or directly
on the scanning object. This is necessary for accurate spatial alignment of the laser
and the object being scanned.
5
Fig. 5. Operating principle of laser scanner
In the work on formation of collections of museum objects the laser 3D scanner
Creaform HandySCAN 700 was used. This scanner is equipped with 7 high-precision
lasers and TRUacuracy dynamic binding system [8], which provides scanning accura-
cy up to 0.03 mm with 0.05 mm resolution.
The main disadvantage of the scanner is its inability to transmit the color of the ob-
ject 's texture, but it provides quite satisfactory results when solving problems to build
the most detailed surface of the object being scanned. The use of this type of scanning
device provided high quality 3D models of gypsum anthropological reconstructions
performed by M.M. Gerasimov http://acadlib.ru/index.php/. The experience of 3D
digitization has shown that some museum objects have proved too complex to be
processed by existing 3D scanners. Thus, the results of the scanning of the wool cover
of the stuffed mouse proved unsatisfactory, their improvement would require the
treatment of "problem zones" (light-absorbing wool or retro-reflective eyes) with a
special spray, which could be detrimental to the objects being scanned. One of the
main requirements for digitization of museum objects is to ensure maximum preserva-
tion of the object during scanning, the solution of this problem requires the develop-
ment and application of computer modeling and/or interactive animation technologies
3600.
6
3 Computer modeling technologies
Computer modeling technologies allow to solve problems on visualization, for exam-
ple, permanently lost or damaged museum objects, to perform detailing of recon-
structed objects, to restore the situation of historical premises, etc. In our project, this
technology is used when editing scanned 3D models with problem areas. In such cas-
es, the operator in the 3D modeling program has to re-create individual 3D model
elements.
Fig. 5. Bust of astralopithec with "defect"
Fig. 6. Bust of astralopithec without "defect"
Figure 5 shows a digital copy of an astralopithec bust, an anthropological recon-
struction performed by M.M. Gerasimov. A red arrow indicates an object defect. Fig-
ure 6 shows the same object, but after manual digital "restoration."
7
4 Photogrammetry technologies
Photogrammetry technology [9, 10] allows you to build a high-quality 3D model.
This technology has been actively developed since the 1970s and was originally used
to draw relief maps from aerial photographs. Photogrammetry uses the methods and
techniques of various disciplines, mostly borrowed from optics and projective geome-
try. In the simplest case, spatial coordinates of points of an object are determined by
measurements made from two or more photographs taken from different positions.
The main task in this case is to define common points on two neighboring images.
After you create an array of shared points, you create a set of lines through each
shared point and camera location (survey points). The intersection of these lines and
determines the location of the point on the surface of the original object in space.
More sophisticated algorithms can use other pre-known object information, such as
object element symmetry, which in some cases allows the spatial coordinates of ob-
ject points to be reconstructed over a limited number of photo images.
5 3600 interactive animation technology
Interactive animation technology [11] can be used to create a virtual collection of 3D
models to provide them to a wide range of users. This technology does not involve
building a polygon 3D model, but is based on a software change of a fixed set of
frames using specialized interactive display programs that simulate the rotation of an
object. Importantly, a high-quality 3D model can be built from the same data set (in-
dividual exposure frames) using photogrammetry techniques.
For such works, in particular, 3D digitization complex based on Recam T-50 turn-
table, 3D-Maker control program [12] and Canon EOS600D digital camera is used,
which allows to perform automatic shooting of museum objects up to 150 cm high
and weighing up to 50 kg.
Figure 7 shows the sequence of frames from which the digital 3D model is dis-
played.
8
Fig. 7. Sequence of frames from which the digital 3D model is displayed.
6 Conclusion
The development of methods of 3D models formation in the direction of obtaining
realistic representation of collections of various objects opens up opportunities for
formation of 3D collections of museum objects of high quality, both to ensure preser-
vation of originals, and to expand availability of high-quality digital copies of muse-
um exhibits [13, 14].
The obtained results formed the basis of formation technology of 3D-models col-
lections of objects from funds of the State Biological Museum named after
K.A. Timiryazev and formation on their basis of virtual exhibitions by means of digi-
tal library "Scientific Heritage of Russia" [8], in particular, virtual exhibition devoted
to scientific activity of M.M. Gerasimov and its anthropological reconstructions,
available at http://acadlib.ru/.
The research is carried out by JSCC RAS – branch of SRISA as part of a state as-
signment.
References
Lyashkov, A.A., Panchuk, K.L., Varepo, L.G.: Osobennost' otobrazheniya giperpoverkh-
nosti chetyrekhmernogo prostranstva. Geometriya i grafika. Moscow, pp. 3–10 (2017).
Wróżyński, R., Pyszny, K., Sojka, M., Przybyła, C., Murat-Błażejewska, S.: Ground vol-
ume assessment using 'Structure from Motion' photogrammetry with a smartphone and a
compact camera. Open Geosciences 9, pp. 281–294 (2017).
9
Scopigno, R.: Digital fabrication techniques for cultural heritage: a survey. Comput.
Graph. Forum 36, pp. 6–21 (2017).
Garstki, K.: Virtual representation: the production of 3D digital artifacts. J. Archaeol.
Method Theory 24, pp. 726–750 (2017).
Gonizzi Barsanti, S., Guidi, G.: 3D digitization of museum content within the 3D icons
project. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., pp. 151–156 (2013).
Prasolov, V.V., Tikhomirov, V.N. Geometriya. MTSNMO, Moscow (2007).
Kirillov, S.A., Sobolevskaya, I.N., Sotnikov, A.N.: Ispol'zovaniye mul'timediynykh
tekhnologiy pri formirovanii virtual'nogo yestestvennonauchnogo muzeynogo pros-
transtva// Informatsionnoye obespecheniye nauki: novyye tekhnologii. Moscow, pp. 201–
207 (2017).
Wohlfeil, J., Strackenbrock, B., Kossyk, I.: Automated high resolution 3d reconstruction of
cultural heritage using multi-scale sensor systems and semi-global matching. International
Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences.. V.
40-4. Pp. 37–43 (2013).
Lobanov, A.N.: Fotogrammetriya. «Nedra», Moscow (1984).
Gill, F., Myurrej, U., Rajt, M.: Prakticheskaya optimizaciya (Practical optimization).
«Mir», Moscow (1985).
Sotnikov, A.N., Sobolevskaya, I.N., Kirillov, S.A., Cherednichenko, I.N.: Tekhnologii vi-
zualizacii 3d web-kollekcij// Nauchnyj servis v seti Internet: trudy XX Vserossijskoj
nauchnoj konferencii (17—22 sentyabrya 2018 g., g. Novorossijsk). M.: IPM
im. M.V. Keldysha, pp. 438–447 (2018).
Kratochvil, J., Sadilek, M., Musil, V., Pagac, M., Stancekova, D.: The effectiveness of
strategies printing printer easy 3d maker. Advances in Science and Technology-research
Journal 12, pp. 197–205 (2018).
Hernando, A., Bobadilla, J., Ortega, F., Gutiérrez, A.: Method to interactivelyvisualize and
navigate related information. Expert Systems with Applications (2018).
Schulz, T., Juttler, B. Envelope Computation by Approximate Implicitization. Industrial
Geometry (2010).