Current trends and prospects of using augmented reality technology for various industries are considered. Analysis of publications and the latest commercial developments that use AR showed that this direction is promising both from the scientific and business points of view. In this study, the concept of information technology for 3D models visualization in augmented reality is proposed. A mathematical model of object representation in three-dimensional space, a method and algorithm for objects 3D models visualization in augmented reality, as well as a structural diagram and principle of operation of the proposed information technology for objects 3D models visualization in augmented reality have been developed. A test threedimensional model of the object was also developed and experiments were conducted on its visualization in AR using the proposed information technology for objects 3D models visualization in augmented reality.
Today, the issue of using augmented reality in various areas of activity is of great importance both from a scientific and a practical point of view. According to the latest research on the market [1] augmented reality is an effective tool for business, as it allows to make purchases, namely trying on clothes, shoes, interior items and furniture without physically visiting the store. This is currently extremely relevant in a world facing the consequences of the global Covid-19 pandemic, where businesses have had to look for tools to be able to operate and communicate with customers remotely. It is also extremely relevant now, when Ukraine is at a state of war.
Augmented reality provides visualizing objects and things that may not be physically nearby, but a person will see them in real time and in life size. This is useful in the development of virtual training equipment and simulators, for example, for the medical and military industries, since real equipment is expensive and in most cases quite large for the equipment of training centers.
There is no doubt that augmented reality (AR) is already being integrated into almost all areas of industry. This technology is already available on almost every smartphone/tablet, and according to Statist's forecasts (Fig. 1), the industry will only grow (capitalization is expected to be 1.73 billion dollars by 2024).
A lot of industrial areas (including retail, automotive, healthcare, education, entertainment and others) are implementing AR, there has never been a greater demand for AR-based applications development services than there is today [1].
According to the analysis, the topics of the most frequently published scientific research works in augmented reality domain are devoted to AR application for educational purposes, medicine, Ecommerce and advertising area and AR/VR-based user interfaces for different purposes. The results of the quantitative analysis of the publications number in each domain are presented in Fig.2.
Considering the abovementioned, development of a multipurpose information technology that could provide the visualization of any kind of object`s three-dimensional model in augmented reality in natural size and in real time currently would be relevant.
Since smartphones or tablets are the most frequently used tools to operate with AR-based applications, the most convenient form of the proposed information technology implementation would be cross-platform mobile application. It would make it available for using on both Android and iOS based devices.
The areas of such information technology application can also be various - learning purposes (for example, an atom or molecule structure visualization in Chemistry), in museums or archeology domain to visualize the historic artefacts, in medicine for internal organs structure visualization etc.
In the course of the study, an analysis of the latest scientific publications devoted to the application of augmented reality for three-dimensional objects visualization was carried out.
In [2] the method, algorithm and software-based approach of route paving using 3D markers and augmented reality technology are proposed.
The authors of [3] propose three relatively nontechnical methods to produce 3D AR objects for chemistry courses and demonstrate their use as both quick in-lecture activities and as part of an extended laboratory.
Thе paper [4] proposes the integration of photogrammetric reconstruction, 3D modelling and augmented reality application in order to achieve the complete visualization of a stone sculpture even if highly damaged or fragmentary.
The paper [5] provides two demonstrations of how Augmented Reality (AR), which is the projection of virtual information onto a real-world object, can be applied in the classroom and in the special laboratory.
The paper [6] applies Geographic Information Technologies (GIT) to the field of Cultural Heritage (CH), aiming to analyze patrimonial valuation through Digital Representations (DR). It approaches the main topics of 3D data acquisition, modelling and visualization, as well as cultural heritage applications, and presents 3D and Augmented Reality (AR) trials, together with their main results and discussion.
In [7] a general review of using augmented reality as an efficient tool for software publications is given. However, any practical case of using AR is not highlighted.
The authors of [8] present DesignAR, an augmented design workstation for creating 3D models.
The authors of [9] provide radiological image visualization using virtual and augmented reality for better planning and monitoring of surgeries.
In paper [10] reviews and advances existing literature concerning immersive employee experiences in the metaverse. In this research, previous findings were cumulated showing that virtual work environments as computer-generated reality spaces integrate digital twinning, remote collaboration tools, productivity software, and wearable self-tracking devices.
The authors of [11] give an example of the application of augmented reality in medical education would be an augmented reality T-shirt that allows students to examine the inside of the human body as an anatomy lab.
Also, since IT industry of Ukraine is developing rapidly and following the world IT trends, it was decided to conduct an analysis of Ukrainian scientists` research works in augmented reality domain. Thus, the authors of [12] conduct an analysis of the current state and prospects for the development of augmented reality in Ukraine in business and education.
In [13] augmented reality is proposed to be used in university education of future IT specialists. The authors of [14] propose using AR technology for interactive Chemistry learning. Overall Ukrainian scientists mostly consider AR implementation for educational purposes.
The conducted review of the literature sources showed that none of the known solutions are aimed for multi-purpose three-dimensional objects visualization in augmented reality. Also the analysis of already known software solutions which have AR-component and provide visualization of 3D models of objects has been conducted. The advantages and disadvantages of the reviewed tools are also given. The results of the analysis are presented in Table 1. -variety of AR- -low quality models AR-models because of moderation lack -overloaded interface relative to the application`s functionality -access to certain AR models is paid - access to the application is granted only after granting access to the camera - low quality AR models - no model preview - the number and variety of AR models is limited - users cannot upload their own models - paid application - a small number of pointers in the form of AR models
Currently, the only completely ready free of charge tool for visualizing three-dimensional models of objects is the AR component of Google mobile application [15].
Among the advantages of this product is that the applications are available for Android and iOS operating systems, and the models for visualization are animated. Among the disadvantages - the database contains only 32 models, these are mostly animals and birds, the function of uploading own models is absent.
Taking into account the relevance of this issue, it was decided to develop an augmented-realitybased information system for objects three-dimensional models visualization in the form of crossplatform mobile application.
Therefore, the aim of this study is: 1) to create a method and algorithm of objects 3D models visualization in augmented reality; 2) to develop the client-based part in the form of cross-platform mobile application which provides 3D models visualization; 3) to create the test models for visualization in AR and conduct the experiment on objects 3D models visualization in augmented reality in Khmelnytskyi National University campus.
To present a 3D model of object in real world, it is necessary to take into account that we need to work in three-dimensional space.
Since the ultimate goal is to develop a tool for visualizing models in the form of a mobile application, we will use the smartphone camera with AR function support as a tool to operate with images in augmented reality.
First, we need to consider the coordinates of the external place, where the camera of mobile phone focuses.
The phone itself will also conditionally be located in the three-dimensional Cartesian coordinate system at the intersection of the X, Y and Z axes.
Figure 3 shows a scene with an object model image in the form of a polygon with a camera (a) and a view from the device's camera (b).
а) b) entire scene with the camera b) the view from the device's camera
To develop an algorithm for representing an object in augmented reality, it is necessary to calculate
the distance from the device's camera to the model of the object, which we will see on the smartphone
screen according to formula (
sin 360, where l is a distance from the device camera to the AR model; R is a radius of the virtual sphere attached to the camera; is an angle of view.
=
2 + 2 + 2, where r is a distance from the origin of the coordinates to the point.
The following formulae (
, , where is a polar angle. where is an azimuthal angle. =
(− , − ) − . =
( 2 − 1)2 + ( 2 − 1)2 + ( 2 − 1)2,
Also we need to calculate the orientation of the model along the Y axis, around the center of rotation (formula (5)) and the distance between points in three-dimensional space (formula (6) : where L is the distance between points or beacons in three-dimensional space.
To develop a proposed tool for 3D models visualization, first it is necessary to develop a method of its operation, taking into account the abovementioned mathematical model. The graphic representation of the Method of objects 3D models visualization in augmented reality is presented in Fig.4.
The proposed method consists of the following steps: 1. Development of software for model visualization in augmented reality; 2. Construction of test models of 3D models of objects 3. Downloading test models to a software and technical tool, which is most convenient to present in the form of a mobile phone application;
4. Life-size, real-time augmented reality 3D models of objects in the environment using a smartphone camera.
5. Conducting experiments on the successful location of the object in space.
As it can be seen from the Figure, software and technical toolkit will contain 3D models in its data storage, making them available for visualization using the smartphone camera. User also can upload own models in application`s data storage throuhg user interface.
When developing applications with complex functionality, special attention should be paid to taking into account all possible bottlenecks at the early stages of the life cycle, that is, when designing the architecture of the software tool.
That is why a special attention should also be paid to UX development.
According to [16] user interface should follow the main Gestalt principles — Proximity, Similarity, Continuation, Closure, and Figure/Ground, since AR-based user interface design is not only about the aesthetics, it is about intuitiveness and comprehensibility of functionality in appearance, which is more a psychological component of user interface design.
Such interface should be user friendly and clear. Also a special attention should be paid to 3D graphics design. The models for representing in AR must be of a high quality.
Based on the method, an algorithm for objects 3D models visualization in augmented reality was developed, which is presented in Figure 5.
As an environment for models visualisation any view from the device camera can be chosen. the image of the model appears on device screen in preview mode.
When user selects the 3D real-time display option, the image is superimposed over the image of the surrounding space (environment) in the smartphone camera, allowing the user to see the model in the field of view of the device's camera.
The user can move and scale the model. The principle of operation of the proposed in this work information technology for 3D objects models visualization in augmented reality is shown in Figure 6.
The proposed information technology for 3D objects models visualization in augmented reality consists of Data Storage and Software System. Data Storage is the part where the models are stored. Users can upload their own models there.
Software System is divided by two parts - a user side part – i.e Frontend part where user can interact with program interface, choose and preview the model for visualization; and server-side part – i.e Backend part which is responsible for saving a new uploaded by user model into the data storage, validation of the chosen by user model in AR and its visualization using device camera. The structure of the proposed information technology for 3D objects models visualization in augmented reality is presented in Fig.7.
For conducting the experiments a test 3D model of “Solar Tree construction” was developed. For development Blender 3D modelling Environment was used. The model is presented in Figure 8.1. Also a script for visualization of the test model was developed. We can upload the model in software database in .glb or .obj extension and have it available for the visualization. The script for the model visualization was transferred to Android-based smartphone with AR function support for conducting the experiment.
The experiment on the proposed model visualization in real time in augmented reality has been conducted. As an environment for the visualization of outdoor art object the Botanical Garden of Khmelnytskyi National University was chosen. During the experiment the test model was visualized in AR through smartphone camera in the external environment and a photo from camera view was taken. The photo with the experiment results is presented in Fig.8.2.
As the experiment proved, the developed software works quite well and performs its functions. The test model was displayed on the smartphone screen and was superimposed over the image of the surrounding space using smartphone camera.
The further efforts of the authors will be aimed at: 1) creating more test models and conduct the experiments on visualization 3D models for different purposes and in various environments; 2) developing user interface of the proposed information system for objects 3D models visualization in augmented reality in the form of cross-platform mobile application. 3) application of the developed tool for scientific and real-life needs, such as digitization and visualization of museum exhibits and archaeological artifacts.
The current trends and the prospective of Augmented Reality technology application for various purposes are considered. The literature analysis and the analysis of the related works showed that the interest to AR technology is present both from scientific and business sides. The industries where augmented reality is currently being implemented the fastest and in the largest volume are science, medicine and e-commerce/advertising.
The literature review provided the conclusion that currently there are no technical means that provide visualization of three-dimensional models of objects in augmented reality with the ability of the user to add their own models. Therefore, creating of such information technology is an urgent task.
AR using trends research has shown that the most effective form for the proposed information technology implementation is the form of a cross-platform mobile application which is available both Android and iOS users.
In this study, a mathematical model for visualizing an object in three-dimensional space, a method and algorithm for visualizing an object model in augmented reality, as well as a structural diagram and principle of operation of the proposed information technology were developed. A test three-dimensional model was also developed and experiments were conducted on its visualization in augmented reality using the proposed information technology. Experiments have shown that the prototype of the developed information technology works quite well. Therefore, directions for further research are developing user interface of the proposed information system for objects 3D models visualization in augmented reality in the form of cross-platform mobile application and its application for scientific and real-life needs, such as digitization and visualization of museum exhibits and archaeological artifacts.