One of the key components of process support in the resource and social and communication networks of a smart city is the organization of data warehouses and IT multidimensional data analysis - OLAP (operational analytical data processing). The use of this technology in the framework of information and technological support of processes in urban social and communication networks provides an opportunity to analyze the current state of social and communication resources of the city, as well as identify trends of their change and states by comparing data from different time periods and different collections. The authors suggest an original information technology that promotes the formation of data warehouses, which accumulate consolidated information resources of libraries, archives, and museums. The key component of process support in the social and communication networks of a smart city is the information technology of multidimensional data analysis. The procedure is based on the study of the characteristics of communication resources, including the choice of attributes used for their parameterization. This approach ensures the effective consolidation of information resources established by the social memory of a smart city and allows you to simulate the structure of the data warehouse. Information technology; data warehouse; data structure; analytical processing COLINS-2021: 5th International Conference on Computational Linguistics and Intelligent Systems, April 22-23, 2021, Kharkiv, Ukraine 4084 (N. Veretennikova) 0000-0003-3007-2462 (N. Kunanets), 0000-0003-0204-3971 (O. Matsiuk), 0000-0001-9508-227X (V. Mudrokha)
Steady informatization of all life spheres encourages changes in the social, cultural, and political life of society and changes in social communications, which are transferred from the plane of interpersonal communication to the electronic remote information environment. In the context of the formation and rapid development of a knowledge-based society, such an environment is designed to provide opportunities for rapid and high-quality access to information that plays a role of significant social heritage. The formation of social and communication environment of a smart city encourages social institutions to seek new forms of their joint information activities to provide quality information services to users. Integration in the single information space of information resources of libraries, archives, and museums to preserve and transmit the cultural and historical heritage of mankind is recognized as one of the priorities of building an information society at the global level.
halyna.lypak@gmail.com (H. nek.lviv@gmail.com (N. Kunanets),
2021 Copyright for this paper by its authors.
Some scholars such as N. Gwyn, J. Trant and others tend to use the term of convergence when it comes to the cooperation of libraries, archives, museums. This approach makes sense if we emphasize the functional, semantic and mental differences of these institutions. It is believed that the convergence of LAM as a process of convergence of unrelated objects, accompanied by the acquisition of common features, took place in the pre-digital period of cooperation between libraries, archives, museums, when it took the form of joint exhibitions, thematic associations, and other forms of interaction. If it is talked about combining digital collections of these institutions, when each exhibit, artifact, etc. is presented in the form of an electronic document and it is possible to access the entire set of these documents from a single access point, it is better to use the term of consolidation.
In general, consolidation means strengthening, uniting, integrating, grouping something. With
regard to information consolidation, a distinction is made between physical consolidation, i.e.
information actually gathered in one place, and logical consolidation that is distributed information,
which is in a single repository with a common directory and equal access to it from the user's point of
view. The concept of consolidated information is often used in the context of physical consolidation,
when it refers to analytical and synthetic activities to select complete and relevant information to
support decision-making in a particular problem area [
In the process of creating consolidated information, data is first transformed into information, then
into knowledge and, finally into an information product [
From the point of view of our study a consolidated information product can be some electronic resources of certain social memory institutions, selected to facilitate the full satisfaction of a user request, and which can be represented by electronic data (information in any form), electronic programs (sets of operators or subprograms that ensure the implementation of certain tasks, including data processing) or a combination of these types in one resource. As a rule, they are remote access resources.
The social and communication environment of a smart city is a complex system where urban communications, information technologies of data transmission, databases and data warehouses are organically interconnected, furthermore, its important element is the consolidated information resource of libraries, archives, and museums. The social and communication environment of a smart city operates through the continuous processing and support of access to information that is consolidated in databases and data warehouses. After processing the consolidated data, their analysis takes place, which facilitates their transfer to a higher level of data management. A city can be distinguished as smart when social capital, traditional and modern communication infrastructure stimulate sustainable economic development and high life quality.
The information product created as a result of information consolidation, as well as the entire information technology consolidation system as material objects and information carriers are covered by the general definition of the resource, and therefore have specific qualitative and quantitative characteristics, which are defined later in this paper.
With the development of information technology, which contributes to the evolution of information processing methods, including digital ones, there are new prospects for projects to combine information resources of libraries, archives, museums. Advances in information and communication technologies make it possible to present an artifact of uncontrolled origin in the form of an electronic document and integrate it into a data warehouse that consolidates the information resources of libraries, archives, and museums in a smart city.
The relevance of unification processes in the field of fundamental social institutions, which are libraries, archives, museums, is confirmed by the active discussion of this issue at various conferences, symposia, and meetings of professional associations.
For example, in the UK, similar activities were coordinated by the Museums, Libraries and Archives Council (MLA), which considered the issue of combining the resources of libraries, museums and archives in the context of continuing education and formulated proposals on this matter for the government. It was funded by the Arts Council England Press Office until 2012, and then the MLA functions were transferred to the Arts Council and the National Archives.
The search for the most rational ways to preserve the national heritage from the funds of libraries,
museums and archives of different countries has stressed the need to achieve a balance between the
formation of information resources of regional and international importance [
Researches by Higgins S., Trant J., Duff W., Marty P., Tammaro A., Kirchhoff T., Mitchell E., Т. Gill T, Van Hooland S., Verborgh R. are devoted to various aspects of consolidation of digital collections of social memory institutions and the specifics of their interaction in the online environment.
J. Trant [
The development of effective repositories of social and communication data that combine the
resources of libraries, archives and museums is impossible without the use of agreed metadata
descriptions of these resources. Thorough research on how to describe metadata on digitized cultural
heritage resources belongs to the belgian scientist S. Van Hooland. His research covers the evolution,
quality and typology of metadata in the cultural heritage sector, their relationship to the semantic and
ontological representation of data, as well as the creation of custom metadata [
Some scholars (N. Gwyn, J. Trant and others) tend to use the term of convergence when it comes to the cooperation of libraries, archives, museums. This approach makes sense if we emphasize the functional, semantic and mental differences of these institutions. It is believed that the convergence of LAM as a process of convergence of unrelated objects, accompanied by the acquisition of common features, took place in the pre-digital period of cooperation between libraries, archives, museums, when it took the form of joint exhibitions, thematic associations, and other forms of interaction. If it is talked about combining digital collections of these institutions, when each exhibit, artifact, etc. is presented in the form of an electronic document and it is possible to access the entire set of these documents from a single access point, it is better to use the term of consolidation.
According to some authors, smart cities are a viable solution for combining information resources,
human capital, social capital, and information and communication technologies to promote their
development. The study aims to analyze the impact of smart management factors on the life quality,
which has become possible using the methodology of structural equation modeling. The main focus is
on measuring transparency, communication on life quality issues, which can help smart city leaders in
developing public policies and actions of the municipal executive power to improve the life quality of
citizens [
The next paper focuses on the study of the method of choice and use of communication means,
which limits the understanding of modern use of information and communication technologies. A
combinatorial perspective has been developed to determine the complexity of using information and
communication technologies to achieve communication goals and tasks, which can have a significant
impact on the productivity and efficiency of individuals and corporations [
To coordinate the use of infrastructure and urban assets to build so-called smart cities, it is
proposed to use various tools from sensors to services and artificial intelligence technologies. The
smart city is suggested to be modeled as a multi-layered architecture in which the communication and
network layer plays a central role for the implementation of intelligent control actions and secure
information exchange [
Implementing projects of consolidation of information resources of libraries, archives and museums, a number of problems need to be solved such as formation of a system of effective information service for a user; providing a fundamentally new approach to the formation of information resources taking into account unpredictable and existing situations; the need to create institutions to ensure the processes of providing stable information services, development of tools and technologies for the consolidation of information resources, the formation of databases and data warehouses. Thus, the formation of social and communication networks of a smart city is occured.
A data warehouse that combines the information resources of libraries, archives, and museums is a subject-oriented, integrated, immutable, chronological set of data that can be a comprehensive source of information for
Data warehouses for storing information entities in the social and communication networks of a smart city have the following features: • obtaining, normalizing, storing and presenting information in a detailed and aggregated form from various sources of social and communication resources of a smart city, including museums, libraries, archives, media, government agencies and municipalities; • multidimensional presentation of data collections accompanied by metadata with descriptions of the data structure and structure of data warehouses for processes occurring in social and communication networks; • availability of software agents for the implementation of procedures for importing data from existing databases and data warehouses of museums, libraries, archives, media, government agencies and municipalities and procedures for uploading them in universal formats; availability of procedures for complex analytical processing on the basis of ITIDP and ITDSS in order to obtain new data and knowledge; • availability of software and algorithmic complexes, mobile and web applications for the implementation of the function of social communication and support of information services to residents and guests of a smart city; • subject orientation of the presentation of data collections on the course of processes in the social and communication networks of a smart city.
The scheme of data aggregation in data warehouses for social and communication networks of a smart city is presented in Fig. 1.
The generalized representation of data warehouses on information and technological support of processes in social communication networks of a smart city has the following features:
Subject orientation. Data in warehouses are organized according to the main aspects of the activities of urban social and communication networks (organization or institution, in particular, museum, category, type, essence, or archive, type, document, essence, etc.). The correct organization of data warehouses of urban social and communication networks in accordance with the subjectoriented approach allows significant simplification of the procedures of analytical processing and increasing the speed of search and analytical queries.
Data are stored in specialized multidimensional databases based on n-dimensional cubes.
Institution database Institutional data
warehouse Organization database
Organization data warehouse
Software and algorithmic complex
Mobile and web applications
Software and algorithmic agent
Software and algorithmic agent
Software and algorithmic agent
Software and algorithmic agent
REST-service REST-service
Analytical processing Data warehouse of
social and communication networks in a smart city
Metadata repository
Information export
Information representation Information use
Integration. The initial data on the data collections of social and communication resources of a smart city are extracted from the databases of institutions, organizations, software and algorithms complexes, mobile and web applications. The obtained data are validated, cleaned and filtered, normalized and aggregated (there is a primary processing and calculation of generalized and total indicators) and uploaded to the appropriate repositories.
Time data binding. The data stored in the warehouses on the processes that take place in the urban social communication networks must have unambiguous timestamps with reference to certain time periods. Data selected from online databases are stored in data warehouses in the form of historical collections according to a specific period of time. Usually, data from urban social and communication networks are characterized by high dynamics and transience of processes, which allows to analyze trends in the processes of their operation.
Irremovability. Getting in a certain historical collection of repositories, data on urban social and communication networks cannot be changed and adjusted.
A formalized description of data warehouses of social and communication networks of a smart city
is presented in the form [
DB is a set of relationships and their schemes and restrictions, which contain information from the input databases (databases of institutions and organizations, including museums, archives, and media),
RF is a scheme of the set of relations of facts rf, RM is a scheme of the set of metadata relations rm, func is a set of decision-making procedures.
Gaining new knowledge is to extract data from the collections of data warehouses by
implementing functions func on the facts rf considering the requirements that are directly formed in
accordance with the needs of users. The connections between the sets RF and DB form data
hypercubes, and their dimensions are the sets of the relations RF of the data warehouses of urban
social and communication networks. Considering the peculiarities of the tools of intellectual
analytical processing in the process of designing data warehouses for social and communication
networks of a smart city opens opportunities for more accurate disclosure and presentation of data
collected in the relevant collections [
One of the key components of process support in the social and communication networks of a smart city is the organization of storage and IT multidimensional data analysis – OLAP (operational analytical data processing). The use of this technology in the framework of information and technological support of processes in urban social and communication networks provides an opportunity to analyze the current state of social and communication resources of the city, as well as identify trends and changes by comparing data from different time periods and different collections.
The processes of generalization of detailed data collections collected in social and communication networks are usually used in OLAP smart city systems, which allows to obtain new knowledge from consolidated in various aspects of the analysis, interconnected information sets. The source data sets for analytical processing with the help of OLAP information on urban social communication networks are a large list of information entities, including archival documents, museum exhibits, publications in the media, etc.
IT OLAP is based on a multidimensional data model, its main basic essences are hypercube of data rel, dimension D, attribute A, cell X, value rel(D,A).
A data hypercube, being an ordered set of cells, contains one or more dimensions. Each of the cells of the hypercube is defined by only one unique set of attribute values that are dimensions. The cell can contain an actual value, or be considered empty one containing Null.
The set of attributes that form one of the faces of a hypercube is called a dimension. For urban social and communication networks, important dimensions are, in particular, time and geography. The lists of years, quarters, months, days, hours, minutes, seconds are attributes for time measurement. The list of administrative and territorial objects such as regions, districts, settlements, neighborhoods, streets, houses, apartments are attributes for geographical measurement.
To access the data in the hypercube, the user selects one or more cells by specifying (fixing) the appropriate dimension values. The set of fixed dimension values is called the set of fixed attributes.
Multidimensional analysis of data on processes in urban social and communication networks, in turn, involves research and analysis of the characteristics of municipal social and communication resources, including the choice of attributes used to parametrize the information model (Fig. 2).
The set of categories and attributes SA used to describe the processes taking place in the social and communication networks of a smart city is presented as follows: (2) where SAorg = SAoSrg , S = Archives , Museum, Biblio, Governement, ZMI are attributes for each selected category of social and communication resources of a smart city, including archives (Archives), museums (Museums), libraries (Biblio), government agencies (Government) and the media (ZMI); SAclases is a category of attributes of characteristics and properties of information essence classification of social and communication resources; SAres is a category of attributes of characteristics and properties of information social and communication resources; SAGEO is a category of geolocation attributes; SAusr is a category of attributes of the description of individual consumers’ services of social and communication resources of a smart city; SAquery is a category of attributes to describe information and search queries for social and communication resources of a smart city.
General information about museum organizations Methods of processing information and search
queries Methods of event processing
...
General information about library organizations Methods of processing information and search queries Methods of event processing ...
networks of a smart city are synonymous and have the same meaning. These attributes can be divided into the following subcategories:
Fonds is characteristics of social and communication funds; Src is information on social and communication resources; Docs is characteristics of the query results; Geopoint is a geolocation point; User is consumer information; Provider is information on service providers; Use is information on the consumption of services.
The information network of the process of providing information services in urban social and communication networks will be presented by a set of parameters (Fig. 3).
Each of the attributes for a separate category Socio = (SocioFonds, SocioSrc , SocioDocs , SocioGeopoint , SocioUser , SocioProvider , SocioUse ), provides a description of the relevant characteristics of the processes occurring in social and communication networks, and in total fully characterize the processes of providing services in social and communication networks of a smart city.
General information about government
agencies Methods of processing information and search
queries Methods of event processing
...
SAoBrigblio
The attributes selected to describe the processes were used to build a multidimensional information model of the set of social and communication networks of a smart city, presented in the form of a data hypercube: (3) where DimSocio is a set of hypercube dimensions; SPSroocvio is a a smart city service provided by a group of performers P rovSocio = P rovkSocio, k = 1, t using a number of urban social and communication resources Fj , j = 1, r , including archives, museums, libraries, government agencies and the media; AttrDSiomciiSoocio = Attr1Socio , Attr2Socio , ... , AttrnSocio, i = 1, ... , m , is a set of attributes that are specific to the i i i dimension DimiSocio ;
Attr Socio = Attr1Socio Attr1Socio ... AttrmSocio is a set of attributes that are typical for a hypercube; Dim'Socio DimSocio is a set of fixed measurements of the hypercube; Attr'Socio AttrSocio is a set of fixed attributes of the hypercube.
It is introduced the notation S 'PSorocivo (Dim'Socio , Attr'Socio ) to describe the subset of the hypercube of social and communication data P rovSocio which is placed in accordance with the set of fixed values and to their access it is necessary to specify the set of fixed dimensions Dim'Socio DimSocio and values of fixed attributes Attr'Socio AttrSocio . The set of cells corresponding to the fixed attributes and measurements of social and communication data is denoted as S 'Socio (Dim'Socio , Attr 'Socio ) SProv 'Socio SPSroocvio . The dimension key is called an attribute that uniquely identifies the tuple (string) of the hypercube dimension. The above analyzed sets of parameters for the description and information technology support of processes in the social and communication networks of a smart city allow to form the following dimensions of the multidimensional data model:
Dim1Socio is data on organizations providing services based on the resources of social and communication networks of a smart city from the set P rovSocio = P rovkSocio, k = 1, t , in particular, AttrDSiomc1iSoocio = AttriSocio , i = 1,10 is a set of dimension attributes Dim1Socio , where ASocio is a type of service 1 11 provider organization, including archives, museums, libraries, government agencies and the media; ASocio is a name of the service provider organization, ASocio is a settlement, ASocio is a form of 21 31 41 ownership, ASocio is a microdistrict, ASocio is a street, ASocio is a street, ASocio is an identifier of the 51 61 71 81 geographic information system reference point, A9Socio is an identifier of a responsible person, A1S0o1cio is 1 a phone number of a responsible person.
Dim2Socio is data on time periods, in particular, AttrDSiomc2iSoocio = AttriSocio , i = 5 is a set of dimension 2 attributes Dim2Socio , where ASocio is a name of the time period, ASocio is the start date of the time period, 12 22 ASocio is the end date of the time period, ASocio is a brief summary of the time period, ASocio is the 32 42 52 parent time period. geographic information system.
Dim4Socio is data on fundraisers, in particular, AttrDSiomc4iRoes = AttriSocio , i = 1,9 is a set of dimension 4 attributes Dim4Socio , where ASocio is a type of fundraiser, it can be a legal or physical person, ASocio is a 14 24 full last name of the fundraiser (for organizations) or surname, name and patronymic (for individuals), ASocio is a functional purpose of the legal person or the value of the individual person in the society 34 life, ASocio is a brief description of the fundraiser, ASocio is a date of foundation (for organizations) or 44 54 birth (for individuals) of the fundraiser, ASocio is a date of closing (for organizations) or death (for 64 individuals) of the fundraiser, ASocio is a parent class of funds from the set of measurements Dim3Socio , 74 ASocio is an organization holder of the fund from the set P rovSocio , ASocio is an essence identifier of the 84 94 geographic information system.
Dim5Socio is data on social and communication funds, in particular, AttrDSiomc5iSoocio = AttriSocio , i = 1,5 is a set 5 of dimension attributes Dim5Socio , where ASocio is a name of the fund, ASocio is an identifier of social and 15 25 communication services from the set Dim1Socio , ASocio is an identifier of the fundraiser from the set 35 Dim4Socio , ASocio is unique attributes of the fund, ASocio is an essence identifier of the geographic 45 55 information system.
Dim6Socio is data on the systematization of entities in the funds, in particular, AttrDSiomc6iSoocio = AttriSocio , i = 1,6 is a set of dimension attributes Dim6Socio , where ASocio is a name of the 6 16 essence category, ASocio is a functional purpose of the essence category, ASocio is a brief description of 26 36 the essence category, ASocio is a parent essence category, ASocio is unique attributes of the essence 46 56 category, ASocio is an essence identifier of the geographic information system.
66
Dim7Socio is data on types of information elements for data storage, in particular, AttrDSiomc7iSoocio = AttriSocio , i = 1,4 is a set of dimension attributes Dim7Socio , where ASocio is a name of data type, 7 17 it can be a database field, a text file, a binary file, URL, etc., ASocio is a brief description of a type of 27 information elements, ASocio is a list of attributes of information elements type, ASocio is a list of 37 47 characteristics of the type of information elements.
Dim8Socio is data on essence types in funds, in particular, AttrDSiomc8iSoocio = AttriSocio , i = 1,5 is a set of 8 dimension attributes Dim8Socio , where ASocio is a name of essence type, it can be an archival document, a 18 museum artifact, a library book, a newspaper article, etc., ASocio is a brief description of essence type, 28 ASocio is a list of essence type attributes, ASocio is a list of characteristics of essence type, ASocio is a list 38 48 58 of information elements used to store data from the dimension set Dim7Socio .
Dim9Socio is data on entities in the funds, in particular, AttrDSiomc9iSoocio = AttriSocio , i = 1,7 is a set of dimension 9 attributes Dim9Socio , where ASocio is a name of the essence, ASocio is a time period to which the essence 19 29 from the set of dimension belongs to Dim9Socio , ASocio is a social and communication fund from the set 39 Dim5Socio , ASocio is a class of essences from the set Dim6Socio , ASocio is a type of set of essence funds used to 49 59 store data Dim8Socio , ASocio is an essence identifier of the geographic information system, ASocio is the 69 79 content of the information essence, or resource identifier.
The values of the dimensions (attributes) discussed above along each axis of the hypercube are hierarchically combined into one or more levels depending on the dimension. Due to this, hierarchical dimensions are formed for the purpose of further analysis of data by their aggregation, or detailing (Fig. 4).
tsn L = 2 e m e r u s a e fm L =1 P rovkSocio o y h c r a r ieH L = 0 Attr1PkSocio AttrMPk1Socio Attr1F1
SPSroocvio F1 ...
F5
Dim1Socio
Dim2Socio ...
Dim9Socio AttrMF12
Attr1F5
AttrMF56
Attr1Dim1Socio AttrMD7im1Socio Attr1Dim2Socio AttrMD8im2Socio
Attr1Dim9Socio AttrMD1i5m9Socio
N0
Data aggregation of OLAP-cubes of social and communication networks of a smart city is a process of obtaining new aggregates (values) corresponding to the attributes of a certain level L based on lower-level values L–1. Such dimensions are axes of hierarchical dimensions, in particular P roviSocio , Fj and DimkSocio that contain the initial attributes of the lower hierarchical level (L=0) and can be supplemented by attributes of higher hierarchical levels from L=1. The slice operation is used to obtain the required subsets of social and communication cells SPSroocvio ' SPSroocvio in order to cut off the unnecessary values by sequentially fixing the attributes.
The use of information and communication technologies contributes to the formation of data warehouses, which store images of artifacts or electronic documents. Thus, a consolidated information resource is formed based on the funds of libraries, archives, and museums of a smart city.
One of the key components of process support in the social and communication networks of a smart city is the creation of data warehouses and information technology for multidimensional data analysis – OLAP (operational analytical data processing).
Multidimensional analysis of data on the processes occurring in urban social and communication networks is based on the study of the characteristics of municipal social and communication resources, including the choice of attributes used for their parameterization.
The values of dimensions (attributes) are hierarchically combined into one or more levels depending on the dimension. Due to this, hierarchical dimensions are formed to further analyze the data by aggregating or detailing. This approach ensures the effective consolidation of the information resources of the social memory institutions in a smart city.
Thus, the paper presents the information technology of multidimensional data analysis in urban social and communication networks based on the methodology of building data hypercubes. This allowed the classification and parameterization of many categories and attributes used to describe the processes in the social and communication networks in a smart city and led to the formation of multidimensional data models used in the formation of prototypes of data warehouses. These repositories, in contrast to existing ones, are better adapted to the dynamic changes in the structure and states of social and communication networks of a large city.
Libraries, museums and archives, as intellectual elements of the social and communication environment of a smart city, get new effective tools for processing, storage, and analysis of existing information resources, which accelerates and improves the quality of analytical and synthetic processing procedures, and users get remote access to documents from their funds through a single access point.
This approach simplifies and increases the efficiency of not only the institutions of social memory, but the social and communication environment in general, increases the efficiency of technologies for processing information flows circulating in it.