<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Multilevel Values of IT Projects SMART- cities and SMART-regions</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sergiy Bushuyev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Natalia Bushuyeva</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Svitlana Onyshchenko</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Inna Khodikova</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alla Bondar</string-name>
          <email>ocheretyankaalla@gmail.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kyiv National University of Construction and Architecture</institution>
          ,
          <addr-line>Povitroflotsky Avenue, 31, 03680 Kyiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Odesa National Maritime University</institution>
          ,
          <addr-line>Mechnikova 34, 65029, Odesa</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This study is devoted to the development of a conceptual model and a method for assessing the value of IT projects for cities and regions as part of their smart transformation. Unlike existing approaches, the model and method take into account the "adjustment" of the value, taking into account the budget and project time frame, as well as the "contribution" of the project to the achievement of multiple targets in interrelated/related areas, taking into account the priorities of areas and goals (integral value) and the significance of the project for different interrelated levels, taking into account the priorities of objects (which are affected by the project), areas and goals (hierarchical value). Together, this makes it possible to take into account the significance of the results and relationships of projects that are characterized by multidimensionality and multi-levelness. The proposed method for assessing the value is developed for three options for the conditions for considering a project: 1) the basic option - taking into account the system of target indicators and their priorities for one "object"; 2) an option that takes into account the conditions of the project's multidimensionality, when its results are significant for various areas, and the value is commensurate with the project's contribution to the achievement of multiple systems of target indicators in several interrelated/related areas, taking into account the priorities of areas and goals integral value; 3) an option that provides for the significance of the project for various areas at various interrelated levels, taking into account the priorities of centres, areas, goals - a hierarchical value. The practical use of this method allows you to reasonably make decisions on financing or other support at the state level. An important feature of the proposed method for assessing the integral and hierarchical value is that the method is universal and can be used for projects of any nature that meet either the condition of multidimensionality, multi-levelness or both. Value, multi-levelness, multidimensionality, SMART-cities, assessment method, IT projects ORCID: 0000-0002-7815-8129 (Sergiy Bushuyev); 0000-0002-4969-7879 (Natalia Bushuyeva); 0000-0002-7528-4939 (Svitlana Onyshchenko); 0000-0001-6341-6941 (Inna Khodikova); 0000-0003-2228-2726 (Alla Bondar)</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Smart cities and smart regions are transforming the way IT projects are created and managed. These
projects have multidimensional and multilevel values, making it important to evaluate their worth. While
there are many publications on assessing project value, most focus on theoretical or practical aspects.
However, it is essential to develop a method for evaluating project value based on the key characteristics
of budget, time, and results. This approach must take into account the different values that IT projects can
bring, such as strategic, operational, financial, and user values [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Furthermore, the significance of a
project and its effectiveness can be linked to different levels, from local to regional, and even
international. This study aims to develop a method for assessing the value of IT projects that considers
their multidimensional and multilevel nature [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        Modern project and program management methodology places great importance on the concept of
"value". As a result, a significant amount of literature has been dedicated to exploring theoretical and
practical approaches to evaluating the value of projects, portfolios, and programs [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. This includes the
development of appropriate methods and models to optimize portfolios and programs based on the
criterion of
maximum
value
      </p>
      <p>
        while considering any constraints [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Today, "value" is a more
comprehensive and significant concept compared to traditional efficiency, although in some cases,
      </p>
      <p>2020 Copyright for this paper by its authors.
"value" is equivalent to "efficiency". In models that optimize portfolios and programs, efficiency is
viewed as a constraint, while the primary goal and corresponding efficiency criterion remain focused on
achieving maximum value.</p>
      <p>
        It should be noted that “value” is one of the key categories of modern project and program
management methodology, therefore a significant number of modern publications are devoted to both
theoretical and practical aspects of assessing the value of projects, portfolios, programs [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], including the
development of appropriate methods, and also models for the formation of portfolios and programs
according to the criterion of maximum value [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], taking into account the system of restrictions. Thus,
today "value" [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] is a broader and more meaningful concept than traditional efficiency, and only for some
categories of projects "value" is equivalent to "efficiency". In the mentioned models of portfolios and
programs, efficiency acts as a constraint, and the main goal and the corresponding efficiency criterion is
precise "value".
      </p>
      <p>
        In the works, a generalization of “value” was proposed as a correspondence to the goals (enterprises,
companies, organizations) or the “degree of contribution” of the project to the achievement of the goal. At
the same time, it was established in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] that each project can contribute to various strategic goals of the
enterprise.
      </p>
      <p>But the question arises - the contribution of the project to the achievement of the goal (goals) can be
high, but the cost of the project is also too high, and slightly less modest results in achieving the goal
(goals) can be provided by a project with a much smaller budget. In addition, the duration of the project is
also significant in terms of its value - if results that are not much different can be achieved using two
projects with different deadlines, then, naturally, preference should be given to the project with a shorter
time to get the result.</p>
      <p>
        In addition, at the level of evaluation methods, such an aspect of the value of projects as
multilevelness is ignored. This is especially true for IT projects [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], infrastructure projects, projects related to
the development of tourism, and environmental projects when financing is provided from budgetary
funds, and the significance of the project and its effectiveness can be associated with both the local and
regional levels, and, in some cases, and with the level of the country as a whole. And for some projects,
which should be implemented with the support of international funds, the significance can be considered
and assessed accordingly within the international community.
      </p>
      <p>
        Thus, the purpose of this study is to develop a conceptual model and an appropriate method for
assessing the value of IT projects, taking into account the multidimensionality and multilevel nature of
their results [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>"Value" is one of the key categories of modern project and program management methodology,
therefore a significant number of modern publications are devoted to both theoretical and practical
aspects of assessing the value of projects, portfolios, and programs, including the development of
appropriate methods, as well as models formation of portfolios and programs according to the criterion of
maximum value, taking into account the system of restrictions. Thus, today "value" is a broader and more
meaningful concept than traditional efficiency, and only for some categories of projects "value" is
equivalent to "effectiveness". In the mentioned models of portfolios and programs, efficiency acts as a
constraint, and the main goal and the corresponding efficiency criterion is precise "value".</p>
      <p>Even though a significant number of publications are devoted to "values", nevertheless, many aspects
remain unexplored or not clearly defined.</p>
      <p>Thus, the essence of the "value" of projects is determined by taking into account their specifics this is
a generally accepted approach. Naturally, the value of an environmental project and the value of a project
related to the development of tourism are formed taking into account their characteristics.</p>
      <p>
        Multidimensionality and multilevel values of IT projects refer to the various ways in which IT projects
can create value for different stakeholders at different levels within an organization. Let's look at the basic
values of IT projects [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>Strategic value: IT projects can provide strategic value by aligning with the overall business strategy
and helping to achieve business goals. For example, a project that introduces new technology to improve
customer experience can create strategic value by increasing customer satisfaction and loyalty.</p>
      <p>
        Operational value: IT projects can also provide operational value by improving the efficiency and
effectiveness of business processes [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. For example, a project that automates a manual process can
reduce errors and save time, resulting in operational efficiency gains.
      </p>
      <p>Financial value: IT projects can generate financial value by reducing costs, increasing revenue, or
both. For example, a project that enables online sales can increase revenue by opening up new sales
channels and reducing costs by automating order processing.</p>
      <p>User value: IT projects can create user value by improving the user experience of employees,
customers, or other stakeholders. For example, a project that introduces a mobile app for employees to
access company resources can improve their productivity and satisfaction.</p>
      <p>
        Societal value: IT projects can also create societal value by contributing to social or environmental
goals. For example, a project that reduces carbon emissions through the use of virtual meetings can
contribute to environmental sustainability [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
      <p>
        At each of these levels, IT projects can create value for multiple stakeholders, such as employees,
customers, partners, shareholders, and society at large. The ability and agility to create value across
multiple dimensions and levels are what makes IT projects such a powerful tool for driving business
success and social impact [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Literature review</title>
      <p>
        Strategic value is one of the key ways in which IT projects can create value for an organization. In the
context of IT projects, strategic value refers to the extent to which the project aligns with the overall
business strategy and helps to achieve business goals [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>IT projects can provide strategic value in several ways.</p>
      <p>Supporting business objectives: IT projects can help to support the achievement of business objectives
by providing tools and systems that enable employees to work more efficiently, provide better customer
service, or develop new products and services.</p>
      <p>Improving competitiveness: IT projects can help to improve the competitiveness of a company by
providing new capabilities that differentiate it from competitors, such as new products, services, or
business models.</p>
      <p>Enhancing customer experience: IT projects can help to enhance the customer experience by providing
better access to information, improving communication channels, or simplifying the buying process.</p>
      <p>Enabling innovation: IT projects can enable innovation by providing tools and systems that support
research and development, or by providing new ways to analyze data and generate insights.</p>
      <p>Supporting decision-making: IT projects can support decision-making by providing access to real-time
data and analytics, enabling better forecasting and risk management, and improving collaboration and
communication across departments.</p>
      <p>
        IT projects can provide strategic value by supporting business objectives, improving competitiveness,
enhancing customer experience, enabling innovation, and supporting decision-making. By aligning with
the overall business strategy and helping to achieve business goals, IT projects can help organizations to
stay competitive, grow, and succeed [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>
        Operational value is another way in which IT projects can create value for organizations. In the
context of IT projects, operational value refers to the extent to which the project improves the efficiency
and effectiveness of business processes [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>IT projects can provide operational value in several ways.</p>
      <p>Automating manual processes: IT projects can automate manual processes, such as data entry,
inventory management, or scheduling, reducing errors and saving time.</p>
      <p>Streamlining workflows: IT projects can streamline workflows by providing tools and systems that
enable employees to work more efficiently, reducing the time required to complete tasks.</p>
      <p>Improving communication: IT projects can improve communication across departments and with
customers, suppliers, or partners, reducing the time required to resolve issues and make decisions.</p>
      <p>Enhancing data analysis: IT projects can enhance data analysis by providing tools and systems that
enable better analysis of data, improving forecasting and decision-making.</p>
      <p>Reducing costs: IT projects can reduce costs by eliminating manual processes, reducing errors, and
improving efficiency, resulting in cost savings.</p>
      <p>IT projects can provide operational value by automating manual processes, streamlining workflows,
improving communication, enhancing data analysis, and reducing costs. By improving the efficiency and
effectiveness of business processes, IT projects can help organizations to reduce costs, increase
productivity, and achieve better results.</p>
      <p>IT projects can create financial value for organizations by reducing costs, increasing revenue, or both.
In the context of IT projects, financial value refers to the extent to which the project generates financial
benefits for the organization.</p>
      <p>IT projects can provide financial value in several ways.</p>
      <p>Reducing costs: IT projects can reduce costs by automating manual processes, improving efficiency,
and reducing errors, resulting in cost savings.</p>
      <p>Increasing revenue: IT projects can increase revenue by providing new capabilities that enable the
organization to develop new products, services, or business models, or by providing new ways to reach
customers and increase sales.</p>
      <p>Improving cash flow: IT projects can improve cash flow by providing tools and systems that enable
faster payment processing, better inventory management, or more accurate forecasting.</p>
      <p>Reducing risk: IT projects can reduce risk by providing tools and systems that enable better risk
management, such as fraud detection or compliance monitoring.</p>
      <p>Enabling cost avoidance: IT projects can enable cost avoidance by providing tools and systems that
enable the organization to avoid costs that would otherwise be incurred, such as by preventing errors or
reducing downtime.</p>
      <p>IT projects can create financial value by reducing costs, increasing revenue, improving cash flow,
reducing risk, and enabling cost avoidance. By generating financial benefits for the organization, IT
projects can help to improve the financial performance of the organization and support its long-term
sustainability.</p>
      <p>
        Societal value is an important way in which IT projects can create value beyond the organization
itself. In the context of IT projects, societal value refers to the extent to which the project contributes to
the well-being of society as a whole, including its impact on social, environmental, and ethical factors
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>IT projects can provide societal value in several ways.</p>
      <p>Improving access to information: IT projects can improve access to information, enabling people to
make more informed decisions and increasing transparency and accountability.</p>
      <p>Enabling innovation: IT projects can enable innovation by providing new tools and systems that
enable new products, services, or business models, stimulating economic growth and creating new
opportunities.</p>
      <p>Reducing environmental impact: IT projects can reduce environmental impact by providing tools and
systems that enable more efficient use of resources, reducing waste, and promoting sustainable practices.</p>
      <p>Enhancing social inclusion: IT projects can enhance social inclusion by providing tools and systems
that enable marginalized or disadvantaged communities to access information, services, or job
opportunities.</p>
      <p>Promoting ethical behaviour: IT projects can promote ethical behaviour by providing tools and
systems that promote transparency, accountability, and ethical decision-making.</p>
      <p>
        IT projects can create societal value by improving access to information, enabling innovation,
reducing environmental impact, enhancing social inclusion, and promoting ethical behaviour. By
contributing to the well-being of society as a whole, IT projects can help to address some of the most
pressing social, environmental, and ethical challenges of our time [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
      <p>IT projects are often multidimensional, meaning they involve multiple dimensions or aspects that
contribute to their overall success or value. The multidimensionality of IT projects can be thought of in
terms of several different dimensions.</p>
      <p>Technical dimension: This dimension involves the technical aspects of the project, such as the
hardware, software, and infrastructure required to implement the project successfully.</p>
      <p>Process dimension: This dimension involves the processes and procedures required to support the
project, such as project management methodologies, change management processes, and quality control
processes.</p>
      <p>People dimension: This dimension involves the people involved in the project, such as project team
members, stakeholders, end-users, and customers.</p>
      <p>Organizational dimension: This dimension involves the organizational context in which the project is
being implemented, such as the culture, structure, and strategic priorities of the organization.</p>
      <p>Financial dimension: This dimension involves the financial aspects of the project, such as the budget,
return on investment, and cost-benefit analysis.</p>
      <p>Time dimension: This dimension involves the timeline or schedule for the project, including deadlines,
milestones, and critical path analysis.</p>
      <p>Strategic dimension: This dimension involves the alignment of the project with the overall strategic
goals and objectives of the organization.</p>
      <p>By considering each of these dimensions, IT project managers can gain a more comprehensive
understanding of the project and its various components, as well as the factors that contribute to its
success or failure. Managing the multidimensionality of IT projects requires careful planning,
coordination, and communication across all dimensions, and a focus on integrating the various aspects of
the project to ensure that they work together effectively. Multilevel in the context of IT projects refers to
the different levels or layers of the project, which may be nested or interconnected. These levels can be
thought of as a hierarchy, with each level building on the one below it and contributing to the overall
success of the project.</p>
      <p>The multilevel nature of IT projects can be viewed in terms of several different levels.</p>
      <p>Strategic level: This level involves the overall strategic direction of the organization and how the
project fits into that strategy. At this level, decisions are made regarding the project's scope, goals, and
objectives.</p>
      <p>Tactical level: This level involves the planning and execution of the project, including the
development of project plans, timelines, and resource allocation.</p>
      <p>Operational level: This level involves the day-to-day management of the project, including monitoring
progress, tracking budgets, and identifying and addressing issues and risks.</p>
      <p>Technical level: This level involves the technical aspects of the project, including the development and
deployment of hardware and software systems, as well as the management of data and information.</p>
      <p>User level: This level involves the end-users of the project, including employees, customers, and
partners, and their needs and requirements.</p>
      <p>Social level: This level involves the broader social and ethical implications of the project, including its
impact on society, privacy, and security.</p>
      <p>By considering each of these levels, IT project managers can gain a more comprehensive
understanding of the project and its various components, as well as the factors that contribute to its
success or failure. Managing the multilevel nature of IT projects requires careful coordination and
communication across all levels and a focus on integrating the various aspects of the project to ensure that
they work together effectively.</p>
      <p>
        In the works [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], a generalization of “value” was proposed as the correspondence to the goals
(enterprises, companies, organizations) or the “degree of contribution” of the project to the achievement
of the goal. At the same time, in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] it is established that each project can contribute to various strategic
goals of the enterprise and, using the example of projects and technical development programs, a method
for assessing value is presented, taking into account the fuzziness of information about the results of
projects. This approach can be considered universal, it takes into account the multidimensionality of
project results, and the unequal goals (using appropriate weights), and to take into account the specifics of
projects, it is required to determine the essence of the goals and results of project implementation.
      </p>
      <p>But the question arises - the contribution of the project to the achievement of the goal (goals) can be
high, but the cost of the project is also too high, and slightly less modest results in achieving the goal
(goals) can be provided by a project with a much smaller budget. In addition, the duration of the project is
also significant in terms of its value - if results that are not much different can be achieved using two
projects with different deadlines, then, naturally, preference should be given to the project with a shorter
time to get the result.</p>
      <p>
        In the models of portfolios and program formation proposed in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], time and expenses (budget) are
used as constraints, which ensures the adequacy of the proposed process of portfolios and program
formation to the real situation and selection conditions.
      </p>
      <p>But in practice, there are many situations when it is necessary to compare projects or rank them for
subsequent selection processes, and in such cases, only compliance with the goals somewhat narrows the
real assessment of the project, which leads to the need to develop a method for assessing the value of
projects, taking into account their key characteristics - "result", "budget" and "time".</p>
      <p>In addition, at the level of evaluation methods, such an aspect of the value of projects as
multilevelness remains unattended. This is especially true for infrastructure projects, tourism development, and
environmental projects when financing is provided from budgetary funds, and the significance of the
project and its effectiveness can be associated both with the local, and regional level and with the level of
the country as a whole. And for some projects, which should be implemented with the support of
international funds, the significance can be considered and assessed accordingly within the international
community.</p>
      <p>
        So, in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] hierarchies of levels of consideration of infrastructure projects and projects of technical
development of ports were built, which is a good example of the "multilevel" results of the project, and
therefore its value.
      </p>
      <p>So, to sum it up:
•
•
•
•
•
the value of the project is a multidimensional concept, which is taken into account in the existing
evaluation methods as the contribution of the project to the achievement of various goals of the
enterprise/organization, thus, the results of the project, which are different, and the set of goals of the
enterprise/organization are compared;
the value of the project should take into account the diversity of results (where appropriate), that is, their
significance from the point of view of a particular locality, region, or country, which, for example, is the
case for infrastructure projects, tourism development projects, and environmental projects. In addition, if
the project is planned as an element of an appropriate program, this should also be taken into account;
the value of the project should take into account its multidimensional nature (where appropriate, such as for
transport and logistics projects for tourist centres);
the value of the project is determined not only by the results but also by their "intensity" and cost, that is,
the assessment of the value of the project should take into account its duration, the period until the results
are obtained, the duration of the results, as well as the budget, which leads to a comparison of "results"
"costs".</p>
      <p>This approach forms the basis of the method for evaluating the value of projects, which is based on existing
evaluation methods as their development, taking into account the foregoing.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Basic concept and method of estimating the value</title>
      <p>Basic concept and method of estimating value. As mentioned above, IT projects that are implemented
at the level of cities or regions as part of their SMART transformation can be social, as well as affect the
transport sector, as well as tourism. Thus, the projects under consideration are connected with the
intersection of many areas (Fig. 1), which are also interconnected.</p>
      <sec id="sec-3-1">
        <title>Smart-cities and Smart-regions transformations</title>
      </sec>
      <sec id="sec-3-2">
        <title>Transport system development</title>
        <p>IT PROJECTS</p>
      </sec>
      <sec id="sec-3-3">
        <title>Tourism</title>
        <p>development</p>
      </sec>
      <sec id="sec-3-4">
        <title>Social development</title>
        <p>In addition, the multidimensionality of the results of the implementation of such projects can be
manifested at various levels - at the level of a separate district of the city, at the level of the city or at the
region as a whole.</p>
        <p>Thus, the method for evaluating the value of an IT project should take into account these two
properties - multidimensionality and multi-levelness. In addition, the value of the project is determined
not only by its results but also by its "intensity" and costs, that is, the assessment of the value of the
project must take into account its duration, the period until the results are obtained, the duration of the
results, as well as the budget, which leads to a comparison of "results" - "expenses". This approach forms
the basis of the proposed method for evaluating the value of projects, which is based on existing
evaluation methods as their development, taking into account the foregoing. Thus, the conceptual model
of the formation of the value of the project and its corresponding assessment, taking into account the
positions formulated above, can be represented as follows (Fig. 2).</p>
        <sec id="sec-3-4-1">
          <title>Aspects of project view</title>
          <p>viewпроєкту
Portfolio ownership
s
e
u
l
a
v
t
c
e
j
o
r
P</p>
        </sec>
        <sec id="sec-3-4-2">
          <title>Deliverables</title>
          <p>PROJECT</p>
        </sec>
        <sec id="sec-3-4-3">
          <title>Time</title>
          <p>Budget
s
l
a
o
g
c
i
g
e
t
a
r
t
S
Country
Region
Company
l
e
v
e
l
w
e
i
v
t
c
e
j
o
r
P</p>
        </sec>
        <sec id="sec-3-4-4">
          <title>Time</title>
        </sec>
        <sec id="sec-3-4-5">
          <title>Budget</title>
          <p>j = 1, m serial number of the project, m - the total number of projects under consideration;
Si , i = 1, n criterion assessment of the i-th goal, n - the total number of goals of the considered
level (company, region of the country) that can be compared with the project under consideration;
n
 i , i = 1, n goal weight (priority), as a rule,   i = 1 the condition is set;</p>
          <p>i=1</p>
          <p>Sij , i = 1, n, j = 1, m characteristics of the results of the implementation of the j-th project from
the position of the i-th goal, that is, the assessment is comparable to Sij , respectively Si , has the same
dimension;</p>
          <p>R j , j = 1, m</p>
          <p>project budget;
- Т j , j = 1, m project implementation period/time to receive the project product.</p>
          <p>As an assessment of the value of projects 0  V j  1, j = 1, m , the following is proposed:
V j = 1 −
T *

R *</p>
          <p>n
  
i=1
i
(Sij − Si )2</p>
          <p>Si2
T j</p>
        </sec>
      </sec>
      <sec id="sec-3-5">
        <title>Thus,</title>
        <p>(Si j − Si )2</p>
        <p>Si2
where Т *, R * - respectively, the budget and the deadline for achieving the goal are taken as the
base. Note that it is logical to consider only projects for which:</p>
        <p>R j  R*, T j  T *, j = 1, m.
it compares the "distance" of the results from the target indicator and
(1)
(2)
</p>
        <p>n
  
T * R *
basic values. The less time and money the project needs, the smaller this correction factor, the smaller the
T j R j (Sij − Si )2</p>
        <p>corrects it by an amount equal to the ratio of the time and budget of the project with some
value</p>
        <p>T * R * i=1 i Si2
two projects with almost the same results, the one with a smaller budget and a faster implementation time
will be more valuable.</p>
        <p>The closer the characteristics of the project are to the “ideal values”, that is, with the maximum
achievement of the goal in a shorter time and with a smaller budget than for the base values, the closer the
value is to 1, and, accordingly, vice versa.</p>
        <p>, and the larger the value (1). The reverse is also true. Thus, of</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Method for evaluating the value multidimensionality and multi-levelness of projects, taking into account</title>
      <p>The second option for considering the value of projects is for multidimensional conditions, when the
project affects, for example, various areas of development at the city/region/country level. That is, the
product of the project and its results are of "value" for various areas. It was determined above that for
projects of transport and logistics support for tourist centres, it is characteristic that their products belong
to the areas of tourism, transport and transport infrastructure, and the social sphere, and can also be
associated with the smart transformation of modern cities and regions. For such projects, the valuation
should be carried out following the one presented in Fig. 3 detail approach.</p>
      <p>Let us introduce the notation:</p>
      <p>k = 1, K the serial number of the area associated with the project, K - the total number of areas
under consideration;
K
 k , k = 1, K priority of the k-th sphere at the considered level, 
k =1
 k = 1 ;
S k , k = 1, K , i = 1, nk criterion assessment of the i-th goal of the k-th sphere, nk - the total number
i
of goals of the considered sphere that can be compared with the project under consideration;
 ik , k = 1, K , i = 1, nk priority
of
the
goal
of
the
sphere
under
consideration
nk
  ik = 1, k = 1, K ;
i=1</p>
      <p>AREAS RELATED TO THE PROJECT</p>
      <p>PRIORITY OF THE AREAS FOR THE LEVEL  k , k = 1, K
AREA 1</p>
      <p>AREA 2
….</p>
      <p>AREA k
….</p>
      <p>AREA K</p>
      <p>GOALS RELATED TO THE PROJECT
CHARACTERISTICS AND PRIORITY OF THE GOALS ik , Sik ,Tik , Rik , k =1, K,i =1, nk 
CHARACTERISTICS
T j , R j , j = 1, m</p>
      <p>RESULTS
Sikj , k = 1, K, i = 1, nk , j = 1, m</p>
      <p>PROJECT</p>
      <p>Sikj , k = 1, K, i = 1, nk , j = 1, m characteristics of the results of the implementation of the j-th
project from the position of the i-th goal of the k-th sphere, Sikj that is, the assessment is comparable to
Sik , respectively, has the same dimension;</p>
      <p>Rik , k = 1, K , i = 1, nk budget of the i-th goal of the k-th sphere;
Тik , k = 1, K , i = 1, nk the term for achieving the i-th goal of the k-th sphere.</p>
      <p>As an assessment of the value of projects 0  V j  1, j = 1, m
а
for the condition of
multidimensionality, the following is proposed:</p>
      <p>K  nk
Vаj = 1 −   k 
k =1  i=1
 k
i
(Sikj − Sik )2</p>
      <p>k 2
(S )
i
</p>
      <p>This value is integral, as it takes into account all related areas and goals. Following (3), the assessment
of the degree of achievement of goals for each area, taking into account the priority of both areas and
goals, is "adjusted" in time and budget based on the reasoning that was outlined above. According to the
approach adopted above, projects are considered for which the conditions for budget and time are met:
(3)
(4)
R j  Rik , k = 1, K , i = 1, nk ,</p>
      <p>T j  Tik , k = 1, K , i = 1, nk ,
Note that components (3) have an independent meaning:</p>
      <p>Vk j = 1 −  k 
 i=1
 k</p>
      <p>i
 nk
(Sikj − Sik )2
(Sik )2

Ti k</p>
      <p>R j 
 k  , k = 1, K</p>
      <p>Ri 
(5)
- the value of the project for the k-th sphere;</p>
      <p>Vikj = 1 − ik (Si(kjS−ik S)2ik )2  TTi kj  RRikj , k = 1, K , i = 1, nk (6)
- the value of the project from the position of the i-th goal of the k-th sphere.</p>
      <p>This allows a more detailed study of the value of the project from various points of view - from a
single goal to an aggregate assessment of value in general.</p>
      <p>An illustration of the operation of formula (3) is presented in the calculation example below (Fig. 4-6).</p>
      <p>Note that this example assumes one goal for each area. The column "Value" presents the results of
calculating the value (integral) according to formula (3), as well as the value of the project for each area
following formula 4. Characteristics of the results and the corresponding goals are presented in arbitrary
units, time - in months, and budget - in conditional monetary units. In the presented data fragment, the
duration of the project varies from 10 to 23 months. In the process of research, the budget and results
were also subject to variation. Priority (weight) of spheres, respectively, 0.2; 0.5; 0.3.</p>
      <p>Figure 4 shows the components of the final (integral) value for each area following formula (4). This
representation allows you to visually characterize the value of the project for each area. In this case, the
greatest value of the project is in terms of area 1 and area 3.
0,950
0,900
0,850
0,800
AREA 3</p>
      <p>AREA 2</p>
      <p>Time-Value
10</p>
      <p>12
Value
14
16
18
20
22
24</p>
      <p>Budget-Value
1
0,98
0,96
0,94
0,92
0,9
0,88
1,02
0,97
0,92
0,87
0,82
0,77
34
39
44
49
54
59
64
Value
1,000
0,980
0,960
0,940
0,920
0,900
0,880
50
55
60
65
70
75
Value</p>
      <p>As you can see, the dynamics of value logically correspond to the dynamics of budget, time and
results - the higher the budget and time, the lower the value; the higher the result in one of the areas, the
higher the integral value and the value of the project from the position of the corresponding area (in this
example, the first one). This confirms the compliance of the proposed formulas (3), (4) with the logic of
the value concept of the project.</p>
      <p>The next, and the last of the situations under consideration, is when the project is connected not only
with different areas but also with different levels. This means that the implementation of the project
produces results at various levels and in various aspects. For example, the implementation of a project
related to the development of transport and logistics infrastructure for a tourist centre of the second level
will have a positive impact on the tourist flow in several geographically interconnected centres at the first,
second and third levels, thus the value of this project is manifested in other centres and levels. This fact
should be taken into account when assessing the value of this project.</p>
      <p>Thus, multidimensionality forms "integrality", and a multi-level - "hierarchy" (from the position of the
hierarchy of tourist centres). Therefore, the value of the project, which takes into account the
multidimensionality, we will define as "integral value", and the value that takes into account the
multilevelness, we will define as "hierarchical value".</p>
      <p>Let us introduce the notation:</p>
      <p>y   - index of the "object" (city, district, region, company), which is affected by the
implementation of the project;</p>
      <p> y - the weight of the priority of the object, which is affected by the implementation of the
project;</p>
      <p>y</p>
      <p>Sikj , y  , j = 1, m, i = 1, nk , k = 1, K
project, the achievement of the i-th target indicator of the k-th aspect on the object y   ;
Siyk , k = 1, K , i = 1, nk , y  
- assessment of the i-th target indicator of the k-th aspect of the
y
object y   , the target indicator has the same dimension as Sikj , which makes it possible to compare
them;</p>
      <p>Riyk , k = 1, K , i = 1, nk , y   - budget of the i-th goal of the k-th sphere y;
Тiyk , k = 1, K , i = 1, nk , y   - the term for achieving the i-th goal of the k-th sphere y.
As an assessment of the value of projects 0  V j  1, j = 1, m for the condition of hierarchy and
h</p>
      <p>- the result of the impact of the implementation of the j-th</p>
      <p>Vhj = 1 − y  y kK=1  ky  in=k1  iyk (Siyk(jS−iyk S)2iyk )2  TTikyj  RRiykj  , j = 1, m (7)
Note that in this case it is assumed that the number of considered areas/aspects related to the project is
the same for each level, regardless of the level.</p>
      <p>As in the case of valuation under multidimensional conditions, (7) contains components that have
independent value:
 iyk
 iyk</p>
      <p>K  nk
V jy = 1 −   y
h k 
k =1  i=1
y − Sik )</p>
      <p>y 2
(Sikj</p>
      <p>y 2
(Sik )
</p>
      <p>T j
T y
ik</p>
      <p>R j 
 y  , y  , j = 1, m</p>
      <p>Rik 
- the value of the j-th project for y   ;</p>
      <p>V jk = 1− 
h
y</p>
      <p> nk
 y 
 i=1
(Siykj − S )
y 2
ik
(Siyk )2
</p>
      <p>T j
T y
ik
</p>
      <p>R j </p>
      <p>y  , k = 1, K , j = 1, m</p>
      <p>Rik </p>
      <sec id="sec-4-1">
        <title>Area 1</title>
        <p>Area 2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Area 1</title>
      </sec>
      <sec id="sec-4-3">
        <title>Area 2</title>
      </sec>
      <sec id="sec-4-4">
        <title>Area 1</title>
        <p>Area 2
al 1
al 2
al 1
al 2
al 1</p>
        <p>al 2
Go
Priority
Area 1
Goal 1
Goal 2
Area 2
Goal 1
Goal 2
y=1
0,4
0,8
0,2
0,6
0,7
0,3
- the value of the project for the k-th sphere.</p>
        <p>The system of indicators of value (6)-(9) allows you to perform an in-depth analysis of the value of the
project for a specific area, the objects under consideration as a whole, taking into account all aspects and
manifestations of the impact of the results of the project. We will demonstrate the work of the proposed
formulas for assessing the value of a specific example. The impact of the project implementation on three
objects, and two spheres for each, is considered. Priority of areas for each centre and priority of goals in
Table 3.3, project results in terms of each goal for each area and centre in Table 1, and targets in Table 2.
Priorities of areas  y
k and goals  iyk
y=2
Go
0,2
0,4
0,6
0,5
0,8
0,2
y= 3
Go
100
70
170
100</p>
        <p>Note that in the example, the data is conditional to demonstrate the operation of the method. As a
result of the calculations, the values of the project values for each centre and the total value (taking into
account the multidimensionality and multi-levelness) for various values of the project implementation
time and its budget were obtained. Calculations show that the value of the project both at the level of a
specific object of consideration and in general in all areas (hierarchical value) logically decreases as the
project budget and time of its implementation increase. Figures 8 and 9 show the dependence of project
value on budget and time.</p>
        <p>Figure 10 shows the dynamics of the project value depending on the budget for a different
distribution of priorities of "objects". So, for example, with an increase in priority y=2 from 0.1 to 0.8, the
value of the project decreases, which decreases much more under the influence of an increase in the
project budget. This is because the contribution of the project to achieving the goals is relatively small,
therefore, with an increase in the priority of this object, the value of the project naturally decreases.</p>
        <p>Thus, the experimental calculations confirmed the validity of the proposed formula for assessing the
value, since the research results are consistent with the logic of the value methodology.</p>
        <p>Conclusion</p>
        <p>This study is devoted to the development of a conceptual model and a method of assessing the value of
IT projects for cities and regions as part of their smart transformation. In contrast to existing approaches,
the model and method take into account the "correction" of the value taking into account the budget and
the project implementation period, as well as the "contribution" of the project to the achievement of
multiple target indicators in interrelated/related areas, taking into account the priorities of areas and goals
(integral value) and the importance of the project for different interconnected levels, taking into account
the priorities of objects (which are affected by the project), spheres and goals (hierarchical value). This
together allows us to more fully take into account the significance of the results and connections of
projects, which are characterized by multifacetedness and multi-levelness. We note that the proposed
value estimation method is developed for three variants of the project consideration conditions:
• basic variant – accounting of the system of target indicators and their priorities for one "object";
• an option that takes into account the conditions of the project's multifacetedness, when its results are significant
for various spheres, and the value is commensurate with the project's contribution to the achievement of multiple
systems of target indicators in several interconnected/related spheres, taking into account the priorities of spheres
and goals - integral value;
• the option providing for the significance of the project for various spheres at various interrelated levels taking
into account the priorities of centres, spheres, goals - hierarchical value.</p>
        <p>The practical use of this method allows you to reasonably make decisions on financing or other
support at the state level. An important feature of the proposed method of assessing integral and
hierarchical value is that the method is universal and can be used for projects of any nature that meet
either the condition of multifacetedness, multi-levelness, or both. This method is applicable both for the
evaluation of projects of individual companies and projects at the regional/national level.
6. Reference</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Fernandez</surname>
          </string-name>
          , Stakeholders Approach to Smart
          <source>Cities: A Survey on Smart City Definitions. Lecture Notes in Computer Science</source>
          <volume>9704</volume>
          (
          <year>2016</year>
          )
          <fpage>157</fpage>
          -
          <lpage>167</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J.</given-names>
            <surname>Wolf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Borges</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.L.</given-names>
            <surname>Marques</surname>
          </string-name>
          , E. Castro,
          <article-title>Smarter Decisions for Smarter Cities: Lessons Learned from Strategic Plans</article-title>
          .
          <source>In New Paths of Entrepreneurship Development</source>
          , Springer: Cham, Switzerland,
          <year>2019</year>
          , pp.
          <fpage>7</fpage>
          -
          <lpage>30</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Correia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Teixeira; J.L. Marques</surname>
          </string-name>
          ,
          <article-title>Study and analysis of the relationship between smart cities and Industry 4.0: A systematic literature review</article-title>
          .
          <source>International Journal of Technology Management and Sustainable Development</source>
          <volume>21</volume>
          (
          <year>2022</year>
          )
          <fpage>37</fpage>
          -
          <lpage>66</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Kubina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Šulyová</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vodák</surname>
          </string-name>
          ,
          <article-title>Comparison of Smart City Standards, Implementation and Cluster Models of Cities in North America and Europe</article-title>
          .
          <source>Sustainability</source>
          (
          <year>2021</year>
          )
          <volume>13</volume>
          . 3120. https://doi.org/10.3390/su13063120
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>R.</given-names>
            <surname>Fistola</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Gargiulo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. A.</given-names>
            <surname>La</surname>
          </string-name>
          <string-name>
            <surname>Rocca</surname>
          </string-name>
          ,
          <article-title>Rethinking vulnerability in city-systems: A methodological proposal to assess "urban entropy"</article-title>
          .
          <source>Environmental impact assessment review 85</source>
          (
          <year>2020</year>
          )
          <article-title>106464</article-title>
          . https://doi.org/10.1016/j.eiar.
          <year>2020</year>
          .106464
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>S.</given-names>
            <surname>Morcov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Pintelon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kusters</surname>
          </string-name>
          ,
          <article-title>Definitions, characteristics and measures of IT project complexity - a systematic literature review</article-title>
          .
          <source>International Journal of Information Systems and Project Management</source>
          <volume>8</volume>
          (
          <issue>2</issue>
          ) (
          <year>2021</year>
          )
          <fpage>5</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>B.</given-names>
            <surname>Aubert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bourdeau</surname>
          </string-name>
          , Alignment and IT Project Value Maximization,
          <source>in: PACIS 2007 - 11th Pacific Asia Conference on Information Systems: Managing Diversity in Digital Enterprises</source>
          .
          <year>2007</year>
          ,
          <volume>26</volume>
          p.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Gonzalez</given-names>
            <surname>Crespo</surname>
          </string-name>
          , Ruben &amp; Piedra
          <string-name>
            <surname>Calderón</surname>
            , Juan &amp; Granados,
            <given-names>J. Javier. IT</given-names>
          </string-name>
          <string-name>
            <surname>Projects</surname>
          </string-name>
          &amp;
          <article-title>Their Specific Elements</article-title>
          .
          <source>La Pensée</source>
          .
          <year>2013</year>
          . 75 p.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M.</given-names>
            <surname>Bloch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Blumberg</surname>
          </string-name>
          , Jürgen Laartz,
          <article-title>Delivering large-scale IT projects on time, on budget, and on value</article-title>
          .
          <source>McKinsey Quarterly</source>
          <volume>27</volume>
          (
          <year>2012</year>
          )
          <fpage>2</fpage>
          -
          <lpage>7</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>S.</given-names>
            <surname>Bushuyev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Bushuyeva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Onyshchenko</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Khodikova</surname>
          </string-name>
          , Smart Cities: Through Projects to Resist Entropy, in: 2022 IEEE
          <string-name>
            <given-names>European</given-names>
            <surname>Technology and Engineering Management Summit (E-TEMS</surname>
          </string-name>
          <string-name>
            <surname>)</surname>
          </string-name>
          , Bilbao, Spain,
          <year>2022</year>
          , pp.
          <fpage>44</fpage>
          -
          <lpage>50</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Harold</surname>
            <given-names>Kerzner</given-names>
          </string-name>
          ,
          <source>Value Driven Project Management</source>
          .
          <year>2015</year>
          . URL: https://doi.org/10.1002/9781119020042.ch4
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Fuentes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Smyth</surname>
          </string-name>
          ,
          <string-name>
            <surname>A. Davies,</surname>
          </string-name>
          <article-title>Co-creation of value outcomes: A client perspective on service provision in projects</article-title>
          .
          <source>International Journal of Project Management</source>
          <volume>37</volume>
          (
          <issue>5</issue>
          ) (
          <year>2019</year>
          )
          <fpage>696</fpage>
          -
          <lpage>715</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>S.</given-names>
            <surname>Bushuyev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Bushuieva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Onyshchenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Pavlova</surname>
          </string-name>
          , Agile-Transformation
          <source>Organizational Development based on Portfolio Management, in: 11th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS)</source>
          , Cracow, Poland,
          <year>2021</year>
          , pp.
          <fpage>444</fpage>
          -
          <lpage>451</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>C.</given-names>
            <surname>Kaufmann</surname>
          </string-name>
          , A. Kock,
          <article-title>Does project management matter? The relationship between project management effort, complexity, and profitability</article-title>
          .
          <source>International Journal of Project Management</source>
          , Volume
          <volume>40</volume>
          (
          <issue>6</issue>
          ) (
          <year>2022</year>
          )
          <fpage>624</fpage>
          -
          <lpage>633</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bondar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bushuyev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Bushuieva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Onyshchenko</surname>
          </string-name>
          ,
          <article-title>Complementary strategic model for managing entropy of the organization</article-title>
          .
          <source>CEUR Workshop Proceedings</source>
          <volume>2851</volume>
          (
          <year>2021</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>R.</given-names>
            <surname>Pellerin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Perrier</surname>
          </string-name>
          ,
          <article-title>A review of methods, techniques and tools for project planning and control</article-title>
          .
          <source>International Journal of Production Research</source>
          <volume>57</volume>
          (
          <year>2018</year>
          )
          <fpage>2160</fpage>
          -
          <lpage>2178</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>R.</given-names>
            <surname>Pellerin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Perrier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Guillot</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Léger</surname>
          </string-name>
          ,
          <article-title>Project characteristics, project management software utilization and project performance: an impact analysis based on real project data</article-title>
          .
          <source>International Journal of Information Systems and Project Management</source>
          . URL: https://www.sciencesphere.org/ijispm/archive/ijispm-0103.pdf
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bomba</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nazaruk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kunanets</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Pasichnyk</surname>
          </string-name>
          ,
          <article-title>Modeling the dynamics of knowledge potential of agents in the educational social and communication environment</article-title>
          .
          <source>Advances in Intelligent Systems and Computing (AISC) 1080</source>
          (
          <year>2020</year>
          )
          <fpage>17</fpage>
          -
          <lpage>24</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>