<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Quality and Usability Assessment of Smart City Mobile Applications by Using a DEMATEL Approach</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Musab Talha Akpinar</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Semih Ceyhan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ankara Yildirim Beyazit University Ankara</institution>
          ,
          <country country="TR">Turkey</country>
        </aff>
      </contrib-group>
      <fpage>23</fpage>
      <lpage>28</lpage>
      <abstract>
        <p>Nowadays, there are many municipalities have provided mobile services related to their smart city implementations. Therefore, citizens can use mobile services at anytime and anywhere [1]. The object of our research is to understand what criteria afect consumers' tendency to use smart city mobile services. We focused on three measurement dimensions for quality: system quality, information quality, and service quality and five dimensions for usability: efectiveness, eficiency, satisfaction, learnability, and security to assess consumers' attitudes. In addition, for usability assessment focalize as a combination of efectiveness, eficiency, satisfaction, learnability, and security. This paper combined the DEMATEL approach to cope with the problem of interdependence exists among criteria, and to select an optimal portfolio of smart city mobile consumers' attitude.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Smart City</kwd>
        <kwd>Mobile Application</kwd>
        <kwd>DEMATEL</kwd>
        <kwd>Quality</kwd>
        <kwd>Usability</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>ter of information examination and have broadened
the capability of utilizing information driven
instruTo make a good decision, the ability to forecast the ments through dynamic procedures. Business
analytoutcome of the available options is very important. ics, as an emerging research area, strives to bring
difThe original decision support systems (DSS) concept ferent fields and disciplines together overlaying diverse
was clearly defined by Gorry and Scott Morton, as “is aspects in terms of technological innovations,
quantithe system that supports any managerial activity in tative/numerical methods, and decision-making.
semi structured or unstructured decisions”. They also Data analytics refers to the information
technolodefined that characteristics of information requiremen- gies that are grounded mostly in three main types
whits and decision models difer in a decision support sys- ch are descriptive, predictive and prescriptive.
Descriptems environment. The reason of the diference is that tive analytics examine data in detail to reveal the
freDSS is defined in terms of the addressed task struc- quency of cases, the cost of processes, and the base
ture. Most study on DSS focuses on the adaptive pro- cause of collapse. It ensures meaningful insight into
cesses about design strategy, decision research and im- activity performance and facilitate users to better
folplementation strategy. low up and operate their work processes. Predictive</p>
      <p>
        Strategy implementation is the conversion of select- analytics use models and techniques to estimate
forthed tactics into organizationasl activity so as to acquire coming results based on historical and streamed data.
strategic targets and objectives [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Decision-making In predictive forming, the statistical model is prepared,
needs to deal with complex problems, with a limited forecast is made, and the pattern is confirmed as
supinformation, in order to reach the organizational goals plementary data becomes existing [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. The final stage
and objectives. Numerical programming models like in understanding a business which can be called
prebusiness investigation devices are significant tools to scriptive analysis, ofers suggestions on how to act and
solve the problems in a dynamic way, as they help de- take advantage of forecast. The last stage of the
anacision models to provide well rounded solutions. These lytics uses a variety of algorithms and data modelling
applications provide businesses with support on their practices to get a complete understanding of the
envidecisions and processes based on computer based sys- ronment and build up activity’s performances.
tems. Lately, new innovations have expanded the mat- The aim of the prescriptive analytics is to define set
of alternatives which is the best appropriate by the
IVUS 2020: Information Society and University Studies, 23 April 2020, group of decision makers as a whole. The main
objecKTU Santaka Valley, Kaunas, Lithuania tive would be one where all the decision makers could
C"eytahkapni)nar@ybu.edu.tr (M.T. Akpinar); sceyhan@ybu.edu.tr (S. convey their options on the alternatives in a certain
way by means of prescriptive, unlike descriptive
analysis which include fundamental analytical component
© 2020 Copyright for this paper by its authors. Use permitted under Creative
CPWrEooUrckReshdoinpgs IhStpN:/c1e6u1r3-w-0s.o7r3g CCoEmUmoRns WLiceonrsekAsthtriobuptioPnr4o.0cIneteerdnaitniognasl ((CCC EBYU4R.0)-.WS.org)
2. Methodology
such as tables or even multidimensional tables.
Research shows that the nature and content of business
decision making has hardly changed and that man- The main research question of this study is how can
agers operate by a majority descriptive analytics, some impact-relations map help us to determine important
predictive analytics, and a few of prescriptive analyt- parameters in quality and usability assessment of smart
ics. There is a lack of prescriptive studies in the field city mobile applications? The aim of this study is to
and this study will provide inspiration for further stud- find out which of the many meaningful attributes
reies and contribute in to that gap. vealed in the smart city mobile applications are
influ
      </p>
      <p>
        In this respect, a novel business analytics approach ential. Furthermore, the concept of prescriptive
anis proposed in this paper for smart city administra- alytics in decision support systems in the smart city
tion and getting a grip on three quality dimensions; context is introduced. In the smart city mobile
apsystem, information and service quality and five di- plications, system quality is a very significant factor
mensions for usability; efectiveness, eficiency, satis- to assess the extent of the all system resources [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
faction, learnability, and security with addressing an High system, information and service quality are
critimportant research method; DEMATEL. The decision- ical factors to ensure end-users trust due to SCMA
unmaking trial and evaluation laboratory method (DE- able to involve face-to-face contact customers.
MATEL) was aimed at the fragmented and oppositional It is important to consider the following 3 aspects of
fact of societies and searched for combined resolutions. usability for all types of software:
This study investigates the DEMATEL to determine
the information importance’s as prescriptive analytics • To use more eficiently: it takes less time to
comforeseeing quality and usability of smart city mobile plete a given task.
application (SCMA) with expert feedbacks are then used • Easier to learn: operations can be learned by
to construct new evaluation and assessment system. looking at the object.
      </p>
      <p>
        DEMATEL methodology have been applied in many
contexts such as mobile banking [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], waste manage- • More user satisfaction: satisfy user expectations.
ment [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ], maintenance management [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], knowledge On the other hand, ISO 9241 defines usability as
management [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], supply chain management [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], ser- “the extent to which a product can be used by
vice quality [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], business process management, brand specified users to achieve specified goals with
marketing [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] efectiveness, eficiency, and satisfaction in a
spec
      </p>
      <p>
        Mobile application frameworks have found their way ified context of use”.
into regular day to day existence, and with an
extensive client base [
        <xref ref-type="bibr" rid="ref13 ref14">13, 14</xref>
        ]. Subsequently, organizations On the other hand, ISO 9241 defines usability as “the
are seeing the advantages of structuring and building extent to which a product can be used by specified
up their items with client arranged strategies rather users to achieve specified goals with efectiveness,
efthan innovation situated techniques, and are attempt- ficiency, and satisfaction in a specified context of use”.
ing to comprehend both client and item, by examin- consolidate the ISO 9241, IOS 9126, ISO 13407,
usabiling the cooperation between them. This huge and ex- ity models, and propose an enhanced one, referred to
panding number of versatile applications in the market as the Consolidated Usability Model (2003). This model
has moved designers to create applications of better describes usability as all combination of efectiveness,
quality all together than contend. Functionality and eficiency, satisfaction, learnability, and security, along
prevalence of smart phones have enabled online ap- with a recommended set of related measures. This
enplications to solve many problems people face in their hanced model, referred to as the Consolidated
Usabildaily lives and make the life easier. Nowadays, mu- ity Model, is presented in Figure 1.
nicipalities also use smart city mobile applications in There are 5 experts who are software developers
order to facilitate the city life by achieving the sus- were invited to identify various criteria and elements
tainability standards. Health, transportation, energy, for quality and usability factors. Base on experts’
diseducation is some of the important services provided cussion and literatures review, this study listed three
by SCMA leading to more comfort of their citizens. In measurement dimensions for quality: system quality,
this sense, investigating SCMA’s quality and usability information quality, and service quality and five
diwill contribute both in theory and practice. mensions for usability: efectiveness, eficiency,
satisfaction, learnability, and security. This study used the
DEMATEL method to establish the network
relationship among eight dimensions. When a user decides
using SCMA may consider many criteria. The most summarized as follows;
common problem is determining the mutual efects of Step 1: Generating the direct-relation matrix. For
criteria. In order to improve the overall performance example, five scales for measuring the relationship
amand the quality and eficiency of users using SCMA, it ong diferent criteria are used: 0 (no influence), 1 (low
is therefore necessary to identify the criterion that has influence), 2 (normal influence), 3 (high influence) and
the greatest impact on other criteria before the evalu- 4 (very high influence). Decision makers prepare sets
ation. To explain DEMATEL steps briefly, attributes of pair-wise comparisons in terms of efects and
direcimpact values have already asked to several diferent tion between criteria. The initial data can be obtained
experts working in this field. The impact value which as the direct-relation matrix which is a n × n matrix A
is from 0 to 4 (0 means that there are not any afect where each element of a is denoted as the degree in
and 4 means that there are dramatically efective re- which the criterion i afects the criterion j.
lations with those attributes) has collected from each Step 2: Normalizing the direct-relation matrix.
Nordiferent specialist. Finally, these 10 experts are asked malization is performed using the Eq. 1
to identify the degree of influence between the factors
or parameters (criteria) to calculate the average matrix
of influence matrix in Tab. 1.  =  ×  (1)
      </p>
      <p>The proposed method has the four-step procedure. 1
Fdiirtisot,ntahleadttercibisuiotensgwoaelrsefeosrtasebglimsheendtintog dtheteeermighintecothne-  =  1⩽ ⩽Σ =1 , ,  = 1, 2, … , 
significance of the factors afecting fragmentary end- Step 3: Attaining the total-relation matrix. Once the
user usage. DEMATEL technique can convert the in- normalized direct-relation matrix X is obtained, the
toterrelations between criteria into an intelligible struc- tal relation matrix T can be acquired by using Eq. 2 ,
tural model of the system and divide them into a cause where I is denoted as the identity matrix,
group and an efect group [15]. DEMATEL is a
practicable and beneficial tool to analyze the interdependent (2)
relationships among elements in a complex framework
and grade them for decision making. Thus, this
technique can be used in prescriptive analysis. The
formulating steps of the classical DEMATEL [16] can be
 =  ⋅ ( −  ) − 1</p>
      <p>Step 4: Producing a causal diagram. The sum of
rows and columns are separately denoted as vector D
and vector R through equations in Eq. 3. The
horizontal axis vector (D + R) named as “prominence” is
made by adding D to R, which reveals the relative im- tained. Next, the total-relation matrix (Tab. 4) was
acportance of each criterion. Similarly, the vertical axis
quired. Following the step of DEMATEL method is
(D - R) called as “relevance” is made by subtracting D
created the total influence matrix. There shows the
from R, which may divide criteria into a cause and
efsum of the direct and indirect efects that factor has
fect groups. Generally, when (D - R) is positive, the
received from the other factors. The total influence
criterion belongs to the cause group, (D - R) is
negamatrix is defined the sum of the rows and the sum of
tive, the criterion represents the efect group.
Therethe columns separately which can be denoted as vector
fore, the causal diagram can be obtained by mapping r and s
the dataset of the (D + R, D - R), providing some insight
for making decisions.</p>
      <p>= [ , ] ×</p>
      <p>,  = 1, 2, … , 
 = [Σ =1 , ] ×1 = [  ] ×1
 = [Σ =1 , ]1× = [  ]1×
where vectorD and vector R denote the sum of rows
and columns in total-relation matrix T.</p>
      <p>Step 5: Obtaining the inner dependence matrix. In
this step, the sum of each column in total-relation
matrix is equal to 1 by the normalization method, and
then the inner dependence matrix can be acquired. At
ifrst step of DEMATEL, attributes impact values have
already asked to 5 diferent experts on working this
ifeld. The impact value which is from 0 to 4 (0 means
that there are not any afect and 4 means that there
are relations with those attributes a very dramatically
efective) has collected each diferent software
developer. 5 experts are asked to identify the degree of
influence between the factors or elements (criteria) to
calculate the average matrix of influence matrix. In step 2,
the experts adopted the eight attributes as evaluation
factors. In step 3, once the relationships between those
attributes were measured by the experts through the
use of the scale, the data from each individual
assessment could be obtained. Then, using the CFCS method
to aggregate these assessment data, the initial
directrelation matrix (Tab. 2 ) was produced.
the normalized direct-relation matrix (Tab. 3) was
ob</p>
      <p>Let i=j and i,j ∈ { 1,2,...n }; the horizontal axis
vector (r + s ) is then made by adding r to s , which
illustrates the importance of the criterion. Similarly,
the vertical axis vector (r - s ) is made by deducting</p>
      <p>r from s , which may separate criteria into a cause

(3) group and an afected group. In general, when (r 
is positive, the criterion is part of the cause group. On
- s )</p>
      <p />
      <p>the contrary, if (r - s ) is negative, the criterion is part
of the afected group. Therefore, a causal graph can be
achieved by mapping the dataset of ( r + s ,r - s ),
providing a valuable approach for decision-making. The</p>
      <p>sum of influences is given and received on criteria will
be shown in Tab 5. The direction of influence between
dimensions and criteria can be visualized in Fig. 2.
After all those analytics, the Integrated Natural Resource</p>
      <sec id="sec-1-1">
        <title>Management (INRM) indicates that A2. Information</title>
      </sec>
      <sec id="sec-1-2">
        <title>Quality and A3. Service Quality are the most efective</title>
        <p>attributes can be understood from Fig. 2. Moreover,</p>
      </sec>
      <sec id="sec-1-3">
        <title>A5. Eficiency factor also may be one of the most affected ones. As a result of the DEMATEL methods, the conditional attributes’ degrees of impacts have been identified.</title>
      </sec>
      <sec id="sec-1-4">
        <title>Moreover, descriptive analytics results (multidimensional reports) have been supported with DEMATEL technique. All those outcomes would give advices for decision makers with meaningful results.</title>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>3. Conclusion</title>
      <sec id="sec-2-1">
        <title>Nowadays, lot of cities have supplied mobile device as</title>
        <p>In step 4, based on the initial direct-relation matrix, a smart city application. In mobile application,
mar</p>
        <p>A2
-0,119
1,000
-0,090
-0,165
-0,060
-0,120
-0,124
-0,085
ket mobile devices and technology has continued to
expand. Internet technology continues to grow that
widely used mergers and action for mobile devices,
has a channel operation trade in services, particularly
in the rapidly. DEMATEL approach to cope with the
problem of interdependence exists among the criteria,
and to select an optimal portfolio of consumers’
inclination. This study the DEMATEL approach to
consider the interdependencies among criteria and to
obtain a priority of inclinations. Then, the DEMATEL
provide a decision model for determining the final
ranking of alternatives using the weights of each criterion
of SCMA. So, the result of the priority for end user’
inclination first is “Information and Service Quality”,
after that is “efectiveness”. Hope these results can help
governors and city managers to evaluate how well each
sourcing decision is able to approximate the expected
maximum benefit.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.</given-names>
            <surname>Giuliano</surname>
          </string-name>
          , G. Cardarilli,
          <string-name>
            <given-names>C.</given-names>
            <surname>Cesarini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. Di</given-names>
            <surname>Nunzio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Fallucchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Fazzolari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Mazzenga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Re</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Vizzarri</surname>
          </string-name>
          ,
          <article-title>Indoor localization system based on bluetooth low energy for museum applications</article-title>
          ,
          <source>Electronics (Switzerland) 9</source>
          (
          <issue>2020</issue>
          )
          <fpage>1</fpage>
          -
          <lpage>20</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Gagné</surname>
          </string-name>
          ,
          <article-title>From strategy to action: transforming organizational goals into organizational behavior</article-title>
          ,
          <source>International Journal of Management</source>
          Re-
          <article-title>by means of ai-driven drones for aromatherapy</article-title>
          , views
          <volume>20</volume>
          (
          <year>2018</year>
          )
          <fpage>83</fpage>
          -
          <lpage>104</lpage>
          . in: CEUR Workshop Proceedings, volume
          <volume>2594</volume>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>F.</given-names>
            <surname>Fassnacht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Hartig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Latifi</surname>
          </string-name>
          ,
          <string-name>
            <surname>C. B. J. Hernán</surname>
          </string-name>
          - 2020, pp.
          <fpage>7</fpage>
          -
          <lpage>12</lpage>
          . dez,
          <string-name>
            <given-names>B. K. P.</given-names>
            <surname>Corvalán</surname>
          </string-name>
          , Importance of sample [15]
          <string-name>
            <given-names>J.-I.</given-names>
            <surname>Shieh</surname>
          </string-name>
          , H.
          <string-name>
            <surname>-H. Wu</surname>
          </string-name>
          ,
          <string-name>
            <surname>K.-K. Huang</surname>
          </string-name>
          ,
          <article-title>A dematel size, data type and prediction method for remote method in identifying key success factors of hossensing-based estimations of aboveground for- pital service quality, Knowledge-Based Systems est biomass</article-title>
          ,
          <source>Remote Sensing of Environment 20</source>
          <volume>23</volume>
          (
          <year>2010</year>
          )
          <fpage>277</fpage>
          -
          <lpage>282</lpage>
          . (
          <year>2014</year>
          )
          <fpage>102</fpage>
          -
          <lpage>114</lpage>
          . [16]
          <string-name>
            <given-names>E.</given-names>
            <surname>Fontela</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gabus</surname>
          </string-name>
          , The dematel observer, de-
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>F.</given-names>
            <surname>Beritelli</surname>
          </string-name>
          , G. Capizzi,
          <string-name>
            <given-names>G. Lo</given-names>
            <surname>Sciuto</surname>
          </string-name>
          , C. Napoli, matel
          <year>1976</year>
          report, Battelle Geneva Research CenF. Scaglione,
          <article-title>Rainfall estimation based on the in- ter,</article-title>
          <string-name>
            <surname>Geneva</surname>
          </string-name>
          (
          <year>1976</year>
          ).
          <article-title>tensity of the received signal in a lte/4g mobile terminal by using a probabilistic neural network</article-title>
          ,
          <source>IEEE Access 6</source>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>W.</given-names>
            <surname>Lin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Hung</surname>
          </string-name>
          ,
          <article-title>Selecting mobile banking system service for consumers by using a combined dematel and anp approach</article-title>
          ,
          <source>Journal of Accounting, Finance &amp; Management Strategy</source>
          <volume>1</volume>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>M.-L. Tseng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Lin</surname>
          </string-name>
          ,
          <article-title>Application of fuzzy dematel to develop a cause and efect model of municipal solid waste management in metro manila</article-title>
          ,
          <source>Environmental Monitoring and Assessment</source>
          <volume>158</volume>
          (
          <year>2009</year>
          )
          <fpage>519</fpage>
          -
          <lpage>533</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Capizzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. Lo</given-names>
            <surname>Sciuto</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Napoli</surname>
          </string-name>
          , G. Susi,
          <string-name>
            <given-names>M.</given-names>
            <surname>Woźniak</surname>
          </string-name>
          ,
          <article-title>A spiking neural network-based long-term prediction system for biogas production</article-title>
          ,
          <source>Neural Networks</source>
          <volume>129</volume>
          (
          <year>2020</year>
          )
          <fpage>271</fpage>
          -
          <lpage>279</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>D.</given-names>
            <surname>Vujanovic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Momilcovic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Bojovic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Papic</surname>
          </string-name>
          ,
          <article-title>Evaluation of vehicle fleet maintenance management indicators by application of dematel and anp</article-title>
          ,
          <source>Expert Systems with Applications</source>
          <volume>39</volume>
          (
          <year>2012</year>
          )
          <fpage>10552</fpage>
          -
          <lpage>10563</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>W.-W.</given-names>
            <surname>Wu</surname>
          </string-name>
          ,
          <article-title>Choosing knowledge management strategies by using a combined anp and dematel approach</article-title>
          ,
          <source>Expert Systems with Applications</source>
          <volume>35</volume>
          (
          <year>2008</year>
          )
          <fpage>828</fpage>
          -
          <lpage>835</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>B.</given-names>
            <surname>Chang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.-W.</given-names>
            <surname>Chang</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.-H. Wu</surname>
          </string-name>
          ,
          <article-title>Fuzzy dematel method for developing supplier selection criteria</article-title>
          ,
          <source>Expert Systems with Applications</source>
          <volume>38</volume>
          (
          <year>2011</year>
          )
          <fpage>1850</fpage>
          -
          <lpage>1858</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>M.-L. Tseng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Lin</surname>
          </string-name>
          ,
          <article-title>Application of fuzzy dematel to develop a cause and efect model of municipal solid waste management in metro manila</article-title>
          ,
          <source>Environmental Monitoring and Assessment</source>
          <volume>158</volume>
          (
          <year>2009</year>
          )
          <fpage>519</fpage>
          -
          <lpage>533</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>W.-R. Lin</surname>
            ,
            <given-names>Y.-H.</given-names>
          </string-name>
          <string-name>
            <surname>Wang</surname>
          </string-name>
          , T.-E. Hung,
          <article-title>Selecting mobile banking system service for consumers by using a combined dematel and anp approach</article-title>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>C.</given-names>
            <surname>Shin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.-H.</given-names>
            <surname>Hong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Dey</surname>
          </string-name>
          ,
          <article-title>Understanding and prediction of mobile application usage for smart phones</article-title>
          ,
          <year>2012</year>
          , pp.
          <fpage>173</fpage>
          -
          <lpage>182</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>G.</given-names>
            <surname>Capizzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Napoli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Russo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Woźniak</surname>
          </string-name>
          ,
          <article-title>Lessening stress and anxiety-related behaviors</article-title>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>