<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Malmquist productivity index for network production systems</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Industrial and Information Management National Cheng Kung University</institution>
          ,
          <addr-line>Tainan 701</addr-line>
          ,
          <country country="TW">Taiwan</country>
        </aff>
      </contrib-group>
      <fpage>733</fpage>
      <lpage>744</lpage>
      <abstract>
        <p>The conventional Malmquist productivity index (MPI) measures the performance improvement of a production system between two periods, where the system is treated as a black box, ignoring the internal operations of the component processes. Based on a relational model of the data envelopment analysis (DEA) for measuring the system and process efficiencies, this paper develops a methodology for calculating the system and process MPIs in one model. Moreover, relationships between the system and process MPIs are derived. By defining the ratio of the inefficiencies of a unit in two periods as complementary MPIs, this paper finds that the system complementary MPI is a linear combination of the process complementary MPIs, and the former is also close to a weighted average of the latter. Knowing the relationship between the system and process MPIs helps identify the processes that deter the improvement of the system; amendments to them will improve the system performance in the future.</p>
      </abstract>
      <kwd-group>
        <kwd>Chiang Kao</kwd>
        <kwd>data envelopment analysis</kwd>
        <kwd>Malmquist productivity index</kwd>
        <kwd>network system</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Efficiency measurement is important for organizations to identify unsatisfactory
operations so that making improvements to them will produce more outputs with the
same amount of inputs. If an organization is relatively efficient as compared to other
similar ones at a point of time, yet it is actually declining as compared to its past
performance, certain indexes for alerting the decision maker are necessary. One such
index is the Malmquist productivity index (MPI), which measures efficiency changes
between two periods for an organization, or any decision making unit (DMU).</p>
      <p>The MPI has been widely applied to measuring performance changes between two
periods, especially due to an act or policy (Banker et al., 2005; Chang et al., 2009;
Kao, 2000). Different forms of the MPI have been proposed in the literature. Suppose
the efficiency change of a DMU between periods t and t+1 is to be measured. The
early work of Caves et al. (1982a, 1982b) calculated the relative efficiencies of the
two periods based on the production technology of period t. Since the production
Copyright © by the paper's authors. Copying permitted for private and academic purposes.</p>
      <p>In: A. Kononov et al. (eds.): DOOR 2016, Vladivostok, Russia, published at http://ceur-ws.org
technology of period t+1 can also be used for calculating the relative efficiencies, and
the results are probably different from those calculated from the technology of period
t, Färe et al. (1994) suggested using the geometric mean of the two measures as the
MPI to solve the problem of disparity.</p>
      <p>A system is usually composed of several processes connected in a network
structure. The conventional MPI measures the performance improvement of a system
considered as a whole unit, neglecting the operations of its component processes.
However, for a network system, it is possible that some processes are worsened while the
system is improved. It is also possible that the system is worsened, while some
processes are improving. Merely looking at the system MPI cannot identify the processes
that cause the deterioration of the aggregate performance. The objective of this paper
is to develop a methodology for measuring the system and process MPIs at the same
time, and explore the relationship between them so that unsatisfactory processes can
be identified. The MPI used for discussion is the global MPI.</p>
      <p>The basic component of MPI is relative efficiency, and the data envelopment
analysis (DEA) technique (Charnes et al., 1978) has been widely used for its calculation.
To calculate the MPI of a network system, a network DEA model is needed. Various
network DEA models have been developed in the literature (see, for example, the
review of Kao (2014)), and they can be classified into three types: independent,
connected (or descriptive), and relational. For independent models, the system and
individual process efficiencies are calculated independently and separately, without
considering the relations among them.</p>
      <p>For descriptive models, the operations of all component processes are described in
the model in calculating the system efficiency. The results obtained are more
reasonable; nevertheless, the process efficiencies still need to be calculated separately. The
system and process efficiencies do not have any relationship, either. The third type of
models, relational, on the other hand, takes the relations between the system and
processes into consideration in developing the model. The system and process
efficiencies can be calculated at the same time. Moreover, there exist some mathematical
relationships between the system and process efficiencies (Chen et al., 2009a; 2009b;
Kao and Hwang, 2008). Due to this property, this paper uses the relational model to
calculate efficiencies. Based on the mathematical relationship between the system and
process efficiencies, certain relationships between the system and process MPIs will
be derived.</p>
      <p>In the next section, relational models for different network structures are firstly
reviewed. Then, in Section 3, models for calculating the global MPI for network
systems are developed. Relationships between the system and process MPIs are
investigated. After that, Section 4 uses three examples to explain the methodology proposed
in this paper. Finally, in Section 5, some conclusions are drawn.
2</p>
      <p>The Relational Model</p>
      <p>Consider a set of n DMUs, each uses the same m inputs to produce the same s
outputs. Denote Xij and Yrj as the ith input, i=1,…, m, and rth output, r=1,…, s,
respec</p>
      <p>Malmquist productivity index for network production systems 735
tively, of the jth DMU, j=1,…, n. The CCR model of DEA for calculating the
efficiency of DMU k under the assumption of constant returns-to-scale can be formulated
as (Charnes et al., 1978):</p>
      <p>s
Ek = max.  urYrk
r1
m
s.t.  vi X ik  1
i1
s m
 urYrj   vi X ij  0,
r1 i1
ur , vi  ε, r  1, ...,s,
where ur and vi are virtual multipliers and  is a small non-Archimedean number
(Charnes and Cooper, 1984) imposed to prevent any input/output factor from being
ignored in calculating the efficiency.</p>
      <p>
        Usually a system is composed of several processes connected as a network. Model
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) treats the system as a black-box, neglecting the operations of the component
processes. Consequently, it is possible that all processes are not efficient while the
system, as a whole, is. The network DEA takes the operations of the processes into
consideration in calculating the system efficiency so that unreasonable results can be
excluded. Network systems have various structures. The two fundamental ones are
series and parallel.
      </p>
      <p>The series structure is a basic network structure where a number of processes are
connected in series. The characteristic of this type of structure is that the inputs used
by all processes, except the first, are produced by their preceding one, and the outputs
produced by all processes, except the last, are utilized by their succeeding one. The
series structure is the most widely discussed network structure in the DEA literature.</p>
      <p>
        Let Z (fjp) denote the fth intermediate product, f=1,…, g, produced by process p,
p=1,…, q1. Note that the intermediate products produced by the last process, q, are
the outputs of the system, Yrj. Kao and Hwang (2008) showed that the system
efficiency is the product of the q process efficiencies:
q s
 Ek( p)   ur*Yrk  EkS (
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
p1 r1
      </p>
      <p>The parallel structure is another basic network structure which is composed of a
number of q processes, and each applies inputs X i(jp) to produce outputs Yr(j p) . The
q
total inputs consumed by the system are Xij  p1 X i(jp) , and the total outputs
produced are Yrj  qp1Yrj( p) .</p>
      <p>The relational model assigns the same multiplier to the same factor, regardless of
which process it is associated with. Kao (2009) showed that the system efficiency is a
weighted average of the q process efficiencies:</p>
      <p>
        pq1 ( p) Ek( p)  pq1 im1 vi* X i(kp)  imrs11vui*r*XYrik((kpp))   pq1 rs1ur*Yrk(p)   EkS (
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
where  ( p) = im1vi* X i(kp) / im1vi* Xik = im1vi* X i(kp) .
      </p>
      <p>Most network systems are a mixture of the series and parallel structures.
Theoretically, they can have numerous forms of structure, although the most complicated
structure that appears in the literature only has five processes (Lewis and Sexton,
2004). Denote I (j p) , O(j p)  {1, 2,…, g} as the index sets of the input and output
intermediate products, respectively, of process p for DMU j. To be generic, we consider
the very general network structure shown in Figure 1, where each process p consumes
exogenous inputs X i(jp) and intermediate products Z (fjp) , j  I (j p) that are produced by
other processes to produce exogenous outputs Y ( p) and intermediate products Z (fjp) ,
rj
j  O(j p) for other processes to use. The total inputs consumed and the total outputs
produced by the system are Xij  qp1 X i(jp) and Yrj  qp1Yrj( p) , respectively. Let the
same factor have the same multiplier; the relational model for calculating the system
efficiency is:</p>
      <p>s
EkS  max.  urYrk
r1
m
s.t.  vi X ik  1
i1
s m
 urYrj   vi X ij  s j  0, j  1, ...,n
r1 i1
( s urYrj( p)  f O(j p) wf Z (fjp) )  ( m vi X i(jp)  f I (j p) wf Z (fjp) )  s(j p)  0,
r1 i1</p>
      <p>j  1, ...,n, p  1, ...,q</p>
      <p>Since all the intermediate products are produced and consumed in the system, the
sum of the constraints corresponding to the q processes is equal to the constraint
corresponding to the system for each DMU. Xi( p) i=1,…, m</p>
      <p>Z (f p)
f  I ( p)
p</p>
      <p>Z (f p)
f O( p)
…</p>
      <p>…
, s
Fig. 1. The general network structure.</p>
      <p>Yr( p)
r=1,…s</p>
      <p>
        Based on Model (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ), the system and process efficiencies of DMU k can be
calculated as:
      </p>
      <p>s m s
EkS  ur*Yrk / vi* X ik  ur*Yrk
r1 i1 r1</p>
      <p>Malmquist productivity index for network production systems 737</p>
      <p>
        Ek( p)  [rs1ur*Yr(kp)  f Ok( p) w*f Z (fkp) ]/[im1 vi* X i(kp)  f Ik( p) w*f Z (fkp) ], p  1, ...,q
where ( ur* , vi* , w*f ) is a set of optimal solutions. Since the sum of the q process
q
constraints is equal to the system constraint for each DMU, that is, s sk   p1 sk( p) ,
weim1vhi*Xavi(kep:)  rsf1Iuk( pr*)Ywrk*f Z (fkp) )] ,im1ovri*, Xfrikom theeqpx1p[resrssi1ounr*Yor(kfp) EkSandf EOkk((pp) )wi*fnZ E(fkpq) u]ati)on
(
        <xref ref-type="bibr" rid="ref9">9</xref>
        ):
      </p>
      <p>q m
1 EkS   (1 Ek( p) )( vi* X i(kp) 
p1 i1

f Ik( p)</p>
      <p>
        q
w*f Z (fkp) )   (1 Ek( p) ) ( p)
p1
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
where  ( p)  im1vi* Xi(kp)   f Ik( p) w*f Z (fkp) . That is, the system inefficiency, 1 EkS ,
is a linear combination of the q process inefficiencies, 1 Ek( p) . Nevertheless, the
former is not a weighted average of the latter because the sum of the weights,
qp1 ( p)  qp1[im1 vi* X i(kp)   f Ik( p) w*f Z (fkp) ]  1 qp1 f Ik( p) w*f Z (fkp) , is
clearly greater than 1.
3
      </p>
      <p>Malmquist Productivity Index</p>
      <p>The MPI is an index for representing the efficiency improvement between two
periods. Various forms of MPI have been developed. The global MPI proposed by
Pastor and Lovell (2005) has several attractive properties and is used in this paper. The
basic idea of the global MPI is to use the observations of all periods to construct the
production frontier. Based on which, the relative efficiencies of a DMU in two
periods are calculated, and their ratio is the MPI. Since all observations have been
included in constructing the frontier, the resulting efficiencies for both periods will not
exceed one.</p>
      <p>Let the superscript h, t, and t+1, denote period. The relational model for calculating
the relative efficiency of DMU k in period t+1 for the series structure based on the
technology constructed from the observations of periods t and t+1 is:</p>
      <p>
        s
(EkS )t 1  max.  ur (Yrk )t1
r1
m
s.t.  vi ( X ik )t 1  1
i1
g m
 wf (Z (f1j) )h   vi ( X ij )h  0, h  t, ...,t 1,
f g1 ig1
 wf Z ((fpj) )h   wf (Z (fjp1) )h  0, h  t, ...,t 1,
f 1 f 1
s g
 ur (Yrj )h   wf (Z (fjq1) )h  0,
r 1 f 1
    vt 1( X i(kp) )t 1  (Ek( p) )t 1 (Ek( p) )t
q  m
p1 i1 i  (Ek( p) )t (EkS )t
    vt 1( X i(kp) )t 1 M k( p) r 1urt (Yrk(p) )t / im1vit ( X i(kp) )t
q  m s
p1 i1 i  rs1urt (Yrk )t
 pq1M k( p)  rsrs11uurtrt((YYr(krkp)))t t im1imv1itvi1t(( XX ii((kkpp)) ))tt 1   pq1M k( p) ( p) (
        <xref ref-type="bibr" rid="ref10">10</xref>
        )
A result that the system MPI is a linear combination of the process MPIs is
derived. However, the former is not a weighted average of the latter because the sum of
q
the weights,  p1 ( p) , is not necessarily equal to 1.
      </p>
      <p>q</p>
      <p>Theoretically, if the total weight,  p1 ( p) , in a linear combination is much
smaller than 1, then it is possible that all process MPIs are greater than 1, yet their
linear combination is less than 1. The opposite situation may also happen, if the total
weight is much greater than 1. In practice, the chance of having a very large or a very
small total weight is quite low. The reason is because the observations of DMU k for
each process p in period t, ( ( X i(kp) )t , (Yr(kp) )t ), and period t+1, ( ( X i(kp) )t1 , (Yrk(p) )t1 ),
m
are usually not too different, which make i1vit1( X i(kp) )t1 approximately equal to</p>
      <p>Malmquist productivity index for network production systems 739
m vt ( X i(kp) )t , especially when they are under the same frontier facet where vit = vit 1 .
Inith1isi case, the ratio of im1vit1( X i(kp) )t1 to im1vit ( X i(kp) )t in  ( p) is approximately
s s
equal to 1, which simplifies  ( p) to ˆ ( p) = r1urt (Yr(kp) )t / r1urt (Yrk )t . Since
q
 p1ˆ ( p)  1, a result in which the system MPI is approximately equal to a weighted
average of the process MPIs is obtained, where the weight associated with process p
is the proportion of the aggregate output of this process in all processes.</p>
      <p>
        For network systems with a general structure of Figure 1, Model (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) can be
adapted to suit the combined technology for calculating the efficiency of DMU k in
period t+1:
      </p>
      <p>s
(EkS )t 1  max.  ur (Yrk )t1
r1
m
s.t.  vi ( X ik )t 1  1
i1
s m
ur (Yrj )h   vi ( X ij )h  (s j )h  0,
r 1 i1
[ sur (Yrj( p) )h 
r 1
h  t, ...,t 1,</p>
      <p>
        j  1, ...,n (
        <xref ref-type="bibr" rid="ref11">11</xref>
        )
m
 wf (Z (fjp) )h ]  [ vi ( X i(jp) )h  
f O(j p) i1 f I (j p)
(s(j p) )h  0, h  t, ...,t 1, j  1, ...,n , p  1, ...,q
wf (Z (fjp) )h ] 
ur , vi , wf  ε,
(s j )h , (s(j p) )h  0,
r  1, ...,s,
      </p>
      <p>i  1, ...,m, f  1, ...,g
h  t, ...,t 1,
j  1, ...,n , p  1, ...,q</p>
      <p>
        From Equation (
        <xref ref-type="bibr" rid="ref6">6</xref>
        ), the system inefficiency is a linear combination of the process
inefficiencies: 1 (EkS )h  qp1(1  (Ek( p) )h )( ( p) )h for h  t, ...,t 1, where ( ( p) )h 
im1vih ( Xi(kp) )h   f Ik( p) whf (Z (fkp) )h . The conventional MPI is defined as the ratio of
the efficiencies of two periods. A value greater (or less) than 1 indicates that the
efficiency has improved (or is worsened). Conceptually, the MPI can also be defined as
the ratio of the inefficiencies of two periods. Under this definition, a value less (or
greater) than 1 indicates that the efficiency has improved(or is worsened). Term this
type of MPI the complementary MPI, and denote it as M . The system
complementary MPI for DMU k can be expressed as:

M kS 
1 (EkS )t 1
1 (EkS )t

qp1[1  (Ek( p) )t1][im1vit1( X i(kp) )t1   f Ik( p) wtf1(Z (fkp) )t1]
      </p>
      <p>
        1  (EkS )t
q  1 (Ek( p) )t 1   [1  (Ek( p) )t ][im1vit1( X i(kp) )t1   f Ik( p) wtf1(Z (fkp) )t1] 

 p1 1 (Ek( p) )t   1  (EkS )t 
From the constraints of Model (
        <xref ref-type="bibr" rid="ref11">11</xref>
        ), we have 1 (EkS )t  (sk )t (because
im1vi ( X ik )t =1) and 1 (Ek( p) )t  (sk( p) )t / im1vit ( Xi(kp) )t   f Ik( p) wtf (Z (fkp) )t ]. Denote
(sk( p) )t [im1vit1( X i(kp) )t1   f Ik( p) wtf1(Z (fkp) )t1]
      </p>
      <p>(sk )t [im1vit ( X i(kp) )t   f Ik( p) wtf (Z (fkp) )t ]
 ( p) 

M kS becomes:</p>
      <p>
        M kS  q M k( p) ( p)

p1
(
        <xref ref-type="bibr" rid="ref12">12</xref>
        )
q
  (1 M k( p) ) ( p)
      </p>
      <p>p1
where M k( p)  [1 (Ek( p) )t1]/[1 (Ek( p) )t ] is the complementary MPI of process p.
Here a property, that the system complementary MPI is a linear combination of the
process complementary MPIs, is obtained.</p>
      <p>For cases where (EkS )t  1, M kS is undefined. However, since (EkS )t  1 implies
(Ek( p) )t  1 for all p, the system and process MPIs become: M kS  (EkS )t 1 and
Mk( p)  (Ek( p) )t1 . The relationship between the system and process MPIs then is:
1 MkS  1 (EkS )t1   (1  M k( p) ) m vit1( X i(kp) )t1  
q
p1  i1 f Ik( p)
wtf1(Z (fkp) )t1 

</p>
      <p>
        The value of M kS in this case is always less than or equal to 1, indicating that the
performance is worsened. If, for period t, the system is not efficient, yet a process is,
then the corresponding term M k( p) in Equation (
        <xref ref-type="bibr" rid="ref12">12</xref>
        ) is changed to [1 Mk( p) ] 
m
[i1vit1( Xi(kp) )t1   f Ik( p) wtf1(Z (fkp) )t1]/ (sk )t .
4
      </p>
      <p>Example</p>
      <p>In this section we use an example to explain how the models developed in Section
3 are used to calculate the system and process MPIs, and the relationships between
them.</p>
      <p>
        Consider a system of three processes connected in a general structure shown in
Figure 2, where process 1 applies input X1 to produce output Y1, process 2 applies
input X2 to produce output Y2, and process 3 applies input X3 and portions of Y1 and Y2
to produce output Y3. There are eight DMUs to be compared, with the data shown in
Table 1. Note that the output of process 1, Y1, is split into Y (I ) and Y (O) , where the
1 1
former is used by process 3 for producing Y3 and the latter is an output of the system.
Similarly, Y2, is split into Y2(I ) and Y2(O) .
(
        <xref ref-type="bibr" rid="ref13">13</xref>
        )
X1
X 3
X 2
1
2
      </p>
      <p>Y (I )
1
Y2(I )
3</p>
      <p>Y (O)
1
Y3</p>
      <p>Y2(O)</p>
      <p>
        By applying Model (
        <xref ref-type="bibr" rid="ref11">11</xref>
        ), the system and process inefficiencies are calculated as
shown in the first two rows of each DMU in Table 2. As discussed in Section 2, the
system inefficiency is a linear combination of the process inefficiencies, and the sum
      </p>
      <p>
        Malmquist productivity index for network production systems 741
of the weights for linear combination is greater than 1 for all DMUs (shown in the last
column in parentheses). The ratio of the inefficiencies in periods t+1 and t is the
complementary MPI, and is shown in the third row and denoted as cMPI. The weight
associated with each process is calculated from Equation (
        <xref ref-type="bibr" rid="ref12">12</xref>
        ) shown in parentheses
next to the complementary MPI. The system complementary MPI is a linear
combination of the process complementary MPIs.
      </p>
      <p>A complementary MPI of greater (or less) than one indicates that the performance
of the associated unit is worsened (or has improved). When the efficiency of period t,
(Ek( p) )t , is close to 1, the inefficiency, 1 (Ek( p) )t , will be close to 0, which may
result in peculiar numbers in calculating ratios. The complementary MPIs of process 3
of DMUs 3 and 6 are examples where the former has a value of 391.75 and the latter
has a value of 674.76. These large values are difficult for human to interpret how
worse the units have performed. A contrary situation is when (Ek( p) )t1 is close to 1,
which makes the complementary MPI close to 0. For example, both process 1 of
DMU 1 and process 2 of DMU 2 have a complementary MPI of 0. There is no way of
knowing which one has improved more.</p>
      <p>Since the MPI and the complementary MPI have opposite trends intersecting at 1,
one can rely on the MPI to help judge the extent of the performance change. The
fourth row of Table 2 shows the MPI, which is the ratio of E(t+1)/E(t), of each DMU.
Comparing the complementary MPI in the third row with the MPI in the fourth, it is
clear that when one has a value greater (or less) than 1, the other has a value less (or
greater) than 1. For the example of 391.75 and 674.76 mentioned in the preceding
paragraph, we know that both processes are worsened, yet their extents are difficult to
judge. Their corresponding MPIs of 0.8753 and 0.90021 make the judgment much
easier. Similarly, for process 1 of DMU 1 and process 2 of DMU 2, where both
processes have a complementary MPI of 0, the former has an MPI of 1.2 and the latter an
MPI of 1.1667, indicating that the former has improved more than the latter. Hence,
one may use the MPI to judge the extent of performance changes. The complementary
MPI is merely for showing the mathematical relationship between the performance
change of the system and the processes.
treating the system as a black box, neglecting the operations of the component
processes. Once the MPI is calculated, it is not clear which processes cause the
improvement of deterioration of the system. More seriously, it is possible that the system
shows an improvement while most of the component processes are actually worsened.</p>
      <p>This paper adopts the idea of the relational DEA model to calculate the system and
process efficiencies at the same time. Most importantly, there exist mathematical
relationships between them. Based on the relationships between the system and
process efficiencies, relationships between those of MPIs are derived. The relationships
show the effects of the process MPIs on the system MPI, and the processes which</p>
      <p>Malmquist productivity index for network production systems 743
cause the improvement or deterioration of the system performance can also be
identified.</p>
      <p>By defining the complementary MPI as the ratio of the inefficiencies of two
periods, this paper finds that the system complementary MPI is a linear combination of
the process complementary MPIs, and the former is approximately a weighted
average of the latter. Although the complementary MPI can also be used to judge whether
a unit has improved or not between two periods, its magnitude is difficult to interpret
as was illustrated by the general-structure example. For these cases, the conventional
MPI can be calculated to help the interpretation.</p>
      <p>The DEA model used in this study is the CCR model under the assumption of
constant returns-to-scale. For series systems with only two processes, Kao and Hwang
(2011) were able to use the BCC model (Banker et al., 1984) to calculate the
efficiency under the assumption of variable returns-to-scale. Its extension to the calculation
and decomposition of MPI should be straightforward. For parallel systems, replacing
the CCR model by the BCC model is not difficult, as briefly mentioned in Kao
(2009). How to generalize to cases of variable returns-to-scale for series structures
with more than two processes and general network structures are not so simple, and is
a direction for future research.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Banker</surname>
            ,
            <given-names>R. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chang</surname>
            ,
            <given-names>H. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Natarajan</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <year>2005</year>
          .
          <article-title>Productivity change, technical progress, and relative efficiency change in the public accounting industry</article-title>
          .
          <source>Management Science</source>
          <volume>51</volume>
          <fpage>291</fpage>
          -
          <lpage>304</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Banker</surname>
          </string-name>
          , R. D.,
          <string-name>
            <surname>Charnes</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cooper</surname>
            ,
            <given-names>W. W.</given-names>
          </string-name>
          ,
          <year>1984</year>
          .
          <article-title>Some models for estimating technical and scale efficiencies in data envelopment analysis</article-title>
          .
          <source>Management Science</source>
          <volume>30</volume>
          <fpage>1078</fpage>
          -
          <lpage>1092</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Caves</surname>
            ,
            <given-names>D. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Christensen</surname>
            ,
            <given-names>L. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Diewert</surname>
            ,
            <given-names>W. E.</given-names>
          </string-name>
          ,
          <year>1982a</year>
          .
          <article-title>The economic theory of index numbers and the measurement of input, output, and productivity</article-title>
          .
          <source>Econometrica</source>
          <volume>50</volume>
          <fpage>1393</fpage>
          -
          <lpage>1414</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Caves</surname>
            ,
            <given-names>D. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Christensen</surname>
            ,
            <given-names>L. R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Diewert</surname>
            ,
            <given-names>W. E.</given-names>
          </string-name>
          , 1982b.
          <article-title>Multilateral comparisons of output, input, and productivity using superlative index numbers</article-title>
          .
          <source>The Economic Journal</source>
          <volume>92</volume>
          <fpage>73</fpage>
          -
          <lpage>86</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <issue>5</issue>
          .
          <string-name>
            <surname>Chang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Choy</surname>
            ,
            <given-names>H. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cooper</surname>
            ,
            <given-names>W. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruefli</surname>
            ,
            <given-names>T. W.</given-names>
          </string-name>
          ,
          <year>2009</year>
          .
          <article-title>Using Malmquist indexes to measure changes in the productivity and efficiency of US accounting firms before and after the Sarbanes-Oxley Act</article-title>
          .
          <source>Omega</source>
          <volume>37</volume>
          <fpage>951</fpage>
          -
          <lpage>960</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Charnes</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cooper</surname>
            ,
            <given-names>W.W.</given-names>
          </string-name>
          ,
          <year>1984</year>
          <article-title>The non-Archimedean CCR ratio for efficiency analysis: A rejoinder to Boyd and Färe</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>15</volume>
          <fpage>333</fpage>
          -
          <lpage>334</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Charnes</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cooper</surname>
            ,
            <given-names>W. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rhodes</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <year>1978</year>
          .
          <article-title>Measuring the efficiency of decision making units</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>2</volume>
          <fpage>429</fpage>
          -
          <lpage>444</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cook</surname>
            ,
            <given-names>W. D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhu</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <year>2009a</year>
          .
          <article-title>Additive efficiency decomposition in twostage DEA</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>196</volume>
          <fpage>1170</fpage>
          -
          <lpage>1176</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liang</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhu</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <year>2009b</year>
          .
          <article-title>Equivalence in two-stage DEA approaches</article-title>
          .
          <source>European Journal of Operational Research</source>
          <volume>193</volume>
          <fpage>600</fpage>
          -
          <lpage>604</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Färe</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grosskopf</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norris</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <year>1994</year>
          .
          <article-title>Productivity growth, technical progress and efficiency change in industrialized countries</article-title>
          .
          <source>American Economic Review</source>
          <volume>84</volume>
          <fpage>66</fpage>
          -
          <lpage>83</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <year>2000</year>
          .
          <article-title>Measuring the performance improvement of Taiwan forests after reorganization</article-title>
          .
          <source>Forest Science</source>
          <volume>46</volume>
          <fpage>577</fpage>
          -
          <lpage>584</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <year>2009</year>
          .
          <article-title>Efficiency measurement for parallel production systems</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>196</volume>
          <fpage>1107</fpage>
          -
          <lpage>1112</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <year>2014</year>
          .
          <article-title>Network data envelopment analysis: A review</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>239</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <year>2016</year>
          .
          <article-title>Measurement and decomposition of the Malmquist productivity index for parallel production systems</article-title>
          .
          <source>(under journal review)</source>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hwang</surname>
            ,
            <given-names>S.N.</given-names>
          </string-name>
          ,
          <year>2008</year>
          .
          <article-title>Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>185</volume>
          <fpage>418</fpage>
          -
          <lpage>429</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hwang</surname>
            ,
            <given-names>S.N.</given-names>
          </string-name>
          ,
          <year>2011</year>
          .
          <article-title>Decomposition of technical and scale efficiencies in two-stage production systems</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>211</volume>
          ,
          <fpage>515</fpage>
          -
          <lpage>519</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Kao</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hwang</surname>
            ,
            <given-names>S. N.</given-names>
          </string-name>
          ,
          <year>2014</year>
          .
          <article-title>Multi-period efficiency and Malmquist productivity index in two-stage production systems</article-title>
          .
          <source>European J. Operational Research</source>
          <volume>232</volume>
          ,
          <fpage>512</fpage>
          -
          <lpage>521</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Lewis</surname>
            ,
            <given-names>H. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sexton</surname>
            ,
            <given-names>T. R.</given-names>
          </string-name>
          ,
          <year>2004</year>
          .
          <string-name>
            <surname>Network</surname>
            <given-names>DEA</given-names>
          </string-name>
          :
          <article-title>Efficiency analysis of organizations with complex internal structure</article-title>
          ,
          <source>Computers &amp; Operations Research</source>
          <volume>31</volume>
          <fpage>1365</fpage>
          -
          <lpage>1410</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Pastor</surname>
            ,
            <given-names>J. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lovell</surname>
            ,
            <given-names>C. A. K.</given-names>
          </string-name>
          ,
          <year>2005</year>
          .
          <article-title>A global Malmquist productivity index</article-title>
          .
          <source>Economics Letters</source>
          <volume>88</volume>
          <fpage>266</fpage>
          -
          <lpage>271</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>