<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Weighted Sum Model for Multi-Objective Query Optimization for Mobile-Cloud Database Environments</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Florian Helff</string-name>
          <email>fhelff@ou.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Le Gruenwald</string-name>
          <email>ggruenwald@ou.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>CNRS, UMR 6158, LIMOS Blaise Pascal University Clermont-Ferrand</institution>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Computer Science University of Oklahoma Norman</institution>
          ,
          <addr-line>Oklahoma</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In a mobile-cloud database environment, different users on multiple mobile devices request services executed on a cloud. During those requests, queries are executed to obtain data, stored on the cloud and partly in caches on the mobile devices. The process of choosing an optimal query execution plan during a query optimization process is difficult because of multiple objectives involved regarding multiple non-static pricing models and different user constrains, such as monetary cost, query execution time and mobile device energy consumption. This paper provides a strategy of how to incorporate those various objectives in this decision process, based on a weighted-sum model, to achieve a good query execution plan. The experimental performance studies show that comparing with strategies, the proposed strategy is able to achieve its goal while incurs almost no additional overhead.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>
        In a mobile-cloud database environment [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], queries are issued at
mobile devices to retrieve data that is stored on the cloud and
optionally on the mobile devices. The process of finding an
optimal query execution plan (QEP) in this environment is
important in many ways. In an application scenario where many
queries are executed per day, organizations try to minimize the
monetary cost spent for query execution to fit their budget. They
also want to minimize query execution times to meet customers’
query response time requirements and to optimize employees’
working time. Furthermore, users also want to minimize energy
consumption on their mobile devices where queries might be
executed [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. This optimization process is a stretch of
contradicting propositions, especially when considering different
cloud pricing models [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Current decision strategies mostly focus on a single main
objective, such as execution time, and order further objectives,
like monetary cost and energy consumption, in a descending
order. This strategy is called lexicographical ordering [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] which is
not sufficient as shown in following example:
      </p>
      <p>Laurent d'Orazio2
2
Consider the three query execution plans (QEPs) with their costs
for monetary costs (M), execution time (T) and energy
consumption (E) shown in Figure 1. Focusing on a single
objective always leads to the decision to select either plan QEP1
or QEP2 for execution since those QEPs have a minimum cost in
one of the three objectives. Since QEP3 does not have a minimum
value in any of the three costs, it will never be selected although it
is a competitive choice considering all three objectives on the
same level of importance. Therefore, a strategy which considers
all objectives at the same time is needed in order to make a
comprehensive decision.</p>
      <p>QEP1: {M= $0.080; T= 0.5s; E= 0.012 mA}
QEP2: {M= $0.050; T= 3.0s; E= 0.300 mA}
QEP3: {M= $0.055; T= 0.6s; E= 0.013 mA}</p>
      <p>
        Figure 1 Execution Plan Costs Example
An existing optimization strategy which incorporates multiple
objectives is called the Weighted Sum Model [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. In this model,
every possible alternative (a QEP in our application) is rated by a
score including all objectives, individually weighted to stress the
importance of different objectives. This model is used in many
multi-objective optimization problems in various fields of
computer science and also other fields such as economics
(CostUtility Analysis) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. However, the weakness of this model is
the process of summarizing the different objectives. The fact that
different objectives might have different dimensions and units
leads to the problem of “adding apples and oranges” [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Since the
mobile-cloud database environment has to deal with multi
objectives with different units, the Weighted Sum Model cannot
be used without major changes in its strategy. This problem is
dealt with in the later explanation of our proposed algorithm in
Section 4.
      </p>
      <p>
        To fit in the context of Query Optimization, the Normalized
Weighted Sum Algorithm (NWSA), which is proposed in this
paper, uses the Weighted Sum Model as basis but makes major
changes to cover the weaknesses of it and to fit in the
mobilecloud database environment. To cover multiple units for different
objectives, the values are normalized to a user-defined maximum.
This process eliminates units and results in distribution on a
percentage basis. Additionally, user weights are implemented to
situational stress on objectives, according to user preferences and
needs. These strategies adapt the ideas of a user based decision
[
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        Experiments are conducted to study the performance of NWSA.
The experimental results show that NWSA is able to derive a
good QEP and incurs almost no additional overhead comparing
with the existing strategy that is based on the lexicographical
ordering of the optimization objectives [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>The rest of the paper is structured as follows.</p>
      <p>Section 2 gives
some fundamental information about the Weighted Sum Model,
underlying principles and explains the adjustments of this model.
Section 3 discusses other related work. Section 4 describes the
proposed strategy, the Normalized
2.</p>
    </sec>
    <sec id="sec-2">
      <title>FUNDAMENTAL INFORMATION</title>
      <p>This section describes the Pareto Set, which is fundamental for
every Multi-Objective Optimization problem, and the Weighted</p>
      <p>Model, that will be modified and used in the proposed
strategy.</p>
    </sec>
    <sec id="sec-3">
      <title>2.1 Pareto set</title>
      <p>The Pareto set is a set of dominant alternatives, which does not
include dominated alternatives. An alternative ‘A’ is dominating
an alternative ‘B’ if at least one objective (decision variable) of
‘A’ is better than the objective in ‘B’ and all other objectives in
‘A’ are at least equal to the objectives in ‘B’. Those dominating
alternatives are called Pareto optimal as defined by Zitzler and
Thile [10]. In the application of query optimization, every
objective corresponds to a cost, for example, query execution
time,
monetary</p>
      <p>cost, or energy consumption cost, and an
alternative is equivalent to a single QEP.</p>
      <p>
        The strength of finding a Pareto set is that every alternative in this
set is optimal for at least one scoring function. A scoring function
describes the stress on the different objectives in order to set the
importance to them and to compare alternatives in this Pareto set.
[
        <xref ref-type="bibr" rid="ref12">11</xref>
        ]
In the context of query optimization, finding a Pareto set of query
execution plans is not sufficient for query execution since a single
execution plan needs to be selected. The process of selecting a
single solution is left open for a user to choose. Regardless, the
following Weighted Sum Model functions as a scoring function,
using a user’s preferences, and always selects a query out of this
Pareto set, which is proven in Section 0.
 ∗
= max ∑    
=
∑
      </p>
    </sec>
    <sec id="sec-4">
      <title>Model</title>
      <p>
        The Weighted Sum Model (WSM) [
        <xref ref-type="bibr" rid="ref14 ref5">5, 12</xref>
        ] is most commonly used
in
multi-objective
optimization
problems. It combines the
different objectives and weights corresponding to those objectives
to create a single score for each alternative to
make them
comparable. The formulas used in this model are shown in the
following Figure 2.
is calculated by adding the products of a weight  
with its corresponding parameter   , the value of this objective.
This parameter is, for example, the monetary cost which has to be
spent to execute the query. The best alternative is chosen as the
one which has the maximum
      </p>
      <p>WSM score (  ∗
−
). The
different objectives are assumed to be positive: the higher the
score, the better the alternative. Assuming objectives to be
negative (in case of cost models), the best alternative has
equivalently the lowest score.
3.</p>
    </sec>
    <sec id="sec-5">
      <title>RELATED</title>
    </sec>
    <sec id="sec-6">
      <title>WORK</title>
      <p>
        The lexicographic ordering is probably the simplest but most used
scoring function to solve multi-objective optimization problems
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. This strategy compares parameters of the most important
objective and selects the alternative
with the highest/lowest
parameter for that objective. If multiple alternatives consist of the
same highest/lowest parameter, the selection process starts over
with the second most important objective under those alternatives
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The complexity of this algorithm is in linear relation to the
count of alternatives it selects its solution from since it scans the
alternative
      </p>
      <p>once for the lowest parameter. This strategy is
equivalent to the example explained in Section 1, which also
shows the weaknesses of the lexicographical ordering. Multiple
objectives are only considered if the selection process on a single
objective is not sufficient. Although this strategy does not have to
deal with multiple dimensions or units, it is not sufficient in
finding an optimal solution for the proposed optimization problem
since it cannot handle multiple objectives and, therefore, is not
able to give a sufficient solution.</p>
      <p>
        The set of all optimal solutions under every possible scoring
function is called the Pareto set. Skyline queries [
        <xref ref-type="bibr" rid="ref16 ref18 ref19">13, 14, 15</xref>
        ] are
one example of a strategy of finding a Pareto set. Those strategies
are used in situations where no scoring function is available. As
also mentioned in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], it is important to distinguish between the
Pareto optimal set, skyline queries which return the Pareto optimal
alternatives, the skyline which represents the result of skyline
queries and the according algorithms to implement the queries. As
already discussed, because one single alternative has to be
returned as the output, a strategy that finds the Pareto optimal
alternatives alone is not sufficient to solve this problem. There
exists work that aims to solve the problem of multi-objective
query optimization in combination with Skyline queries [
        <xref ref-type="bibr" rid="ref20">16</xref>
        ] or
Pareto set computations [
        <xref ref-type="bibr" rid="ref21">17</xref>
        ] [
        <xref ref-type="bibr" rid="ref10">18</xref>
        ] but all those strategies have to
be concluded by a user selecting one of the solutions from the
Skyline/Pareto Set. The reason of calculating a Pareto set is
because of lack of an existing scoring function during execution
time. The weakness of such calculation is the generated overhead
of the calculation since this is an expensive computation. Given a
scoring
function, and
making
the
user
decide
on
his/her
preferences prior execution to directly compute a single solution,
which is an element in a Pareto set, avoids the additional overhead
since computing the Pareto set is not necessary.
      </p>
    </sec>
    <sec id="sec-7">
      <title>NORMALIZED</title>
    </sec>
    <sec id="sec-8">
      <title>WEIGHTED SUM</title>
    </sec>
    <sec id="sec-9">
      <title>ALGORITHM</title>
      <sec id="sec-9-1">
        <title>This section describes the proposed algorithm called the Normalized</title>
        <p>battery status, an ongoing charging process or factors describing
the currently used cloud. The environmental weight adjusts the
user weight if, for example, a mobile device is being charged and
energy consumption is obsolete, or a query is run overnight and
execution time should be assigned a minor importance factor.</p>
      </sec>
      <sec id="sec-9-2">
        <title>In conclusion, the Modified Weighted Sum Model Scoring</title>
      </sec>
      <sec id="sec-9-3">
        <title>Function</title>
        <p>can
be
expressed
as
in</p>
        <p>Figure
3.
 
 
=</p>
        <p>Figure 3 Modified Weighted Sum Model Scoring Function
  is the value of alternative i (QEPi) for objective j,   the
userdefined acceptable maximum value for objective j, and   the
normalized composite</p>
        <p>weight of user and environment for
objective j defined in Figure 4.
seen in this algorithm, each alternative is checked if it violates the
user-defined maximum value for each objective (Lines 8-13). The
violation itself has to
be saved for future
use (Line 11)
Afterwards, the best alternative (Abest) which is the one with the
lowest score is selected (Lines 14-22) and returned as the output
of the
algorithm. If all possible
alternatives
violate those
restrictions, the algorithm will return the lowest score alternative
(AbestRestrictionViolating) as well as the previously saved restriction(s)
that it violates (Lines 24-25). The complexity of this algorithm is
in linear relation to the count of alternatives, which is also the
complexity of the lexicographical ordering strategy as discussed
in Section 3.</p>
        <p>=
is
4.3</p>
      </sec>
    </sec>
    <sec id="sec-10">
      <title>Proof for Pareto-Set</title>
      <p>This section provides a proof that, independent from possible
weights and from</p>
      <p>the number of objectives, the proposed
algorithm always picks an alternative within the Pareto set.</p>
      <sec id="sec-10-1">
        <title>Proof by contradiction:</title>
        <p>It is assumed that the chosen algorithm picks an alternative Abest
which is not an element of the Pareto set. Compliant with the used
formula in the proposed algorithm (Figure 3) it can be determined
that
 

−
5.</p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>PERFORMANCE EVALUATION</title>
      <p>This section describes an evaluation of the proposed strategy by
means of simulation experiments. It also compares the differences
of the proposed algorithm</p>
      <p>
        with the lexicographical ordering
strategy [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
5.1
      </p>
    </sec>
    <sec id="sec-12">
      <title>Simulation Model</title>
      <p>In the proposed mobile-cloud database environment, each QEP
consists of three costs: monetary cost for using the cloud provider,
query execution time as time to run a certain query plan, and
energy used
on the</p>
      <p>
        mobile device. The last cost becomes
important under the condition of using a cache on the mobile
device to have the option of receiving partial or total requested
data from the mobile device itself [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. This obviously results in a
lower monetary cost since the cloud provider is less or not used,
but also results in a higher amount of consumed energy since
processing the cache consumes more energy than waiting for
incoming data. A full review of such a system is given in [
        <xref ref-type="bibr" rid="ref11">19</xref>
        ].
Regarding that background, the simulation is built as follows:
The simulation consists of one million experiments, where the
proposed NWSA as well as the lexicographical ordering strategy
have to choose a single QEP out of a set of 20 QEPs. The cost of
each QEP is generated randomly within the following ranges:
Monetary Cost (M) has a range of 0 up to 10 cents and was
chosen according to the current Amazon EC2 pricing models [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ];
the range for query execution time was selected to be between 0
and 10 seconds (including data transfer time), and energy between
0 and 0.5 mAh. This simulation is repeated for multiple weight
compositions.
5.2
      </p>
    </sec>
    <sec id="sec-13">
      <title>Experimental Results</title>
      <p>In comparison to the lexicographical ordering strategy the
experimental results show two facts: First, the NWSA computes
the same results under the same costs as the lexicographical
ordering when focusing only on one objective. Second, NWSA
produces negligible overhead in computing this selection. As it
was already discussed in the previous sections 3 and 4.2, both
algorithms are running linear execution time related to the size of
QEPs to choose from. That leads to a total algorithm execution
time of less than one millisecond per experiment for both
algorithms so that the difference is negligible. Concluding this
comparison, negligible overhead is incurred and no higher cost
alternatives results are selected. Looking at the performance of
NWSA, this evaluation shows the possibilities of this strategy.</p>
      <p>Impact of Monetary Cost Weight on</p>
      <sec id="sec-13-1">
        <title>Total Monetary Cost (MC)</title>
        <p>MC
in $
60000
50000
40000
30000
20000
10000
0
0
1
1
2
4
5
6
7
8
9
3
,
,
,
,
0
0
0
0
0
0
0
0
0</p>
      </sec>
      <sec id="sec-13-2">
        <title>Weight on Monetary Cost</title>
        <p>0 ,1 ,2 ,3 ,4 ,5 ,6 ,7 ,8 ,9 1</p>
        <p>0 0 0 0 0 0 0 0 0</p>
        <p>Weight on Monetary Cost
To have an option of deciding how to stress the weights on the
different objectives can change a lot in terms of total cost as it can
be seen in Figure 7-9. The figures show the changes of the total
cost of the one million chosen QEPs as the weight on monetary
cost increases. The remaining weight is divided equally between
execution time and energy consumption.</p>
        <p>It can be seen that when the monetary cost weight increases, the
monetary costs decreases, while the query execution time and
energy consumption increase. It is notable that the minimum and
maximum values of an objective span a large gap, so an impact of
having weights is easily seen. Already having a small weight on
one objective can lead to a big difference in the total cost.
While not shown in this paper, the graphs plotting the impacts of
increasing weights on the execution time and energy consumption
show an equivalent trend as the impact of increasing weights on
the monetary cost.</p>
      </sec>
    </sec>
    <sec id="sec-14">
      <title>6. CONCLUSION AND OUTLOOK</title>
      <p>In this paper, a new algorithm, called Normalized Weighted Sum
0 0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 1
Algorithm (NWSA), was proposed, to select the best query
execution plan for query optimization that includes multiple
objectives, such as monetary cost, query execution time, and
energy consumption, in the decision process. The simulation
experiments evaluating NWSA in the context of a mobile-cloud
query optimization have been presented. NWSA is able to select
the query execution plan that is an element of the Pareto set, while
avoiding the expensive cost of computing the Pareto set. NWSA is
highly adaptable to any multi-objective decision problem since it
is not limited to any number of objectives. The experimental
results show that NWSA incurs negligible computational
overhead in comparison to the existing lexicographical ordering
strategy. Additionally, the use of weights enables a more precise
selection of a query execution plan since the minimum and
maximum values of an objective span a wide gap.</p>
      <p>
        A future modification is to also consider non-linear functions of
the normalization of objectives as well as of the composition of
user and environmental weights. As far as the usage of this
algorithm is concerned, we intend to incorporate it into the query
optimization process to calculate fast estimations of query costs
for clouds [
        <xref ref-type="bibr" rid="ref13 ref15 ref17">20, 21, 22, 23</xref>
        ]. Another future field of usage of this
algorithm is a new Cache Replacement Policy for the mobile
Cache to extend semantic Caching [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Based on the computed
score of a QEP, the new policy can help to keep more valuable
data in the semantic cache (the higher the score is, the higher the
cost to regain those results will be).
      </p>
      <p>ACKNOWLEDGEMENT
This work is partially supported by the National Science
Foundation Award No. 1349285.
[10] E. Zitzler and L. Thiele, "Multiobjective Evolutionary
Algorithms:," in IEEE TRANSACTIONS ON
EVOLUTIONARY COMPUTATION, VOL. 3, NO. 4, ,
NOVEMBER 1999.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>H. T.</given-names>
            <surname>Dinh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. Niyato und P.</given-names>
            <surname>Wang</surname>
          </string-name>
          , „
          <article-title>A survey of mobile cloud computing: architecture, applications</article-title>
          , and approaches,“ in
          <source>Wireless communications and mobile computing 13.18</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Perrin</surname>
          </string-name>
          ,
          <article-title>"Time-</article-title>
          ,
          <string-name>
            <surname>Energy-</surname>
          </string-name>
          , and
          <article-title>Monetary Cost-Aware Cache Design for a Mobile Cloud Database System,"</article-title>
          <source>May</source>
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Amazon</surname>
          </string-name>
          , „Amazon EC2 Pricing,“
          <year>2015</year>
          . [Online]. Available: https://aws.amazon.com/ec2/pricing/?nc1=h_ls.
          <source>[Zugriff am 18 08</source>
          <year>2015</year>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A.</given-names>
            <surname>Ben-Tal</surname>
          </string-name>
          ,
          <article-title>Characterization of Pareto and lexicographic optimal solutions</article-title>
          , Springer Berlin Heidelberg,
          <year>1980</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>E.</given-names>
            <surname>Triantaphyllou</surname>
          </string-name>
          <article-title>, Multi-criteria decision making methods: a comparative study</article-title>
          , 44 ed., Springer Science &amp; Business
          <string-name>
            <surname>Media</surname>
          </string-name>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>P.</given-names>
            <surname>Kind</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. E.</given-names>
            <surname>Lafata</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Matuszewsk und D. Raisch</surname>
          </string-name>
          , „
          <article-title>The use of QALYs in clinical and patient decision-making: Issues and prospects</article-title>
          ,“
          <source>in VALUE IN HEALTH 12</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>M. G. M. Hunink und M. C.</surname>
          </string-name>
          <article-title>Weinstein, Decision Making in Health and Medicine: Integrating Evidence and Values, 2nd Hrsg</article-title>
          ., Cambridge University Press,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>P. C.</given-names>
            <surname>Fishburn</surname>
          </string-name>
          ,
          <article-title>"Methods of estimating additive utilities</article-title>
          .
          <source>: Management science 13</source>
          .7,"
          <year>1967</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>C.-H. Goh</surname>
            ,
            <given-names>Y.-C. A.</given-names>
          </string-name>
          <string-name>
            <surname>Tung</surname>
          </string-name>
          and C.-H. Cheng,
          <article-title>" A revised weighted sum decision model for robot selection,"</article-title>
          <source>in Computers &amp; Industrial</source>
          Engineering Vol.
          <volume>30</volume>
          (
          <issue>2</issue>
          ),
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>C.</given-names>
            <surname>Lei</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Zhuang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Rundensteiner und M. Eltabakh</surname>
          </string-name>
          , „Shared Execution of Recurring Workloads in MapReduce∗,“ in
          <source>Proceedings of the VLDB Endowment</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>J.</given-names>
            <surname>Mullen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Perrin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Helff</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Gruenwald</surname>
          </string-name>
          and L.
          <string-name>
            <surname>d'Orazio</surname>
          </string-name>
          ,
          <article-title>"A Vision of Time-</article-title>
          ,
          <string-name>
            <surname>Energy-</surname>
          </string-name>
          ,
          <source>and Monetary Cost-Aware Query Processing in Mobile Cloud Database Environment," March</source>
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D. V.</given-names>
            <surname>Lindley</surname>
          </string-name>
          ,
          <source>Scoring Rules and the Inevitability of Probability</source>
          , 50 ed.,
          <source>International Statistical Review</source>
          Vol
          <volume>50</volume>
          ,
          <year>1982</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>N.</given-names>
            <surname>Bruno</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Jain</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <article-title>"Continuous cloud-scale query optimization and processing,"</article-title>
          <source>in Proceedings of the VLDB Endowment 6.11</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>I.</given-names>
            <surname>Kim</surname>
          </string-name>
          and
          <string-name>
            <surname>O. de Weck</surname>
          </string-name>
          ,
          <article-title>"Adaptive weighted-sum method for bi-objective optimization: Pareto front generation,"</article-title>
          <source>in Structural and multidisciplinary optimization 29.2</source>
          ,
          <issue>2005</issue>
          , pp.
          <fpage>149</fpage>
          -
          <lpage>158</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>H.</given-names>
            <surname>Kllapi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Sitaridi und M. M. Tsangaris</surname>
          </string-name>
          , „
          <article-title>Schedule Optimization for Data Processing Flows on the Cloud,“</article-title>
          <source>in Proceedings of the 2011 ACM SIGMOD International Conference on Management of data (ACM)</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J.</given-names>
            <surname>Chomicki</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Ciaccia</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Meneghetti</surname>
          </string-name>
          ,
          <article-title>"Skyline queries, front and back,"</article-title>
          <source>in ACM SIGMOD Record 42.3</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>M.</given-names>
            <surname>Armbrust</surname>
          </string-name>
          and e. al.,
          <article-title>"A view of cloud computing,"</article-title>
          <source>in Communications of the ACM 53.4</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>D.</given-names>
            <surname>Kossmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Ramsak</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Rost</surname>
          </string-name>
          ,
          <article-title>"Shooting stars in the sky: An online algorithm for skyline queries,"</article-title>
          <source>in Proceedings of the 28th international conference on Very Large Data Bases (VLDB)</source>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>D.</given-names>
            <surname>Papadias</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Tao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Fu</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Seeger</surname>
          </string-name>
          ,
          <article-title>"An optimal and progressive algorithm for skyline queries,"</article-title>
          <source>in Proceedings of the 2003 ACM SIGMOD international conference on Management of data (ACM)</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [16]
          <string-name>
            <surname>C. H. Papadimitriou und M. Yannakakis</surname>
          </string-name>
          , „
          <article-title>Multiob jective Query Optimization,“ in Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems</article-title>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [17]
          <string-name>
            <surname>I.</surname>
          </string-name>
          <article-title>Trummer und C. Koch, „Multi-Objective Parametric Query Optimization,“ in Proceedings of the VLDB Endowment</article-title>
          , [23]
          <string-name>
            <surname>H. M. Fard</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Prodan</surname>
            ,
            <given-names>J. J. D.</given-names>
          </string-name>
          <string-name>
            <surname>Barrionuevo</surname>
            and
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Fahringer</surname>
          </string-name>
          ,
          <article-title>"A Multi-Objective Approach for Workflow Scheduling in Heterogeneous Environments,"</article-title>
          <source>in 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>