<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Optimal quorum for a reliable Desktop grid</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ilya Chernov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Natalia Nikitina</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Inst. Applied Math Research</institution>
          ,
          <addr-line>Pushkinskaya 11, Petrozavodsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We consider a reliable desktop grid solving multiple tasks with answers from a given set. Wrong answer can be obtained with some small probability p: reliability means that p is small with respect to 1 p. Penalty is added to the computation cost if a wrong answer is believed to. We consider the optimization problem of choosing the quorum in case of nite set of possible answers, countable set, and set with continuously distributed subset.</p>
      </abstract>
      <kwd-group>
        <kwd>Desktop grid</kwd>
        <kwd>optimal quorum</kwd>
        <kwd>replication</kwd>
        <kwd>reliable computation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        In the presented work we consider the problem of task scheduling in a Desktop
Grid. The term stands for a distributed computing system with computational
nodes voluntarily donated by an organization (or a group of organizations
following the same research goals) in their idle time. The nodes of such system
are desktop PCs, compute servers, cluster nodes, and other computational
resources available in a local network and/or the Internet. The BOINC middleware
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] can be considered a de-facto standard for organizing Desktop Grids. Since
late 1990s, BOINC-based Desktop Grids have proven to serve as an e ective,
highly scalable tool for solving computationally intensive problems. But the
definition given above implies that computational nodes of a Desktop Grid can
be highly heterogeneous by technical and software characteristics and become
available/unavailable in unpredicted moments. Moreover, the answer returned
by the computing node can be wrong, due to malfunction, errors in transaction,
malicious actions etc. In order to harness the volatile Desktop Grid resources
rationally, special scheduling methods and algorithms should be developed. Much
e ort has been paid recently to optimize the calculation process in a Desktop
Grid and improve its reliability. For example, a series of works [
        <xref ref-type="bibr" rid="ref3 ref4 ref6">3, 4, 6</xref>
        ] consider
heuristics for mapping independent tasks onto identical nodes that may leave
Desktop Grid in random moments; the work [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] presents closed-form conditions
of task replication to be reasonable; the authors of [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] consider
heterogeneity of computational nodes, etc. The contribution of the presented work is
investigation of the optimal task replication level and the optimal quorum for a
Desktop Grid with high reliability of the answers returned from computational
nodes. Solving a computational problem with high reliability may signi cantly
increase the cost of computations, such as the overall time, due to high
precision of calculations. We try to evaluate the expected cost and select the optimal
strategy of task scheduling.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>The mathematical model</title>
      <p>Let us consider a desktop grid computing system that consists of multiple
computers and solves numerous similar tasks. Each task has an answer from some
set of possible answers. Without loss of generality we can assume that this set
is a subset of real numbers or integer numbers. The correct answer is obtained
with some probability q. Errors are possible due to malfunction of hardware,
malicious actions, or wrong answers produced by a correct non-deterministic
algorithm. Other, wrong answers have the total probability 1 q; some of them
can have non-zero probability, others are distributed continuously.</p>
      <p>Such errors can be made less likely by replication: sending copies of each
task to di erent computing nodes until a chosen number of identical answers
is received. This number is called the quorum. Obviously, for a given quorum
the number of copies is at least but can be more, up to N ( 1) + 1 for nite
number N of possible answers. However, the average number of copies is nite
even in case of in nite set of answers.</p>
      <p>If a wrong answers is taken, this error will later be revealed and can cost
much. The losses can be connected with loosing a rare desired phenomenon,
unnecessary expensive laboratory checks, reputational losses, etc. These penalties
can be huge compared to the average cost of a single task.</p>
      <p>Here we assume that q 1 in the following sense: 1 q is negligibly small
compared to q. Therefore we can neglect possible cases of choosing between
di erent wrong answers or any wrong answers seen if the correct one has been
believed.</p>
      <p>First we consider the nite set of possible answers. Then we will add some
simple notes about more general case with in nite set of answers, with positive
probabilities and/or continuously distributed.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Finite set of answers</title>
      <p>Assume that M + 1 possible answers have probabilities pm, p0 = q 1 (the
correct answer), penalties of di erent answers are Fm, F0 = 0. If quorum is
chosen and the correct answer is accepted, the average number of copies is
up to the precision discussed above, the probability to get the correct answer
is q. However, for each wrong answer number m possible durations can be any
between (the same wrong answer in a row) and 2 1 (after 1 correct and
1 wrong answers the nal wrong answer was received). The corresponding
probabilities of durations + i, i = 0; : : : ; 1 are, respectively, equal to
The rst factor chooses i positions of correct answers among
while the nal answer is accepted.</p>
      <p>The mean cost is</p>
      <sec id="sec-3-1">
        <title>1 rst tries, E( ) =</title>
        <p>i. To prove this equality, we need two well-known formulae (the Pascal
On the nal step we applied the obvious equality
the proof.</p>
        <p>Now we can rewrite the mean cost as
nn = nn 11 . This completes
We want to minimize this cost keeping in mind the fact that penalties Fm are
not known precisely, so that conditions should allow variations of Fm. Let us
consider di erences E = E( + 1) E( ) and take the rst with E 0.
It is easy to check that</p>
      </sec>
      <sec id="sec-3-2">
        <title>It follows from if j = triangle):</title>
      </sec>
      <sec id="sec-3-3">
        <title>Now consider 2 Continue to obtain</title>
        <p>n
m
:
2
=
(1)</p>
      </sec>
      <sec id="sec-3-4">
        <title>So we need the smallest such that 2 1</title>
        <p>M
X Fmpm
m=1
1:
(2)</p>
        <p>It is clear that inequality (2) holds, then each term is less than 1; although
it is possible to choose parameters in such a way that all terms are less than
one while the sum is more. However, if we take making each term less than 1,
di erence between optimal value is at most 1.</p>
        <p>Let us simplify condition (2) in case M = 1 using the asymptotical formulae
2</p>
        <p>22
= p
;
2
1</p>
        <p>22 1
= p
Note that they are rather precise even for low : 10% for
the condition (2) can be replaced by the approximate one:
= 1 and less. Then
22 1
p</p>
        <p>F p
1:
If F = 2A, p = 2 B (A &gt; 1, B &gt; 2), then</p>
      </sec>
      <sec id="sec-3-5">
        <title>The right-hand side is less than 3 for</title>
        <p>&lt; 20 and we can safely neglect it; then
(2</p>
        <p>B) + A
1
0:5 log2</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>In nite set of wrong answers</title>
      <p>Assume that beside the correct answer of some probability q 1 and M wrong
ones with probabilities pm &gt; 0 the set of possible answers contains a subset
S of continuously distributed answers of total probability r. Obviously these
answers are thrown o by any replication because they have zero probabilities
and therefore receiving an answer again is an impossible event. However, wrong
answers with positive probabilities can come a few times and be believed. In this
case the cost is increased on some penalty Fm.</p>
      <p>The results here are completely the same as in the previous section, only the
average cost of = 1 case is di erent because estimated value of penalty for an
answer from S must be added to the average cost.</p>
      <p>Now let us consider the case of countable (M = 1) set of answers with
positive probabilities. This assumption may look nice, for example in case when
answers are integer numbers. However, such case does not allow equal (or at
least comparable) probabilities pm: the series
1
X pm
m=1
must converge to some p which is small compared to 1
are given, the average cost
p. Provided that pm
can still diverge for some or all , depending on behaviour of penalties Fm.
It is clear that polynomial (at most) growth of Fm with respect to m is su
cient for convergence. To prove that, note that a binomial coe cient grows with
polynomial rate:
n
m
2n;
0
m
n;
and the sequence pm decreases more quickly that m 1 because it forms a
convergent series; therefore su ciently large = makes the terms of the series
decrease quickly enough, so the the series converges. Higher only reduce the
sum at least (max pm) times, so that the second term in the expression for
E decreases. So, for high enough values of the expected cost E grows, almost
lineary. Then it has the unique minimal value being the solution to the
optimization problem. We have proven that the optimization problem we are studying
always has a solution. It is solved in the similar way as the one for the nite set
of answers, only the cost function may be equal to in nity for some . Note that
the solution can equal 1 in case of low (or no) penalties. This means that no
replication is necessary.</p>
      <p>It is clear that both countable set of possible answers and continuously
distributed set of impossible answers can also be combined.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgements References</title>
      <p>The work was nancially supported by grants 13-07-00008 and 15-29-07974 of
Russian Foundation for Basic Research.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>D.</given-names>
            <surname>Anderson</surname>
          </string-name>
          .
          <article-title>BOINC: A system for public-resource computing and storage</article-title>
          .
          <source>In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing</source>
          , pages
          <volume>4</volume>
          {
          <fpage>10</fpage>
          , Washington, DC, USA,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>C.</given-names>
            <surname>Anglano</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Brevik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Canonico</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Nurmi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Wolski</surname>
          </string-name>
          .
          <article-title>Fault-aware scheduling for bag-of-tasks applications on desktop grids</article-title>
          .
          <source>In Proceedings of the 7th IEEE/ACM International Conference on Grid Computing</source>
          , pages
          <volume>56</volume>
          {
          <fpage>63</fpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3. L.
          <string-name>
            <surname>-C. Canon</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Essa</surname>
            , G. Mounie, and
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Trystram</surname>
          </string-name>
          .
          <article-title>A bi-objective scheduling algorithm for desktop grids with uncertain resource availabilities</article-title>
          .
          <source>In Proceedings of the 17th International Conference on Parallel Processing (Euro-Par11)</source>
          , volume II, pages
          <volume>238</volume>
          {
          <fpage>249</fpage>
          , Berlin, Heidelberg,
          <year>2011</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. H.
          <string-name>
            <surname>-C. Hwang</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Lee</surname>
            , and
            <given-names>S. Y.</given-names>
          </string-name>
          <string-name>
            <surname>Chang</surname>
          </string-name>
          .
          <article-title>The e ect of machine availability on the worst-case performance of LPT</article-title>
          .
          <source>Discrete Applied Mathematics</source>
          ,
          <volume>148</volume>
          (
          <issue>1</issue>
          ):
          <volume>49</volume>
          {
          <fpage>61</fpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>O.</given-names>
            <surname>Ibarra</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Kim</surname>
          </string-name>
          .
          <article-title>Heuristic algorithms for scheduling independent tasks on nonidentical processors</article-title>
          .
          <source>Journal of ACM</source>
          ,
          <volume>24</volume>
          (
          <issue>2</issue>
          ):
          <volume>280</volume>
          {
          <fpage>289</fpage>
          ,
          <year>1977</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>C</surname>
            .-
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Lee</surname>
          </string-name>
          .
          <article-title>Parallel machines scheduling with nonsimultaneous machine available time</article-title>
          .
          <source>Discrete Applied Mathematics</source>
          ,
          <volume>30</volume>
          (
          <issue>1</issue>
          ):
          <volume>53</volume>
          {
          <fpage>61</fpage>
          ,
          <year>1991</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Rumiantsev</surname>
          </string-name>
          .
          <article-title>Optimizing the execution time of a desktop grid project</article-title>
          .
          <source>Program Systems: Theory and Applications online journal</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          (
          <issue>19</issue>
          )):
          <volume>175</volume>
          {
          <fpage>182</fpage>
          ,
          <year>2014</year>
          . (In Russian).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>