<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>cient Updates of Uncertain Databases</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Extended Abstract</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Andreas Hubmer</institution>
          ,
          <addr-line>Reinhard Pichler, Vadim Savenkov, and Sebastian Skritek</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Vienna University of Technology</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Uncertain databases have evolved as an active area of database research, surveyed, for example, in [10].The possible worlds semantics [1] is commonly used to deal with uncertain data. Several representation systems for uncertain databases have been proposed to provide e cient storage and query facilities for a potentially big number of possible worlds, see, e.g., [14,4,8]. Antova et al. introduced U-relations [2], which guarantee polynomial data complexity for queries of positive relational algebra (RA, for short). U-relations have been implemented and are available in the MayBMS system [6]. As in the case of certain databases, we clearly also want to update uncertain databases and pose queries of unrestricted RA. In [3], an API for uncertain databases, which also covers updates, is presented. The paper mentions that, for updates, decompression of the succinct representation of the possible worlds may be necessary. However, it leaves open the details and also the question if decompression could at least partly be avoided by some extension of the representation system. While the evaluation of positive RA queries on uncertain databases has been studied extensively, there has been little work beyond positive RA, like queries with having clauses [7] and queries with one level of anti-join (not-exists [13]). Fink et al. [5] describe an approach for unrestricted RA queries, but in a formalism that does not exhibit polynomial time data complexity for computing possible answers. The goal of this work is to start the investigation of the update problem of U-relations and to tackle the problem of evaluating queries with anti-joins over this formalism. To this end, we will rst de ne the anti-join operator for U-relations and show how to use it to model updates. It will turn out that the decompression of the succinct representation of possible worlds may indeed be a performance problem. We will therefore introduce an extension of the Urelation representation system and show that our new formalism may lead to an exponential decrease in the representation of an updated uncertain database. Our main contributions will be as follows.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Formal de nition. We rst present a formal de nition of the anti-join operator
on U-relations such that the result is again a U-relation. Using the anti-join, we
then de ne the semantics of the update operator on U-relations.
New representations. Non-monotonous operators and updates can seriously
compromise the space e ciency of U-relations. To address this problem, we
introduce two generalizations of U-relations: (i) Ui-relations, which additionally allow
inequalities in the descriptors of possible worlds; and (ii) Uint-relations, which
allow intervals to specify ranges of the variables in descriptors of possible worlds.
We prove that by using Ui-relations or Uint-relations, the required storage and
the complexity of query answering can drop exponentially.</p>
      <p>Complexity of optimization of world sets. We point out the intractability of a
basic optimization problem for U-relations, Ui-relations, and Uint-relations.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Preliminaries</title>
      <p>
        Propositional Logic of Finite Domains. The formalism of U-relations uses
the logic known in the literature as propositional logic of nite domains, PLFD
[
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. It is an extension of propositional logic, in which each variable x is associated
with a xed set of constants called the domain of x, denoted dom(x). The atomic
formulas in PLFD have the form x = v, where x is a variable and v 2 dom(x) is a
value from the domain of x. A PLFD interpretation ( )i assigns to each variable
a value from its domain: (x = v)i = &gt; i xi = v. The interpretations of complex
formulas using the usual Boolean connectives ^; _; !; : are de ned as usual.
Possible worlds and U-relations. In the possible worlds semantics, an
uncertain database can have multiple possible states called possible worlds. In the
sequel, we will write P w to denote the state of the relation P in the possible
world w. Two ideas are crucial for U-relations: (i) possible worlds are described
by conjunctions of PLFD atoms, and (ii) vertical decomposition of relations may
allow one to exponentially reduce the size of the representation of the possible
worlds.
      </p>
      <p>
        Given an uncertain database B with a relational schema S, one can nd a
set of PLFD variables W with accordingly chosen domains, so that each total
valuation ( )i assigning a value to every variable in W corresponds to exactly
one possible world in B. U-relations split each relation R = (T ; A) 2 S with
key T in one or more vertical partitions U1; : : : ; Um with the schema (D; T ; Ai),
i = 1 : : : m where Ai is a subset of the attributes in A, and D stores the world-set
descriptors, or ws-descriptors, for short. In the original de nition of the
formalism of U-relations [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], the world-set descriptors in D are simply conjunctions
of PLFD atoms. Since possible worlds of B are associated with total valuations
for variables in W , each world-set descriptor de nes a set of possible worlds:
namely, the worlds associated with the valuations that turn to &gt;. The relation
R can be recombined from the partitions U1; : : : ; Um by joining the tuples with
consistent ws-descriptors over T . The semantics of the usual positive relational
operators is a straightforward extension of the semantics of queries over a
vertically partitioned database schema, projecting ws-descriptors along with the
primary key columns: see [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] for a complete speci cation. The main di erence
is in the binary operators like cartesian product and join: they only allow
combining tuples whose ws-descriptors are not contradictory. Importantly, unary
neg dnf clause(U ) := f(d0; a) j (d; a) 2 U; d0 is a clause in the DNF of :dg
negate(U; A) := neg dnf clause
      </p>
      <p>AGW D</p>
      <p>D;A(U ) :
JQ1 . Q2K :=</p>
      <p>D1^D2 as D;T1;A1 U1 no negate(U2; A2)</p>
      <p>D 6j=?
where the condition of anti-join . and join no operators is A1 = A2:
[ (U1 . U2);
operators do not alter ws-descriptors, whereas positive binary operators take
a conjunction of the ws-descriptors of the relations passed as operands. Thus,
positive relational operators on U-relations can be e ciently implemented.
Notation of Relational Operators. We use the extended form of the
projection operator which supports computed attributes: e.g., A1+A2 as A0 (U ) is
a unary relation whose attribute A0 is the sum of the attributes A1 and A2 in
U . The anti-join operator (\where not exists") is denoted by the symbol .. The
operator A1 Gf(A2)(U ) applies the aggregate function f to the set of attributes
A2 of U , whereby the tuples of U are grouped by the values of attributes A1.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Anti-joins and updates on U-Relations</title>
      <p>As pointed out in the previous section, U-relations allow for a natural
implementation of positive relational operators. However, the non-monotonic
operators over U-relations have not yet been considered. One such operator especially
well-suited for U-relations, which must contain tuple ids, is the anti-join.
De nition 1. The anti-join R . P is the uncertain relation de ned, for each
possible world w, by the expression Rw n (Rw &gt;&lt; P w).</p>
      <p>Theorem 1. The translation in Fig. 1 satis es De nition 1.</p>
      <p>Example 1. Consider the U-relation U = (D; T; A) consisting of the following
tuples: hx = 1; t1; ai; hx = 2; t1; bi; hy = 1; t2; ai; hy = 2; t2; ci; hy = 3; t3; ai. The
result U. of the relational expression T =t1 (U ) .A T 6=t1 (U ) is found as follows.
U. contains all possible t1-tuples of U that do not match any possible
t2;3tuples. This corresponds to the (U1 . U2) branch in Fig. 1. Such a tuple is
hx = 2; t1; bi. Additionally, for t1-tuples that have matches in t2 or t3, the
transformation of ws-descriptors using negate is needed. Such tuple is hx = 1; t1; ai.
The call negate( T 6=t1 (U ); A) rst aggregates ws-descriptors of tuples that
satisfy the condition A = a using _ and then passes the relation hy = 1 _ y = 3; ai
to neg dnf clause. The latter function negates the aggregate ws-descriptor and
transforms it to the DNF: provided that dom(y) = f1; 2; 3g, the resulting DNF
has a single clause y = 2. Thus, the result of negate( T 6=t1 (U ); A) is fhy = 2; aig.
The join ( T =t1 (U ) onA negate( T 6=t1 (U ); A)) followed by merging ws-descriptors
with ^ thus gives hx = 1 ^ y = 2; t1; ai. Since (x = 1 ^ y = 2) 6j= ? holds, the
result of the anti-join query U. is fhx = 1 ^ y = 2; t1; ai; hx = 1; t1; aig.</p>
      <p>Important on its own right, the anti-join operator allows implementing
updates of U-relations. Consider a general form GU of the update operator:</p>
      <p>GU : update R set Ak = Q:Expr from Q on R
Such update queries are supported by all major RDBMS's. GU updates an
attribute Ak of a relation R = (A1; : : : ; Ak; : : : ; An) and allows to join R with some
query Q serving as a source for the new value Expr of Ak. It is essential that
the update be unambiguous, i.e. if a tuple in R has more than one join partner
in Q then Expr must return the same value for all join partners. The update GU
can be expressed as a query QGU, which is a union of two queries, in which the
former selects the updated tuples and the latter selects the unchanged ones:
QGU :</p>
      <p>A1;:::Ak 1;Expr;Ak+1;:::;An (R on Q) [ (R . Q)
It is not di cult to show that no positive relational expression can express QGU.
4
4.1</p>
    </sec>
    <sec id="sec-4">
      <title>Extended U-relations</title>
      <p>
        Ws-descriptors with inequalities and intervals
As follows from the de nition in Fig. 1 and from Example 1, the performance
of anti-join on U-relations depends crucially on the function negate. In
compliance with the de nition of U-relations [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], this function produces ws-descriptors
being conjunctions of PLFD atoms. In the presence of non-monotonic queries
or updates such restricted form of ws-descriptors may prevent U-relations from
delivering on the promise of representing possible worlds succinctly.
Example 2. Consider a schema R = (T; A1; : : : ; An), where T is the key
attribute, split into n U-relations Ui = (D; T; Ai). Let B be an uncertain instance
of relation R, and let the tuple t in R have possible values constructed by
picking an arbitrary value from some xed set of constants V for each attribute
t:Ai. Using the vertical partitioning in U-relations, the jV jn possible values of t
can be represented by total n jV j tuples in the U-relations Ui; : : : ; Un. E.g., for
n = 3 and V = fa; b; cg, the following tuples in the U-relations are needed. U1 :
hx = 1; t; ai; hx = 2; t; bi; hx = 3; t; ci, U2 : hy = 1; t; ai; hy = 2; t; bi; hy = 3; t; ci,
U3 : hz = 1; t; ai; hz = 2; t; bi; hz = 3; t; ci.
      </p>
      <p>Now, consider the result of the relational expression B . fR(t; a; a; a)g. The
entries with T = t in the U-relations should represent the remaining 26 possible
values of t: V V V nfa; a; ag. After recombining R from U1;2;3 and subtracting
fhx = 1 ^ y = 1 ^ z = 1; t; a; a; aig according to the de nition of ., U1 contains
tuples hx = 1 ^ y = 2 ^ z = 1; t; ai; hx = 1 ^ y = 3 ^ z = 1; t; ai; hx = 1 ^ y =
1 ^ z = 2; t; ai; hx = 1 ^ y = 1 ^ z = 3; t; ai; hx = 2; t; bi; hx = 3; t; ci. U2 and
U3 need to be updated accordingly. That is, 6 tuples with T = t per U-relation
are now needed to represent the result of anti-join operator, instead of the 3
tuples per U-relation in B. One can show that for R with n attributes split into
n U-relations, additional m (jV jn jV j) entries in each U-relation are needed
to represent the deletion of one possible world with m tuples from B.
We address this issue by allowing more expressive ws-descriptors.</p>
      <p>Iws-descriptors allow for inequalities along with equalities to be present in the
conjunctive formulas. Thereby the PLFD formula x 6= vi is a shorthand for (x =
v1) _ : : : _ (x = vi 1) _ (x = vi+1) _ : : : _ (x = vm), where dom(x) = fv1; : : : ; vmg,
which explains the source of increased space-e ciency of the new representation.
The resulting formalism is called Ui-relations .</p>
      <p>Intws-descriptors replace equalities and inequalities with intervals of values
which the given variable can take. An intws-descriptor is a set of triples (v; lo; hi)
that consist of a variable v with a lower bound lo and an upper bound hi, such
that lo hi, lo; hi 2 dom(v) and such that each v occurs at most once in the set.
It is assumed that the domain of v is 0 : : : n, for some integer n. The respective
modi cation of U-relations is called Uint-relations. For instance, for vi 62 f0; ng,
we can represent the formula x 6= vi by two triples (x; 0; vi 1) and (x; vi + 1; n).
Theorem 2. There exist ws-descriptors whose negation represented as sets of
iws- resp. intws-descriptors is exponentially more succinct than if represented as
sets of ws-descriptors.</p>
      <p>For instance, using Ui-relations the result of the anti-join B . fR(t; a; a; a)g from
Example 2 can be expressed by exactly the same number of tuples as in B:
U1 : hx = 1 ^ y 6= 1; t; ai; hx = 2; t; bi; hx = 3; t; ci,
U2 : hy = 1 ^ x 6= 1 ^ z 6= 1; t; ai; hy = 2; t; bi; hy = 3; t; ci;</p>
      <p>U3 : hz = 1 ^ x 6= 1 ^ y 6= 1; t; ai; hz = 2; t; bi; hz = 3; t; ci.</p>
      <p>Extending ws-descriptors preserves the favorable properties of U-relations:
Theorem 3. Positive relational algebra queries can be evaluated on U i- resp.
Uint-relational databases in polynomial time data complexity.</p>
      <p>
        Proof (Sketch). Evaluating positive RA operators on extended U-relations only
di ers from evaluating these operators on U-relations of [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] in the consistency
test of the binary operators: the tuples in two relations are only combined if the
respective ws-descriptors are mutually consistent. That is, if the conjunction of
two ws-descriptors is satis able. The satis ability test is feasible in polynomial
time in all three cases of U-relations, Ui-relations and Uint-relations. Therefore,
the claim of the theorem follows from the result in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] claiming that the problem
of evaluating positive RA operators on U-relations has polynomial data
complexity.
)snd 5.556 intiwwwsss
coe 4.5
isn 4
(tc 3.5
lsee 3
fro 2.5
e 2
itm 1.5
1 2
3
The performance of queries and updates depends on the choice of the concrete
expression representing the set of possible worlds. Below, we show that
optimizing sets of ws-descriptors is intractable even without the extensions proposed
above. Obviously, this intractability result also holds for Ui-relations and
Uintrelations.
      </p>
      <p>Proposition 1. Let S be a set of ws-descriptors occurring in a given U-relation
U . Let !(S) denote a set of all valuations which turn at least one ws-descriptor
in S to &gt;. It is 2P -complete to decide whether a ws-descriptor S0 exists, such
that jS0j &lt; jSj and !(S) = !(S0).</p>
      <p>
        Proof (Sketch). We show hardness by a reduction from the DNF minimization
problem Min-DNF( ; k) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] de ned as follows:
Given a propositional formula in DNF and an integer k, is there a DNF
formula equivalent to that contains k or fewer occurrences of literals?
This problem has been shown to be 2P -complete by Umans [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. We encode an
instance of Min-DNF( ; k) as a problem in the claim of the theorem. Thereby
each propositional variable x in gives rise to a fresh PLFD variable x_ with
domain f1; 2g, and each conjunctive clause in is encoded into a ws-descriptor
by replacing the positive propositional literal x with the PLFD atom x_ = 1 and
each negative literal x with the PLFD atom x_ = 2.
      </p>
      <p>For membership, consider the following algorithm: guess a set of
ws-descriptors S0 and check in polynomial time whether it contains at most k equalities
(PLFD atoms). With a coNP oracle we check that there does not exist a valuation
w such that w 2 !(S) and w 2= !(S0) or vice versa. The check itself is feasible
in polynomial time.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>
        In this paper we have introduced two features of U-relations missing so far: the
non-monotonous operator of anti-join and updates. Moreover, we have shown
how the formalism of U-relations can be extended in order to improve the
performance of these operations. We have also implemented our extensions on top of
the open-source MayBMS system [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and experimentally veri ed their e ciency.
For example, Fig. 2 shows the impact of extended U-relations from Section 4 on
the performance of both select and update queries, for various limits of possible
values which uncertain tuple attributes can take.
      </p>
      <p>To deal with the high worst-case complexity of optimizing U-relations, we
have incorporated some easy heuristics that often lead to better representations
(which are not guaranteed to be optimal, though). Our experiments show the
e ectiveness of these heuristics. A systematic investigation of such methods and
further experiments with extending U-relations, enabling e cient support of
updates and non-monotonic operators, remains a subject of future research.
Acknowledgements. This work has been supported by the Austrian Science
Fund (FWF): P25207-N23.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Serge</surname>
            <given-names>Abiteboul</given-names>
          </string-name>
          , Paris Kanellakis, and Gosta Grahne.
          <article-title>On the representation and querying of sets of possible worlds</article-title>
          .
          <source>Theor. Comput. Sci.</source>
          ,
          <volume>78</volume>
          :
          <fpage>159</fpage>
          {
          <fpage>187</fpage>
          ,
          <year>1991</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Lyublena</given-names>
            <surname>Antova</surname>
          </string-name>
          , Thomas Jansen, Christoph Koch, and
          <string-name>
            <given-names>Dan</given-names>
            <surname>Olteanu</surname>
          </string-name>
          .
          <article-title>Fast and simple relational processing of uncertain data</article-title>
          .
          <source>In Proc. of ICDE '08</source>
          , pages
          <fpage>983</fpage>
          {
          <fpage>992</fpage>
          . IEEE,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Lyublena</given-names>
            <surname>Antova</surname>
          </string-name>
          and
          <string-name>
            <given-names>Christoph</given-names>
            <surname>Koch</surname>
          </string-name>
          .
          <article-title>On APIs for probabilistic databases</article-title>
          .
          <source>In Proc. of QDB/MUD '08</source>
          , pages
          <fpage>41</fpage>
          {
          <fpage>56</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Jihad</given-names>
            <surname>Boulos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Nilesh N.</given-names>
            <surname>Dalvi</surname>
          </string-name>
          , Bhushan Mandhani, Shobhit Mathur, Christopher Re, and Dan Suciu.
          <article-title>MYSTIQ: A system for nding more answers by using probabilities</article-title>
          .
          <source>In Proc. of SIGMOD '05</source>
          , pages
          <fpage>891</fpage>
          {
          <fpage>893</fpage>
          . ACM,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Robert</given-names>
            <surname>Fink</surname>
          </string-name>
          , Dan Olteanu, and
          <string-name>
            <given-names>Swaroop</given-names>
            <surname>Rath</surname>
          </string-name>
          .
          <article-title>Providing support for full relational algebra in probabilistic databases</article-title>
          .
          <source>In Proc. of ICDE '11</source>
          , pages
          <fpage>315</fpage>
          {
          <fpage>326</fpage>
          . IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Christoph</given-names>
            <surname>Koch</surname>
          </string-name>
          .
          <article-title>MayBMS: A system for managing large uncertain and probabilistic databases</article-title>
          .
          <source>In Managing and Mining Uncertain Data</source>
          . Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Re</surname>
          </string-name>
          and
          <string-name>
            <given-names>Dan</given-names>
            <surname>Suciu</surname>
          </string-name>
          .
          <article-title>The trichotomy of having queries on a probabilistic database</article-title>
          .
          <source>The VLDB Journal</source>
          ,
          <volume>18</volume>
          :
          <fpage>1091</fpage>
          {
          <fpage>1116</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Sarvjeet</given-names>
            <surname>Singh</surname>
          </string-name>
          , Chris May eld, Sagar Mittal, Sunil Prabhakar,
          <source>Susanne Hambrusch, and Rahul Shah. Orion 2</source>
          .
          <article-title>0: native support for uncertain data</article-title>
          .
          <source>In Proc. of SIGMOD '08</source>
          , pages
          <fpage>1239</fpage>
          {
          <fpage>1242</fpage>
          . ACM,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Larry</surname>
            <given-names>J. Stockmeyer.</given-names>
          </string-name>
          <article-title>The polynomial-time hierarchy</article-title>
          .
          <source>Theoretical Computer Science</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ):1{
          <fpage>22</fpage>
          ,
          <year>1976</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Dan</surname>
            <given-names>Suciu</given-names>
          </string-name>
          , Dan Olteanu, Christopher Re, and
          <string-name>
            <given-names>Christoph</given-names>
            <surname>Koch</surname>
          </string-name>
          . Probabilistic Databases. Morgan &amp; Claypool,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Umans</surname>
          </string-name>
          .
          <article-title>The minimum equivalent DNF problem and shortest implicants</article-title>
          .
          <source>In Proc. of FOCS '98</source>
          , pages
          <fpage>556</fpage>
          {
          <fpage>563</fpage>
          . IEEE,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>Andrey</given-names>
            <surname>Voronkov</surname>
          </string-name>
          .
          <article-title>Propositional logic of nite domains</article-title>
          .
          <source>Chapter 12 of the \Logic and Modelling" course script</source>
          , University of Manchester. http://www.voronkov. com/lm_doc.
          <source>cgi?what=chapter&amp;n=12, Accessed: March</source>
          <volume>22</volume>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Ting-You</surname>
            <given-names>Wang</given-names>
          </string-name>
          , Christopher Re, and
          <string-name>
            <given-names>Dan</given-names>
            <surname>Suciu</surname>
          </string-name>
          .
          <article-title>Implementing NOT EXISTS predicates over a probabilistic database</article-title>
          .
          <source>In Proc. of QDB/MUD '08</source>
          , pages
          <fpage>73</fpage>
          {
          <fpage>86</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>Jennifer</given-names>
            <surname>Widom</surname>
          </string-name>
          .
          <article-title>Trio: A system for data, uncertainty, and lineage</article-title>
          .
          <source>In Managing and Mining Uncertain Data</source>
          . Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>