<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>SEBD</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>How Many Inconsistencies Are In Your Database?⋆</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>(Discussion Paper)</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francesco Parisi</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>John Grant</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>DIMES Department, University of Calabria</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Maryland at College Park</institution>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <volume>31</volume>
      <fpage>02</fpage>
      <lpage>05</lpage>
      <abstract>
        <p>Measuring inconsistency is an approach that provides ways to quantify the severity of inconsistency and helps understanding the primary sources of conflicts. In this paper, we discuss inconsistency measures for indefinite databases, which allow for indefinite or partial information which is formally expressed by means of disjunctive tuples. We introduce inconsistency measures for indefinite databases with denial constraints, and explore the complexity of the problem of computing the value of the proposed inconsistency measures as well as of the problems of deciding whether the inconsistency value is lower than, greater than, or equal to a given threshold for indefinite and definite databases.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Relational database</kwd>
        <kwd>Indefinite database</kwd>
        <kwd>Inconsistency measure</kwd>
        <kwd>Denial constraints</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Handling conflicting information is an important challenge. In fact, data of poor quality can
significantly limit the implementation of effective AI solutions [
        <xref ref-type="bibr" rid="ref2 ref3">2, 3</xref>
        ]. So, having information on
the quality of data used in data-driven approaches is crucial, as poor quality data can have serious
adverse consequences on the quality of decisions made using AI [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Measuring inconsistency [
        <xref ref-type="bibr" rid="ref5 ref6">5,
6</xref>
        ] is a well-understood approach that can be used towards assessing data quality, as it provides
ways to quantify the severity of inconsistency that help understanding the primary sources of
conflicts and devising ways to deal with them. In this regard, inconsistency measurement has
been extensively investigated for propositional logic (e.g., [
        <xref ref-type="bibr" rid="ref10 ref11 ref12 ref7 ref8 ref9">7, 8, 9, 10, 11, 12</xref>
        ]), and explored in
other settings such as software specifications [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and ontologies [
        <xref ref-type="bibr" rid="ref14 ref15">14, 15</xref>
        ], among others.
      </p>
      <p>
        In this paper, we explore inconsistency measures for definite and indefinite databases (DBs).
Classical relational DBs can store definite information only, while in practical situations much
of the information is not precise. Indefinite DBs, also known as disjunctive DBs, represent
disjunctive information in the form of indefinite tuples, i.e., disjunctive facts. They have been
studied for a long time [
        <xref ref-type="bibr" rid="ref16 ref17 ref18 ref19">16, 17, 18, 19, 20</xref>
        ], and their potential applications include e.g. data
integration, extraction and cleaning [21, 22]. Classical relational DBs are a special case of
indefinite DBs where the information is definite, i.e., there is no disjunction of tuples.
      </p>
      <p>
        There are few interesting works addressing the problem of measuring inconsistency in
relational DBs. [23] first developed single-dependency axioms for dirtiness functions quantifying
inconsistency w.r.t. one functional dependency (FD)—a simple type of denial constraint (DC)—
considered in isolation, and proposed a measure that satisfies these axioms. Then a single axiom
for dirtiness functions that handle multiple FDs was proposed, although such functions are
supposed to be built on top of a dirtiness function for single FDs. The approach in [24, 25, 26] deals
with relational databases from the point of view of first-order logic, as in logic programming.
Its purpose is to show how database inconsistency measures (IMs) can be applied to integrity
checking [27, 28], relaxing repairs, and repair checking, which are applications that also fit within
our framework. However, the degrees of inconsistency defined in [ 26] form a partially ordered
set; hence it is not always possible to compare the inconsistency of different DBs. An IM based
on an abstract repair semantics is proposed in [29], where the degree of inconsistency depends
on the distance between the database instance and the set of possible repairs under a given repair
semantics; an instantiation for cardinality-repairs that can be computed via answer-set programs
is proposed in [30]. Provenance-informed annotations of the base tuples are used in [31, 32] to
characterize the level of inconsistency of data and query results. In particular, building upon the
computed annotations, different measures of inconsistency which consider single and multiple
violations of DCs are introduced. IMs have been considered as the basis of progress indicators
for data-cleaning systems in [33], where properties that account for operational aspects of repair
systems are introduced as well as a measure satisfying such properties. Finally, the Shapley
value [34] of tuples is investigated in [35] to calculate the contribution of a tuple to inconsistency
for inconsistent DBs w.r.t. FDs. The work in [36], which is an early version of [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], as well
as all those discussed above focus on definite DBs only. An approach to translate a general
information space into an inconsistency equivalent propositional knowledge base is introduced
in [37, 38], enabling propositional IMs to be applied also to DBs. However, this approach makes
no distinction between DB tuples and integrity constraints as it blames simultaneously tuples
and constraints without considering that inconsistency in DBs typically refers to the tuples rather
than the integrity constraints.
      </p>
      <p>
        We explore the problem of tailoring propositional inconsistency measures to indefinite (and
definite) DBs, and in particular analyze the computational complexity of the resulting
inconsistency measures for both the general case of indefinite DBs and the special case of definite DBs [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Our work contributes to understanding how the database counterpart of well-established methods
to quantify inconsistency in propositional logic behaves in the relational database context, where
data are generally the reason for inconsistency, not the integrity constraints.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Indefinite Databases</title>
      <p>We assume that the reader is familiar with the relational model and the basic concept of definite
DBs [39]. An indefinite tuple over relational scheme (1, . . . , ) is a set of (definite) tuples
over (1, . . . , ). An indefinite relation instance (or simply relation) is a finite set of indefinite
tuples over a given relation scheme, and an indefinite DB instance (database) is a set of indefinite
relations over a given DB scheme. Under the model-theoretic approach to relational DBs, an
indefinite DB is a set of minimal models [ 40] (instead of a unique model of the underlying
firstorder theory as for the case of definite DBs). Under the proof-theoretic approach, an indefinite
tuple corresponds to a logical formula with inclusive disjunctions. The information content of an
indefinite DB  consists of a set of definite DBs called possible worlds. A possible world for 
is a set of (definite) tuples that contains a tuple from each element of  and is minimal w.r.t. set
inclusion. More formally, let Def() be the set of all the definite DBs that can be obtained from
an indefinite DB  by selecting a (definite) tuple from each indefinite one in . The meaning
of  is given by the set of possible worlds  () = { |  ∈ Def(), ∄ ′ such that  ′ ∈
Def() and  ′ ⊂  }.</p>
      <p>We use the terminology element to refer to an indefinite tuple of a database . A definite DB
is a special case of an indefinite DB, where each element is a definite tuple and only one possible
world exists, that is, () = {}.</p>
      <p>Example 1. Consider a genealogical DB whose scheme  consists of the relation scheme
Ancestor (Id, Name, Birth Year, Parent, Death Year), where every record has an id and contains
the name, the birth and death year of a person as well as the name of her/his parent. An instance
 of  consisting of 7 elements (obtained from 9 different definite tuples) is shown in
Table 1. A possible world for  is {1, 3, 5, 6, 7, 8}, which is obtained from  by selecting
the tuple 1 from the elements 1 and 3, the tuples 3, 5, 6, and 7 from the singleton elements
2, 4, 5, and 6, respectively, and 8 from element 7. Let  = {3, 5, 6, 7}, the set of possible
worlds for  is () = { ∪ {1, 8},  ∪ {1, 9},  ∪ {2, 4, 8},  ∪ {2, 4, 9}}.</p>
      <p>It is worth noting that an indefinite DB may contain redundant information because an
indefinite tuple is part of another one. For instance, the database {{(1, 1), (1, 2)}, {(1, 1)}}
is equivalent to {{(1, 1)}}, that is, they have the same set of possible worlds.
Redundancy can be removed by deleting redundant tuples, that is, indefinite tuples that subsume
other tuples. This is polynomial in the number of indefinite tuples, assuming that the size
of the largest indefinite tuple is a constant (usually a small integer). In the following, we
assume that the given DB is not redundant. It is also worth noting that since each
indefinite tuple corresponds to a logical formula with inclusive disjunctions, it is possible for
more than one tuple within an indefinite tuple to be the real world truth. For instance, for
the database {{(1, 1), (1, 2)}, {(1, 1), (1, 3)}, {(1, 2), (1, 3)}}, a possible world is
{(1, 1), (1, 2)}, which is obtained from the DB by selecting the definite tuple (1, 1) from
the first two indefinite tuples and (1, 2) from the third one.</p>
      <p>A denial constraint (DC) over a database scheme  is a first-order sentence of the form:
∀ ⃗1, . . . , ⃗ [¬1(⃗1) ∨ · · · ∨ ¬ (⃗) ∨  (⃗1, . . . , ⃗)] where: (i) ∀  ∈ [1..], ⃗ are tuples
of variables and (⃗) are atoms over ; and (ii)  is a disjunction of built-in predicates
of the form   ∘   where   and   are variables in ⃗1, . . . , ⃗ or constants, and ∘ ∈ { =
, ̸=, &gt;, &lt;, ≥ , ≤} . In the following, we will omit the prefix of universal quantifiers and write
[¬1(⃗1) ∨ · · · ∨ ¬ (⃗) ∨  (⃗1, . . . , ⃗)] for a denial constraint.</p>
      <p>A functional dependency (FD) is a DC of the form [¬(⃗, , ⃗) ∨ ¬(⃗, , ⃗) ∨ ( = )]
where ⃗, ⃗, ⃗ are tuples of variables. It is written as  :  →  (or simply  →  ), where 
is the set of attributes of  corresponding to ⃗ and  is the attribute corresponding to  (and ).</p>
      <p>For a DB scheme  and a set  of integrity constraints over , an indefinite DB instance
 of  is said to be consistent w.r.t.  (denoted as  |= ) iff there is at least one possible
world of  which is consistent w.r.t.  (in the standard model-theoretic sense), that is, { |  ∈
(),  |= } ̸= ∅; otherwise,  is said to be inconsistent (w.r.t. ).</p>
      <p>Example 2. Continuing from Example 1, let  be the set of the following DCs:
∙ 1 = [¬Ancestor(1, 2, 3, 4, 5) ∨ 5 &gt; 3], stating that the death year must be greater
than the birth year.
∙ 2 = [¬Ancestor(1, 2, 3, 4, 5) ∨ ¬Ancestor(1, 6, 7, 8, 9) ∨ 2 = 6], that is the
FD Id→Name.
∙ 3 = [¬Ancestor(1, 2, 3, 4, 5) ∨ ¬Ancestor(6, 2, 7, 8, 9) ∨ ¬Ancestor(10, 2,
11, 12, 13) ∨ 4 = 8 ∨ 4 = 12 ∨ 8 = 12], that is the numerical dependency [41]
Name→2Parent stating that for every person there can be at most 2 parents.</p>
      <p>We have that  is inconsistent w.r.t. . In particular, going through the constraints we find
that 1) 2 ̸|= 1, while e.g. 3 |= 1 as one of its two tuples (disjuncts) satisfies the constraint;
2) the pairs of elements 1, 2 and 2, 3 are inconsistent with 2 (notice that {1, 3} |= 2 as
there is a world consisting of their common tuple 1 which is consistent); 3) the three elements
5, 6, and 7 together are inconsistent with 3. None of the possible worlds for  is consistent
w.r.t. , as each one violates one or more constraints (e.g., 1 is violated by all of them).</p>
    </sec>
    <sec id="sec-3">
      <title>3. Database Inconsistency Measures</title>
      <p>The idea of an inconsistency measure is to assign a nonnegative number to a knowledge base
that measures its inconsistency [42]. We introduce inconsistency measures (IMs) for indefinite
DBs with denial constraints. We use D to denote the set of all indefinite database instances over a
ifxed but arbitrary database scheme . In general, we will omit the database scheme and the set
 of integrity constraints in the terminology.</p>
      <p>Definition 1 (Inconsistency Measure). A function ℐ : D → R≥ 0 is an inconsistency measure iff
∞
the following two conditions hold for all , ′ ∈ D:
1) Consistency ℐ() = 0 iff  is consistent; 2) Monotony If  ⊆ ′, then ℐ() ≤ ℐ (′).</p>
      <p>
        Consistency and Monotony are called (rationality) postulates. We require that a function on
databases must at least satisfy these two postulates in order to be called an IM. Consistency
means that all and only consistent DBs get measure 0. Monotony means that the enlargement of a
DB cannot decrease its measure. Note that we are limiting the integrity constraints to DCs. This
means that inconsistencies cannot be resolved by insertions. This is not the case in the presence
of existential constraints, such as inclusion dependencies, where Monotony is not appropriate.
Additional postulates are given in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], where satisfaction for definite and indefinite DBs is studied.
      </p>
      <p>We now give some basic definitions needed to define IMs. A minimal inconsistent subset
(MIS) of  is a set of elements  ⊆  such that  is inconsistent (w.r.t. ) and no proper subset
of  is inconsistent. We denote by MI() the set of minimal inconsistent subsets of . Similarly,
a maximal consistent subset is a set of elements  that is consistent and no proper superset of
 is consistent. We write MC() for the set of maximal consistent subsets (of ). Any element
that occurs in a MIS is problematic; otherwise it is free. We use Problematic() and Free()
to denote the sets of problematic and free elements of . An element  is contradictory if {} is
inconsistent w.r.t. . We write Contradictory() for the set of contradictory elements.</p>
      <sec id="sec-3-1">
        <title>3.1. Measures using Minimal Inconsistent Subsets</title>
        <p>We start with the measures that rely on MISs and the related concepts defined above.
Definition 2 (Database IMs). For any DB , the IMs ℐ , ℐ , ℐ , ℐ, and ℐ are such that
• ℐ () = 1 if  is inconsistent and ℐ () = 0 if  is consistent.
• ℐ () = |MI()|.
• ℐ () = |Problematic()|.
• ℐ() = (|MC()| + |Contradictory()|) − 1.</p>
        <p>• ℐ () = min{|| ..  ⊆  and ∀ ∈ MI(),  ∩  ̸= ∅}.</p>
        <p>We explain the measures as follows. ℐ is also called the drastic measure [43]: 0 means
consistent; 1 means inconsistent. ℐ counts the number of MISs [43]. The rationale is that a MIS
represents a minimal inconsistency for a set of database elements; hence this measure counts
the number of such inconsistencies. ℐ counts the number of elements that are in one or more
minimal inconsistencies [44]. ℐ uses the cardinality of the set of maximal consistent subsets [44]
(corresponding to repairs for DBs [45]). Intuitively, the larger this set, the larger is the space of
different ways to get consistency, the higher the degree of inconsistency. Contradictory elements
are added as they do not appear in any way in a maximal consistent set; then 1 must be subtracted
to obtain ℐ() = 0 for a consistent  because every consistent DB has a maximal consistent
subset, namely  itself. ℐ counts the minimal number of elements whose deletion makes the
DB consistent [46]. Hence ℐ can be written as ℐ = min{|| ..  ∖  is consistent }. In
fact, both ℐ and ℐ link the inconsistency measurement to the ways of restoring consistency,
an idea explored for definite DBs in [ 29, 30] where the degree of inconsistency depends on the
distance between the DB and the set of possible repairs under a given repair semantics.
Example 3. Continuing with our running example, MI() = {{2}, {5, 6, 7}}. Note
that {1, 2} as well as {2, 3} are not included because they contain {2}. Thus
there are 4 problematic elements in , and 3 free elements. Also, MC() =
{{1, 3, 4, 5, 6}, {1, 3, 4, 5, 7}, {1, 3, 4, 6, 7}}. Therefore, the values of the IMs for
 are as follows. ℐ() = 1 as the database is inconsistent. ℐ () = 2 as there are
2 MISs. ℐ () = 4 as 4 elements are in MI(). ℐ() = 3 as there are 3 maximal
consistent subsets and one contradictory element (that is, 2). Finally, ℐ () = 2 as no less
than 2 elements intersect with each MIS.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. A Measure Using 3VL</title>
        <p>We now consider the Contension measure [44], which uses a three-valued (3VL) logic. A 3VL
interpretation is a function  that assigns to each atom (⃗) in  one of the three truth values: 
(true),  (false), or  (both). The logical connectives are extended to 3VL interpretations using
Priest’s three-valued logic, the Logic of Paradox [47]. This interpretation uses an ordering on
the truth values where  &lt;  &lt;  and ∧ computes the minimum value while ∨ computes the
maximum value; also ¬() = . So, for example,  ∧  =  and  ∨  = . In classical
two-valued logic, an interpretation is a model for a set of formulas if every formula gets the value
 (the unique designated value). But in 3VL there are two designated values,  and . This
means that for a given DB  with a set  of constraints, a 3VL interpretation is a 3VL model iff
all the integrity constraints and elements get the value  or . We use Models() to denote the
set of 3VL models for  (with the constraints in the background). Also, for a 3VL interpretation
 we define Conflictbase() = {(⃗) | ((⃗)) = }, the atoms that have truth value .
Definition 3 (Contension measure ℐ ). For any database , ℐ is such that ℐ () =
min{|Conflictbase()| |  ∈ Models()}.</p>
        <p>For our running example, we have that ℐ () = 2 as the minimal number of  values for
an interpretation occurs when assigning  to the tuple in 2 and a tuple in either 5 or 6.</p>
        <p>For definite DBs, it can be shown that ℐ () = ℐ (). No other pair of measures considered
in this paper is identical for definite DBs. For indefinite DBs, ℐ and ℐ need not give the same
result. For instance, ′ = {{(− 1), (− 2)}, {(− 1), (− 3)}} and ′ = {¬() ∨  &gt; 0}.,
we have that ℐ (′) = 2 &gt; ℐ (′) = 1 because both elements in ′ are self-contradictions,
while for 3VL it suffices to assign (− 1) the value  and both (− 2) and (− 3) the value 
to eliminate the inconsistency. In general, ℐ () ≤ ℐ  () holds for all indefinite DBs because
assigning  to one of the disjuncts in an element that needs removal for ℐ suffices to eliminate
the inconsistency for ℐ as well.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. A Probabilistic Measure</title>
        <p>
          Finally, we define the database counterpart of the probabilistic measure  that uses the PSAT
(probabilistic satisfiability) concept [48]. A PSAT instance is a set, Γ = { () ≥  | 1 ≤  ≤
}, that assigns probability lower bounds to a set {1, . . . , } of formulas; hence 0 ≤  ≤ 1
for 1 ≤  ≤ . A probability distribution over a set  is a function  :  → [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] such that
∑︀∈  () = 1. Let  be the set of all classical interpretations (of the set of formulas) and  a
probability distribution over . The probability of a formula  according to  is the sum of the
probabilities assigned to the interpretations assigning  to , that is,  () = ∑︀∈,()=  ()
for every formula  in the knowledge base. A PSAT instance is satisfiable if there is a probability
distribution  over  such that  () ≥  for all 1 ≤  ≤ .
        </p>
        <p>
          finds the maximum probability lower bound  that one can consistently assign to all
formulas in a knowledge base; if  is equal to 1 then the knowledge base is consistent. In our
setting, it means interpreting a DB as a PSAT instance, where every element in the DB is assigned
probability  , and every (ground) integrity constraint is assigned a probability 1. Thus, given
a DB , a set of integrity constraints , and a probability threshold  ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ], we define the
PSAT instance Γ , () = { () ≥  |  ∈ } ∪ { (()) = 1 | () is a ground constraint
for  ∈ }, which enables the following definition.
        </p>
        <p>
          Definition 4 (Probabilistic measure ℐ ). Given any DB  and a set of integrity constraints , the
inconsistency measure ℐ is such that ℐ () = 1 − max {︀  ∈ [
          <xref ref-type="bibr" rid="ref1">0, 1</xref>
          ] | Γ , () is satisfiable }︀ .
        </p>
        <p>Thus, ℐ () is one minus the maximum probability lower bound one can consistently assign
to all elements in . For the database of our running example we have that ℐ () = 1 because
the maximum probability that can be assigned to (the contradictory) element 2 is zero.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Complexity of Database Inconsistency Measures</title>
      <p>We investigate the data-complexity of the following three decision problems, which intuitively
ask if a given rational value  is, respectively, lower than, greater than, or equal to the value
returned by a given IM when applied to a given database. Observe that every IM returns a rational
number, including ℐ (as shown in [48]).</p>
      <p>Definition 5 (Lower (LV), Upper (UV), and Exact Value (EV) problems). Let ℐ be an IM.
Given a DB  over a fixed database scheme with a fixed set of constraints, and a positive value
 ∈ Q&gt;0, LVℐ (, ) is the problem of deciding whether ℐ() ≥ . Given  and a non-negative
value ′ ∈ Q≥ 0, UVℐ (, ′) is the problem of deciding whether ℐ() ≤ ′, and EVℐ (, ′) is
the problem of deciding whether ℐ() = ′.</p>
      <p>We also consider the problem of determining the IM value.</p>
      <p>Definition 6 (Inconsistency Measurement (IM) problem). Let ℐ be an inconsistency measure.
Given a DB  over a fixed database scheme with a fixed set of constraints, IMℐ () is the
problem of computing the value of ℐ().</p>
      <p>ℐ
ℐ
ℐ
ℐ
ℐ
ℐ
ℐ
def.</p>
      <p>LVℐ (, )
indefinite
  -c
  -h,  
Σ2-c
 
  -c
  -c
  -c
def.</p>
      <p>UVℐ (, )
indefinite</p>
      <p>-c
  -h,  
Π2-c
 
  -c
  -c
  -c
def.</p>
      <p>EVℐ (, )
indefinite</p>
      <p>-h, =</p>
      <p>2-c
=ℬ(  )
-c
-c

def.
 
 
 
# -c</p>
      <p>IMℐ ()
indefinite</p>
      <p>#· Σ2[]
# -h, # ·  
   [ ]-c
   [ ]-c</p>
      <p>
        A summary of the complexity results obtained for the above-mentioned problems is given
in Table 2. We found that while ℐ , ℐ , and ℐ become tractable for definite DBs and the
complexity of ℐ decreases, ℐ , ℐ and ℐ remain as hard as in the propositional case [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] even
under data complexity for both definite and indefinite DBs. Moreover, while ℐ , ℐ , and ℐ are
tractable for definite DBs, for indefinite DBs they are intractable. Specifically, the complexity of
LV, UV, and EV for ℐ and ℐ is in the first and second level of the polynomial hierarchy [ 49],
respectively, while that for ℐ relies on classes from the counting polynomial hierarchy [50] (as
that for ℐ)—we briefly recall complexity classes in Appendix A. Except for the measures ℐ ,
ℐ , and ℐ that are tractable in the case of definite DBs, for indefinite DBs the complexity of
the function problem IM ranges from being in the classes    for ℐ ,    [ ] for ℐ and
ℐ ,     for ℐ , and   Σ2[ ] for ℐ to the counting class # ·   [51], which includes
# [52], for ℐ and ℐ.
      </p>
      <p>
        It is worth noting that almost all the results in Table 2 hold even if the set of integrity constraints
consists of FDs only. On the one hand, all the membership results trivially hold for FDs since
they have been shown to hold for DCs. On the other hand, all the hardness results except the
2-hardness for EVℐ , the -hardness for EVℐ , and the     [ ]-hardness for IMℐ
can be shown to hold for FDs [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions and Future Work</title>
      <p>
        We have introduced a framework for measuring inconsistency in DBs that relies on absolute IMs,
measuring by some criteria the total amount of inconsistency. In contrast, relative IMs recently
explored in [53] provide a ratio of the amount of inconsistency w.r.t. some parameter, e.g. the
size of the DB. Many interesting issues concerning IMs in DBs remain unexplored. We plan to
extend our work to other types of integrity constraints, and in particular to inclusion dependencies.
Also, we plan to identify tractable cases for the hard measures, possibly exploiting connections
with work done on inconsistent DBs, and devise efficient algorithms for evaluating IMs. In this
regard, a dichotomy for FDs for the problem of computing the cost of a cardinality repair (that is
equivalent to computing the value of measure ℐ ) for definite DBs has been recently presented
in [54]. In fact, the polynomial-time 2-approximation given in [54] entails an approximability
result for the problem IMℐ . The IMs we have considered work at the tuple-level, without
distinguishing inconsistencies arising from different (sets of) attributes, which is another issue
we want to address in the future by following the idea of dimensional inconsistency measures
proposed in [55] for spatio-temporal databases, where the dimensions considered are those
concerning space, time, and (moving) objects [56, 57]. Finally, as indefinite DBs considered in
this paper allow the representation of a form of incomplete information (disjunctive information),
another interesting direction for future work is considering other forms of incomplete information
such as maybe information [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] as well as dealing with databases with null values [
        <xref ref-type="bibr" rid="ref16">16, 58</xref>
        ].
      </p>
    </sec>
    <sec id="sec-6">
      <title>A. Appendix: Complexity Classes</title>
      <p>The classical classes Σ , Π  and ∆ , with  ≥ 0, are defined as follows [ 49]: i) Σ 0 = Π 0 = ∆ 0 =
  
 ; ii) Σ 1 =   and Π 1 =   ; iii) ∆  =  Σ− 1 , Σ  =   Σ− 1 , and Π  = Σ , ∀ &gt; 0.
Thus,   (resp.,    ) denotes the class of the decision problems that can be solved in polynomial
tMimoereboyveurs,inagdeacnisoiroanclperionbtlheemc ilΣsasisn+1b⊆yiaffdiettiesrmthiencisotnicju(nrecstpio.,nnoofna-dpertoebrmleimnΠ isinti +cΣ)1T⊆ uanridnga mpraocbhlienme.
It holds that Σ  ⊆ ∆ +1 ⊆    and Π  ⊆ ∆ +1 ⊆   .
in Π . 1 is also denoted as . It holds that  ⊆ ∆ 2.</p>
      <p>We also use the classes  [59] and   from the counting polynomial hierarchy defined
in [50]. These classes rely on a counting quantifier  defined as follows. Given a predicate
 (, ) with free variables  and ,  (, ) holds iff |{ :  (, ) is true}| ≥ , i.e., the
counting quantifier is true for predicate  and bound  iff the number of values of  such that
 (, ) holds is at least . The polynomially bounded version of the counting quantifier is
defined as follows. Given a class  of decision problems, we say that a problem  is in  iff
there is a problem  ∈ , a polynomial-time computable function  , and a polynomial  such
that  is a positive instance of  iff ,(|)|≤ ()(, ) ∈ . That is, instance  ∈  iff there are
at least  () many ’s whose size is polynomially bounded by that of  such that a predicate
for (, ) holds, with checking the predicate being in . The class  coincides with the class
  of the decision problems that can be solved in polynomial time by a probabilistic Turing
machine [59, 50]. The relationships between the classes   ,  and   are as follows:
  ⊆  and   ⊆  . Differently from   that is closed under union and intersection
and is not known to be closed under complement, the class  is closed under complement.
Like   ,  is closed under union and intersection, though this question remained open for
several years [60]. Like  ,   is closed under complement. It holds that  ⊆   .
Moreover,   = ℬ(  ), where ℬ(  ) is the Boolean closure of   [50], that implies
that  ⊆ ℬ (  ) and   = . The class = is defined exactly as  except that the
counting quantifier holds iff it is satisfied by equality.</p>
      <p>(resp.,    ) is the class of the function problems that can be solved by a deterministic
(resp., non-deterministic) Turing machine in polynomial time.    is the class of functions
computableby a deterministic polynomial-time Turing machine using a -oracle. Thus, FP NP
(resp., FP Σ2 ) is the class of problems that can be solved by a polynomial-time Turing machine
that can ask a polynomial number of queries to an   oracle (resp., Σ 2 oracle). If a logarithmic
number of queries is asked by the machine, then we have the class FP NP[log ] (resp., FP Σ2[log ]).</p>
      <p>Finally, given a class  of decision problems, # ·  is the class of the counting problems
defined by means of witness functions  that assign to a given input  a set () of witnesses.
Herein, a counting problem returns the cardinality |()| of a set of witnesses. For the witness
function , (i) for every input , the size of every witness  ∈ () is polynomially bounded by
that of ; and (ii) given  and , deciding whether  ∈ () is in class . A canonical problem
for # ·  is counting the satisfying assignments of a SAT formula. This problem is in # [52],
which coincides with # ·  . It holds that # ·  ⊆ # ·   and # ·   = # · ∆ 2.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <p>The fist author acknowledges financial support from PNRR MUR project PE0000013-FAIR.
Computational Logic: Logic Programming and Beyond, Essays in Honour of Robert A.</p>
      <p>Kowalski, Part I, 2002, pp. 472–511.
[20] M. Alviano, W. Faber, N. Leone, S. Perri, G. Pfeifer, G. Terracina, The disjunctive datalog
system DLV, in: Proc. of International Workshop on Datalog, 2010, pp. 282–301.
[21] O. Benjelloun, A. D. Sarma, A. Y. Halevy, M. Theobald, J. Widom, Databases with
uncertainty and lineage, VLDB J. 17 (2008) 243–264.
[22] C. Molinaro, J. Chomicki, J. Marcinkowski, Disjunctive databases for representing repairs,</p>
      <p>Ann. Math. Artif. Intell. 57 (2009) 103–124.
[23] M. V. Martinez, A. Pugliese, G. I. Simari, V. S. Subrahmanian, H. Prade, How dirty is
your relational database? an axiomatic approach, in: Proc. of European Conference on
Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU), 2007,
pp. 103–114.
[24] H. Decker, Inconsistency-tolerant database repairs and simplified repair checking by
measure-based integrity checking, T. Large-Scale Data- and Knowledge-Centered Systems
34 (2017) 153–183.
[25] H. Decker, S. Misra, Database inconsistency measures and their applications, in: Proc. of
International Conference on Information and Software Technologies (ICIST), 2017, pp.
254–265.
[26] H. Decker, Measuring database inconsistency, in: J. Grant, M. V. Martinez (Eds.), Measuring</p>
      <p>Inconsistency in Information, College Publications, 2018, pp. 271–311.
[27] H. Decker, D. Martinenghi, Classifying integrity checking methods with regard to
inconsistency tolerance, in: Proc. of International Conference on Principles and Practice of
Declarative Programming (PPDP), 2008, pp. 195–204.
[28] H. Decker, D. Martinenghi, Inconsistency-tolerant integrity checking, IEEE Trans. Knowl.</p>
      <p>Data Eng. 23 (2011) 218–234.
[29] L. E. Bertossi, Measuring and computing database inconsistency via repairs, in: Proc. of</p>
      <p>International Conference on Scalable Uncertainty Management (SUM), 2018, pp. 368–372.
[30] L. E. Bertossi, Repair-based degrees of database inconsistency, in: Proc. of Logic
Programming and Nonmonotonic Reasoning (LPNMR), 2019, pp. 195–209.
[31] O. Issa, A. Bonifati, F. Toumani, Evaluating top-k queries with inconsistency degrees, Proc.</p>
      <p>VLDB Endow. 13 (2020) 2146–2158.
[32] O. Issa, A. Bonifati, F. Toumani, INCA: inconsistency-aware data profiling and querying,
in: Proc. of International Conference on Management of Data (SIGMOD), 2021, pp. 2745–
2749.
[33] E. Livshits, R. Kochirgan, S. Tsur, I. F. Ilyas, B. Kimelfeld, S. Roy, Properties of
inconsistency measures for databases, in: Proc. of International Conference on Management of
Data (SIGMOD), 2021, pp. 1182–1194.
[34] K. Hausken, M. Mohr, The value of a player in n-person games, Soc. Choice Welf. 18
(2001) 465–483.
[35] E. Livshits, B. Kimelfeld, The shapley value of inconsistency measures for functional
dependencies, in: Proc. of International Conference on Database Theory (ICDT), volume
186, 2021, pp. 15:1–15:19.
[36] F. Parisi, J. Grant, On measuring inconsistency in relational databases with denial
constraints, in: Proc. of European Conference on Artificial Intelligence (ECAI), 2020, pp.
857–864.
[37] J. Grant, F. Parisi, Measuring inconsistency in a general information space, in: Proc. of
International Symposium on Foundations of Information and Knowledge Systems (FoIKS),
2020, pp. 140–156.
[38] J. Grant, F. Parisi, General information spaces: measuring inconsistency, rationality
postulates, and complexity, Ann. Math. Artif. Intell. 90 (2022) 235–269.
[39] S. Abiteboul, R. Hull, V. Vianu, Foundations of Databases, Addison-Wesley, 1995.
[40] J. Minker, On indefinite databases and the closed world assumption, in: Proc. of the 6th</p>
      <p>Conference on Automated Deduction, 1982, pp. 292–308.
[41] J. Grant, J. Minker, Inferences for numerical dependencies, Theoretical Computer Science
41 (1985) 271–287.
[42] M. Thimm, On the evaluation of inconsistency measures, in: J. Grant, M. V. Martinez
(Eds.), Measuring Inconsistency in Information, College Publications, 2018, pp. 19–60.
[43] A. Hunter, S. Konieczny, Measuring inconsistency through minimal inconsistent sets,
in: Proc. of International Conference on Principles of Knowledge Representation and
Reasoning (KR), 2008, pp. 358–366.
[44] J. Grant, A. Hunter, Measuring consistency gain and information loss in stepwise
inconsistency resolution, in: Proc. of European Conference Symbolic and Quantitative Approaches
to Reasoning with Uncertainty (ECSQARU), 2011, pp. 362–373.
[45] M. Arenas, L. E. Bertossi, J. Chomicki, Consistent query answers in inconsistent databases,
in: Proc. of Symposium on Principles of Database Systems (PODS), 1999, pp. 68–79.
[46] J. Grant, A. Hunter, Distance-based measures of inconsistency, in: Proc. of European
Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
(ECSQARU), 2013, pp. 230–241.
[47] G. Priest, Logic of paradox, Journal of Philosophical Logic 8 (1979) 219–241.
[48] K. Knight, Measuring inconsistency, J. Philosophical Logic 31 (2002) 77–98.
[49] C. H. Papadimitriou, Computational complexity, Addison-Wesley, Reading, Massachusetts,
1994.
[50] K. W. Wagner, The complexity of combinatorial problems with succinct input representation,</p>
      <p>Acta Inf. 23 (1986) 325–356.
[51] L. A. Hemaspaandra, H. Vollmer, The satanic notations: counting classes beyond #P and
other definitional adventures, SIGACT News 26 (1995) 2–13.
[52] L. G. Valiant, The complexity of computing the permanent, Theor. Comput. Sci. 8 (1979)
189–201.
[53] F. Parisi, J. Grant, Relative inconsistency measures for indefinite databases with denial
constraints, in: Proc. of International Joint Conference on Artificial Intelligence (IJCAI),
2023.
[54] E. Livshits, B. Kimelfeld, S. Roy, Computing optimal repairs for functional dependencies,</p>
      <p>ACM Trans. Database Syst. 45 (2020) 4:1–4:46.
[55] J. Grant, M. V. Martinez, C. Molinaro, F. Parisi, Dimensional inconsistency measures and
postulates in spatio-temporal databases, J. Artif. Intell. Res. 71 (2021) 733–780.
[56] J. Grant, F. Parisi, A. Parker, V. S. Subrahmanian, An agm-style belief revision mechanism
for probabilistic spatio-temporal logics, Artif. Intell. 174 (2010) 72–104.
[57] F. Parisi, J. Grant, On repairing and querying inconsistent probabilistic spatio-temporal
databases, Int. J. Approx. Reason. 84 (2017) 41–74.
[58] R. van der Meyden, Logical approaches to incomplete information: A survey, in: Logics
for Databases and Information Systems (the book grow out of the Dagstuhl Seminar 9529:
Role of Logics in Information Systems, 1995), 1998, pp. 307–356.
[59] J. Simon, On the difference between one and many (preliminary version), in: Proceedings
of Fourth Colloquium on Automata, Languages and Programming (ICALP), 1977, pp.
480–491.
[60] R. Beigel, N. Reingold, D. A. Spielman, PP is closed under intersection, J. Comput. Syst.</p>
      <p>Sci. 50 (1995) 191–202.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>F.</given-names>
            <surname>Parisi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Grant</surname>
          </string-name>
          ,
          <article-title>On measuring inconsistency in definite and indefinite databases with denial constraints</article-title>
          ,
          <source>Artificial Intelligence</source>
          <volume>318</volume>
          (
          <year>2023</year>
          )
          <fpage>103884</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>A. Y. Levy,</surname>
          </string-name>
          <article-title>Combining artificial intelligence and databases for data integration</article-title>
          ,
          <source>in: Artificial Intelligence Today: Recent Trends and Developments</source>
          , Springer,
          <year>1999</year>
          , pp.
          <fpage>249</fpage>
          -
          <lpage>268</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Jain</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Patel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Nagalapatti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Gupta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mehta</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. C.</given-names>
            <surname>Guttula</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Mujumdar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Afzal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. S.</given-names>
            <surname>Mittal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Munigala</surname>
          </string-name>
          ,
          <article-title>Overview and importance of data quality for machine learning tasks</article-title>
          , in: KDD, ACM,
          <year>2020</year>
          , pp.
          <fpage>3561</fpage>
          -
          <lpage>3562</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>I. H.</given-names>
            <surname>Sarker</surname>
          </string-name>
          ,
          <article-title>Data science and analytics: An overview from data-driven smart computing, decision-making and applications perspective</article-title>
          ,
          <source>SN Comput. Sci. 2</source>
          (
          <year>2021</year>
          )
          <fpage>377</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>J.</given-names>
            <surname>Grant</surname>
          </string-name>
          ,
          <article-title>Classifications for inconsistent theories</article-title>
          ,
          <source>Notre Dame Journal of Formal Logic XIX</source>
          (
          <year>1978</year>
          )
          <fpage>435</fpage>
          -
          <lpage>444</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Grant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. V.</given-names>
            <surname>Martinez</surname>
          </string-name>
          , Measuring Inconsistency in Information, College Publications,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          ,
          <article-title>On the expressivity of inconsistency measures</article-title>
          ,
          <source>Artif. Intell</source>
          .
          <volume>234</volume>
          (
          <year>2016</year>
          )
          <fpage>120</fpage>
          -
          <lpage>151</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>K.</given-names>
            <surname>Mu</surname>
          </string-name>
          ,
          <article-title>Measuring inconsistency with constraints for propositional knowledge bases, Artif</article-title>
          . Intell.
          <volume>259</volume>
          (
          <year>2018</year>
          )
          <fpage>52</fpage>
          -
          <lpage>90</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>G. D.</given-names>
            <surname>Bona</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Grant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hunter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Konieczny</surname>
          </string-name>
          ,
          <article-title>Classifying inconsistency measures using graphs</article-title>
          ,
          <source>J. Artif. Intell. Res</source>
          .
          <volume>66</volume>
          (
          <year>2019</year>
          )
          <fpage>937</fpage>
          -
          <lpage>987</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. P.</given-names>
            <surname>Wallner</surname>
          </string-name>
          ,
          <article-title>On the complexity of inconsistency measurement</article-title>
          ,
          <source>Artif. Intell</source>
          .
          <volume>275</volume>
          (
          <year>2019</year>
          )
          <fpage>411</fpage>
          -
          <lpage>456</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>P.</given-names>
            <surname>Besnard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Grant</surname>
          </string-name>
          , Relative inconsistency measures,
          <source>Artif. Intell</source>
          .
          <volume>280</volume>
          (
          <year>2020</year>
          )
          <article-title>103231</article-title>
          . doi:https://doi.org/10.1016/j.artint.
          <year>2019</year>
          .
          <volume>103231</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>M.</given-names>
            <surname>Ulbricht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Thimm</surname>
          </string-name>
          , G. Brewka,
          <article-title>Handling and measuring inconsistency in nonmonotonic logics</article-title>
          ,
          <source>Artif. Intell</source>
          .
          <volume>286</volume>
          (
          <year>2020</year>
          )
          <fpage>103344</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>K.</given-names>
            <surname>Mu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Jin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Lu</surname>
          </string-name>
          , W. Liu,
          <article-title>Measuring inconsistency in requirements specifications</article-title>
          ,
          <source>in: Proc. of European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU)</source>
          ,
          <year>2005</year>
          , pp.
          <fpage>440</fpage>
          -
          <lpage>451</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>L.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Huang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Qi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Huang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Qu</surname>
          </string-name>
          ,
          <article-title>Measuring inconsistency in DL-Lite ontologies</article-title>
          ,
          <source>in: Proc. of International Conference on Web Intelligence (WI)</source>
          ,
          <year>2009</year>
          , pp.
          <fpage>349</fpage>
          -
          <lpage>356</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>X.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ma</surname>
          </string-name>
          , G. Qi,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Feng</surname>
          </string-name>
          ,
          <article-title>A distance-based framework for inconsistency-tolerant reasoning and inconsistency measurement in DL-Lite, Int</article-title>
          .
          <source>J. Approx. Reasoning</source>
          <volume>89</volume>
          (
          <year>2017</year>
          )
          <fpage>58</fpage>
          -
          <lpage>79</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>J.</given-names>
            <surname>Grant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Minker</surname>
          </string-name>
          ,
          <article-title>Answering queries in indefinite databases and the null value problem</article-title>
          ,
          <source>Adv. Comput. Res</source>
          .
          <volume>3</volume>
          (
          <year>1986</year>
          )
          <fpage>247</fpage>
          -
          <lpage>267</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>K. C. Liu</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Sunderraman</surname>
          </string-name>
          ,
          <article-title>Indefinite and maybe information in relational databases</article-title>
          ,
          <source>ACM Trans. Database Syst</source>
          .
          <volume>15</volume>
          (
          <year>1990</year>
          )
          <fpage>1</fpage>
          -
          <lpage>39</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>T.</given-names>
            <surname>Imielinski</surname>
          </string-name>
          , R. van der Meyden,
          <string-name>
            <given-names>K. V.</given-names>
            <surname>Vadaparty</surname>
          </string-name>
          ,
          <article-title>Complexity tailored design: A new design methodology for databases with incomplete information</article-title>
          ,
          <source>J. Comput. Syst. Sci</source>
          .
          <volume>51</volume>
          (
          <year>1995</year>
          )
          <fpage>405</fpage>
          -
          <lpage>432</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>J.</given-names>
            <surname>Minker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Seipel</surname>
          </string-name>
          ,
          <article-title>Disjunctive logic programming: A survey and assessment</article-title>
          , in:
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>