<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Pouya Khani</string-name>
          <email>pouya.khani@cs.au.dk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ira Assent</string-name>
          <email>ira@cs.au.dk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Explainability, Query Answering, Data Analytics, Explainable Data Management</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, Aarhus University</institution>
          ,
          <addr-line>Aarhus</addr-line>
          ,
          <country country="DK">Denmark</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Aggregate queries are essential for summarizing data and obtaining condensed information. Explaining such queries-by identifying how specific predicates influence the result-provides deeper insights into the factors shaping query outcomes. However, existing statistical, interventional, and game theoretic explanation methods lack causal grounding, while causal methods require complete causal graphs, which are rarely available in large databases. To address this, we propose Causal Banzhaf Value (CBV): introducing causal awareness into Banzhaf values, our CBV method delivers explanations even in the absence of full causal graphs. Experiments on real world data demonstrate that CBV is computationally eficient, aligns with human intuition, and is consistent with causal explanations.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        The increasing reliance on data-driven decision-making in
ifelds such as business, healthcare, and science amplifies the
importance of query explanations in understanding patterns,
trends, and anomalies [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1, 2, 3</xref>
        ]. Aggregate queries, such as
averages or sums, play a pivotal role in summarizing
highdimensional data but pose challenges for understandability.
Analysts often need explanations, such as the contributions
of individual data segments or predicates1 to understand
results, especially in high-dimensional datasets where
interactions and dependencies are complex [
        <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
        ].
      </p>
      <p>Example</p>
      <p>
        Consider the Stack Overflow Developer Survey
[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] with features such as age, developer role, education level,
and salary. An analyst might pose the aggregate query
      </p>
      <p>SELECT AVG(Salary) FROM StackOverflow;
to retrieve the average salary. Still, understanding why it takes
a specific value requires additional explanation; e.g., predicate
{Role = C-level Executive} might increase salary, while
{Age = 25} might decrease it. Aggregate query explanation
breaks down results into additive contributions of predicates,
enabling analysts to identify key factors and make informed
decisions or policy recommendations.</p>
      <p>
        However, accurately attributing the importance of
individual predicates is challenging due to feature
interdependencies and causal relationships. Existing techniques, such
as DIFF [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] or MacroBase [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], fail to capture these
dependencies, while game-theoretic methods like Shapley [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and
Banzhaf values [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] lack causal awareness [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Causal
approaches, including XInsight [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and CauSumX [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], rely
on fully specified causal models, which are often
computationally expensive and impractical to construct [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        To address these limitations, we introduce Causal
Banzhaf Values (CBV), a novel approach for causally
informed query explanations. CBV integrates causal
knowledge of feature dependencies and employs conditional
sampling [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] to estimate contributions accurately. E.g., it
accounts for interdependence between Age and Education,
guages and Analytical Processing of Big Data, co-located with EDBT/ICDT
∗Corresponding author.
0000-0002-4786-0572 (P. Khani); 0000-0002-1091-9948 (I. Assent)
1Please note that we use the term ”predicate” to refer to feature values
for explanations rather than to selection predicates in SQL queries.
© 2025 Copyright for this paper by its authors. Use permitted under Creative Commons License
ensuring causal information is reflected in the explanation.
Unlike methods focusing on entire features, CBV
evaluates the importance of predicates, ofering more granular
insights. For example, identifying that Role = C-level
drives salary outcomes is more informative than
attributing importance to feature Role. Moreover, CBV does not
require a fully specified causal graph, making it suitable for
scenarios where defining complete causal models is
infeasible. Finally, CBV is computationally eficient, balancing
accuracy with practicality for real-world applications.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. Related</title>
    </sec>
    <sec id="sec-3">
      <title>Work</title>
      <p>
        Statistical query explanation, e.g. [
        <xref ref-type="bibr" rid="ref2 ref4">2, 4</xref>
        ], finds associations;
relational methods, e.g. [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], trace data transformations
through relational operations like joins. Intervention-based
approaches, e.g. [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], detect outliers in aggregate queries.
All lack the ability to provide causal explanations.
Gametheoretic methods like Shapley [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and Banzhaf values [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ],
capture interactions between features, but assume feature
independence and disregard causal relationships [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Also,
the computational demands of simulating interventional
scenarios grow exponentially with dimensionality, limiting
scalability. OLAP explanations mostly focus on predefined
query structures (cubes) rather than analyzing feature
interactions. [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] extend OLAP operations with abstract
highlevel interpretability mechanisms, such as unexpectedness.
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] annotate OLAP cubes, focusing on statistical rather
than causal relationships [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. Causal approaches, such
as XInsight [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and CauSumX [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], assume fully specified
causal models between all features, which are often dificult
or infeasible to construct [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], or even completely
unavailable, depending on the domain. Still, some knowledge about
causal feature interactions is usually available, e.g., from
domain knowledge or causal knowledge discovery approaches.
Our approach can leverage partial causal knowledge,
meaning CBV can operate even when no complete causal graph
is available. This makes it more practical than fully
interventional causal methods, while still incorporating causal
awareness beyond statistical or game-theoretic methods.
      </p>
    </sec>
    <sec id="sec-4">
      <title>3. Predicate Attribution</title>
      <p>The Banzhaf Value quantifies the influence of each
predicate (feature-value pair) on a query outcome by computing
its marginal contribution across all possible subsets of
predicates. Given a function  ∶ 2  → ℝ that assigns a value to
CEUR</p>
      <p>ceur-ws.org
each subset  of predicates, representing the query result
(e.g., average salary), the Banzhaf Value of predicate ( = )
(feature  with value  ) is:
 (=)
= 2−11</p>
      <p>∑
⊆ ∖{(=)}
[ ( ∪ {( = )}) −  ()</p>
      <p>
        Banzhaf Value is particularly suited here because it
considers subsets, so is inherently order-independent. This
aligns with query explanations, where order of predicates
does not influence their contribution (e.g., {Education
= Master's, Developer Role = CTO} is equivalent to
{Developer Role = CTO, Education = Master's}). In
contrast, Shapley Value [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] relies on coalition-based
marginal contributions which inherently consider order.
Banzhaf Value computation is thus more eficient, as it
avoids the factorial complexity of Shapley Value [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>Banzhaf Value (BV) ofers a systematic framework for
attributing contributions by evaluating all possible subsets of
predicates. However, its limitations become evident when
applied to aggregate query explanations. BV assumes
independence among predicates, overlooking dependencies such
as between Age = 10 and Education level = Doctoral
Degree. This lack of causal awareness leads to
misrepresentation of contributions. Also, BV distributes contributions
symmetrically, failing to account for the hierarchical and
asymmetric nature of causal chains (e.g., Education afects
Role, which influences Salary). As a result, foundational
predicates are undervalued. BV also incurs high
computational overhead by evaluating all subsets exhaustively,
which becomes impractical for high-dimensional datasets.
CBV addresses these issues by integrating causal
knowledge via partial DAGs to respect predicate dependencies,
enabling accurate attribution. Unlike BV, CBV attributes
contributions to specific predicate-value pairs, capturing
their individual impacts while reflecting causal asymmetry.
By focusing on causally valid subsets and using sampling
techniques, CBV achieves eficiency without sacrificing
accuracy. For predicates without causal ancestors, CBV
defaults to BV, ensuring consistency.</p>
    </sec>
    <sec id="sec-5">
      <title>4. Causal Banzhaf Value</title>
      <p>Traditional Banzhaf Value fairly attributes contributions by
averaging marginal efects but assumes feature
independence. For instance, in a causal chain where Education</p>
      <p>Years
Coding</p>
      <p>Age
Major</p>
      <p>Salary</p>
      <p>Student</p>
      <p>Education
Developer
role</p>
      <p>Level influences Job Role, which then afects Salary, it
treats Education Level and Job Role as independent
contributors, potentially misestimating their true impact.</p>
      <p>
        We propose the Causal Banzhaf Value (CBV), which
incorporates causal knowledge into attribution by working
with partial causal graphs to leverage available knowledge
without requiring complete DAGs. CBV focuses on causally
valid subsets to maintain consistency and employs
conditional sampling to estimate contributions eficiently. This
combination of partial causal integration, flexibility, and
eficiency makes CBV a practical alternative to causal
methods. Unlike Banzhaf value in Explainable AI [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], which
focuses on features, CBV evaluates the contributions of
feature values (predicates). This aligns with query explanation
needs, where specific feature values, such as Role =
Clevel, drive outcomes. Here, causal relationships are at
attribute level (e.g., Education), and contributions at predicate
level (e.g., ”Master’s”). Predicate-level causal relationships
are left for future work.
      </p>
      <p>CBV incorporates causal dependencies by considering
causally valid subsets of features, defined based on a partial
directed acyclic graph (DAG)  : for each feature  , we
identify its ancestors   = { ∈  ∣  ≺  } , where ≺ represents
the causal ordering in  (Algorithm 1, line 2). Then, we
identify the set of all causally valid subsets for feature  ,
denoted as   (Algorithm 1, line 3):</p>
      <p>← { ∣   ⊆ ,  ⊆  ∖ {,  }},
Thus, a subset  is valid if it contains all causal ancestors
of  (  ), and contains neither feature  itself nor the
target variable  . This ensures that attributions respect the
known causal structure, while otherwise adopting the
assumption of order independence as in the Banzhaf value for
feature combinations where order is not known to impact
outcomes. For example,  ( Gender = Male ∣ Education =
Bachelor's, Age = 25) is identical to  ( Gender = Male ∣
Age = 25, Education = Bachelor's).</p>
      <p>The Causal Banzhaf Value (CBV)  C for a predicate
( op ) of feature  , a comparison operator  such as
equality =, and value  is defined as:</p>
      <p>C 1
 ( op ) = 2−1
∑ ∑ [ ( r ∪ {( op )}) −  (
∈  r∈ℛ()
r)] ,
where ℛ() is the set of all possible realizations (value
assignments) of features in subset  , and  ( r) is the expected
value of the target variable  conditioned on subset  with
realization r. For simplicity, we adopt the equality operator,
i.e. predicate ( = ) , in the following presentation.</p>
      <p>
        To estimate  ( r) and  ( r ∪ {( = )}) , we employ
conditional sampling [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], which maintains feature dependencies
and provides high estimation accuracy. For each subset  ,
realizations r() are sampled from the empirical distribution
 ( )̂ (Algorithm 1, line 7), while features not in  ∪ {} are
sampled conditionally as x() ∼  ( ∖̂( ∪ {}) ∣  = r() )
(Algorithm 1, line 8). These samples allow the estimation of
the expected value  ( r) (Algorithm 1, line 13):
 ( r) ←
1
      </p>
      <p>∑  ( r() , x() ),
 =1
and similarly for  ( r ∪ {( = )}) , where ( = )
during sampling (Algorithm 1, line 14):
is fixed
 ( r ∪ {( = )}) ←
1</p>
      <p>∑  ( r() ,  = , x(=) ).</p>
      <p>=1
Here,  ( r() , x() ) is the estimated value of target variable 
given a sampled realization r() of the subset  (Algorithm
1, line 9), and x() , which includes the sampled values for all
features not in  ∪ {} . This term reflects the target outcome
based on the sampled configuration of the subset  and
the conditionally sampled remaining features. Similarly,
 ( r() ,  = , x(=) ) captures target variable  under the same
realization of  , but with feature  explicitly set to value 
(Algorithm 1, line 10). The term x(=) corresponds to the
sampled values of the remaining features conditioned on
 = r() and  =  . By setting  =  , this estimate reflects
the impact of the specific value  for feature  on the target
variable  , considering the dependencies defined in the data
distribution (Algorithm 1, line 11).</p>
      <p>Example Respecting causal dependencies (Fig. 1), for e.g.
Education = Master's , CBV finds causally valid subsets
 Education, and for each  ∈  Education, marginal contribution
 ( r∪{( Education = Master's )})− ( r), where  ( r) is the
average salary conditioned on r, the realization of predicates
in  . CBV aggregates these contributions across all subsets and
realizations to quantify causally consistent importance.</p>
      <p>
        Enumerating all subsets and performing conditional
sampling can be computationally intensive, especially for
highdimensional datasets. To address this, We propose to
approximate CBV by employing Monte Carlo sampling [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], which
involves randomly selecting a suitable number of subsets 
from   and estimating the corresponding expected values.
This approach balances eficiency and accuracy (Alg. 1).
      </p>
    </sec>
    <sec id="sec-6">
      <title>5. Experimental Evaluation</title>
      <p>
        We implement Banzhaf Value (BV) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and Causal Banzhaf
Value (CBV) using PyTorch with GPU acceleration on
an NVIDIA T4 GPU, with 500 Monte Carlo samples for
marginal contribution estimates via conditional sampling.
Experiments are conducted on Stack Overflow Developer
Survey [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], ofering insights into developer demographics,
education, roles, and salaries. A partial causal DAG is
created from the complete version in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] by excluding one
feature and several edges, see Figure 1.
      </p>
      <p>Figure 2 illustrates BV and CBV contributions for
different features (plots (a)-(g)), and for diferent equality and
range predicates. For features without ancestors in the DAG
(race/ethnicity, age in Fig. 2g, Fig. 2f), BV and CBV produce
identical results, as causal dependencies are absent. We now
discuss cases where CBV and BV difer.</p>
      <p>For FormalEducation (Fig. 2a), BV underestimates
contributions of advanced degrees (Doctoral, Master’s,
Professional) and overestimates those of elementary and secondary
Algorithm 1 CBV
Require: Dataset  , features  = {1, 2, … , } , target variable  ;
partial causal DAG  ; number of samples</p>
      <p>CBV for all features  ∈  and unique
Ensure: Contributions  (=)</p>
      <p>values for that feature  ∈  
1: for  ∈  do
2:   ← { ∈  ∣  ≺  }
3:   ← { ∣   ⊆ ,  ⊆  ∖ {,  }}
4: for  ∈   do
5: for  ∈   do
6: for  = 1 to  do
7: r() ∼  ()̂
8: x() ∼  (̂ ∖(∪{}) ∣  = r() )
9:  () =  ( r() , x() )
10: x(=) ∼  (̂ ∖(∪{}) ∣  = r() , ( = ))
11:  (( =)) =  ( r() , ( = ), x(=) )
12: end for
 ( r) ←
1</p>
      <p>∑ ()
 =1
 ( r ∪ {( = )}) ←</p>
      <p>()
← 2−11 [ ( r ∪ {( ==∑1)})(=−)  (
1 
r)]
13:
14:
15:  (C=B)V
16: end for
17: end for
18: end for
school by treating all efects as direct, ignoring downstream
roles like developer role and upstream factors like Age, which
significantly drive salaries. A notable example is ”No Formal
Education”, which BV incorrectly attributes as highly
important for higher salaries. CBV reveals that its apparent
importance is actually due to its causal ancestor Age—many
individuals in the dataset with no formal education are older and
hold senior roles. For UndergradMajor (Fig. 2b), BV
overestimates contributions for fields like Mathematics and Social
Science, which often afect salaries indirectly through roles
or skills. CBV reduces these contributions while increasing
contributions for fields like Computer Science, which have
direct links to high-paying roles, aligning better with
domain knowledge in the causal model. For DevType (Fig. 2c),
BV misses the importance of roles like Marketing and
Clevel. CBV redistributes contributions, assigning higher
values to roles like C-level, influenced by education and
age (experience), and lower values to roles like Marketing.
While negative attribution to ”Marketing”, and minor
attribution to ”Student” may be surprising, it actually captures
the underlying causality: Age is ancestor of DevType.
Students tend to be young, and with limited work experience,
which is captured by CBV. People in marketing roles
exhibit a diferent distribution concerning age and experience,
where others with similar age and experience tend to have
higher salaries. Unlike BV, CBV recognizes this pattern. For
YearsCoding (Fig. 2d), BV attributes all contributions directly
to coding experience, inflating the importance of mid-level
ranges (12–14 years, 15–17 years). CBV incorporates the
causal dependency of YearsCoding on Age, recognizing that
older individuals naturally accumulate more experience,
which indirectly influences salary. This adjustment results
in more accurate contributions. For Student status (Fig. 2e),
BV suggests similar contributions for full-time and part-time
students, which contradicts domain knowledge, as full-time
students typically have less time for work and lower salaries.
This issue arises because BV ignores Age as an ancestor of
student status in the DAG, which appears to be the main
cause for salary levels, whereas CBV contributions are in
(a) Predicates in Formal Education
(b) Predicates in Undergraduate Major
(c) Predicates in Developer Type
(d) Predicates in Years Coding
(e) Predicates in Student
(f) Predicates in Race / Ethnicity
(g) Predicates in Age
line with domain knowledge. For race/ethnicity
(RaceEthnicity, Fig. 2f) and Age (Age, Fig. 2g), BV and CBV results
coincide exactly, as the DAG has no causal incoming edges
for these features. Both methods highlight disparities in
salary outcomes for e.g. Native Americans and higher age.</p>
      <p>CBV is much faster than BV ( Fig. 3). By focusing only
on causally valid subsets, CBV avoids unnecessary
computations on infeasible configurations, substantially reducing
runtime. This improvement is especially notable for
features with many causal dependencies, such as developer role.
Even with Monte Carlo sampling applied to both methods,
CBV is faster as it limits sampling and evaluation to valid
combinations, reducing overhead and efort. For features
age and race/ethnicity, without causal parents, BV and CBV
produce identical results represented as a single bar for both.</p>
    </sec>
    <sec id="sec-7">
      <title>6. Conclusion and Future Work</title>
      <p>CBV presents a novel eficient causally consistent method
for predicate attribution for aggregate query explanations,
addressing the limitations of traditional game-theoretic or
causal methods. CBV integrates partial causal knowledge
without requiring complete causal graphs, making it a
valuable contribution in practice. In real-world applications
where causal knowledge is incomplete, the quality of
explanations naturally depends on how well the available
causal information reflects actual data-generating
mechanisms. While conditional sampling preserves feature
dependencies and enhances accuracy, it introduces computational
overhead, particularly in high-dimensional settings. CBV
could be extended to handle continuous domains directly,
without the need to define predicate ranges (e.g., for age).</p>
    </sec>
    <sec id="sec-8">
      <title>7. Acknowledgments</title>
      <p>This work is part of RELAX (Grant Agreement No.
101072456), supported by Marie Skłodowska-Curie Actions.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>P.</given-names>
            <surname>Ma</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Ding</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Wang</surname>
          </string-name>
          , S. Han,
          <string-name>
            <surname>D</surname>
          </string-name>
          . Zhang, Xinsight:
          <article-title>explainable data analysis through the lens of causality</article-title>
          ,
          <source>Proceedings of the ACM on Management of Data</source>
          <volume>1</volume>
          (
          <year>2023</year>
          )
          <fpage>1</fpage>
          -
          <lpage>27</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>F.</given-names>
            <surname>Abuzaid</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Kraft</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Suri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Gan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Xu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Shenoy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Ananthanarayan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Sheu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Meijer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Wu</surname>
          </string-name>
          , et al.,
          <article-title>Dif: a relational interface for large-scale data explanation</article-title>
          ,
          <source>The VLDB Journal</source>
          <volume>30</volume>
          (
          <year>2021</year>
          )
          <fpage>45</fpage>
          -
          <lpage>70</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.</given-names>
            <surname>Meliou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Gatterbauer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. F.</given-names>
            <surname>Moore</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Suciu</surname>
          </string-name>
          ,
          <article-title>The complexity of causality and responsibility for query answers and non-answers</article-title>
          ,
          <source>arXiv preprint arXiv:1009</source>
          .
          <year>2021</year>
          (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>P.</given-names>
            <surname>Bailis</surname>
          </string-name>
          , E. Gan,
          <string-name>
            <given-names>S.</given-names>
            <surname>Madden</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Narayanan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Rong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Suri</surname>
          </string-name>
          , Macrobase:
          <article-title>Prioritizing attention in fast data</article-title>
          ,
          <source>in: Proceedings of the 2017 ACM International Conference on Management of Data</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>541</fpage>
          -
          <lpage>556</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Miao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Zeng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Glavic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Roy</surname>
          </string-name>
          ,
          <article-title>Going beyond provenance: Explaining query answers with patternbased counterbalances</article-title>
          ,
          <source>in: Proceedings of the 2019 International Conference on Management of Data</source>
          ,
          <year>2019</year>
          , pp.
          <fpage>485</fpage>
          -
          <lpage>502</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Stack</given-names>
            <surname>Overflow</surname>
          </string-name>
          , Developer Survey,
          <year>2021</year>
          . URL: https: //survey.stackoverflow.co/
          <year>2021</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>L. S.</given-names>
            <surname>Shapley</surname>
          </string-name>
          ,
          <article-title>A value for n-person games, Contributions to the Theory of Games 2 (</article-title>
          <year>1953</year>
          )
          <fpage>307</fpage>
          -
          <lpage>317</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J. F.</given-names>
            <surname>Banzhaf</surname>
          </string-name>
          <string-name>
            <surname>III</surname>
          </string-name>
          ,
          <article-title>Weighted voting doesn't work: A mathematical analysis</article-title>
          ,
          <source>Rutgers Law Review</source>
          <volume>19</volume>
          (
          <year>1965</year>
          )
          <fpage>317</fpage>
          -
          <lpage>343</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>T.</given-names>
            <surname>Heskes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Sijben</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I. G.</given-names>
            <surname>Bucur</surname>
          </string-name>
          , T. Claassen,
          <article-title>Causal shapley values: Exploiting causal knowledge to explain individual predictions of complex models</article-title>
          ,
          <source>Advances in neural information processing systems</source>
          <volume>33</volume>
          (
          <year>2020</year>
          )
          <fpage>4778</fpage>
          -
          <lpage>4789</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>B.</given-names>
            <surname>Youngmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cafarella</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gilad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Roy</surname>
          </string-name>
          ,
          <article-title>Summarized causal explanations for aggregate views</article-title>
          ,
          <source>Proceedings of the ACM on Management of Data</source>
          <volume>2</volume>
          (
          <year>2024</year>
          )
          <fpage>1</fpage>
          -
          <lpage>27</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>S.</given-names>
            <surname>Chakraborty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Fischer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Goldhirsh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Matsliah</surname>
          </string-name>
          ,
          <article-title>On the power of conditional samples in distribution testing</article-title>
          ,
          <source>in: Proceedings of the 4th conference on Innovations in Theoretical Computer Science</source>
          ,
          <year>2013</year>
          , pp.
          <fpage>561</fpage>
          -
          <lpage>580</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>C.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Miao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q.</given-names>
            <surname>Zeng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Glavic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Roy</surname>
          </string-name>
          ,
          <article-title>Putting things into context: Rich explanations for query answers using join graphs</article-title>
          ,
          <source>in: Proceedings of the 2021 International Conference on Management of Data</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>1051</fpage>
          -
          <lpage>1063</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>E.</given-names>
            <surname>Wu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Madden</surname>
          </string-name>
          ,
          <article-title>Scorpion: explaining away outliers in aggregate queries</article-title>
          ,
          <source>Proc. VLDB Endow</source>
          .
          <volume>6</volume>
          (
          <year>2013</year>
          )
          <fpage>553</fpage>
          -
          <lpage>564</lpage>
          . URL: https://doi.org/10.14778/2536354. 2536356. doi:
          <volume>10</volume>
          .14778/2536354.2536356.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>D.</given-names>
            <surname>Deutch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Frost</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Kimelfeld</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Monet</surname>
          </string-name>
          ,
          <article-title>Computing the shapley value of facts in query answering</article-title>
          ,
          <source>in: Proceedings of the 2022 International Conference on Management of Data</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>1570</fpage>
          -
          <lpage>1583</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>O.</given-names>
            <surname>Abramovich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Deutch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Frost</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kara</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Olteanu</surname>
          </string-name>
          ,
          <article-title>Banzhaf values for facts in query answering</article-title>
          ,
          <source>Proceedings of the ACM SIGMOD International Conference on Management of Data</source>
          <volume>2</volume>
          (
          <year>2024</year>
          )
          <fpage>1</fpage>
          -
          <lpage>26</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>P.</given-names>
            <surname>Vassiliadis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Marcel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Rizzi</surname>
          </string-name>
          ,
          <article-title>Beyond roll-up's and drill-down's: An intentional analytics model to reinvent olap</article-title>
          ,
          <source>Information Systems</source>
          <volume>84</volume>
          (
          <year>2019</year>
          )
          <fpage>147</fpage>
          -
          <lpage>168</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>M.</given-names>
            <surname>Francia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Golfarelli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Rizzi</surname>
          </string-name>
          ,
          <article-title>Describing and assessing cubes through intentional analytics</article-title>
          ,
          <source>in: Proceedings of the 24th International Conference on Extending Database Technology (EDBT)</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>M.</given-names>
            <surname>Francia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Rizzi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Marcel</surname>
          </string-name>
          ,
          <article-title>Explaining cube measures through intentional analytics</article-title>
          ,
          <source>Information Systems</source>
          <volume>121</volume>
          (
          <year>2024</year>
          )
          <fpage>102338</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>A.</given-names>
            <surname>Karczmarz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Michalak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mukherjee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Sankowski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Wygocki</surname>
          </string-name>
          ,
          <article-title>Improved feature importance computation for tree models based on the banzhaf value</article-title>
          ,
          <source>in: Uncertainty in Artificial Intelligence, PMLR</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>969</fpage>
          -
          <lpage>979</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>A.</given-names>
            <surname>Shapiro</surname>
          </string-name>
          ,
          <article-title>Monte carlo sampling methods</article-title>
          ,
          <source>Handbooks in operations research and management science 10</source>
          (
          <year>2003</year>
          )
          <fpage>353</fpage>
          -
          <lpage>425</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>