<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Knowledge Elicitation within the Knowledge Base Paradigm: Disentangling Domain Knowledge from Decision Making in Industrial Applications ?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marjolein Deryck</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Joost Vennekens</string-name>
          <email>joost.vennekensg@kuleuven.be</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Computer Science, KU Leuven Campus De Nayer</institution>
          ,
          <addr-line>Sint-Katelijne-Waver</addr-line>
          ,
          <country country="BE">Belgium</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The use of business rules systems to control operational decisions has gained a foothold in the industry. These systems are excellent to de ne an outcome based on a series of deterministic rules. However, often there is not exactly one outcome, but multiple possible solutions that might be more or less convenient, e.g.; depending on the preference of the user. A constraint based approach that limits the possible solution space is more appropriate for these kind of queries. In my research I use a combination of rule based and constraint based systems in multiple case studies. The overall motivation is to simplify the development of a system, while ensuring a maximal range of functionalities.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction and research questions</title>
      <p>The output of a company is the result of di erent kinds of decisions. Take Net ix
for example. The fact that you can watch your favorite show on the channel, is
the result of strategic, tactical and operational decisions within the company.
Net ix strategically decides to work with subscriptions rather than
pay-perview content as their business model. They implement their model with tactical
decisions, such as the amount Net ix wants to invest in their own productions.
Finally, the decision on the launching date of a new series, is an operational
decision. Even though the importance of each individual operational decision
might be relatively small, as these kind of decisions are taken frequently and
everywhere in companies, they altogether have a considerable impact on the
result. Therefore they are the core focus of my research.</p>
      <p>Operational decision are typically guided by company rules or applicable
legislation. Rules may present themselves in di erent variants, may contain a lot
of detail and exceptions, and tend to evolve over time. A lot of these decisions
are still processed manually by domain experts. This often works well, but at
? Copyright 2019 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
times, decisions might be awed or incoherent. Moreover, when valued experts
leave the company, it puts the company in a risky situation and involves costs.</p>
      <p>Sometimes fragments of the decision logic are automated as part of larger
digitization projects. This makes sense, as it is a way to ensure that decisions
are taken fast and correct. Typically, requirements for this are detailed in bulky
documents. Programs need to be tested elaborately and corrected.In classical
code, a lot of work is needed to add or change something, even if the needed
information is already present in the program.</p>
      <p>
        Declarative expert systems can o er a solution for the last problem. In it,
information is gathered in such a way that the system can reason with and act
upon it. Although some applications were successful (see e.g.; [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]), the
deployment of such an expert system requires a substantial investment.
      </p>
      <p>
        An important challenge in this respect, concerns the knowledge acquisition
e ort needed to create a decent knowledge base [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Even rather small-scale
applications often build on a vast and changing sphere of domain knowledge.
Some of this knowledge is implicit, and needs an additional elicitation step. The
formalization of this involves a large e ort, and is time consuming. It especially
requires the precious time of domain experts, who typically have an (over-)loaded
schedule.
      </p>
      <p>My research wants to enable more companies to automate their operational
decisions, by addressing the challenges related to the implementation of such an
automated system. Hence, my main research question is:
How can the knowledge acquisition process from expert's decision
making knowledge be improved to overcome the aforementioned
challenges?
2</p>
    </sec>
    <sec id="sec-2">
      <title>Used technology</title>
      <p>In my research, I use and combine two complementary approaches. In the
constraint based approach, the initial solution space is constrained by limitations,
such as physical constraints, cost or material constraints, legal constraints...
Solutions that are not excluded by any of these constraints, are valid. The result
could be zero, one or multiple valid solutions. The optimal solution can be
chosen from these, based on the preference of the user. In the rules based approach,
deterministic rules with exactly one output are combined together to come to
the nal solution. The di erence between constraints and preferences disappears.
E.g.; for the selection of a material to be used in an application, materials M1
and M2 might both be suitable. As M1 is the cheapest, the decision rule will
state that M1 needs to be used for this application. The information that M2
would also be possible, disappears. Consequently, if the price of M1 rises and M2
becomes the cheapest, this change would not be re ected in the decision rule.</p>
      <p>The IDP reasoning engine that I use in my research, is able to cope with
rules and constraints. It is discussed in the next subsections. Decision Model and
Notation(DMN) is a business oriented methodology to formalize and implement
business rules. It is discussed in subsection 2.2 and further.
2.1</p>
      <p>
        IDP and the KBP
Knowledge Based Paradigm The IDP engine represents an implementation
of the Knowledge Based Paradigm (KBP). The KBP advocates a strict
separation between domain knowledge and the way this knowledge is used with
di erent inferences [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The domain knowledge is declaratively formalized in the
knowledge base. This KB contains data and (logical) relations between elements.
      </p>
      <p>Inferences are developed independently of speci c knowledge bases. They
allow the user to solve a speci c problem with the available knowledge. As both the
KB and the inference tasks are developed independently, they each demonstrate
a high level of exibility. For the KB this means that it is easy to maintain,
because it only contains domain knowledge. For the inferences it means that they
can be deployed on multiple KBs. Similarly, multiple inferences can be deployed
on one KB, hence leveraging the existing KB to solve questions that were not
foreseen previously.</p>
      <p>
        Knowledge Based Systems A KB can be created in di erent tools, and
di erent solvers can be used to get a solution for a speci c problem. For my
research I selected the IDP-system. As the research focuses on real life cases,
the KB language needs to have a high level of expressivity to make sure that
real life situations can be expressed. Many FO-based language exist, that are
all able to model more or less complex constructs. The IDP-language that I use
in my research, has the particularly interesting possibility to express inductive
de nitions, as demonstrated in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Also, as the purpose is to demonstrate the use
of KBS in practice, an additional advantage of IDP is the online availability of
some generic interfaces, that allows to solicit end user feedbac. Finally, enougkh
support needs to be available to assist with solving modeling problems. For
the IDP system, this support is both available in my own research group, and
through close collaboration with the DTAI research group (who developed the
IDP system)
IDP IDP (Imperative/Declarative Programming) is the name of both a First
Order (FO) Logic based language used to represent domain knowledge, and the
reasoning engine in which it is used [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. An IDP speci cation consists of three
parts, that together form the KB, and represent a stand alone piece of knowledge
on the problem domain.
      </p>
      <p>To solve speci c problems, multiple inference algorithms can be used. M odel
Expansion, P ropagation, and Optimization are commonly used inferences.
With a vocabulary V , and theory T and structure S over V , M odel Expansion
looks for a model. In a model, all elements of V get a value, such that T and S
are satis ed. P ropagation is the derival of the value of some unassigned element
of V based on the partial interpretation in S and taking into account T . The
result after propagation is a partial model (i.e.; a model that assigns values to
some, but not all elements of V ) that extends S and satis es T , and is more
speci c than the original interpretation S. Whereas model expansion calculates
any total model that satis es the given constraints, Optimization calculates the
best model that satis es the constraints according to the de ned term.
Using IDP IDP o ers the advantages typical for a Knowledge Based System
(KBS), a system that implements the KBP. The maintainability of the KB,
and the exible use of this KB with multiple inference tasks were already
mentioned before. A less obvious use of the KB, is to use it as a training tool for
new employees or library of decision knowledge. After all, it does contain all
relevant information. This multi-deployability increases the return on the heavy
investment of analyzing and creating the KB.</p>
      <p>Crucial for an operable KBS, is the possibility to express relations and
concepts from the real world at a su cient exible and ne grained level. This is
possible in the IDP language. FO logic uses logical symbols and connectors to
express relations between concepts in a semantically unambiguous way, but for
people not familiar with the syntax, reading the statements is challenging and
proves to be a stumbling stone.
2.2</p>
      <p>
        DMN
Decision taking is a quintessential activity in companies. Using standardized
models to re ect them, enables the portability of these models internally or
outside the company as communication tool. Simple and readable models, are
a vantage in this regard. Since 2015 a uniform standard for decision models is
available in the form of the Decision Model and Notation(DMN) standard [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. As
I want to combine the use of business oriented decision models with a FO-based
KBS, it is interesting to note that a formal semantic interpretation of a DMN
table in FO has been provided by Calvanese [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Moreover, the combination of
DMN and IDP has been demonstrated in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>DMN gives business analysts a tool to separate business processes from the
decisions that need to be taken in the process. It favors a separation of concerns
between the two areas, which makes both the process and the decision logic
more manageable and agile. DMN provides two ways of looking at decisions.
First, a Decision Requirements Diagram (DRD) shows an end-to-end view of a
decision, from its inputs over intermediate subdecisions to the nal decision. In
a top-down view, it shows which inputs and intermediate decisions are required
to take the top decision. Second, the details of the underlying decision logic.
Typically, this logic is represented in a decision table, which maps each set of
inputs to the appropriate output. Di erent kinds of tables are possible and can
be distinguished by means of a \hit policy" that de nes how di erent rows of
the table interact. These tables can be considered the KB of the decision logic.
Using DMN Together, the use of these two glasses o er big advantages in
decision projects. The DRD allows users to get an overview of the domain at hand,
without diving into the speci cs of a subdecision. It can be used to delineate the
borders of an automation project, and make sure that IT and business owners
are on the same page. The individual decision tables are easily understandable
with little or no prior training, because they are small, (almost) syntaxless, and
declarative. This means that decision tables can be used to discuss the decision
logic between di erent employees from di erent services. In fact, tables prove to
be so easy to use, that business owners are able to maintain the logic without
intervention of IT. Hence, business ownership of decisions increase, and business
knowledge can be documented better: centralized at one place and potentially
continuously updated by business owners. Finally, the decision logic can also be
automated.</p>
      <p>The use of DMN runs into its limits when it comes to using the
information contained in decision tables. Most toolvendors o er one functionality, i.e.;
forward chaining starting from all input data, and calculating a single outcome.
Reasoning with partial data usually does not act the way humans would. For
example, in the OpenRules application, missing data is ignored ('null') and one
possible outcome is presented as the only solution. It would make more sense
to reason with the information that we do know, to decrease the solution space,
and potentially end up with multiple possibilities instead of one solution. The
current applications make a strict distinction between input and output data,
and reasoning goes from in- to output. Backwards reasoning is not possible.</p>
      <p>Also the principle of formatting knowledge in a decision table, restricts its
expressivity. Technically, business rules in a table have the same value. In reality,
this might not always be the case. Users might want to make a distinction
between a physical constraint and a preference. An example of the rst is a
physical law, e.g.; if temperature is above 200 degrees, material x and y can be
used. An example of the latter would be : if temperatures is above 200 degrees,
we use material x (e.g.; because x is cheaper than y).
3</p>
    </sec>
    <sec id="sec-3">
      <title>Proposed approach and preliminary ndings</title>
      <p>As the strengths and weaknesses of both approaches are complementary, we
combine them to leverage their respective advantages.
3.1</p>
      <sec id="sec-3-1">
        <title>Combining DMN and IDP</title>
        <p>In my case studies, DMN is used as a rst step to analyze the domain of interest,
build a glossary and discover links between concepts. These models are built with
the help of domain experts in multiple feedback runs. Because DMN tables are
easily readable, they can be validated (and if necessary, corrected or completed)
by colleagues that were not involved from the beginning. The result is a rst
model, with the advantages of clarity and readability.</p>
        <p>
          Subsequently we use the DMN model as an intermediate model to create
the IDP speci cation. Although this may seem unwieldy, the creation of an
intermediate model forces the modeler to think trough the domain completely,
independently of the nal implementation [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
        <p>
          Alternatively, for single purpose cases, an application solely based on decision
tables, might meet all the needs. Multiple tools are available to this end [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>Once we have created the IDP speci cation, it is time to think about the
possible uses of the information. For the IDP web-IDE, a number of standard
inferences are already available [?]. There also exist a couple of generic interfaces,
that each incorporate a number of these inferences. New inferences can be created
or added according to the needs. This step typically requires close collaboration
with the domain expert.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Case studies</title>
        <p>Methodology The proposed approach will be applied to ve case studies. They
cover a wide area of cases, ranging from tax legislation, doctor planning to
nancial collateral selection. For each of the cases, a template report is lled
out, discussing the background of the case, requirements, DMN and IDP models,
and di culties during the modeling and lessons learned. Conclusions from the
cases are analyzed and generalized, and additional developments to improve the
proposed combination for similar cases are done. The following section gives an
example of a case in which both approaches are combined.</p>
        <p>
          Registration rights [
          <xref ref-type="bibr" rid="ref11 ref12">11, 12</xref>
          ] When purchasing a house in Belgium, some taxes
in the form of registration rights need to be paid. The legislation to determine
the exact amount was overly complex. To keep up with all the exceptions, a
notary's o ce requested the development of an application that would allow the
entry of information during an interview in any order, point to missing parts
of information still needed to take a decision, and explain the nal result. The
system should be able to reason with each additional piece of information that
becomes available.
        </p>
        <p>The intermediate DMN model was created with OpenRules. The fully
working model was discussed with the notary. His evaluation proved useful in two
ways :</p>
        <p>To get feedback on the modeled information : the formalization of the highly
complex domain contained some mistakes in the rst (and also second) run.</p>
        <p>To understand better which functionalities the notary requires from the tool.
The largest disadvantage of the DMN tool, was the inability to reason with
incomplete information. All information needed to be entered upfront before
running the tool.</p>
        <p>
          Therefore the DMN model was translated to an IDP speci cation. As the
domain had been analyzed using DMN, this went smooth: the formalisation of
the DMN model took several weeks, while the translation to a fully working IDP
speci cation took only 10 person days. The IDP speci cation was used in the
IDP autocon g interface [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. This interface o ers the inference of propagation,
meaning the for each piece of information that is entered, the unalterable
consequences are immediately re ected. This proved to be a large step forward to
meet the notary's requirements.
        </p>
        <p>What was still missing, is the possibility to see at a glance which questions are
still relevant to come to the optimal tax rate, and a way to explain the outcome.
To meet these additional requirements, the existing inferences of explanation
and relevance were integrated in an advanced version of the interface.</p>
        <p>Half way through the project, the legislation was profoundly reformed. The
KB was amended to re ect these changes. Even though the change had a
significant impact, the modeling e ort (after analysis) was limited to a meager half
day. This supports the KBP claim that the separation of knowledge and the way
it is used indeed advances the maintainability of the KB.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Contributions</title>
      <p>With my thesis I anticipate to contribute to the current body of knowledge in
several ways:</p>
      <p>Give a (partial) answer to the question how and in which circumstances
companies adopting DMN can realize the proclaimed bene ts. In the product
design case, a DMN application su ced for the selection of standard seals.
In the registration rights case the exible enactment of multiple inferences
is needed.</p>
      <p>Make suggestions on how to apply DMN and propose extensions to the
standard. The development of DMN+ makes a start with this.</p>
      <p>To demonstrate how to use knowledge bases and di erent inferences in
selected domains.</p>
      <p>To demonstrate the importance of interactivity. The interactive reasoning
with partial data turns out to be important in the applications of the case
studies.</p>
      <p>To provide general guidelines on how to do this analysis in other domains.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Future steps</title>
      <p>During the rst period of my research, a lot of attention was devoted to the
development of solutions for the di erent case studies. In the following months,
the crosswise comparison and abstraction of ndings from each case, will lead
to general applicable conclusions. The analysis will also point to blind spots.
In the following year, additional cases will be executed to address these. After
the additional cases, a new round of analysis will allow me to further re ne
the preliminary conclusions. The DMN+ extension that we started developing
recently, will be further developed during the following months: testing the
approach, introducing new concepts, implementing full cases. To learn from experts
in similar elds, I will undertake an international research visit in the third year
of my PhD. During the entire trajectory, the appropriate attention is devoted
to the valorization of results: creating prototypes for the case study companies,
communicating lessons learned, writing professional and academic papers...
Finally, during the last year, some time is blocked to write the actual thesis.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Breuker</surname>
            , J., van de Ven,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>El-Ali</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bron</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hoekstra</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klarman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Milosev c, U.,
          <string-name>
            <surname>Wortel</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , Forhecz,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Estrella</surname>
          </string-name>
          ,
          <string-name>
            <surname>P.</surname>
          </string-name>
          :
          <article-title>Deliverable n : 4.6 developing HARNESS towards a hybrid architecture for LKIF</article-title>
          . (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Gaines</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Knowledge acquisition: Past, present and future</article-title>
          .
          <source>International Journal of Human-Computer Studies</source>
          <volume>71</volume>
          (
          <issue>02</issue>
          <year>2013</year>
          )
          <fpage>135156</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Van</given-names>
            <surname>Hertum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Dasseville</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Janssens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            ,
            <surname>Denecker</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.:</surname>
          </string-name>
          <article-title>The KB paradigm and its application to interactive con guration</article-title>
          .
          <source>Theory and Practice of Logic Programming</source>
          <volume>17</volume>
          (
          <issue>1</issue>
          ) (
          <year>2017</year>
          )
          <fpage>91117</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Deryck</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mitsikas</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Almpani</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stefaneas</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frangos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ouranos</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boley</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vennekens</surname>
          </string-name>
          , J.:
          <article-title>Aligning, interoperating, and co-executing air tra c control rules across psoa ruleml and idp</article-title>
          ., Springer (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5. de Cat,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Bogaerts</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Bruynooghe</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Denecker</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.:</surname>
          </string-name>
          <article-title>Predicate logic as a modelling language: The IDP system</article-title>
          .
          <source>CoRR abs/1401</source>
          .6312 (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6. OMG:
          <article-title>Decision Model and Notation 1.1 (</article-title>
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Calvanese</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laurson</surname>
            ,
            <given-names>U</given-names>
          </string-name>
          .,
          <string-name>
            <surname>Maggi</surname>
            ,
            <given-names>F.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montali</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Teinemaa</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Semantics and analysis of DMN decision tables</article-title>
          .
          <source>In: International Conference on Business Process Management</source>
          , Springer (
          <year>2016</year>
          )
          <volume>217</volume>
          {
          <fpage>233</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Dasseville</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Janssens</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Janssens</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vanthienen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Denecker</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>Combining DMN and the knowledge base paradigm for exible decision enactment</article-title>
          . In:
          <article-title>RuleML 2016 Supplementary Proceedings</article-title>
          . (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Bench-Capon</surname>
            ,
            <given-names>T.J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coenen</surname>
            ,
            <given-names>F.P.</given-names>
          </string-name>
          :
          <article-title>Isomorphism and legal knowledge based systems</article-title>
          .
          <source>Arti cial Intelligence and Law</source>
          <volume>1</volume>
          (
          <issue>1</issue>
          ) (
          <year>1992</year>
          )
          <volume>65</volume>
          {
          <fpage>86</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <article-title>DMCommunity: DMN supporting tools</article-title>
          .
          <source>dmcommunity catalogs, release 2.0.1 of aug 12</source>
          ,
          <year>2016</year>
          . openjvm.jvmhost.net/DMNtools/
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Deryck</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Devriendt</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marynissen</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vennekens</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>Legislation in the knowledge base paradigm: interactive decision enactment for registration duties</article-title>
          ,
          <source>IEEE</source>
          (
          <year>2019</year>
          )
          <volume>174</volume>
          {
          <fpage>177</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Deryck</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hasic</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vanthienen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vennekens</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>A case-based inquiry into the decision model and notation (DMN) and the knowledge base (KB) paradigm</article-title>
          . In: Rules and Reasoning - Second International Joint Conference,
          <source>RuleML+RR</source>
          <year>2018</year>
          ,
          <article-title>Luxembourg</article-title>
          ,
          <source>September 18-21</source>
          ,
          <year>2018</year>
          , Proceedings. (
          <year>2018</year>
          )
          <volume>248</volume>
          {
          <fpage>263</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>13. DTAI: Idp. https://dtail.cs.kuleuven.be/software/idp</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>