<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Uncertain Reasoning for Business Rules</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Hamza Agli?</string-name>
          <email>hamza.agli@fr.ibm.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Philippe Bonnard</string-name>
          <email>philippe.bonnard@fr.ibm.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christophe Gonzales</string-name>
          <email>christophe.gonzales@lip6.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Pierre-Henri Wuillemin</string-name>
          <email>pierre-henri.wuillemin@lip6.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>IBM France Lab</institution>
          ,
          <addr-line>9 rue Verdun Gentilly, France Sorbonne Universites, UPMC Univ Paris 6, CNRS, UMR 7606 LIP6</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>1988</year>
      </pub-date>
      <abstract>
        <p>Business rules (BRs) have been widely adopted within decision making processes in the industrial elds (banking, assurance, transport ...). A BR is a high level description allowing non-computer scientists to author and/or make a decision by the use of vocabulary and concepts speci c to the organization. It encompasses the business knowledge of experts and separates clearly the business logic from the application logic which implements it by de ning and authoring it through a very structured and connected set of applications called a Business Rule Management System (BRMS). In this paper we propose to investigate the possibility of integration of probabilistic reasoning in a business rules-based system. As a consequence, we can deal with incoherent and incomplete data. Our approach is to extend an object BR model with a probabilistic model. This will be done by coupling business rules and probabilistic engines . The result will allow to perform inferences in Bayesian networks and Probabilistic Relation Models (PRMs) in order to sophisticate the calculations performed in classical BR inference.</p>
      </abstract>
      <kwd-group>
        <kwd>Business rules</kwd>
        <kwd>BRMS</kwd>
        <kwd>Decision Making</kwd>
        <kwd>Bayesian network</kwd>
        <kwd>Probabilistic Relational Model (PRM)</kwd>
        <kwd>Bayesian inference</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>General description</title>
      <p>URBS (Uncertain Reasoning for Business ruleS) is an applied research project of
IBM France which has the ambition to promote the eld of business rule-based
decision making. It takes into account the uncertainty on data and the temporal
aspect within the industrial context. This can be done through an hybridization
between business rules and probabilistic graphical models.</p>
      <p>On the one hand, the concept of Business Rule Management System (BRMS)
has been introduced more than a decade ago in order to facilitate authoring,
checking, deploying and executing the business policy of companies as conceived
by their business (as opposed to technical) sta in the form of condition/action
business rules. But it turns out that whereas BRMSs are well adapted to deal
with structured and complete data by using classical Boolean inference, they
face di culties when they take into account incomplete or incoherent data.
On the other hand, Bayesian Networks (BNs) { which are very popular
Probabilistic Graphical Models { were proposed in the late 80s for modeling
uncertain knowledge and reasoning with uncertainty. The core of the Bayesian
networks representation is a directed acyclic graph (DAG) whose nodes
represent random variables and whose arcs represent probabilistic dependencies
between these random variables. BNs encode compactly the joint probability over
their nodes/random variables as the product of the conditional probabilities of
the nodes given their parents in the DAG. Calculation in this graph are done
through algorithms that implement probabilistic inference. They were initially
used as tools for probabilistic reasoning in early expert systems. The BNs have
been applied in several elds in which the decision aiding is a key element. For
example: medicine, automatic diagnosis or the robotics.</p>
      <p>Today's knowledge-based software systems have to inter-operate. Moreover, the
emergence of the "Big Data" processing emphasizes the importance of analytics
and probabilistic modeling of data. Hence, adapting the Business Rules to
uncertain reasoning is essential. For this reason, this PhD thesis aims at building a
bridge between two separate "worlds" by introducing the notion of Probabilistic
Production Rules (PPR).</p>
      <p>In e ect, we propose to specify, implement and validate extensions of current
BRMSs to enable them to take into account probabilistic information, which
means notably, as mentioned above, dealing with incomplete and/or incoherent
data. We will also investigate valid extensions of BNs dealing with rules,
implementing these extensions and validating them on real-world decision-making
applications. Once coupled with Probabilistic Relational Models (PRM), the
BRs will bene t from the improvement of the inference quality as they will be
able to apply both Bayesian and Boolean inferences. Since PRMs are an
objectoriented extension of BNs, their object oriented nature seems to be very well
suited for combining them with BRs.</p>
      <p>The notion of PPR has been recently implemented as an intern prototype and
it allows the generation of the probabilistic model, which is currently a BN, via
annotations of the BR object model (java classes) and/or an externally located
Bayesian network. Unfortunately, the current approach is rapidly limited
whenever we tackle complex conditions because BNs show their limits when dealing
with very large-scale models, which are di cult to create, maintain and utilize.
These problems shall be dealt with by combining BRs with PRMs instead of
with BNs. Actually, by essence, PRMs are designed to cope with very large
systems.</p>
      <p>It is important to highlight the di erence between the paradigms on which
BNs and PRMs on the one hand, and BRs on the other hand are built on.
Actually, while the rst ones are "descriptive", the BRs paradigm is more procedural
and keeping them rst separated in a weak coupling approach, will facilitate
the management of every component. Indeed, putting a procedural model inside
a BN will downgrade its mathematical base. Decision making at that level are
usually poor compared to BRMSs level. In addition, trying to manage BNs
inference and update inside BRMS will be ine cient and di cult since our rule
engine is not monotonic and is by essence a procedural engine on object data.
Maybe in a tight coupling we will be oriented to change rules semantic and add
more constraints in the BRs model.
2</p>
    </sec>
    <sec id="sec-2">
      <title>The plan</title>
      <p>In this PhD research project, we propose to couple PRMs and BRs in order
to tackle the limitations mentioned above. We also plan to introduce, some
advanced temporal concepts into probabilistic models. It is clear that we are
looking for creating an e ective hybridization of PRMs and BRs. In order to
validate this approach, we are developing a new prototype based on this engine
coupling called Bayesian Insight System (BIS).</p>
      <p>We propose the following research directions:
1. In the rst step, we are currently making a comparative study of the language
expressivity of both PRMs and BRs. This will enable us to create a common
language that holds the advantages of every paradigm. This comparison will
point out the formal probabilistic models and inference algorithms that are
the most useful for our study.</p>
      <p>Notably, it must be stressed that we deal with temporal probabilistic models
and the processing of stochastic events.</p>
      <p>Moreover, our study should also include formal speci cation of the BNs,
PRMs, OOBNs, BLOG models and a comparison with other logics like fuzzy
logic, CRF and uncertain ontology.</p>
      <p>Finally, based on the results of our study, our approach will consist of
extending current BRs by combining them with the best suited uncertainty models
and their inference engines. To characterize the best models, we will exploit
Use Cases to determine empirically the expressivity of our new language and
to help designing it in a most e cient way. We will ensure that we keep the
good properties of this expressivity with regards to the utilization and the
e ciency of pattern matching algorithms which are an essential component
of BRs.</p>
      <p>This will, precisely, lead us to perform two main extensions:
(a) extend the object data model of the IBM BRMS, Operational Decision
Manager (ODM), called XOM (for eXecution Object Model). The point
is to practically use two models and keep their own logic: one linked to the
application logic and the other is associated to the uncertain reasoning.</p>
      <p>We demonstrate that O3PRM [15] (for Open Object Oriented PRM),
which is a programming language that models and speci es PRMs using
a strong object-oriented syntax, and the XOM have some good
interaction properties and thus will be at the core of this extension.
(b) extend the O3PRM model to handle incremental operations, improve its
query process and manage temporal evolution.
2. In the second part, we intend to implement and validate this hybrid
language by designing a new prototype of probabilistic business rules engine,
Bayesian Insight System prototype, which will use the open source C++
library, aGrUM 1. This part contains:
{ experiments on how to integrate these prototypes in our BRMS
environment and also on the coupling with existing Bayesian engines (SPSS,
JSmile, Bayesia, ProBT..)
{ exploration of tight coupling techniques of algorithms developed for the
new paradigm and de ned in the rst part.
{ introduction of the probability calculation in the BRs' temporal
expressions, namely the Complex Event Processing.
{ one can also use the probabilistic data to implement the learning of
probabilistic models and some parts of the rules within this framework.
{ another important aspect to explore is modeling helpers (aiding): IDE
graphical interface, high level language etc.. are very interesting tools
when dealing with modeling performed by business experts.
3. In the third part of this research, we will elaborate from the theoretical
structure de ned in the rst stage and from its expressivity and its
constraints, speci c algorithms to deal with our hybridization to improve the
time and size complexity of calculations. We should extend also the BR
languages de nition to probabilistic concepts. Which means that we will develop
a natural and intuitive formulation of the stochastic notions for end-users
(non-computer scientists) as well as for the experts of the domain.
The overall research work of this PhD will be validated and oriented through
the utilization of some Use Cases from the industrial elds exploiting the
collaborations of the laboratory and the company. For instance,
{ Fraud detection: this use case proposes to introduce a probabilistic approach
to model fraud-control issues. It aims to estimate the likelihood of a potential
tax fraud, with the objective either to improve detecting and ltering \false
positives", or to better identify \true positives".
{ Gathering information about public data available on the Web: introducing
probabilistic inference and evaluation in the rules is likely to reduce \false
positive" detections in the web-site identi cation and improve the quality of
the meta-data extraction
{ Decision Support System diagnosis: rendering the DSS autonomic from costly
human expert supervision.
1 aGrUM, for a Graphical Universal Model, is an open source software that implements
O3PRM
Educational Background</p>
      <p>Software engineer &amp; PhD Candidate
Experiences</p>
      <p>
        Feb-..
2013
May-Oct
(
        <xref ref-type="bibr" rid="ref5">5 months)
2012</xref>
        Apr-Sept
(6 months)
Jan-Mar
2011
June-Oct
(3 months)
2010
      </p>
      <p>UniversitØ Paris Dauphine- cole des mines de Paris , Paris, France.</p>
      <p>M.Sc (Research Master) in Operations Research and Decision Aiding .
. Modeling, Optimization, Decision &amp; Organization.</p>
      <p>Toulouse Institute of Technology (Enseeiht) , Toulouse, France.</p>
      <p>Engineering Diploma (M.Sc Degree equivalent) .
. Applied Mathematics &amp; Computer Science.</p>
      <p>Toulouse Institute of Technology (INP) , Toulouse, France.</p>
      <p>M.Sc (Master Research) in Computer Science and Telecommunication .
. Distributed systems and Critical Software Program.</p>
      <p>LycØe Ibn Taimia , Marrakesh, Morocco.</p>
      <p>Two-year intensive undergraduate course to prepare for competitive entrance to National Engineering
Schools.
. Classes PrØparatoires aux Grandes cole (MPSI/MP*).</p>
      <p>IBM France Center for Advanced Studies .</p>
      <p>LIP6, Computer science lab of UPMC and CNRS, Paris area, France.</p>
      <p>PhD researcher &amp; software engineer in Business Rules and Probabilistic Graphical Models.
? Siemens - Mines ParisTech, Paris, France.</p>
      <p>Logistic decision aiding.
− Forecasting the European Silicon Valley (Plateau de Saclay) logistic demand within the Grand Paris
project framework.
− Introducing a new mean of transportation : Modeling &amp; analysis of the impact on the supply chain of
an urban freight system.
− This solution will integrate the freight in the infrastructure of the fully automated Great Paris MØtro.</p>
      <p>Inria, Sophia Antipolis, France.</p>
      <p>Orbital transfer &amp; the low thrust 3 or 2-body problem : Optimization, model, simulation, optimal control.</p>
      <p>Enseeiht, Toulouse, France.</p>
      <p>Numerical resolution for a medical imaging contrast problem : Optimal control, study and evaluation of
three solvers performances.</p>
      <p>Total SA {Jean FØger Scientifc and Technical Center} , Pau, France.</p>
      <p>Advanced optimization algorithms and development techniques: inversion optimization problem.</p>
      <p>Data ltering for 2D NMR inversion of real log data from hydrocarbon wells, including test and
computation performances and using wavelet transform.
? Forum Toulouse Technologie , Toulouse, France.</p>
      <p>Organization and prospection team.
? Mentor Teaching Maths, Physics and Arab language ( Enseeiht, private tutoring).
? Commercial ocer (stocktaking ).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>L.</given-names>
            <surname>Torti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Wuillemin</surname>
          </string-name>
          ,
          <article-title>"O3PRM Language speci cation"</article-title>
          ,
          <source>Technical report UPMC</source>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>B.</given-names>
            <surname>Berstel{Da Silva</surname>
          </string-name>
          ,
          <article-title>"Veri cation of Business Rules Programs"</article-title>
          ,
          <source>PhD thesis</source>
          , Uni Freiburg, Germany 2012
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>L.</given-names>
            <surname>Torti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Gonzales</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Wuillemin</surname>
          </string-name>
          ,
          <article-title>"Speeding-up structured probabilistic inference using pattern mining"</article-title>
          <source>International Journal of Approximate Reasoning</source>
          ,
          <volume>900</volume>
          {
          <fpage>918</fpage>
          ,
          <year>2013</year>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>L.</given-names>
            <surname>Torti</surname>
          </string-name>
          ,
          <article-title>"Structured Probabilistic Inference in Object-Oriented Bayesian Networks,"</article-title>
          <source>PhD Thesis</source>
          ,
          <year>2012</year>
          , UPMC, France.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>P.</given-names>
            <surname>Weber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Medina-Oliva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Simon</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Iung</surname>
          </string-name>
          ,
          <article-title>"Overview on Bayesian networks applications for dependability, risk analysis and maintenance areas,"</article-title>
          <source>Engineering Applications of Arti cial Intelligence</source>
          , vol.
          <volume>25</volume>
          ,
          <issue>iss</issue>
          . 4, pp.
          <fpage>671</fpage>
          -
          <lpage>682</lpage>
          ,
          <year>2012</year>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>B.</given-names>
            <surname>Iung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Medina-Oliva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Weber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and E.</given-names>
            <surname>Levrat</surname>
          </string-name>
          ,
          <article-title>"Using probabilistic relational models for knowledge representation of production systems: A new approach to assessing maintenance strategies,"</article-title>
          <source>CIRP Annals { Manufacturing Technology</source>
          , vol.
          <volume>61</volume>
          ,
          <issue>iss</issue>
          . 1, pp.
          <fpage>419</fpage>
          -
          <lpage>422</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>L.</given-names>
            <surname>Torti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Gonzales</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Wuillemin</surname>
          </string-name>
          ,
          <article-title>"Patterns Discovery for E cient Structured Probabilistic Inference,"</article-title>
          <source>in Proceedings of the Fifth International Conference on Scalable Uncertainty Management</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>C.</given-names>
            <surname>Gonzales</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Wuillemin</surname>
          </string-name>
          ,
          <article-title>"PRM inference using Ja ray Fays Local Conditioning,"</article-title>
          <source>Theory and Decision</source>
          , vol.
          <volume>71</volume>
          ,
          <issue>iss</issue>
          . 1, pp.
          <fpage>33</fpage>
          -
          <lpage>62</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. I. Siskeviciute, \
          <article-title>Introduction of temporal probabilistic reasoning in business rules management system"</article-title>
          .
          <source>2012</source>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>J.</given-names>
            <surname>Pearl</surname>
          </string-name>
          .
          <article-title>Probabilistic Reasoning in Intelligent Systems: \Networks of Plausible Inference"</article-title>
          . San Mateo, CA.,
          <year>1988</year>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>K.R. McNaught</surname>
            and
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Zagorecki</surname>
          </string-name>
          .
          <article-title>Using dynamic bayesian networks for prognostic modelling to inform maintenance decision making. In Industrial Engineering and Engineering Management</article-title>
          .
          <source>IEEE IEEM</source>
          ,
          <year>2009</year>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>H.Ait Kaci</surname>
          </string-name>
          , P.Bonnard, \
          <article-title>Probabilistic Production Rules"</article-title>
          ,
          <source>Technical report</source>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Cohen</surname>
            <given-names>T</given-names>
          </string-name>
          ,
          <string-name>
            <surname>S Chvaneveldt R</surname>
          </string-name>
          .&amp; W Iddows D. \
          <article-title>Re ective random indexing and indirect inference : A scalable method for the discovery of implicit connections</article-title>
          .
          <source>Biomed Inform 43 iss. 2</source>
          ,
          <issue>240</issue>
          {
          <fpage>256</fpage>
          "
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>A.ElGhali</surname>
          </string-name>
          , P.Bonnard, K.ELGhali, D.Hromada, H.Ait Kaci, \
          <article-title>Regles de production et reseaux bayesiens pour l'extraction de mots cles</article-title>
          ,
          <source>Technical report.</source>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <article-title>Web site for the Open Object Orientd PRM http</article-title>
          ://o3prm.lip6.fr/
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16. Web site for aGrUM : https://forge.lip6.fr/projects/agrum/wiki 9 Rue Verdun 94250 Gentilly, France Phone: +
          <volume>33</volume>
          (
          <issue>0</issue>
          )
          <fpage>149</fpage>
          08
          <fpage>36</fpage>
          87 Email: hamza.agli@fr.ibm.com
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>