<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Case-Based Real-Time Adaptive Engineer Site Support System</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kyle Martin</string-name>
          <email>k.martin@rgu.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>School of Computing Science and Digital Media, Robert Gordon University</institution>
          ,
          <addr-line>Aberdeen AB25 1HG, Scotland</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <fpage>184</fpage>
      <lpage>188</lpage>
      <abstract>
        <p>Employee experience is a valuable asset for any company. A system which can store, retrieve and adapt these experiences to meet the requirements of new scenarios can play an important role in corporate knowledge management. Case-Based Reasoning provides an excellent mechanism for this because it allows the capture and reuse of past experiences, which in this paper involves the generation of expert-level support in response to questions raised by British Telecommunications eld engineers. However, experience capture is hard in dynamic environments involving multi-modal communication and content. This paper examines the context of this research and details the work which has been completed thus far, as well as potential next steps.</p>
      </abstract>
      <kwd-group>
        <kwd>Case-Based Reasoning</kwd>
        <kwd>Siamese Neural Networks</kwd>
        <kwd>Knowledge</kwd>
        <kwd>Management</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>This research project is a collaboration between British Telecommunications
(BT) and Robert Gordon University to produce a system which uses experiential
content gathered from users as a case-base to answer new queries. The query
and answer process will take place while engineers are out in the eld, giving
them access to the support they require within the dynamic environment of their
jobs. This would facilitate the exchange of knowledge and experience between
employees within the company and assist in the development of a `corporate
memory', which stores the relevant experiences of every engineer in the company,
preventing these assets from being lost if an employee were to leave BT.</p>
      <p>This paper is structured as follows: section 2 gives an overview of the context
of the project and section 3 describes its contributions. Section 4 discusses
related work and research. The report concludes with a description of the
research which has been completed so far and details future work and next
steps the research could take.</p>
      <p>Copyright © 2017 for this paper by its authors. Copying permitted for private and
academic purpose. In Proceedings of the ICCBR 2017 Workshops. Trondheim, Norway</p>
    </sec>
    <sec id="sec-2">
      <title>An Overview of the Project</title>
      <p>The goals of this project are to develop a means of capturing experiential
knowledge from BT engineers and to produce an application which can learn to provide
expert-level support in the eld using that information. The system should be
able to support engineers by retrieving relevant results and adapting to new
situations accordingly, producing results which are applicable in the real-world.</p>
      <p>In the eld, an engineer is only able to access notes (historical task records)
which are part of the current task. These notes are plain text and contain
customer and location information, but rarely indicate what piece of equipment
the fault may relate to (as this may not be known at the time of task allocation),
the context of the task, or similar tasks. An engineer is expected to rely heavily
on past experiences and training in order to diagnose and solve problems, but
this can fail if the task has novel, unusual or specialist elements. Some of these
failures may be avoided if there existed a means of drawing upon the experiences
of engineers who had previously encountered similar problems.</p>
      <p>To give a real example, a BT power engineer was called out to a `low-voltage'
alarm in a rural exchange. It transpired that the mains power had failed and the
back-up generator had not started, so the exchange was beginning to lose power
and risked the network going down for nearby customers. The engineer was
unsure of what the exact fault with the back-up generator could be and spent
some time attempting to diagnose the problem before calling for help. It was
only when an engineer with more experience arrived that the fault was eventually
diagnosed - the ac/mc contactor within the generator needed replaced. This was
a time-dependent and critical fault which could have had important business
repercussions and was only solved because a more experienced engineer was
able to attend on short notice. If experience and knowledge could be more
e ectively transferred between engineers, then we could severly reduce the time
taken to solve these faults, as well as the manpower required to do so and the
risk of failing to complete time-critical faults.</p>
      <p>We aim to use the notes and other knowledge assets (including video, photo
and audio content) as the case base for an intelligent system which can reply to
engineer's queries and propose a solution. This would alleviate pressure upon
engineers by giving them access to a `digital expert' which could draw upon
historical experiences from the entire work force to provide support in the eld.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Contributions</title>
      <p>As this project is a collaboration between a representative of industry and a
university, it is important that the research provides an academic contribution,
but remains viable for use in a commercial setting. There often exists a
disconnect between the two, fuelled by the exploratory nature of research and the fact
that 'state-of-the-art' measures may involve expensive procedures or equipment
which do not have commercial viability. Therefore, this project is a case study
of a research project which has both academic importance and good business
viability and o ers contributions in both areas.</p>
      <p>The main contribution of this project towards industry will be to improve
information access for engineers in the eld and facilitate the exchange of
knowledge and expertise by using an intelligent system. By doing so, this system
should ultimately improve an engineer's ablity to complete a task and, at an
organisational level, increase overall engineer productivity.</p>
      <p>The contribution of this project to academia is to develop a dynamic decision
support system which can operate on a large scale across multiple engineer
domains. This project will ultimately showcase a system which can retrieve
relevant results from vast quantities of complex, inter-related multi-media data.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Related Works</title>
      <p>
        Due to its very nature of reusing and adapting previous examples, Case-Based
Reasoning (CBR) is the branch of machine learning which most closely re ects
the goals of the project. Using CBR techniques to facilitate knowledge ow
between users is not a new concept, having been pursued with di ering levels of
success for a number of years. Of these, many projects have speci cally targeted
domain experts within a pre-identi ed industry niche, including food quality
control [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and help desk support [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], in order to provide relevant assistance
based upon experts' and users' experiences.
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] Goker et al developed an adaptive expertise provider dubbed the
Pricewaterhouse Cooper (PwC) Connection Machine. The Connection Machine
allowed users to enter their queries into a web application and made use of CBR
techniques in order to identify experts who may be able to answer. Use of the
system facilitated the exchange of knowledge and experience between users and
provided a singular forum for accessing all experts within the company. The
biggest disadvantage of the system was that it relied upon experts to actively
answer queries. Drawing upon this idea, our project aims to allow users to
access the sum of all experience of BT engineers in a single place, but remove
the need for human experts to explicitly answer queries. The system will return
relevant answers based upon its knowledge gained from the input task notes.
      </p>
      <p>
        A Case Retrieval Net (CRN) is a CBR framework which facilitates the return
of a small number of cases in a large case base. CRNs use a memory structure
that stores both the contents of the case base and similarity knowledge between
cases [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] using Information Entities (IEs). An IE is any speci c piece of
information pertaining to a case (such as an attribute-value pair). Results are returned
using `spreading activation'; the most relevant IE to a query is activated and
nearby IEs receive diminishing activation the less similar they are to the
identied IE. The case nodes associated with the activated IEs are then collected and
returned. CRNs have demonstrated promising results in reuse of textual cases
within large medical databases [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The return of a small number of relevant
results from a massive case base and the use of similarity knowledge to
facilitate case adaptation are both vital components of the project. However, this
requires a method of generating the extensive similarity knowledge required for
spreading activation of the net. This may be achieved using the object-to-object
similarity generated by a Siamese Neural Network.
      </p>
      <p>
        A Siamese Neural Network (SNN) architecture consists of two neural
networks that share identical weights and are joined at one or more layers.
Introduced in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] as a method of signature veri cation, SNNs are trained and tested
on pairs of examples to develop similarity knowledge at a case-to-case level.
Desirable pairs are dubbed as `genuine' during training, while undesirable pairs
are `impostors', so that the network develops vectors representative of case
features. At test time, the SNN measures the distance between the queried vectors
to determine whether they are `genuine' or `impostor' based on a threshold.
      </p>
      <p>
        Recent research has demonstrated that SNNs are able to generate
object-toobject similarities after being trained with relatively few examples or in datasets
where a vast number of classes exist [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. This could be particularly useful in the
current project, where the broad domain could mean that there are a massive
number of classes within the case base. SNNs have been applied with success
in areas like sketch-based retrieval [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], and speaker recognition [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. In [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], an
SNN is applied to the task of similar question retrieval, and outperforms the
state-of-the-art. In the same way, this project would aim to return similar cases
to the situation described in the query, but unlike in the examples above it
would also attempt to adapt these cases to better suit the described situation.
5
      </p>
    </sec>
    <sec id="sec-5">
      <title>Current and Future Work</title>
      <p>Much of our recent work has been gathering data to determine the industrial and
academic context of this project. In particular, we reviewed literature featuring
industry examples of experience capture and knowledge transfer systems to see
how others have dealt with similar problems. In addition, we gathered data
from within BT to establish the speci c business context of the project. This
involved determining the available information sources for use by engineers, how
they are used on specifc tasks and in what areas they are lacking.</p>
      <p>One of the key aspects of this project is the development of a large and
dynamic case base which can be used and updated in real-time throughout the
day. Often, retrieval from a huge case base can be extremely costly. We are
examining methods of reducing this cost without sacri cing case base coverage
or retrieval accuracy through similarity-based retrieval in a CRN, but learning
similarity knowledge in a huge system can be expensive. To this end we are
performing experiments to learn similarity between cases in a quick and inexpensive
manner. Recently we have examined generating case-to-case similarity
knowledge by using an SNN and have demonstrated that this is capable of developing
case-to-case similarity knowledge suitable for similarity-based retrieval.</p>
      <p>In future work, we would like to experiment with training SNN on limited
data to ascertain whether they can successfully learn similarity knowledge. Also,
we would like to examine populating the IEs of a CRN using the values developed
by the output of an SNN to see whether we can return improved results with
spreading activation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Adeyanju</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          et al.
          <year>2009</year>
          .
          <article-title>Case Retrieval Reuse Net (CR2N): An Architecture for Reuse of Textual Soutions</article-title>
          . In: L.
          <string-name>
            <surname>McGinty</surname>
            ,
            <given-names>D. C.</given-names>
          </string-name>
          Wilson (eds)
          <source>CaseBased Reasoning Research and Development. ICCBR 2009. Lecture Notes in Computer Science</source>
          , vol.
          <volume>5650</volume>
          . Berlin: Springer-Verlag
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Bromley</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          et al.
          <year>1993</year>
          .
          <article-title>Signature Veri cation Using a"Siamese" Time Delay Neural Network</article-title>
          .
          <source>International Journal of Pattern Recognition and Arti cial Intelligence</source>
          ,
          <volume>7</volume>
          (
          <issue>4</issue>
          ) pp.
          <fpage>669</fpage>
          -
          <lpage>688</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>K</given-names>
          </string-name>
          and Salman,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <year>2011</year>
          .
          <article-title>Extracting Speaker-Speci c Information with a Regularized Siamese Deep Network</article-title>
          . In: J.
          <string-name>
            <surname>Shawe-Taylor</surname>
          </string-name>
          et al (eds
          <source>) Advances in Neural Information Processing Systems 24 (NIPPS</source>
          <year>2011</year>
          ). Granad, Spain,
          <source>December 12 17</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Das</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          et al.
          <year>2016</year>
          .
          <article-title>Together We Stand: Siamese Networks for Similar Question Retrieval</article-title>
          .
          <source>In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL</source>
          <year>2016</year>
          ). Berlin, Germany,
          <source>August</source>
          <volume>7</volume>
          -
          <issue>12</issue>
          ,
          <year>2016</year>
          . Stroudsburg, PA, USA: ACL
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Goker</surname>
            ,
            <given-names>M.H.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Roth-Berghofer</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <year>1999</year>
          .
          <article-title>Development and Utilization of a Case-Based Help-Desk Support System in a Corporate Environment</article-title>
          . In:
          <string-name>
            <surname>K-D.</surname>
          </string-name>
          Altho et al.
          <source>(eds) Case- Based Reasoning Research and Development: Third International Conference on Case-Based Reasoning, ICCBR99. Seeon Monastery, Germany. July 27 - 30</source>
          . Berlin: Springer-Verlag
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Goker</surname>
            ,
            <given-names>M.H.</given-names>
          </string-name>
          et al.
          <year>2006</year>
          .
          <article-title>The PwC Connection Machine: An Adaptive Expertise Provider</article-title>
          . IN:
          <string-name>
            <surname>Thomas</surname>
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Roth-Berghofer</surname>
          </string-name>
          et al.
          <source>(eds) Advances in Case Based Reasoning 8th European Conference</source>
          ,
          <string-name>
            <surname>ECCBR</surname>
          </string-name>
          <year>2006</year>
          . Fethiye, Turkey, September 4 -
          <issue>7</issue>
          ,
          <year>2006</year>
          . Berlin: Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Koch</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          et al.
          <year>2015</year>
          .
          <article-title>Siamese Neural Networks for One-Shot Learning</article-title>
          .
          <source>In: ICML 2015. Lille Grand Palais, Lille, 6 11 July</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Lao</surname>
            ,
            <given-names>S. I.</given-names>
          </string-name>
          et al.
          <year>2012</year>
          .
          <article-title>Achieving Quality Assurance Functionality in the Food Industry Using a Hybrid Case Based Reasoning and Fuzzy Logic Approach</article-title>
          .
          <source>Expert Systems with Applications</source>
          . Vol
          <volume>39</volume>
          . pp
          <fpage>5251</fpage>
          -
          <lpage>5261</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Lenz</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Burkhard</surname>
            ,
            <given-names>H. D.</given-names>
          </string-name>
          <year>1996</year>
          .
          <article-title>Case Retrieval Nets: Foundtions, Properties, Implementation and Results</article-title>
          .
          <source>[Technical Report</source>
          ] Berlin, Germany: Humboldt University
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Qi</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          et al.
          <year>2016</year>
          .
          <article-title>Sketch-Based Image Retrieval via Siamese Convolutional Neural Network</article-title>
          . In: 2016 IEEE ICIP. Phoenix Convention Centre, Phoenix, USA.
          <source>September 25 28</source>
          ,
          <year>2016</year>
          . Red Hook,
          <string-name>
            <surname>NY</surname>
          </string-name>
          , USA: Curran Associates
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>