<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshops, March</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>A Virtual Customer Assistant for the Wealth Management domain in the UWMP project</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Georgios Lekkas Objectway SpA</string-name>
          <email>davide.ingoglia@objectway.com</email>
          <email>doriana.filisetti@objectway.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Milan</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Italy georgios.lekkas@objectway.com</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ACM Reference Format: Andrea Iovine, Marco de Gemmis, Fedelucio Narducci, Giovanni Semeraro, Doriana Filisetti, Davide Ingoglia, and Georgios Lekkas. 2020. A Virtual Customer Assistant for the Wealth Management</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Andrea Iovine Università degli Studi di Bari Aldo Moro</institution>
          ,
          <addr-line>Bari</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Conversational Agents</institution>
          ,
          <addr-line>Digital Assistants, Finance, Wealth Management</addr-line>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Davide Ingoglia Objectway SpA</institution>
          ,
          <addr-line>Milan</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Doriana Filisetti Objectway SpA</institution>
          ,
          <addr-line>Milan</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>Fedelucio Narducci Università degli Studi di Bari Aldo Moro</institution>
          ,
          <addr-line>Bari</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff6">
          <label>6</label>
          <institution>Giovanni Semeraro Università degli Studi di Bari Aldo Moro</institution>
          ,
          <addr-line>Bari</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff7">
          <label>7</label>
          <institution>Marco de Gemmis Università degli Studi di Bari Aldo Moro</institution>
          ,
          <addr-line>Bari</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <volume>17</volume>
      <issue>2020</issue>
      <abstract>
        <p>The Universal Wealth Management Platform (UWMP) project has the objective of creating a new service model in the financial domain. An integral part of this service model is the creation of a new Virtual Customer Assistant, that is able to assist customers via natural language dialogues. This paper is a report of the activities performed to develop this assistant. It illustrates a general architecture of the system, and describes the most important decisions made for its implementation. It also describes the main financial operations that it is able to assist customers with. Finally, it delineates some avenues for future work.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Human-centered computing → Natural language
interfaces; • Computing methodologies → Information
extraction; Discourse, dialogue and pragmatics.</p>
    </sec>
    <sec id="sec-2">
      <title>1 INTRODUCTION AND BACKGROUND</title>
      <p>The purpose of Wealth Management firms is to advise clients
on investment strategies, execute orders on their behalf and
help them custody their financial assets. This type of work
has always been closely associated to personal relationships
and confidentiality. Today however, we expect that the
coming of age of a new, digital-savvy generation of wealthy
individuals will change the relations between clients and
wealth management firms.</p>
      <p>Digital Assistants such as Amazon Alexa and Apple Siri
have popularized the notion of software applications helping
users with everyday tasks. In the realm of business, such
applications are also known as Virtual Customer Assistants
and they support text or voice interactions to deliver
information or to act on behalf of the customer. The goal of a
Virtual Customer Assistant is twofold: first, to take over
routine interactions so that human service agents can engage in
more value-adding activities; second, to improve customer
experience by reducing friction, i.e. eliminating any factor
that can deter or slow down interactions between clients and
ifrm. There are more than 200 software companies ofering
Digital Assistants for customer interaction. In the financial
domain some prominent cases are IBM Watson, Microsoft
Virtual Assistant, boost.ai, Creative Virtual. Most of these
assistants interact via the bank’s mobile app and web site,
while a few in the USA use Facebook Messenger.</p>
      <p>
        For example, Royal Bank of Canada has a chatbot called
Arbie that helps users open a new account. Bank of
America’s assistant called Erica [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] interacts with customers using
voice and text messages. Wells Fargo’s chatbot [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] provides
account information via Facebook Messenger. Capital One’s
chatbot named Eno [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], interacts via SMS to execute money
transfers and supply account information.
      </p>
      <p>Objectway is a global Fintech 100 software provider of
the wealth, investment &amp; asset management industry. The
company launched its Universal Wealth Management
Platform (UWMP) initiative to implement a new, fully-digital
service model destined to financial institutions. The new
digital model complements the existing model based on financial
advisors and physical interactions, by ofering clients
selfserve functionality on a wide range of investment services.</p>
      <p>One of the activities of the UWMP project in support of the
new digital service model was to implement a service that
enables clients to interact with wealth management firms using
Natural Language dialogue. The goal was to empower clients
with informational and transactional capabilities that were
always-on and accessible from everywhere. The new service
would have to satisfy the requirement of confidentiality, so
priority was set on text interactions. Work on voice was
postponed due to potential issues with revealing sensitive
client information. Another requirement was to ensure high
quality of interactions, since failures would have an adverse
efect on the perception of quality and trust that clients place
on wealth management firms. This advised us to focus on the
most recurring, time-consuming routine tasks that clients
faced when interacting with the firm, such as requesting
information on account balance and performance.</p>
      <p>To try out more complex dialogues, we also decided to
explore tasks of a transactional nature, although we expect the
adoption of such features in real life to be slow. Investment
transactions increase the dificulty of interaction due to the
number and variety of financial products, order types and
the associated ambiguity that derives from such complexity.
The rest of this paper is organized as follows: the system
architecture is describe in Section 2, while Section 3 shows
how the system works. Conclusions are outlined in Section
4.
2</p>
    </sec>
    <sec id="sec-3">
      <title>SYSTEM ARCHITECTURE</title>
      <p>
        Chatbots can be classified as open-domain or goal-oriented.
Open-domain agents handle generic conversations, while
goal-oriented chatbots interact with users via natural
language conversations to assist them in their tasks. Goal-oriented
CAs can then be classified as informational, transactional
or advisory. Advisory chatbots learn from users, and can
recommend products based on the interaction, such as in
[
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. Our digital assistant falls into the category of
goaloriented chatbots [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Figure 1 shows a typical architecture
for a goal-oriented conversational agent.
      </p>
      <p>This architecture is called modular, as it is made up of
several components, each with a specific task.</p>
      <p>The Speech Recognizer component has the responsibility
of transcribing the user’s voice input into a text message.
This is an optional component used by conversational agents
that support a voice-based interaction.</p>
      <p>The Natural Language Understanding (NLU) component
takes in input the user’s text message, and outputs a
semantic representation of that message. The objective is to
understand the meaning of the message itself. This means
performing several Natural Language Processing tasks. In
the NLU component, Intent Recognition is done to
understand the action or the request that the user is making. For
example, the message "Pay 200 USD to Alice" means that the
user is trying to start a payment. Entity Recognition is also a
common NLU task, which is used to recognize mentions to
entities such as people, organizations, or numbers. From the
previous example message, it should be able to extract "200
USD" as a monetary amount, and "Alice" as a person name.
Sentiment Analysis is performed to understand the emotional
state expressed through the message. This could be used to
make the agent react diferently to diferent emotional states.</p>
      <p>For example, a customer support agent can decide to hand
of the request to a human operator, in case it detects that
the user is frustrated.</p>
      <p>
        The Dialog Manager (DM) component maintains an
estimate of the current state of the conversation. Based on
this state and the current user message, it decides the next
appropriate action to perform in order to complete the user’s
request. For example, the DM might respond by asking a
question (if some information is needed), or by performing a
transaction (if all information has been provided). Typically,
Goal-Oriented agents employ a frame-based Dialog Manager
[
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], in which goal-specific data is enclosed into frames, and
can be provided via slot filling . For example, the payment
frame requires several slots, such as the name of the payee,
the amount, and the type of payment. In order to complete
a payment, the DM will need to ask these slots one by one.
Users are also free to provide the values to the slots in any
preferred order, and the DM reacts accordingly. In our
architecture, the Dialog Manager also interacts with external
services that manage the domain-specific data and perform
A Virtual Customer Assistant for the Wealth Management domain in the UWMP project
the transactions. A Natural Language Generator (NLG)
component is used to transform the output of the DM into a
textual form, which can then be presented to the user. In our
architecture, the NLG component uses template responses,
that are filled dynamically with domain-specific data, as done
in Shah et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. Finally, voice-based systems adopt a
Text-tospeech synthesizer component to transform the text response
of the NLG into speech.
      </p>
      <p>
        Our agent implements the NLU, DM and NLG, with
Intent and Entity recognition functionalities implemented in
the NLU component. An analysis phase was conducted in
order to determine the most appropriate tools for
developing the aforementioned components. Several options were
vetted, based on their ability to cover the requirements of
the project. In particular, we opted for solutions that
require little training, since traditional supervised methods
require large amount of domain-specific conversational
corpora, such as [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Big tech companies such as Google or IBM
already provide their own platforms for the development of
conversational agents, such as Dialogflow 1 or Watson
Assistant2. These platforms provide a simple implementation
for most of the components of the architecture described in
Figure 1, such as Intent Recognition, Entity Recognition, and
Dialog Management. However, due to several limitations,
not all of their components are suitable for the requirements
of our project. Therefore, we decided to adopt the Intent
Recognition component from Dialogflow, while the other
parts of the architecture are custom-made.
      </p>
      <p>
        The Entity Recognition (ER) module used in the system is
implemented using Stanford CoreNLP3 and Apache Lucene4.
It is able to do both Named Entity Recognition and Entity
Linking. The ER function can recognize entities such as
numbers and person names, and also mentions to entities that
are contained in a dictionary (e.g. financial products). It uses
a combination of classifiers in order to recognize entity
mentions in the user message. A regex (regular expression)
classifier is used to recognize entities and keywords using exact
matching. Additionally, it uses a text classifier based on
Conditional Random Fields (CRF) [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The strength of the CRF
classifier is that it exploits the sentence structure to detect
entity mentions. Therefore, it is able to recognize entities that
cannot be confined in a dictionary (such as person names),
as well as misspelled and incomplete entities. The output of
the Entity Recognition function is then passed to the Entity
Linking function. Entity linking is used to map certain entity
mentions to objects in a knowledge base. Fuzzy matching is
used for the entity linking step, which allows the ER
component to map misspelled and incomplete entities. The ER
1https://dialogflow.cloud.google.com/
2https://www.ibm.com/cloud/watson-assistant
3https://stanfordnlp.github.io/CoreNLP/
4https://lucene.apache.org/
component can also recognize dates such as "November 13th,
2019", or relative time expressions such as "three weeks ago",
using the CoreNLP SUTime component.
      </p>
      <p>The Dialog Manager component was also custom-made
for this project. As said before, it uses frames to store the
goal-specific information, and slot filling to acquire said
information during the dialog. Given a user message, the Dialog
Manager can either: perform a transaction, request a slot, or
request a disambiguation. Disambiguation is required when
multiple entities are found as possible candidate values for a
slot. For example, given the user utterance "I want to buy 200
BMW shares", the ER component may recognize two
diferent products: "BMW AG" and "BMW ORD". Therefore, the
user will be asked to clarify which one should be selected.
During the conversation, the Dialog Manager also performs
checks on the slot values, and can auto-fill slot values based
on some conditions (e.g. when the user makes a payment to
a known payee).
3</p>
    </sec>
    <sec id="sec-4">
      <title>THE SYSTEM AT WORK</title>
      <p>The main objective of the Virtual Customer Assistant created
for the UWMP project is to assist customers of banks or
other financial institutions. The bot is reactive, that is, it
responds to requests made by users. It can respond both to
information requests, and can perform financial transactions.
This means that it can be categorized both as a informational
and transactional agent.</p>
      <p>From the informational side, the agent can be used to
obtain general information about the user’s financial
situation, such as the balance of the user’s cash account. Figure
2 shows an example of this use case. Given the message
"What is my cash account balance?", the NLU component will
recognize the account balance intent, and the agent will
provide the requested information, responding with: "Your cash
account balance is 4890.00 EUR". Users can also keep track
of the performance of their investments, such as the value,
the performance, and the profit and loss . The agent can also
provide a report for a specific time period provided by the
user. For example, a user can type "What was my portfolio
performance in the last three weeks?", or "What is my portfolio
performance from May 1st to August 31st?". This is possible
thanks to the time expression recognition component of the
Entity Recognizer, described in Section 2.</p>
      <p>Users can also perform financial transactions directly from
the chatbot, as said earlier. The most notable transactions
are payments and investments. Indeed, users can send
payments by writing for example "Send a payment of 200 USD to
Alice Smith". In this case, the NLU component will recognize
the payment intent, and some of the required entities, such
as the payee "Alice Smith", and the amount of "200 USD".
Alternatively, the user may not provide any information at
the start, e.g. by saying "I want to make a payment". The
Dialog Manager reacts to this accordingly, by collecting all the
mentioned entities, and prompting the user for the missing
information via slot filling. This can be seen in the example
in Figure 2. In this case, the user provided the payee, but not
the amount. Thus, the Dialog Manager responds by asking:
"Please tell me the amount to transfer". If the user wants to
make a payment to an already known payee, some slots will
be automatically filled, making repeated payments easier. If
multiple payees are found, the Dialog Manager will prompt
the user to specify the correct one. When all the required
information is collected, the Dialog Manager will ask for a
ifnal confirmation, e.g. by saying "I prepared a payment of 200
USD to Alice Smith, alias Aunt Alice, at Barclays account...".
An authorization code is required to complete the
transaction, to increase security. When the correct code is entered,
the agent completes the transaction, and returns a positive
feedback to the user, as seen in Figure 2.
The agent also lets the user invest in funds or trade stocks.
Investments can be made by specifying a product, the
number of stocks (or the amount of money to invest), and the
direction (buy or sell). For example, given the message "I
want to buy 200 BMW shares, the investment intent will be
recognized by the NLU component, as well as the amount
"200", and the "buy" keyword, indicating the direction of the
trade. The "BMW" entity will be extracted by the Entity
Recognizer, and the Entity Linking component will try to match
it to two diferent products: "BMW AG" and "BMW ORD". In
this case, the Dialog Manager will request the user to specify
the correct one, e.g. by saying "I found several matches for
this product.". This can be seen in the example in Figure 2.
Just like for payments, missing information is acquired via
slot filling.</p>
    </sec>
    <sec id="sec-5">
      <title>4 CONCLUSION</title>
      <p>In this paper, we presented a Virtual Customer Assistant
developed for the UWMP project. The aim of the project is
to assist users in completing financial operations of
varying complexity using natural language dialogues. The agent
supports a wide range of informational and transactional
operations, and several components were developed to support
them. As future work, we plan to investigate the
introduction of a voice-based interaction model. Another avenue for
future work is the introduction of advisory functionalities,
such as financial product recommendations, that enable the
agent to take a more proactive role in the interaction. Finally,
the Virtual Customer Assistant will be subject of in-vitro and
in-vivo experiments, that will assess its ability to aid users
in their financial tasks.</p>
    </sec>
    <sec id="sec-6">
      <title>5 ACKNOWLEDGEMENTS</title>
      <p>This work has been funded by the project UNIFIED
WEALTHMANAGEMENT PLATFORM - OBJECTWAY SpA - Via
Giovanni Da Procida nr. 24, 20149 MILANO - c.f., P. IVA 07114250967.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1] Bank of America Erica [n.d.].
          <source>Meet Erica, Your Financial Digital Assistant From Bank of America</source>
          . https://promo.bankofamerica.com/Erica/
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Antoine</given-names>
            <surname>Bordes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.-Lan</given-names>
            <surname>Boureau</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Jason</given-names>
            <surname>Weston</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Learning End-to-End Goal-Oriented Dialog</article-title>
          . arXiv:
          <volume>1605</volume>
          .07683 [cs] (May
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>CapitalOne</given-names>
            <surname>Eno</surname>
          </string-name>
          [n.d.].
          <article-title>Eno, your Capital One assistant</article-title>
          . https: //www.capitalone.com/applications/eno/
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Jenny</given-names>
            <surname>Rose</surname>
          </string-name>
          <string-name>
            <surname>Finkel</surname>
          </string-name>
          , Trond Grenager, and
          <string-name>
            <given-names>Christopher</given-names>
            <surname>Manning</surname>
          </string-name>
          .
          <year>2005</year>
          .
          <article-title>Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling</article-title>
          .
          <source>In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05)</source>
          .
          <fpage>363</fpage>
          -
          <lpage>370</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Andrea</given-names>
            <surname>Iovine</surname>
          </string-name>
          , Fedelucio Narducci, and Marco de Gemmis.
          <year>2019</year>
          .
          <article-title>A Dataset of Real Dialogues for Conversational Recommender Systems</article-title>
          . In CLiC-it
          <year>2019</year>
          . 6.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Fedelucio</given-names>
            <surname>Narducci</surname>
          </string-name>
          , Pierpaolo Basile, Marco de Gemmis, Pasquale Lops, and
          <string-name>
            <given-names>Giovanni</given-names>
            <surname>Semeraro</surname>
          </string-name>
          .
          <year>2019</year>
          .
          <article-title>An investigation on the user interaction modes of conversational recommender systems for the music domain. User Modeling and User-Adapted Interaction (Nov</article-title>
          .
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Fedelucio</given-names>
            <surname>Narducci</surname>
          </string-name>
          , Pierpaolo Basile, and
          <string-name>
            <given-names>Andrea</given-names>
            <surname>Iovine</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>A domain-independent Framework for building Conversational Recommender Systems</article-title>
          .
          <source>In KARS@Recsys</source>
          .
          <fpage>29</fpage>
          -
          <lpage>34</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>A</given-names>
            <surname>Rudnicky</surname>
          </string-name>
          .
          <year>1999</year>
          .
          <article-title>AN AGENDA-BASED DIALOG MANAGEMENT ARCHITECTURE FOR SPOKEN LANGUAGE SYSTEMS</article-title>
          .
          <source>IEEE Automatic Speech Recognition and Understanding Workshop</source>
          <volume>13</volume>
          (
          <year>1999</year>
          ),
          <fpage>4</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Kiner</surname>
            <given-names>B</given-names>
          </string-name>
          <string-name>
            <surname>Shah</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Approaches towards Building a Banking Assistant</article-title>
          .
          <source>International Journal of Computer Applications</source>
          <volume>166</volume>
          (
          <year>2017</year>
          ),
          <fpage>6</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Wells</surname>
            <given-names>Fargo Chatbot</given-names>
          </string-name>
          <year>2017</year>
          .
          <article-title>Wells Fargo first U.S. bank with Facebook Messenger chatbot</article-title>
          . https://stories.wf.com/helpful-bankingassistanton-facebook/
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>Jason</given-names>
            <surname>Williams</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Antoine</given-names>
            <surname>Raux</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Matthew</given-names>
            <surname>Henderson</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>The Dialog State Tracking Challenge Series: A Review</article-title>
          .
          <source>Dialogue &amp; Discourse</source>
          <volume>7</volume>
          ,
          <issue>3</issue>
          (April
          <year>2016</year>
          ),
          <fpage>4</fpage>
          -
          <lpage>33</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>Tiancheng</given-names>
            <surname>Zhao</surname>
          </string-name>
          and
          <string-name>
            <given-names>Maxine</given-names>
            <surname>Eskenazi</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Towards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learning</article-title>
          .
          <source>(Jun</source>
          <year>2016</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>