<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Question Answering System for retrieving German COVID-19 data-driven and quality-controlled by Semantic Technology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Andreas Both</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Aleksandr Perevalov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Johannes Richard Bartsch</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Paul Heinze</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rostislav Iudin</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Johannes Rudolf Herkner</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tim Schrader</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jonas Wunsch</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ann Kristin Falkenhain</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rene Gurth</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Anhalt University of Applied Sciences, Kothen (Anhalt)</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Federal Ministry of the Interior</institution>
          ,
          <addr-line>Building and Community</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Informationstechnikzentrum Bund (ITZBund)</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The COVID-19 pandemic is a showcase for a data-driven society. However, making the corresponding data available is not easy due to local characteristics and time-depending metrics. In this paper, we present the Coronabot that is facilitating the access to German Coronavirus pandemic data. It is capable of answering German and English questions. The component-based system understands time-related questions and questions related to the localities of all administrative levels in Germany. The system is driven by semantic technologies from two perspectives. First, for all internal component interaction, RDF is used which is establishing an extensible architecture as well as microbenchmarking the integrated components as quality assurance is a crucial issue w.r.t. health and freedom-restricting scenarios. Second, several components take advantage of data from the Linked Open Data (LOD) cloud.</p>
      </abstract>
      <kwd-group>
        <kwd>Question Answering</kwd>
        <kwd>Coronavirus</kwd>
        <kwd>COVID-19</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>During the Coronavirus pandemic, numbers are presented to people on a daily
basis. For example, news portals provide such data using texts and interactive
maps. Many areas of interest for citizens (e.g., curfews) depend on the concrete
administrative regions. In Germany the Coronavirus data is captured and
evaluated on the district level (groups of villages and towns) which is an uncommon
abstraction level for ordinary citizens as they typically expect an answer for
their hometown. Moreover, historic data from weeks or months ago is not
easily accessible. Despite other aspects, this might lead to a misunderstanding and
misinterpretation of the current situation by politicians, decision makers, and
citizens as it is very hard for humans to remember exact numbers for a long
period of time. Additionally, debunking wide-spreading misinformation sometimes
Copyright © 2021 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
consumes precious resources. Hence, among other major challenges for societies,
a pandemic is also a reference example of the need for good data accessibility
providing the potential to increase transparency and trust.</p>
      <p>Consequently, o ering natural-language interfaces (i.e., Question Answering
systems, short: QA systems) to provide information access to data to any citizen
is obviously preferred, as common users are typically not familiar with
technical query languages. Such a QA system should work over veri ed structured
data storage, s.t., reasonable good quality can be ensured out of the box.
Finally, the quality of such a QA system needs to be very high due to the o cial
characteristics of the o ered data.</p>
      <p>
        To address these issues, we followed the Qanary methodology [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] for our
implementation, as it enables traceability through a centralized tracing of the QA
process and quality-control on the component level. The corresponding Qanary
framework is intended to build structured data-based QA systems by reusing
existing components. To store all information it uses the Resource Description
Framework1 (RDF) as internal knowledge representation. In this paper we
describe our Coronabot Demonstrator (cf. Figure 1) that was developed in
collaboration with the Federal Ministry of the Interior, Building and Community of
Germany and the Informationstechnikzentrum Bund (short: ITZBund) which is
the government-owned software development unit for the German authorities.
It encapsulates data-driven functionality that is also integrated in the o cial
COVID-19 chatbot of the German government2 which previously only had
supported FAQ-like functionality.
1 cf. https://www.w3.org/RDF/
2 https://c19.bundesbots.de/
      </p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Dialogue systems are mainly divided into two classes: (1) task-oriented [
        <xref ref-type="bibr" rid="ref5 ref6 ref7">6,5,7</xref>
        ]
and (2) general domain systems (like Amazon Alexa, Google Assistant, Yandex
Alisa). In this work, we refer our system to the 1st class as its main goal is to
consult people on COVID-19 questions. The architecture of data-driven dialogue
systems is extended with one or more QA components, such as: query builder,
document retriever, query executor, and passage retrieval (reader) component
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Typically, QA systems are separated into 2 main paradigms: (1) Knowledge
Base QA (KBQA) and (2) Open Domain QA (OpenQA). The KBQA systems
are designed to give precise answers to natural-language questions over
structured data [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] while transforming questions into a corresponding query to a KB
and then execute it in order to get an answer. End-to-end QA provides precise
answers to natural language questions. However, such systems require a large
set of training data as they are based on neural models and consequently are
data-hungry. Modern examples of OpenQA systems are [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], and [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. One of the
major problems of all QA systems is that its components are being created from
scratch all the time when a new system is developed [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. To overcome the
described problem, the Qanary framework was created [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The core concept of
the framework is reducing recurring e ort during the creation of QA systems.
Instead of implementing QA components from scratch, they should be reused.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Approach and Implementation</title>
      <p>The intended QA system is demanded to provide support on place-based
questions (e.g., \How many cases were reported in August in Dessau?"), where even
small places can be mentioned. Additionally, a time dimension is required,
leading to the possibility of fetching data for a speci c time span (e.g., \How many
people died in February ?"). Moreover, the system has to answer questions that
combine place and time dimensions. It is worth to mention that the system has
to work in two languages: German and English.</p>
      <p>Following the Qanary methodology, typical tasks of the question processing
are identi ed to model the components of the intended QA system. Each
component will execute its dedicated task, i.e., creating new information about the
given question and stores it in the Qanary triplestore which is representing the
global memory of the RDF information computed while analyzing a question.
For example, regarding the question \How many cases are reported in August
in Dessau?" there are at least 3 RDF annotations that are created connected
to the question resource established by the Qanary system: (1) there is a
timerelated statement from character index 29 to 37, and it is referring to August
2020, (2) at character index 42 to 47 a named entity is present that was linked
to https://www.wikidata.org/wiki/Q487070, and (3) the whole question has
the intent \case numbers". Hence, as (small) knowledge graph is created during
the processing of each question. In the Qanary methodology, this RDF data is
called semantic annotations of the given question.</p>
      <p>How many cases
were reported in
August in Dessau?</p>
      <p>Question Intent Classification ■
Time Entity Recognition (de/en) ■
Location Entity Recognition (de/en) ■</p>
      <p>RESTful
Request
Generation</p>
      <p>Natural
Language</p>
      <p>Generation</p>
      <p>As the data is stored as RDF the annotations are modeled using the Qanary
vocabulary which is a lightweight extension of the Web Annotation Data Model
(WADM)3. While retrieving the stored annotations, the subsequently executed
components of the QA process can retrieve any information that was previously
stored in the Qanary triplestore for the given question. Finally, in our
application, the data is fetched from an API4 via a RESTful request to a Web service
capable of providing the o cial data since the pandemic started.</p>
      <p>According to this approach the following Qanary components were designed
and implemented (see Figure 2): Language Detection as the component detecting
whether a German or English question was asked, Question Intent Classi cation
recognizes one 6 classes from the set: finfections, deathsg ftime, location, time
and locationg. Location Entity Recognition detects location entities and links
the detected text span to the Wikidata ID5, Time Entity Recognition recognizes
time entities in the question and converts it to a normalized date representation,
RESTful Request Generation generates and executes an NPGEO API request,
Natural Language Generation provides a textual answer. The components are
controlled by the pre-implemented Qanary pipeline (the reference
implementation of the Qanary methodology) that is available as open source6.</p>
      <p>Hence, while a question is processed, an RDF graph is created re ecting all
information that was computed within the QA process. To ful ll the quality
demands an extensive test set of 18,000 questions were de ned that is
evaluated while reusing the RDF data stored in the Qanary triplestore, i.e., each test
question is executed and thereafter several SPARQL queries are used to check
if the expected semantic annotations were created in the virtual graph of the
Qanary triplestore that is corresponding the current question. The evaluation
results demonstrated that the system achieved an F1 score of 0.896 on English
and 0.986 on German questions w.r.t. the prede ned test set of location
entities. Hence, by reusing background knowledge from the LOD cloud, an ad-hoc
implementation of reasonable quality was possible.
3 W3C Recommendation, 2017-02-23 (cf. http://www.w3.org/TR/annotation-model)
4 NPGEO API of Robert Koch institute, the German federal government agency
responsible for disease control and prevention: https://npgeo-corona-npgeo-de.
hub.arcgis.com/datasets/dd4580c810204019a7b8eb3e0b329dd6_0
5 The following Germany-speci c entities are detected: federal states (16), counties
(412), cities + communities (11806). The data was retrieved from the Wikidata KG.
6 cf. https://github.com/WDAqua/Qanary
In this work, we showed a Coronabot Demonstrator based on a
componentoriented architecture for creating dialogue systems over structured data driven
by semantic technologies. The Coronabot extends the existing German
government's chatbot functionality by providing a natural-language interface for
data in two dimensions: date and location. The system was developed
according to Qanary methodology, which demonstrated its exibility for developing
and evaluation processes. Since the QA system is RDF-based, it also o ers
the great advantage of processing traceability and thus end-to-end quality
control. The demonstrator capturing the described functionality is available at
http://coronabot.ins.hs-anhalt.de/ the complete functionality is available
as o cial Federal Coronabot at https://c19.bundesbots.de/. In the future,
the implementation will be extended to cover additional knowledge domains of
the Federal Government of Germany as well as additional generalized, reusable
Qanary components that will be published as Open Source. Based on our
outcomes, we believe that data-driven QA systems using semantic annotations have
a clear perspective to become a development standard for QA processes.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Both</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Diefenbach</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shekarpour</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cherix</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lange</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Qanary{a methodology for vocabulary-driven open question answering systems</article-title>
          .
          <source>In: European Semantic Web Conference</source>
          . pp.
          <volume>625</volume>
          {
          <fpage>641</fpage>
          . Springer (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Cui</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiao</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Song</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hwang</surname>
            ,
            <given-names>S.w.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>W.:</given-names>
          </string-name>
          <article-title>KBQA: learning question answering over QA corpora and knowledge bases</article-title>
          . arXiv preprint arXiv:
          <year>1903</year>
          .
          <volume>02419</volume>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Diefenbach</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lopez</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maret</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Core techniques of question answering systems over knowledge bases: a survey</article-title>
          .
          <source>Knowledge and Information systems 55(3)</source>
          ,
          <volume>529</volume>
          {
          <fpage>569</fpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Radhakrishna</surname>
            ,
            <given-names>A.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Both</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shekarpour</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lytra</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Usbeck</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , et al.:
          <article-title>Why reinvent the wheel: Let's build question answering systems together</article-title>
          .
          <source>In: Proceedings of the 2018 World Wide Web Conference</source>
          . pp.
          <volume>1247</volume>
          {
          <issue>1256</issue>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Wei</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peng</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tou</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>X.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wong</surname>
            ,
            <given-names>K.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dai</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          :
          <article-title>Task-oriented dialogue system for automatic diagnosis</article-title>
          .
          <source>In: Proceedings of the 56th Annual Meeting of the ACL</source>
          (Vol.
          <volume>2</volume>
          : Short Papers). pp.
          <volume>201</volume>
          {
          <issue>207</issue>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Wen</surname>
            ,
            <given-names>T.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vandyke</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mrksic</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gasic</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rojas-Barahona</surname>
            ,
            <given-names>L.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Su</surname>
            ,
            <given-names>P.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ultes</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Young</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>A network-based end-to-end trainable task-oriented dialogue system</article-title>
          .
          <source>arXiv preprint arXiv:1604.04562</source>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Yan</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Duan</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhou</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhou</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          :
          <article-title>Building task-oriented dialogue systems for online shopping</article-title>
          .
          <source>In: Proceedings of the AAAI Conference on Arti cial Intelligence</source>
          . vol.
          <volume>31</volume>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xie</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tan</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiong</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          :
          <article-title>End-toend open-domain question answering with BERTserini</article-title>
          .
          <source>In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations)</source>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>A.W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dohan</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Luong</surname>
            ,
            <given-names>M.T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norouzi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le</surname>
            ,
            <given-names>Q.V.</given-names>
          </string-name>
          :
          <article-title>QANet: Combining local convolution with global self-attention for reading comprehension</article-title>
          . ArXiv abs/
          <year>1804</year>
          .09541 (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>