<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Temporal Evolution, Research Themes, and Emerging Trends in Case-Based Reasoning Literature</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Gu Dongxiao</string-name>
          <email>gudongxiao@hfut.edu.cn</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Liu Bo</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bichindaritz Isabelle</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Liang Changyong</string-name>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>Case-Based Reasoning, Informetric Analysis, Knowledge Map, Co-citation Analysis, Emerging Trends</string-name>
        </contrib>
      </contrib-group>
      <fpage>1994</fpage>
      <lpage>2007</lpage>
      <abstract>
        <p>Case-based reasoning, a methodology of artificial intelligence, is applicable to various fields, such as fault diagnosis, medical and health decision support, engineering aided design, and risk pre-alert, etc. In recently years, this area has attracted contributions from many researchers, but little work has described the overall development of case-based reasoning research through informetrics or literature visualization. To analyze the temporal evolution, research themes, and emerging trends in case-based reasoning, in this paper, we completed an informetrics analysis based on 4460 articles about case-based reasoning published from 2000 to 2015 in SCI-E, SSCI, CPCI-S and CPCI-SSH, the sub-databases of Web of Science, using visual knowledge maps and informetrics methods. This paper summarizes conclusions on the temporal evolution, research themes, and emerging trends for case-based reasoning. The results will help researchers rapidly grip the overall development and future directions of case-based reasoning.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        the late 1980s and the early 1990s, CBR concepts impacted numerous fields such as computer
science (Ros, Arcos, Mantaras, &amp; Veloso, 2009), medicine
        <xref ref-type="bibr" rid="ref12">(Gu, Liang, &amp; Zhao, 2017)</xref>
        ,
engineering
        <xref ref-type="bibr" rid="ref11">(Gu, Liang, Bichindaritz, Zuo, &amp; Wang, 2012)</xref>
        , jurisprudence
        <xref ref-type="bibr" rid="ref3">(Branting, 2003)</xref>
        ,
environmental science (Toro, Meire, Gálvez, &amp; Fdez-Riverola, 2013), public administration
and policy
        <xref ref-type="bibr" rid="ref2">(Amailef, &amp; Lu, 2013)</xref>
        , business administration and E-commerce
        <xref ref-type="bibr" rid="ref22">(Li, &amp; Sun,
2009)</xref>
        . In the new millennium, CBR systems have continually integrated with other AI
techniques including artificial neural networks (ANN)
        <xref ref-type="bibr" rid="ref16">(Henriet et al., 2012)</xref>
        , rule-based
reasoning (RBR)
        <xref ref-type="bibr" rid="ref21">(Kumar, Singh, &amp; Sanyal, 2009)</xref>
        , genetic algorithms
        <xref ref-type="bibr" rid="ref1">(Ahn, &amp; Kim, 2009)</xref>
        and others, CBR research has been focused on projects concerning knowledge discovery, case
representation, reasoning and meta-reasoning models, retrieval algorithms, similarity
assessment, case adaptation and management, and applications.
      </p>
      <p>
        To date, there has been many review studies regarding the CBR methodology, the
construction and application of CBR systems
        <xref ref-type="bibr" rid="ref11 ref12">(Gu, Liang, &amp; Zhao, 2017; Gu, Liang,
Bichindaritz, Zuo, &amp; Wang, 2012)</xref>
        , and CBR integration with other methods
        <xref ref-type="bibr" rid="ref1 ref21">(Kumar, Singh,
&amp; Sanyal, 2009; Ahn, &amp; Kim, 2009; Wei, Mahmud, &amp; Raj, 2014)</xref>
        . Most existing relevant
literature reviews have focused on CBR technology and the applications of CBR, but have
hardly described the overall development of CBR as a field. For example, Watson and
        <xref ref-type="bibr" rid="ref23">Marir
(1994)</xref>
        in 1994 described the development of CBR technology in the last century,
        <xref ref-type="bibr" rid="ref6">Chen and
Burrell (2001)</xref>
        in 2001 analyzed the development of CBR applications with artificial neural
networks,
        <xref ref-type="bibr" rid="ref10">Greene et al. (2008)</xref>
        in 2008 summarized the evolution of research themes in the
CBR conference literature (ICCBR, ECCBR, and EWCBR) published from 1993 to 2008,
however, they did not analyze developments and emerging trends of CBR research using
informetrics and visualization approaches
        <xref ref-type="bibr" rid="ref20 ref8">(Kim, &amp; Chen, 2015; Fang, 2015)</xref>
        , In contrast to
published articles, this paper has four advantages: (1)Use informetrics and visualization
approaches for analysis; (2)Analyze up-to-date, the literature records in this paper published
from 2000 to 2015; (3)More literature types, including proceedings papers, journal articles
and reviews; (4)More comprehensive analysis, containing temporal evolution, literature
co-citation, journals co-citation, research themes, and emerging trends etc.
      </p>
      <p>To make up the research gap mentioned above, and also explore the overall development and
future directions of CBR technology, in this study, we conducted an informetrics analysis
based on published articles in CBR and investigated the implicit knowledge associated with
CBR methodology. We collected 4460 articles from 4 databases including SCI-E, SSCI,
CPCI-S and CPCI-SSH, which are the sub-databases of Thomson Reuter’s Web of Science
(WOS), and conducted literature data analysis with the HistCite, CiteSpace, Netdraw
bibliometric tools, among others. After that, we summarized the temporal evolution, research
themes, and emerging trends for CBR research in the 21st century. The results of this paper
will be helpful for relevant researchers in CBR, and also to promote research and
development in CBR.</p>
      <p>The rest of this paper is organized as follows: In section 2, we introduce the methods and
tools we used in this research, and also explain the process of data collection in detail. In
section 3, we thoroughly present the results of the informetrics analysis of literature data
associated with CBR using HistCite, CiteSpace, etc, including changes in published articles
over time, knowledge domain visualization (co-citation analysis of literature), core journals
and co-citation analysis, and research trends evolution analysis. Finally, this paper concludes
with a summary of findings and some future directions in Section 4.</p>
    </sec>
    <sec id="sec-2">
      <title>Methodology</title>
      <sec id="sec-2-1">
        <title>Literature data</title>
        <p>The literature data for this study were retrieved from SCI-E, SSCI, CPCI-S, and CPCI-SSH,
the sub-databases of the Web of Science, on November 25, 2016. The detailed retrieval
process is as follows:
Firstly, retrieve relevant literature by “topic = (case-based reason*)” in SCI-E, SSCI, CPCI-S
and CPCI-SSH, the sub-databases of WOS, with time span from 2000 to 2016, which
returned 4465 articles;
Secondly, eliminate 5 repeated or invalid articles by using HistCite software;
Finally, the remaining 4460 articles are pertinent and were used for informetrics analysis.</p>
      </sec>
      <sec id="sec-2-2">
        <title>Methods and tools</title>
        <p>
          There are mainly two methods, informetrics and visualization analysis, and two tools,
HistCite and CiteSpace, used in this paper, Informetrics combines mathematics, statistics and
philology, to quantitatively analyze knowledge carriers and quantify the implicit knowledge
in literature data, focusing on the object of the analysis, which in this research consists in
literature data
          <xref ref-type="bibr" rid="ref24">(Mingers, &amp; Leydesdorff, 2015)</xref>
          . In this case, informetrics is also called
bibliometrics, a branch of informetrics. In the early 1900s, the method of quantitative
literature analysis was created first to allow researchers mainly to count and classify
documents according to quantitative statistical methods. After the 1960s, some researchers
integrated bibliometrics concepts into statistics, and since then bibliometrics has become a
multidisciplinary study of statistics and metrics, and a vital paradigm in library and
information science. The strengths of bibliometrics is to mathematically mine the implicit
knowledge from an abundant literature and to statistically infer the characteristics and
prospects of a specific subject. In this paper, we mapped the evolution and development of
CBR research based on informetrics and visualization analysis.
        </p>
        <p>
          Statistical analysis with HistCite. HistCite is a web-based software enabling researchers to
analyze the overall view of literature records from the Web of Science. Its major feature is
statistical analysis
          <xref ref-type="bibr" rid="ref4 ref9">(Garfield, 2009; Bornmann, &amp; Marx, 2012)</xref>
          . By using HistCite to analyze
literature data, we obtained a large volume of information about the development of CBR.
The overview of 4460 articles is as follows: there are 2966 keywords in 7 languages,
contributed by 5895 authors from 1728 institutions, published in 1718 journals, and circulated
in 89 countries/regions during the years 2000 to 2015, and the references of these papers are
49212.
        </p>
        <p>
          Visualization analysis with CiteSpace. CiteSpace is a Java application for analyzing and
visualizing developments and trends in scientific literature, it was developed by Professor
Chen Chaomei
          <xref ref-type="bibr" rid="ref5">(Chen, 2006)</xref>
          as a tool for knowledge visualization. By using CiteSpace, we
can mine valuable information from literature records and visualize developments and trends
of CBR research, which are also two main tasks in this paper. The main analysis contents
include changes over time of published articles, co-occurrence of knowledge carriers (two
levels: references and journals), and evolution analysis of research hot topics.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <sec id="sec-3-1">
        <title>Distribution over time</title>
        <p>To explore publication trends of CBR research in the 21st century, we examined the temporal
changes in 4460 articles, which describe the yearly number of CBR publications, reflecting
some changes in research interests of global scholars, and also revealing the future
development trends in CBR. In this section, the major bibliometrics indicator is the annual
number of articles (referred to as Recs for records) – see Figure 1.</p>
        <p>
          Fig 1. Temporal distribution of the CBR Recs (records) between 2000 and 2015
From Figure 1, we mainly divide this time series into two stages. Shown with the left arrow,
the first stage from 2000 to 2006, is a period of sustained development, all of the Recs rose
steadily except an abnormal high point in 2001. CBR technology, as an advanced topic,
attracted larger numbers of relevant researchers at this stage, who produced large quantities of
excellent academic papers, such as
          <xref ref-type="bibr" rid="ref15 ref17 ref7">(Hui, &amp; Jha, 2000; Humphreys, Mcivor, &amp; Chan, 2003;
Chow, Choy, Lee, &amp; Lau, 2006)</xref>
          . The second stage from 2006 to 2014, is a period of ups and
downs, showing mainly three changes: a dive in 2007, a continuous rise again from 2008 to
2009, and a slow decrease from 2010 to 2013. It shows that most researchers have not
contributed satisfactorily to innovation in CBR since 2009, and we also found a similar
situation from the annual total global citation scores of articles. In addition, owing to the fact
that part of the papers published in 2015 and 2016 may not have been included, we do not
have a complete analysis of 2015 and 2016. However, it is notable that the quantity of
literature rose again in 2014, and in consideration of the emerging research themes in recent
years, such as big data, cloud computing, Internet of Things, and smart health, by integrating
CBR technology with these emerging field, 2014 might be a turning point and may hold that
it is possible for the research of CBR to rise again.
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Co-occurrence of knowledge carriers</title>
        <p>There are two carriers analyzed in this section, references co-citation and journal co-citation.
The references co-citation is essential for informetrics in order to investigate the knowledge
base of the CBR field and distinguish the leading edge (Zhu, &amp; Hua, 2017), while the journal
co-citation can distinguish the core journals, the marginal journals and the relative preference
between them, allowing researchers to rapidly identify important documents and the key
journals available for their contributions.</p>
        <p>
          Knowledge base of subject development. If one document cites two other documents together,
these two documents are co-cited. The more co-citations two documents receive, the more
likely they are semantically related (Small, 2003). Document co-citation indicates the
knowledge base of a subject or a research field, which is the stepping-stone of insights into
research
          <xref ref-type="bibr" rid="ref5">(Chen, 2006)</xref>
          . Document co-citation measures a spatial data assemblage of
documents using citation relationships.
        </p>
        <p>
          Early in 1965,
          <xref ref-type="bibr" rid="ref25">Price (1965)</xref>
          proposed the concept of the research frontier to depict dynamic
nature of academic research. He claimed that the research frontier of one field was built on
40-50 documents published in recent years. While the knowledge base is a concept which
benefits to further distinguish the nature of the research frontier (Persson, 1994). If the
research frontier is defined as the development of a research field, accordingly the knowledge
base consist of the references of the research frontier, professor Chen Chaomei
          <xref ref-type="bibr" rid="ref5">(Chen, 2006)</xref>
          ,
the software developer of CiteSpace, redefined the knowledge base of the research frontier as
the quote path of the references, i.e, literature co-citation. Which means the research frontier
and the knowledge base can be found through co-citation analysis.
        </p>
        <p>Fig 2. The network of CBR references co-citation
Figure 2 shows the CiteSpace results of references co-citation of 4460 articles, analyzing the
top 50 cited references for each one-year time slice. The threshold value of the cited
documents is Freq&gt;=17 and retained more than 30 nodes. The colored lines represent the
years of the first co-citations, and the rings of the nodes are co-citation frequencies.
Obviously, there are two major color groups in the network of literature co-citation, a cold
area and a warm area, which represent the knowledge base and research frontier respectively.
In the blue area, all the cited references were published in the early CBR stage, and also
belong to highly cited documents; as a result, these cited references are the knowledge base of
CBR research. In the red area, overall cited references were contributed in recent years;
furthermore, these documents are highly cited documents, consequently all the cited
references are the research frontier of CBR research, shown in the red area. According to
above results, tables 1a and 1b illustrate the top 33 highly cited documents.</p>
        <sec id="sec-3-2-1">
          <title>Remembering to forget: A competence-preserving case deletion policy for case-based reasoning systems</title>
        </sec>
      </sec>
      <sec id="sec-3-3">
        <title>Journal/Book</title>
        <sec id="sec-3-3-1">
          <title>Book</title>
          <p>AI Commun
14th Int Joint C AI</p>
        </sec>
      </sec>
      <sec id="sec-3-4">
        <title>Year</title>
        <p>2005
2006
2007
2009
Leake DB</p>
        <sec id="sec-3-4-1">
          <title>Watson I</title>
        </sec>
        <sec id="sec-3-4-2">
          <title>Lenz M</title>
          <p>Watson I
Aha DW
Chiu CC
Corchado</p>
          <p>JM
Pal SK</p>
        </sec>
      </sec>
      <sec id="sec-3-5">
        <title>Author</title>
        <p>De Mantaras</p>
        <p>RL
Bichindaritz</p>
        <p>I
Diaz-Agudo</p>
        <p>B
Ahn H
2011
Begum S</p>
      </sec>
      <sec id="sec-3-6">
        <title>Freq</title>
        <p>25
40
18
24
19</p>
        <sec id="sec-3-6-1">
          <title>CBR is a methodology not a technology</title>
        </sec>
        <sec id="sec-3-6-2">
          <title>Knowl-Based Syst</title>
        </sec>
        <sec id="sec-3-6-3">
          <title>CBR in context: The present and future</title>
        </sec>
        <sec id="sec-3-6-4">
          <title>Applying Case-Based Reasoning: Techniques for Enterprise Systems</title>
        </sec>
        <sec id="sec-3-6-5">
          <title>Case-Based Reasoning Technology: From Foundations to Applications</title>
        </sec>
        <sec id="sec-3-6-6">
          <title>Conversational case-based Reasoning</title>
        </sec>
        <sec id="sec-3-6-7">
          <title>A case-based customer classification approach for direct marketing</title>
        </sec>
        <sec id="sec-3-6-8">
          <title>Constructing deliberative agents with</title>
          <p>case-based reasoning technology</p>
        </sec>
        <sec id="sec-3-6-9">
          <title>Foundations of Soft Case-Based Reasoning Case Based Reasoning</title>
        </sec>
        <sec id="sec-3-6-10">
          <title>Book</title>
        </sec>
        <sec id="sec-3-6-11">
          <title>Case Based Reasoning</title>
        </sec>
        <sec id="sec-3-6-12">
          <title>Appl Intell</title>
        </sec>
        <sec id="sec-3-6-13">
          <title>Expert Syst Appl</title>
        </sec>
        <sec id="sec-3-6-14">
          <title>Int J Intell Syst</title>
        </sec>
        <sec id="sec-3-6-15">
          <title>Book</title>
        </sec>
      </sec>
      <sec id="sec-3-7">
        <title>Title</title>
        <sec id="sec-3-7-1">
          <title>Retrieval, reuse, revision, and retention in case-based reasoning</title>
        </sec>
        <sec id="sec-3-7-2">
          <title>Case-based reasoning in the health sciences: What's next?</title>
        </sec>
        <sec id="sec-3-7-3">
          <title>Building CBR systems with JCOLIBRI</title>
        </sec>
        <sec id="sec-3-7-4">
          <title>Global optimization of case-based reasoning for breast cytology diagnosis</title>
        </sec>
        <sec id="sec-3-7-5">
          <title>Case-based reasoning systems in the health sciences: A survey of recent trends and developments</title>
        </sec>
      </sec>
      <sec id="sec-3-8">
        <title>Journal</title>
        <sec id="sec-3-8-1">
          <title>Knowl Eng Rev</title>
        </sec>
        <sec id="sec-3-8-2">
          <title>Artif Intell Med</title>
        </sec>
        <sec id="sec-3-8-3">
          <title>Sci Comput Program</title>
        </sec>
        <sec id="sec-3-8-4">
          <title>Expert Syst Appl</title>
        </sec>
        <sec id="sec-3-8-5">
          <title>IEEE T Syst Man C Part C: A&amp;R</title>
          <p>There are 78 clusters among the co-cited documents in figure 2. Table 2 illustrates the top 10
clusters (the size of clusters is: more than 20). The size reflects the number of cluster nodes,
and the silhouette is the contour value of the clusters, which is a measure of network
homogeneity. The network homogeneity is proportional to the silhouette: the closer the
silhouette is to 1, the higher is the network homogeneity. If the silhouette is not less than 0.5,
the cluster is reliable; if not less than 0.7, highly reliable. The label is the result of topic
extraction by the LLR (Log-Likelihood Ratio) algorithm. Mean Year is the average of the
years of citation. Most of the cited references of literature records about CBR research were
included in the top 21 clusters (covering 85.4% of all the documents), which means that these
cluster terms can represent the core content of the knowledge base and the research frontier.
0.497
0.663</p>
          <p>recommender system (2219.56)
case-based reasoning-perspective (1651.08)</p>
          <p>possible failure (1414.44)
multiple proportion case-basing (1414.44)
supporting ontological integration (921.52)
proficient knowledge (921.52)
pattern classification (2235.31)
retrieval strategies (2235.31)</p>
          <p>dos attack (1433.1)
agent-based intrusion detection mechanism</p>
          <p>soap message (1179.33)
resource allocation (1117.67)
learning automata (1117.67)
multi-modal reasoning system (2689.72)</p>
          <p>utility problem (2460.56)
adaptation methodology (2255.01)
environmental emergency preparedness (2241.37)</p>
          <p>supply network (6232.05)
supplier relationship management (3443.7)
diabetes management (3121.39)
knowledge management (3021.8)
2008
2005
1997
2006
2004
1997
2008
1998
1998
Core journals and trends. If a document in one journal cites documents in two other journals,
these two journals are co-cited (Small, 2003). Journal co-citation indicates many factors, such
as the main knowledge source for disciplinary development, specific journals for a research
field, and academic spheres consisting of journal clusters, distinguishing core journals and
marginal journals. Figure 3 shows the CiteSpace results for the literature data. A time slice is
a span of 1 year, the threshold value of time slices is the top 100, the type of network pruning
is pathfinder, and the threshold value of journals display is co-citation frequency &gt; 150 (to
provide a brief and clear layout to understand).</p>
          <p>Fig 3. Journal co-citation network</p>
          <p>Fig 4b. Declining &amp; remaining journals (partial)
According to the colorful rings in figure 3, we analyzed the change of co-citations in the top
24 journals, and randomly selected 12 journals to draw the change curve of co-citation
history, which includes 6 rising journals (shown in figure 4a) and 6 declining or remaining
journals (shown in figure 4b). In recent years, the co-citation frequency of several journals has
been decreasing gradually, mainly including APPL INTELL, ARTIF INTELL MED, ARTIF
INTELL, CASE BASED REASONING, COMMUN ACM, ENG APPL ARTIF INTELL,
IEEE EXPERT, IEEE T SYST MAN CYB, LECT NOTES ARTIF INT, and MACH
LEARN, while the co-citation frequency of some journals has been increasing gradually,
mainly containing AI COMMUN, ARTIF INTELL REV, DECIS SUPPORT SYST, EUR J
OPER RES, EXPERT SYST APPL, FUZZY SET SYST, IEEE T KNOWL DATA EN,
INFORM SCIENCES, KNOWL ENG REV, and KNOWL BASED SYST. We also found
that the preference of the journals with decreasing trend is more inclined to the research of
CBR method, while the journals with increasing trend prefer to receive the study about CBR
application.</p>
        </sec>
      </sec>
      <sec id="sec-3-9">
        <title>Research focus</title>
        <p>The keywords associated with a document provide a summary, which can intuitively present
its major research content. According to co-word analysis of the keywords of several
documents in a research field, we can trace the major contents of this research field during a
certain period, and also explore the potential trends for the future by tracking the changes of
the keywords co-occurrence frequency over time. Co-word means two or more keywords
appearing in one document together. Co-word analysis is a text-based analysis method, which
counts the co-occurrence frequency of a pair of words in several documents to measure the
relationship between the keywords (Wu, &amp; Leu, 2014).</p>
        <p>To analyze the research focus in CBR, we used co-words analysis with the CiteSpace
software. The analysis process of CiteSpace includes three steps, extracting keywords,
building the matrix of co-words, and drawing the network of co-occurrences (Wu, &amp; Leu,
2014). The relevant parameters of CiteSpace are: time span from 2000 to 2015, one year per
time slice, select top100 keywords, the co-occurrence frequency per time slice, the network
pruning type is pathfinder. The analysis results are shown in Figure 5, and the colored bar at
the top of the figure corresponds to 16 years, from 2000-2015; the colored circles represent
the keywords (a.k.a. the nodes); the bigger nodes indicate the higher co-occurrence frequency;
the thickness of colored layers refers to the frequency of the nodes in various years; the lines
between two nodes indicate the co-occurrence relationship of two keywords in one document;
the color of lines indicates the first year of the keywords co-occurrence. The results are shown
in Table 3 (frequency of the top 20 keywords) and Figure 5 (the co-occurrence network of
keywords).
knowledge management
artificial intelligence</p>
        <p>retrieval
knowledge</p>
        <p>Freq
500
122
40
35
33
27
25
24
24
21</p>
        <p>Keyword
decision support</p>
        <p>classification
machine learning
knowledge based system
selection
similarity
framework
knowledge representation</p>
        <p>genetic algorithm
information retrieval</p>
        <p>Freq
15
14
14
14
11
11
10
10
10
9</p>
        <p>Fig 5. The co-occurrence network of keywords
From Table 3 and Figure 5, we can find that the top 3 keywords are case based reasoning,
system, and expert system, and the ratio of case-based reasoning is maximum, showing that
the core of CBR research lies in CBR methodology and its application.</p>
        <p>In addition, according to the sequential evolution of keywords, we summarized two trends in
CBR research development from 2000 to 2015. The first one is that the research in CBR has
placed more emphasis in actual applications and fulfilling real demands from society. For
example, from 2000 to 2009, the research focus of CBR concentrated on the methodological
layer, the typical keywords containing case-based reasoning, knowledge management (KM),
information retrieval, similarity, classification and model. However, since 2010, the research
focus has been to emphasize problem solving, for instance, decision support, expert system,
fault diagnosis, health service, and so forth. The second trend shows increased integration
with other techniques or methods. Before 2010, the research in CBR was involved in its core
methodology, such as case based reasoning, retrieval, classification, selection, similarity, and
knowledge representation, which are all fundamental CBR topics. However, since 2010, CBR
research has been applied more broadly, and more relevant research topics have been related
to CBR integration with other techniques, including neural networks, machine learning,
artificial intelligence, ontology, data mining, genetic algorithm, and others.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>In this study, we have conducted an informetrics analysis to explore the temporal distribution
and emerging trends of CBR research. This research has analyzed literature data from 4460
papers published from 2000 to 2015 and indexed by the databases SCI-E, SSCI, CPCI-S and
CPCI-SSH. From CiteSpace, HistCite, and visual graph, we can summarize several results as
follows:
With technical research evolution over time, until 2014 the number of published papers
associated with CBR had decreased since 2006, such that in the last 5 years, the development
of CBR research generally presented this tendency steadily. However, we found that CBR
research still has great value in consideration of two aspects; the first consideration is the pull
factor, referring to the research actual demand, for instance, health-care management,
artificial intelligence systems, text-based sentiment analysis, etc; the push factor is the second
consideration, which is the emergence of new technologies, which includes big data, cloud
computing, the Internet of Things, etc.</p>
      <p>In the co-occurrence analysis of knowledge carriers, on the one hand, we summarized several
typical references about the knowledge base and the research frontier in CBR field. We also
listed relevant details of its typical references. We identified the major research contents of
these typical references through clustering; on the other hand, we analyzed the changes in the
co-citation frequency of the core journals.</p>
      <p>We summarized two trends of development in CBR research from 2000 to 2015 through the
evolution of the core keywords over time. First, the research in CBR has placed more
attention in creating actual applications and thus fulfilling actual demands of society. Second,
more integration with other technologies or methods has been taking place.</p>
      <p>In conclusion, we have conducted a comprehensive and systematic analysis and discussion
about the development of CBR in 21st century. The informetrics analysis and visualization
based on historical literature data will help scholars understand the general development,
research hot topics, and potential future directions in the area of CBR. To foster CBR
research, according to the analysis results in this paper and the development of emerging
information techniques, we suggest two directions for future work.</p>
      <p>First, the research of depth information integration and knowledge services for
high-dimensional dynamic space-time cases. Extensive application of big data technology and
general development of Internet of things made sequential cases with temporal-spatial trait
present four obvious features, the explosive growth of data volume, the high-dimensional data
structure, the complex data types, and the dynamic evolution of case data, and the existing
system of case-based reasoning cannot meet such demands for processing large-scale data. On
the one hand, the age of big data has brought great challenges for data processing in
case-based reasoning, the development of case-based reasoning has to make new innovation
and change to realize operation and maintenance of large-scale case base, for instance, the
innovation of representation method for high-dimensional heterogeneity and time series cases,
the change of organization and storage method for large-scale case base, the innovation of
efficient case-retrieve model for case-knowledge quickly obtain and visualization for retrieve
results based on larger-scale case base; on the other hand, the rise of Internet of Things and
wearable device provides a new research direction for CBR system, the Internet of Things is
all things are connected in brief, its foundation and core is still Internet, and wearable device
is representative product of information technology in the era of the Internet of Things. CBR
system based on big data and cloud computing not only need to processing static and
historical cases, and also need to analyzing dynamic and real-time data, the Internet of Things
and wearable device enable case base to real-time obtain case data, but it is a challenge for
CBR system to connect with wearable device and Internet of Things at the moment.
Second, the research of theories and methods for collaborative CBR system in cloud
computing environment. Now, the development in CBR system is facing many challenges,
such as the storage and organization for larger-scale case base, distributed retrieval and
similarity measures, and multi-agent collaborative operation and maintenance. In
consideration of these issue, at first, we suggested that construct novel CBR system based on
big data and cloud platform for the organization and storage of larger-scale case base and
distributed retrieval and similarity measures; further, to address collaborative smart CBR
systems (CS-CBRS), CS-CBRS is integrated with multi-agent systems (MAS) and is actually
a novel case-based reasoning technique based on cloud computing and big data analysis. As a
powerful analytical technique of big case data for knowledge discovery from multiple
heterogeneous case bases located in different agencies and cities, it allows problem solving
experiences to be shared among multiple institutes and has the potential to improve the
overall performance of knowledge-based reasoning systems compared with traditional CBR
systems. As a mechanism that enhances their individual reasoning capabilities, CS-CBRS
offers a new paradigm for organizing artificial intelligence applications and may be used to
solve important challenges in the area of complex heterogeneous big data from various
organizations. The possible key research questions in the CS-CBRS research include
problem-oriented mathematical modeling, intelligent case revision and solution generation,
the visualization of analysis results, as well as data standardization, data quality assurance,
data sharing mechanisms and privacy protection for big historical case data.</p>
      <p>In conclusion, if CBR technology could successfully realize integration with emerging
information techniques including big data, Internet of Things, and cloud computing, the
present situation and mentioned problems about CBR research will be greatly solved, and the
performance and efficiency of a CBR system will be greatly improved.</p>
      <p>This research is the first review investigating the temporal distribution, emerging trends and
new developments of CBR in the 21st century to help scholars better understand the whole
development process, current status, and possible directions for future research. Owing to
space limitations, we only thoroughly described partial analysis results of CBR, mainly
including sequential distribution, co-citation of literature, co-occurrence of journals, and
research focus. In addition, we also analyzed the spatial distribution and cooperation network
of literature data about CBR, and containing three levels: countries/regions, institutions, and
individual. The analysis results of spatial distribution and cooperation network will be
presented in a future publication.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgments</title>
      <p>The data collection, analysis and interpretation of this research are partially supported by the
National Natural Science Foundation of China (NSFC) under grant Nos. 71771077,
71331002, 71601061, 71301040 &amp; 71573071 as well as China Social Science Foundation
(major project program) under grant No. 12&amp;ZD221.
Persson, O. (1994). The intellectual base and research fronts of JASIS 1986-1990. Journal of the</p>
      <p>Association for Information Science &amp; Technology, 45(1), 31-38.</p>
      <p>Ros, R., Arcos, J. L., Mantaras, R. L. D., &amp; Veloso, M. (2009). A case-based approach for coordinated
action selection in robot soccer. Artificial Intelligence, 173(9), 1014-1039.</p>
      <p>R, L. D. M., D, M., D, B., D, L., B, S., &amp; S, C., et al. (2005). Retrieval, reuse, revision and retention in
case-based reasoning. Knowledge Engineering Review, 20(3), 215-240.</p>
      <p>Schank, R. C. (1982). Dynamic Memory: A Theory of Reminding and Learning in Computers and</p>
      <p>People. Cambridge University Press.</p>
      <p>Sycara, E. P. (1987). Resolving adversarial conflicts: an approach integrating case-based and
analytical methods. Nuovi Annali Digiene E Microbiologia, 5(1).</p>
      <p>Small, H. (2003). Paradigms, citations, and maps of science: a personal history. Journal of the</p>
      <p>Association for Information Science &amp; Technology, 54(5), 394–399.</p>
      <p>Simpson, &amp; Lee, R. (1985). A computer model of case-based reasoning in problem solving : an
investigation in the domain of dispute mediation. Georgia Institute of Technology, 56, 813–824.
Toro, C. H. F., Meire, S. G., Gálvez, J. F., &amp; Fdez-Riverola, F. (2013). A hybrid artificial intelligence
model for river flow forecasting. Applied Soft Computing, 13(8), 3449-3458.</p>
      <p>Wu, C. C., &amp; Leu, H. J. (2014). Examining the trends of technological development in hydrogen
energy using patent co-word map analysis. International Journal of Hydrogen Energy, 39(33),
19262-19269.</p>
      <p>Wei, L. Y., Mahmud, R., &amp; Raj, R. G. (2014). An application of case-based reasoning with machine
learning for forensic autopsy. Expert Systems with Applications, 41(7), 3497-3505.
Zhu, J., &amp; Hua, W. (2017). Visualizing the knowledge domain of sustainable development research
between 1987 and 2015: a bibliometric analysis. Scientometrics, 110(2), 1-22.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>Ahn</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>K. J.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Bankruptcy prediction modeling with hybrid case-based reasoning and genetic algorithms approach</article-title>
          . Applied Soft Computing,
          <volume>9</volume>
          (
          <issue>2</issue>
          ),
          <fpage>599</fpage>
          -
          <lpage>607</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Amailef</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lu</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Ontology-supported case-based reasoning approach for intelligent m-government emergency response services</article-title>
          .
          <source>Decision Support Systems</source>
          ,
          <volume>55</volume>
          (
          <issue>1</issue>
          ),
          <fpage>79</fpage>
          -
          <lpage>97</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Branting</surname>
            ,
            <given-names>L. K.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>A reduction-graph model of precedent in legal analysis</article-title>
          .
          <source>Artificial Intelligence</source>
          ,
          <volume>150</volume>
          (
          <issue>1</issue>
          ),
          <fpage>59</fpage>
          -
          <lpage>95</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Bornmann</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Marx</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>HistCite analysis of papers constituting the h-index research front</article-title>
          .
          <source>Journal of Informetrics</source>
          ,
          <volume>6</volume>
          (
          <issue>2</issue>
          ),
          <fpage>285</fpage>
          -
          <lpage>288</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>CiteSpace II: detecting and visualizing emerging trends and transient patterns in scientific literature</article-title>
          .
          <source>Journal of the Association for Information Science and Technology</source>
          ,
          <volume>57</volume>
          (
          <issue>3</issue>
          ),
          <fpage>359</fpage>
          -
          <lpage>377</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Burrell</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2001</year>
          ).
          <article-title>Case-based reasoning system and artificial neural networks: a review</article-title>
          .
          <source>Neural Computing &amp; Applications</source>
          ,
          <volume>10</volume>
          (
          <issue>3</issue>
          ),
          <fpage>264</fpage>
          -
          <lpage>276</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Chow</surname>
            ,
            <given-names>H. K. H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Choy</surname>
            ,
            <given-names>K. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>W. B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Lau</surname>
            ,
            <given-names>K. C.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>Design of a RFID case-based resource management system for warehouse operations</article-title>
          .
          <source>Expert Systems with Applications</source>
          ,
          <volume>30</volume>
          (
          <issue>4</issue>
          ),
          <fpage>561</fpage>
          -
          <lpage>576</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <surname>Fang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Visualizing the structure and the evolving of digital medicine: a scientometrics review</article-title>
          .
          <source>Scientometrics</source>
          ,
          <volume>105</volume>
          (
          <issue>1</issue>
          ),
          <fpage>5</fpage>
          -
          <lpage>21</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Garfield</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>From the science of science to scientometrics visualizing the history of science with HistCite software</article-title>
          .
          <source>Journal of Informetrics</source>
          ,
          <volume>3</volume>
          (
          <issue>3</issue>
          ),
          <fpage>173</fpage>
          -
          <lpage>179</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Greene</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Freyne</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Smyth</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Cunningham</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2008</year>
          ).
          <source>An Analysis of Research Themes in the CBR Conference Literature. European Conference on Advances in Case-Based Reasoning</source>
          ,
          <volume>5239</volume>
          ,
          <fpage>18</fpage>
          -
          <lpage>43</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Gu</surname>
            ,
            <given-names>D. X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liang</surname>
            ,
            <given-names>C. Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bichindaritz</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zuo</surname>
            ,
            <given-names>C. R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>A case-based knowledge system for safety evaluation decision making of thermal power plants</article-title>
          .
          <source>Knowledge-Based Systems</source>
          ,
          <volume>26</volume>
          ,
          <fpage>185</fpage>
          -
          <lpage>195</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Gu</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liang</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>A case-based reasoning system based on weighted heterogeneous value distance metric for breast cancer diagnosis</article-title>
          .
          <source>Artificial Intelligence in Medicine</source>
          ,
          <volume>77</volume>
          ,
          <fpage>31</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Hammond</surname>
            ,
            <given-names>K. J.</given-names>
          </string-name>
          (
          <year>1986</year>
          ).
          <article-title>CHEF: A model of case-based planning</article-title>
          .
          <source>National Conference on Artificial Intelligence. 1</source>
          ,
          <fpage>267</fpage>
          -
          <lpage>271</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Hinrichs</surname>
            ,
            <given-names>T. R.</given-names>
          </string-name>
          (
          <year>1992</year>
          ).
          <article-title>Problem Solving in Open Worlds</article-title>
          . Georgia Institute of Technology.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <surname>Hui</surname>
            ,
            <given-names>S. C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Jha</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          (
          <year>2000</year>
          ).
          <article-title>Data mining for customer service support</article-title>
          .
          <source>Information &amp; Management</source>
          ,
          <volume>38</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <surname>Henriet</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leni</surname>
            ,
            <given-names>P. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laurent</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roxin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chebel-Morello</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Salomon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al. (
          <year>2012</year>
          ).
          <article-title>Adapting numerical representations of lung contours using case-based reasoning and artificial neural networks</article-title>
          .
          <source>International Conference on Case-Based Reasoning</source>
          ,
          <volume>7466</volume>
          ,
          <fpage>137</fpage>
          -
          <lpage>151</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>Humphreys</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mcivor</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2003</year>
          ).
          <article-title>Using case-based reasoning to evaluate supplier environmental management performance</article-title>
          .
          <source>Expert Systems with Applications</source>
          ,
          <volume>25</volume>
          (
          <issue>2</issue>
          ),
          <fpage>141</fpage>
          -
          <lpage>153</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <string-name>
            <surname>Kolodner</surname>
            ,
            <given-names>J. L.</given-names>
          </string-name>
          (
          <year>1983</year>
          ).
          <article-title>Reconstructive memory: a computer model</article-title>
          .
          <source>Cognitive Science</source>
          ,
          <volume>7</volume>
          (
          <issue>4</issue>
          ),
          <fpage>281</fpage>
          -
          <lpage>328</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>Koton</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Using experience in learning and problem solving</article-title>
          . Massachusetts Institute of Technology.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>A scientometric review of emerging trends and new developments in recommendation systems</article-title>
          .
          <source>Scientometrics</source>
          ,
          <volume>104</volume>
          (
          <issue>1</issue>
          ),
          <fpage>239</fpage>
          -
          <lpage>263</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          <string-name>
            <surname>Kumar</surname>
            ,
            <given-names>K. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sanyal</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Hybrid approach using case-based reasoning and rule-based reasoning for domain independent clinical decision support in ICU</article-title>
          .
          <source>Expert Systems with Applications</source>
          ,
          <volume>36</volume>
          (
          <issue>1</issue>
          ),
          <fpage>65</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Sun</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>Gaussian case-based reasoning for business failure prediction with empirical data in china</article-title>
          .
          <source>Information Sciences</source>
          ,
          <volume>179</volume>
          (
          <issue>1</issue>
          ),
          <fpage>89</fpage>
          -
          <lpage>108</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <string-name>
            <surname>Marir</surname>
            ,
            <given-names>I. W. F.</given-names>
          </string-name>
          (
          <year>1994</year>
          ).
          <article-title>Case-based reasoning: a review</article-title>
          .
          <source>Knowledge Engineering Review</source>
          ,
          <volume>9</volume>
          (
          <issue>4</issue>
          ),
          <fpage>327</fpage>
          -
          <lpage>354</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          <string-name>
            <surname>Mingers</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Leydesdorff</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>A review of theory and practice in scientometrics</article-title>
          .
          <source>European Journal of Operational Research</source>
          ,
          <volume>246</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Price</surname>
            ,
            <given-names>D. J.</given-names>
          </string-name>
          (
          <year>1965</year>
          ).
          <article-title>Networks of scientific papers</article-title>
          .
          <source>Science</source>
          ,
          <volume>149</volume>
          (
          <issue>3683</issue>
          ),
          <fpage>510</fpage>
          -
          <lpage>515</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>