<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visual Dashboards in Trend Analytics to Observe Competitors and Leading Domain Experts</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Darmstadt University of Applied Sciences, Human-Computer Interaction &amp; Visual Analytics group</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>222</fpage>
      <lpage>235</lpage>
      <abstract>
        <p>The rapid change due to digitalization challenge a variety of market players and force them to find strategies to be aware of developments in these markets, particularly those that impact their business. The main challenge is what a practical solution could look like and how technology can support market players in these trend observation tasks. The paper outlines therefore a technological solution to observe specific authors e.g. researchers who influence a certain market or engineers of competitors. In many branches both are well-known groups to market players and there is almost always the need of a technology that supports the topical observation. This paper focuses on the concept of how a visual dashboard could enable a market observation and how data must be processed for it and its prototypical implementation which enables an evaluation later. Furthermore, the definition of a principal technological analysis for innovation and technology management is created and is also an important contribution to the scientific community that specifically considers the technology perspective and its corresponding requirements.</p>
      </abstract>
      <kwd-group>
        <kwd>visual trend analysis</kwd>
        <kwd>visual analytics</kwd>
        <kwd>business intelligence</kwd>
        <kwd>information exploration</kwd>
        <kwd>innovation management</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Market trends are a major opportunity and risk in the ongoing digitalization of current
markets. A variety of new players that are well known today, for instance Tesla, Uber
Pop, Lieferando are still relatively new web giants like Amazon or Google, who have
had huge success in establishing a successful digital business. Most of their
technologies are used in our daily life. Many of those technologies are replacing or outpacing
traditional businesses with the help of information technology and are making their
usage easier and more comfortable. These new giants can benefit from the
digitalization, as they have been making use of the opening opportunities. At the same time other
giants fall because they fail to recognize these opportunities. And even more, they are
unable to complete a sustainable digitalization strategy in time. The list of losing
players, like AOL, Quelle, or Kodak, is long and it shows, how crucial trend observation in</p>
      <p>Visual Computing and Data Analytics
2
a fast-changing world has become and how important it is to react to those trends timely
and sustainably.</p>
      <p>However, trend observation is quite a complex issue that requires experts with
significant domain and technological knowledge. It also requires tools that support a
periodical trend observation in a variety of data sources. Trends can be found in many data
sources. To register them as an important upcoming topic, a considerable amount of
data from a variety of sources is needed. In addition to data (sources) and expert users,
there is also a third component that is essential to successfully identify trends: A
technological solution to perform an appropriate data analysis in perspective of trends.</p>
      <p>
        Therefore, this paper aims on introducing a new technical approach to observe trends
in perspective of competitors and leading domain experts to enable an early trend
recognition. Instead of starting the trend analysis from the topical point by direct searches or
topical listings, what we already investigated [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], we propose a different approach by
beginning the analysis with “the inventors” – so to say the persons behind developed
new technologies. The idea aims more on monitoring certain groups of inventors
instead on investigating principal new developments in general. This kind of monitoring
is common in highly innovative fields or market niches with just very few competitors.
The approaches oversee research and engineering actions of persons in form of authors
and enable analysts to early identify new findings and developments that might be
impacting the analyst’s business.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Foundations to Visual Trend Analytics</title>
      <p>
        Trend analysis is a frequently used term in several domains, which makes it essential
to define it more clearly to reach a common understanding. To find an access to the
topic of visual trend analytics, we must first investigate the current state of the art of
several closely related fields. A well-known area in which trend analytics is regularly
performed is the banking industry, where market analysts try to predict future stock
price movements based on temporal data [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. However, in this paper we consider
(Visual) Trend Analysis always in perspective of economic and market analysis [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
In general, a trend is defined as “a method of identifying and describing specific
changes over a long period of time, and the future can thus be predicted using past
patterns” [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Complementary to this definition, trend detection can be defined as
“Knowledge of emerging trends is particularly important to individuals and companies
who are charged with monitoring a particular field or business. […] Manual review of
all the available data is simply not feasible. Human experts who are tasked with
identifying emerging trends need to rely on automated systems as the amount of information
available in digital form increases [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].” While trend detection is a relevant task within
trend analysis, we follow the definition of trend analysis by Sharma et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] where it
is “a process of estimating gradual change in future events from past data”. Trend
analysis is a quantitative method that requires precise specification of objectives that will
be fulfilled from such investigation of data. The following list shows different goals,
Visual Computing and Data Analytics
3
presented by Chandler and Gray [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ][
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], that can be achieved by performing trend
analysis:
• To describe the past behavior of a process.
• To try and understand the mechanisms behind observed changes.
• To make assessments of possible future scenarios, by extrapolating past changes into
the future.
• To enable analysis of systems where long-term changes serve to obscure the aspects
of real interest.
• Detect and estimate the magnitude of a trend.
• Identification of time periods in which there was a substantial trend and times in
which there was negligible trend.
• To predict and forecast a trend.
2.1
      </p>
      <sec id="sec-2-1">
        <title>Relevance of Trend Analytics in Innovation and Technology Management</title>
        <p>Nowadays, most innovations are not only a random side-effect of daily work. It can be
described as a much more seriously organized procedure. Especially international
companies have big research and development (R&amp;D) departments, in which they follow a
well-organized innovation process including a type of innovation center. In contrast to
other departments, the R&amp;D departments have a higher flexibility and less focus on the
company’s business. However, the intention in all their activities is to extend the
company’s products and services. For that purpose, the innovation center is building the
bridge between research actions and normal departments.</p>
        <p>One of the more established innovation process models, which a variety of
organizations have implemented, is the one of Gaubinger et al. (top model at Fig. 1). The process
describes the innovation process in a tripartite process during which the uncertainty
decreases. Each phase is subdivided into separate stages.</p>
        <p>The first phase of the process is “innovation strategy” during which the situation is
analyzed until a strategy can be formulated and implemented. The process is subject to
steady evaluation and control and covers three stages.</p>
        <p>In the second phase, called “product innovation”, the general uncertainty has already
decreased. Furthermore, due to the lower uncertainty the steps are more precise and
cover a higher number of stages, namely five. It starts with the first stage in which the
product ideas are generated and evaluated. Afterwards, a concrete product is conceived
which involves a detailed analysis of the product and general business planning. After
the conceptualization stage has come to an end, the product can be developed. Before
the product is launched on the market, it should be tested to ensure the quality and the
market’s acceptance.</p>
        <p>The last phase is the maintenance of the product. This phase is mostly a variation
differentiation which might involve important security updates, new features, or simple
design differences. Every variation goes through different stages before its launch,
which are very similar to the second phase. Because of the similarity to the second
phase, the number and stage objectives are similar, except for one additional to perform
Visual Computing and Data Analytics
4
the situation analysis, in which current product situation is analyzed and ideas for
variations or rather advancements are gathered. Those ideas are conceived, developed, and
tested before they are launched.</p>
        <p>From a technical point of view, the entire innovation process can be supported with a
suitable analysis software. Especially the research for existing approaches, algorithms
or available technologies and systems can be supported and it is in principle in any
phase almost similar. From the perspective of research systems, all three phases of the
innovation process can be summarized into a three-stage model, which takes the main
research objectives and goals into account (Fig. 1 shows on the bottom the three-stage
innovation research model and covers also the transitions to the original innovation
model above).</p>
        <p>The first step includes the process of analyzing the current situation and developing
ideas. As the first step mostly depends on the finding of information, we call it
“information foraging”.</p>
        <p>The second step involves creativity in choices for the innovative product. This includes
creative new ideas and their conceptualization as well as their development. As this
step involves creativity and design choices for the innovation, we call it “innovation
design”.
Visual Computing and Data Analytics
5
The last step that can be identified is what comes after the product is developed, which
mostly contains tests and validation phases. As it is about analyzing the impact of the
product, we are going to call that phase “impact analysis”.</p>
        <p>As the identified three phases are not static and include a lot of trial and error, the
process and the identified phases are an iterative process, which may have to start over at
any step.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Visual Trend Analytics Methodology</title>
        <p>
          An important aspect of Visual Trend Analytics is Visual Analytics, which is also the
main interface functionality with which the user gets in contact. Keim et al. [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] describe
visual analytics as: “[…] an iterative process that involves information gathering, data
preprocessing, knowledge representation, interaction and decision making. The
ultimate goal is to gain insight into the problem at hand which is described by vast amounts
of scientific, forensic or business data from heterogeneous sources.”
Visual trend analysis combines trend analysis with the benefits of visual analytics.
        </p>
        <p>
          Nazemi et al. [
          <xref ref-type="bibr" rid="ref10 ref12">10, 12</xref>
          ] describe their approach to visual trend analysis as a process
which starts with the extraction and identification of key topics and their relevance,
over a specific period, from scientific publications. The extracted information can be
displayed in visual analysis tools which support users in the process of identifying
trends and making decisions.
        </p>
        <p>They developed an approach that utilizes the benefits of visual analytics to gather
thus topic information and visually display the data inside several visualizations.</p>
        <p>The starting point of their approach lies in the formulation of a search term by a user.
Depending on the search query, data is enriched and transformed into different data
models. Those data models can be made for geographical, temporal, semantic or topic
information. In a process of visual mapping the data is transformed and combined to be
displayed in different visualizations which are orchestrated and displayed inside a
visual user-interface. The interface enables user interactions on different levels. The user
may change the data models used, the data displayed or interact with the visualizations.
Visual Computing and Data Analytics
6
With their approach they try to deliver a system to answer several key questions which
are relevant when identifying technological trends.</p>
        <p>
          They define these questions as the following [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]:
1. When did technologies or topics emerge and when did they establish?
2. Where are the key-players and key-locations?
3. Who are the key-players?
4. What are the core topics?
5. How will the technologies or topics probably evolve?
6. Which technologies or topics are relevant for a certain enterprise or application area?
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Visual Dashboard Approach to Observe Trends of</title>
    </sec>
    <sec id="sec-4">
      <title>Researchers and Inventors</title>
      <p>
        In order to make objective decisions, decision-makers from various industries (e.g. the
mobility, transportation and logistics domain [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]) need information about the behavior
of the competition.
      </p>
      <p>
        Abstract data gathered from text mining algorithms can contain such information
about the competition, but neither has that data only quantitative measures that can be
visualized nor is their dimensionality just two. They have far more different
perspectives or aspects on data that could help to achieve the main goal of information
visualization. There are different ways to visualize these data, e.g. by super-imposing visual
variables or visualizations and by juxtaposing those into visualization dashboards [
        <xref ref-type="bibr" rid="ref15 ref16">15,
16</xref>
        ]. Commonly superimposing visualizations leads to overstraining users due to the
complexity of the visual representations. Therefore, juxtaposing visualization as
socalled dashboards or visualization dashboards leads to a more efficient interaction of
the visualized data. But there are several ways to create such dashboards and different
methods to ensure an easy interaction to meet the users’ requirements [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
3.1
      </p>
      <sec id="sec-4-1">
        <title>Visual Trend Analytics in Innovation Management</title>
        <p>
          The process of innovation management starts according to Gaubinger et al. [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] with
the development of an innovation strategy. The first step when building such a strategy
is an analysis of the current situation.
        </p>
        <p>
          The information gathered in the process defined by Nazemi et al. [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] can assist in this
process, by providing valuable information about technologies and the most relevant
authors in different research areas. As the information comes in huge amounts of nested
datasets, the data must be transformed into data models which can be visualized and
orchestrated.
Visual Computing and Data Analytics
7
3.2
        </p>
      </sec>
      <sec id="sec-4-2">
        <title>Data Processing for Dashboard Generation</title>
        <p>
          There are several steps of data transformation applied before the data is ready to be
displayed inside the different visualizations. As fundament we consider the already
established data processing methodology in theory and practice as described and
explained by Nazemi et al. [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>
          At first, enriched data is gathered with the text mining algorithm LDA, which uses
methods of unsupervised learning to convert collections of discrete data into topic
models [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. The data is indexed, so that it can be requested from a database.
        </p>
        <p>As the data still has not reached its final form in which it can be displayed inside
different visualizations, there are several relevant steps to undertake before doing so.</p>
        <p>The first step is to convert the data into different data models, according to the
transformational steps shown in figure 2. Data models for the topics, authors and the
temporal development are needed.</p>
        <p>Those models can be used and combined into visual structures. An example for the
combination of the data structures is the process of receiving the name of a specific
topic. As the topics are represented by numeric values which refer to a specific entry
inside the topic data model, many models must be combined with the topic data model.</p>
        <p>Before the final data can be displayed, data cleansing is necessary. Nonexistent
values must be marked and displayed for completeness. For example, if there was a
publication of an author without a publishing year, the value is set to 0 and will be displayed
as the first bar in the bar chart.
3.3</p>
      </sec>
      <sec id="sec-4-3">
        <title>Dashboard Design for Author Analysis</title>
        <p>
          In the next section, we describe the developed analysis dashboard according to the
different analysis stages, based on Shneiderman’s Visual Information-Seeking Mantra
[
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
        </p>
      </sec>
      <sec id="sec-4-4">
        <title>Overview Phase</title>
        <p>The overview phase provides basic information on an author’s research behavior,
the main topics of his publications and his co-authors.
Visual Computing and Data Analytics
8</p>
        <p>Figure 2 shows the initial view on the dashboard application. (1) is the navigation bar
at the top of the screen. It displays the current author, that means the author the
dashboard is currently created for. It can be set initially to the most interesting author.
The next component to look at is the search field. The user may search for an author,
by typing his name into the search field and clicking the search button. This will
automatically change the name of the current author and it will also reload the entire
dashboard.</p>
        <p>Another navigation bar is (2) which is on the right side of the screen. The side
navigation is displayed on the right side of the window. It contains several draggable
components which the user must drag to the screen and drop, to display a new visualization.
The dashboard which contains the charts (4)(5)(6) fills the rest of the screen.
The first visualization is a bar chart (4). The chart’s y-axis indicates the amount of
publications the searched author has published. The x-axis indicates the year in which
he published the specific amount of publications. If there are publications with no year
given, the x value is set to zero. The ticks on the y-axis mark the amount of publications
in one year, starting from zero.</p>
        <p>The list (5) displays the different co-authors of the searched author. The list is scrollable
and displays the data in the format: first name, last name, amount. The amount depends
on the number of publications they published together.</p>
        <p>The bubble chart visualization (6) displays the main topics that the searched author
explored in his publications. It has a slider to filter the main topics by their occurrence.
Figure 4 shows the communication between the right navigation bar and the
dashboard. As mentioned on the arrow the user may drag any visualization from the side
navigation into the dashboard and drop it there. The dashboard shows the new
visualization depending on which of the items the user dragged into it.</p>
        <p>(1) The user can change the position of every visualization on the screen with drag
and drop. The initial positioning of the visualizations is just a suggestion. The
visualizations affected by the drag, because the dragged item is situated above them, are
dodging to the next free position automatically. The dragged item has an on-hover
effect. Marked in the dashboard by a blue shimmering underneath, as shown in figure 4.
This is displaying where the visualization will be dropped on the screen.</p>
        <p>(2) shows how to resize any visualization on the dashboard. Every visualization is
inside a container which has a resize handler in the lower right corner. The user can
resize the container and the visualizations resize too.1</p>
      </sec>
      <sec id="sec-4-5">
        <title>Analysis Phase (Data Zooming and Filtering)</title>
        <p>After gaining a first impression on an author’s current research activity and the main
research of his studies a more detailed view on the data can help investigate the work
of an author. For tasks like those we provide a more detailed view on the data as shown
in figure 5.</p>
        <p>1 There is a video of the first prototype of the system available on:
http://s.vis.hda.de/video-vis-dashboard (last accessed: 31/08/2020)
Visual Computing and Data Analytics
10
(1) The first chart is not a typical chart. It shows the ranking of a specific facet like
topics or authors displayed as slices of different width. The width refers to the amount
in comparison to its neighbors. The vertical position refers to the ranking that facet has,
as they are sorted descendant. The colors of the slices change when a user hovers and
highlights the same facet over different years, making it easy to analyze the temporal
development of a facet over the years.</p>
        <p>(2) The second chart is a list view for specific publications by the author. It delivers
information about the title and the involved authors. List items expand on click and
display several other relevant pieces of information like the abstract of the publication,
the main topics, and hyperlinks to the publications.</p>
      </sec>
      <sec id="sec-4-6">
        <title>Details Phase</title>
        <p>A competitor analysis can require very specific knowledge of the work of an author. It
is therefore necessary to provide as much details as possible. Figure 6 shows on the
right side the view on one specific publication. It provides links to the full texts of the
publications.
3.4</p>
      </sec>
      <sec id="sec-4-7">
        <title>Prototypical Implementation</title>
        <p>Figure 6 shows the prototypical implementation of the overview dashboard which is
currently created for the author “Daniel A. Keim”. The implementation strictly sticks
to the planning in the wireframes.
The prototypical implementation of the analysis and details phases can be viewed inside
figure 7.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Use Case Competitor and Leading Domain Experts</title>
    </sec>
    <sec id="sec-6">
      <title>Observations</title>
      <p>The application developed is an expert system which may deliver specific insights into
the research work of competitors. For that reason, the general audience of the system is
a small group of decision-makers.
Visual Computing and Data Analytics
12</p>
      <p>To outline the benefit of our developed approach better, we will now write our
description further based on the exemplary scenario. To be aware of all activities relating
to your market, almost any leading actor is interested in a solution to observe research
and developments of its field and particularly those of scientific influencers and
competitors. So, they need a software system that allows them to identify the rest of the
newly formed research team and they also need to clarify the main topics of their former
and current re-search. Moreover, they must keep track of that research groups activities
every month to investigate their current state of research.</p>
      <sec id="sec-6-1">
        <title>Use Case Objective</title>
        <p>Let us imagine your role in a company is to be head of department toward visual
analytics solution. In this position you want to be aware of any research activities in the
field e.g. in form of news or research papers, especially those that are relevant for your
market. Of course, you also want to know about any activities of you competitors. From
the research field you will follow researchers in the R&amp;D domain such as Daniel Keim.
Similarly, you would do it with competitors.</p>
      </sec>
      <sec id="sec-6-2">
        <title>Use Case Description</title>
        <p>In the first step an overview dashboard for the author Daniel Keim is created.</p>
        <p>As one can see in figure 6, the overview dashboard provides different visualizations.
This helps receiving different information about the searched author Daniel A. Keim.</p>
        <p>The first information (1) delivers a temporal overview of the amount of publications
over the last years. As one can see, Keim has been publishing significantly over the last
years.</p>
        <p>(2) provides an overview of his co-authors. The top co-author is Tobias Schreck.
They have 61 publications together.
(3) provides a basic overview of the main topics of his publications.</p>
        <p>As the overview dashboard - which is initially created - only delivers a basic overview,
we need to dive deeper into the data to find out more about that author’s work.</p>
        <p>Figure 7 shows details about that author’s publications. Chart (1) shows a ranking of
the main topics for the last four years.</p>
        <p>Chart (2) shows a list of the publications that author has published.
5</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>Conclusion</title>
      <p>All in all, one can say that metadata gathered by text mining algorithms (visualized,
and juxtaposed inside visual layouts like dashboards), provides specific insights and
knowledge into technological trends and people. This comes in handy in innovation
management and competitor research. This is a specific need a lot of enterprises have.
They need to be aware of changes in their market early and react to those changes fast
in order not to fail the future customers’ requirements.</p>
      <p>The prototype developed in this paper tried to show a comprehensible use-case on
how such a dashboard can be used to analyze a specific competitor. Even though it is
Visual Computing and Data Analytics
13
only a prototype it still presents a variety of benefits to observer market trends of
specific persons. It is important to remind ourselves that for almost any market and
business just a few influencing persons exist beside well-known competitors. This makes
this approach so effective. It allows us to be aware of changes and new directions in a
field by just observing a handful of people.</p>
      <p>The future goal is to implement the dashboard functions for observations next to the
already existing analysis solution for visual trend analytics to achieve an encompassing
solution for trend analysis.</p>
    </sec>
    <sec id="sec-8">
      <title>Acknowledgements</title>
      <p>This work was partially funded by the Hessen State Ministry for Higher Education,
Research and the Arts within the program “Forschung für die Praxis” and was
conducted within the research group on Human-Computer Interaction and Visual Analytics
(http://www.vis.h-da.de).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Liheng</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aggarwal</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,Qi*, G.:
          <article-title>Stock Price Prediction via Discovering Multi-Frequency Trading Patterns</article-title>
          . In: Matwin,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Farooq</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.</surname>
          </string-name>
          :
          <source>Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '17)</source>
          , pp.
          <fpage>2141</fpage>
          -
          <lpage>2149</lpage>
          , New York, NY, USA (
          <year>2017</year>
          ). doi:
          <volume>10</volume>
          .1145/3097983.3098117
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Burkhardt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nazemi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kuijper</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ginters</surname>
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>A mobile visual analytics approach for instant Trend Analysis in mobile Contexts</article-title>
          .
          <source>In Proceedings of the 5th International Conference of the Virtual and Augmented Reality in Education (VARE2019)</source>
          , pp.
          <fpage>11</fpage>
          -
          <lpage>19</lpage>
          ,
          <issue>I3M</issue>
          (
          <year>2019</year>
          ). doi:
          <volume>10</volume>
          .5281/zenodo.3473040
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Hwang</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , In, M.,
          <string-name>
            <surname>Ha</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          : TASIS:
          <article-title>Trend analysis system for international standards</article-title>
          . ITU Kaleidoscope:
          <article-title>Challenges for a DataDriven Society (ITU</article-title>
          K), pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          , IEEE (
          <year>2017</year>
          ). doi:
          <volume>10</volume>
          .23919/ITU-WT.
          <year>2017</year>
          .
          <volume>8247002</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Kontostathis</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Galitsky</surname>
            ,
            <given-names>L. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pottenger</surname>
            ,
            <given-names>W. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roy</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Phelps</surname>
            ,
            <given-names>D. J.:</given-names>
          </string-name>
          <article-title>A survey of emerging trend detection in textual data mining</article-title>
          . In Berry, M. W.: Survey of Text Mining, pp.
          <fpage>185</fpage>
          -
          <lpage>224</lpage>
          . Springer, New York, USA (
          <year>2004</year>
          ). doi:
          <volume>10</volume>
          .1007/978-1-
          <fpage>4757</fpage>
          -4305-
          <issue>0</issue>
          _
          <fpage>9</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Sharma</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Swayne</surname>
            ,
            <given-names>S. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Obimbo</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Trend analysis and change point techniques: a survey</article-title>
          .
          <source>Energy, Ecology and Environment</source>
          , pp.
          <fpage>123</fpage>
          -
          <lpage>130</lpage>
          (
          <year>2016</year>
          ).
          <source>doi: 10.1007/s40974-016- 0011-1</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Chandler</surname>
            ,
            <given-names>R. E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Scott</surname>
          </string-name>
          , M.:
          <article-title>Statistical methods for trend detection and analysis in the environmental sciences</article-title>
          . John Wiley &amp; Sons. Chichester, UK (
          <year>2011</year>
          ).
          <source>doi:10.1002/9781119991571</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Gray</surname>
            ,
            <given-names>K. L.</given-names>
          </string-name>
          :
          <article-title>Comparison of Trend Detection Methods</article-title>
          .
          <source>PhD thesis</source>
          , Department of Mathematics, University of Montana, USA (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Gaubinger</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rabl</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Swan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Werani</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          : Innovation and
          <string-name>
            <given-names>Product</given-names>
            <surname>Management</surname>
          </string-name>
          . Springer, Heidelberg (
          <year>2015</year>
          ). doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>642</fpage>
          -54376-0
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Keim</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bak</surname>
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bertini</surname>
            <given-names>E</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oelke</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Spretke</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ziegler</surname>
            <given-names>H.</given-names>
          </string-name>
          :
          <article-title>Advanced Visual Analytics Interfaces</article-title>
          , In Santucci, G.:
          <source>Proceedings of the International Conference on Advanced Visual Interfaces (AVI'10) the International Conference</source>
          . Roma, Italy, pp.
          <fpage>3</fpage>
          -
          <lpage>10</lpage>
          , ACM Press, New York, USA (
          <year>2010</year>
          ). doi:
          <volume>10</volume>
          .1145/1842993.1842995
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Nazemi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Retz</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ; Burkhardt,
          <string-name>
            <given-names>D.</given-names>
            ;
            <surname>Kuijper</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ;
            <surname>Kohlhammer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ;
            <surname>Fellner</surname>
          </string-name>
          ,
          <string-name>
            <surname>D. W.</surname>
          </string-name>
          :
          <article-title>Visual Trend Analysis with Digital Libraries</article-title>
          .
          <source>Proceedings of the 15th International Conference on Knowledge Technologies and Data-driven Business</source>
          . pp.
          <volume>14</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>14</lpage>
          :
          <fpage>8</fpage>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          , Graz, Austria, (
          <year>2015</year>
          ). doi:
          <volume>10</volume>
          .1145/2809563.2809569
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Nazemi</surname>
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burkhardt</surname>
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2018</year>
          )
          <article-title>: „Juxtaposing Visual Layouts - An Approach for Solving Analytical and Exploratory Tasks Through Arranging Visual Interfaces“</article-title>
          .
          <source>In proceedings of 4th International Conference of the Virtual and Augmented Reality in Education, I3M</source>
          (
          <year>2018</year>
          ). doi:
          <volume>10</volume>
          .5281/zenodo.2542952
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Nazemi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burkhardt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Visual Analytics for Analyzing Technological Trends from Text</article-title>
          .
          <source>In Proceddings of the 23rd International Conference Information Visualization (IV2019)</source>
          , Paris, France, pp.
          <fpage>191</fpage>
          -
          <lpage>200</lpage>
          , IEEE (
          <year>2019</year>
          ), doi: 10.1109/IV.
          <year>2019</year>
          .
          <volume>00041</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Shneiderman</surname>
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>The eyes have it: A task by data type taxonomy for information visualizations (</article-title>
          <year>1996</year>
          ). doi:
          <volume>10</volume>
          .1109/VL.
          <year>1996</year>
          .545307
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Blei</surname>
            ,
            <given-names>D. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ng</surname>
            <given-names>A. Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jordan</surname>
            <given-names>M. I.</given-names>
          </string-name>
          :
          <article-title>Latent Dirichlet Allocation</article-title>
          .
          <source>Journal of Machine Learning Research. Journal of Machine Learning Research</source>
          <volume>3</volume>
          (
          <year>2003</year>
          ). doi:
          <volume>10</volume>
          .1162/jmlr.
          <year>2003</year>
          .
          <volume>3</volume>
          .4-
          <fpage>5</fpage>
          .
          <fpage>993</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Nazemi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Breyer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burkhardt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fellner</surname>
            ,
            <given-names>D. W.</given-names>
          </string-name>
          :
          <article-title>Visualization Cockpit: Orchestration of Multiple Visualizations for Knowledge-Exploration</article-title>
          . In
          <source>International Journal of Advanced Corporate Learning</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>26</fpage>
          -
          <lpage>34</lpage>
          , ISSN:
          <fpage>1867</fpage>
          -
          <lpage>5565</lpage>
          , International Association of Online Engineering, Vienna, Austria (
          <year>2010</year>
          ). doi:
          <volume>10</volume>
          .3991/ijac.v3i4.
          <fpage>1473</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Nazemi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burkhardt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Breyer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stab</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fellner</surname>
            ,
            <given-names>D. W.</given-names>
          </string-name>
          :
          <article-title>Semantic Visualization Cockpit: Adaptable Composition of Semantics-Visualization Techniques for KnowledgeExploration Conference</article-title>
          .
          <source>In International Conference on Interactive Collaborative Learning (ICL)</source>
          , Kassel University Press, Germany (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Nazemi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Burkhardt</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaupp</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dannewald</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kowald</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ginters</surname>
          </string-name>
          , E.:
          <article-title>Visual Analytics in Mobility, Transportation and Logistics</article-title>
          .
          <source>In Workshop on ICTE in Transportation and Logistics</source>
          , pp.
          <fpage>82</fpage>
          -
          <lpage>89</lpage>
          , Springer (
          <year>2020</year>
          ). doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -39688-6_
          <fpage>12</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>