<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Using Emotional Markers' Frequencies in Stock Market ARMAX-GARCH Model?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alexander V. Porshnev</string-name>
          <email>aporshnev@hse.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Valeriya V. Lakshina</string-name>
          <email>vlakshina@hse.ru</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ilya E. Red'kin</string-name>
          <email>ilya-redkin@yandex.ru</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>National Research University Higher School of Economics</institution>
          ,
          <addr-line>603155, Bolshaya Pecherskaya St., 25/12, Nizhny Novgorod</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>STM LLC</institution>
          ,
          <addr-line>603024, 5 Kazanskaya naberezhnaya, o ce 25, Nizhny Novgorod</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>61</fpage>
      <lpage>72</lpage>
      <abstract>
        <p>We analyze the possibility of improving the prediction of stock market indicators by adding information about public mood expressed in Twitter posts. To estimate public mood, we analysed frequencies of 175 emotional markers - words, emoticons, acronyms and abbreviations - in more than two billion tweets collected via Twitter API over a period from 13.02.2013 to 22.04.2015. We explored the Granger causality relations between stock market returns of S&amp;P500, DJIA, Apple, Google, Facebook, P zer and Exxon Mobil and emotional markers frequencies. We found that 17 emotional markers out of 175 are Granger causes of changes in returns without reverse e ect. These frequencies were tested by Bayes Information Criteria to determine whether they provide additional information to the baseline ARMAX-GARCH model. We found Twitter data can provide additional information and managed to improve prediction as compared to a model based solely on emotional markers.</p>
      </abstract>
      <kwd-group>
        <kwd>Twitter</kwd>
        <kwd>mood</kwd>
        <kwd>emotional markers</kwd>
        <kwd>stock market</kwd>
        <kwd>volatility</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Mood, emotions and decision making are closely connected. Modeling decision
making process [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] report that psychological states invoked by reading stories can
a ect the evaluation of risk level. Positive moods lead individuals to make more
optimistic choices and, vice versa, negative moods lead to pessimistic choices,
see [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
      </p>
      <p>
        Positive and negative moods in uence the decision making process by
invoking di erent heuristics. For example, individuals in positive mood tend to
spend less time on decision making by referring more rarely to already reviewed
alternatives and ignoring information they believe is irrelevant according to [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] expresses the idea that general level of optimism/pessimism in society
can be connected with economic activity. Nofsinger also supposes that the stock
market itself can be a direct measure of social mood. Following Nofsinger, we will
regard the economy not as a physical system, but as a complex system of human
interactions, in which moods and irrationalities can play a signi cant role. This
point can be supported by observing the informational cascades phenomenon in
the stock market.
      </p>
      <p>Regarding the stock market and Twitter as two possible measures of social
mood, we can assume their correlation and the possibility of using analyses
of moods expressed in tweets to increase prediction accuracy for stock market
indicators.</p>
      <p>
        Experiments in psychology and behavioral economics show how moods and
emotions in uence decision making [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The role of moods and emotions
in decision making grows in situations of uncertainty incidental to the stock
market. Behavioral researchers found a trader's decision to demonstrate a wide set
of human cognitive biases and in uence of emotional factors [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Publicly
expressed emotions in Facebook and Twitter draw attention of many researchers
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. A relation between Facebook's Gross National Happiness Index
and 20 international markets is shown in [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. They also demonstrated that
negative sentiments are related to increases in trading volumes and return volatility.
We propose to use an alternative measure of sentiment based on posts published
by user marked their location in US in Twitter.
      </p>
      <p>Noteworthy is that people tend to often use abbreviations and emoticons
in Twitter, so we extended the list of words with such signs and termed them
emotional markers.</p>
      <p>
        Another important question we raise in our research is whether frequencies
of emotional posts from Twitter add information according to the Bayes
Information Criteria, see, for example, [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. In their detailed review of methods
and models applied in textual sentiment analysis in the nancial eld [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] note
that volatility models have rarely been used. For example in recent paper by
Nofer and Hinz the returns are modelled by a linear regression without
taking into account autoregressive and conditional heteroskedasticity e ects [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
In our research we tested the hypothesis that Twitter could provide additional
information to increase the t of the ARMAX-GARCH econometric model. We
expected information about Twitter users' sentiment to be a signi cant
regressor in complex ARMAX-GARCH models for S&amp;P500 index. ARMAX-GARCH
model was chosen as one of the most widespread models in time series analysis,
which allow autocorrelation and heteroskedasticity to be taken into account [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>
        Over the last ve years social media and sentiment analysis have drawn
attention of many researchers in economics. According to [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], most of 38 studies
run in this area in 2004-2013 were concerned with the usage of news articles,
annual reports, earnings press or other nancial-related information and only one
dealt with information from Internet messages. On the one hand, the approach
based on nancial data looks more relevant, but it may fail to recognize faked or
historical news as was the case in 2013 [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. We also expect public moods
and emotions to provide additional information and in uence investors' response
to certain news and events.
      </p>
      <p>
        Although in several preprints [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] the authors report that
Twitter mood could be used to enhance the quality of stock market forecasts,
the validity of the conclusions made by the authors remains doubtful. Regretfully,
in the rst preprints concerned with this topic there was either a short (less than
40 days) out-of-sample testing period or the authors only compared the results of
using moods to a simple econometric model. In our research we extended the
outof-sample period to 100 days and applied a more complicated ARMAX-GARCH
model.
      </p>
      <p>Assuming that some words, abbreviations and emoticons can be more related
to emotions, we veri ed the hypothesis that emotional marker frequencies can
be indicators of stock prices movement.</p>
      <p>The rest of the article is organized as follows. Section 2 describes the methods
employed in the research, Sect. 3 describes the data and their preprocessing,
Sect. 4 contains the results and Sect. 5 concludes.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Methodology</title>
      <sec id="sec-2-1">
        <title>Emotional Markers</title>
        <p>
          One of the simplest and most intuitive way of textual analysis is word
counting [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ], so we use the frequencies of words from a specially drawn up list instead
of combining them into one or several mood indexes3. The results obtained reveal
a high correlation between words expressed in Twitter and the S&amp;P500 index,
but those correlations did not always ensure that information was added to the
ARMAX-GARCH model.
        </p>
        <p>
          We compile our list of emotional markers using a Brief Mood Introspection
Scale with 8 scales and 2 adjectives representing each mood as the starting point
in creating dictionaries [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. We extend this list with all the synonyms of the
adjectives selected from the WordNet dictionary [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. For example, we measure the
presence of an energetic state in tweets by the occurrence of the following words:
animate, animated, athletic, brisk, chipper, emphatic, enterprising, exuberant,
fresh, lusty, passionate, robust, sprightly, spry, strenuous, strong, tireless,
trenchant, warming party, honor, and vote. We also add the possibility of recognizing
derived words, such as \happyyy" or \happppppyyyyyyy" and count them using
regular expressions.
        </p>
        <p>
          We do not include negations, because after analyzing a testing sample of
9000 tweets we found that negations were not common. For example, the testing
sample with 51 words \happy" contains the negation \not happy" only once.
The same is the case with \but" and sentences expressing desires, e. g. \wanna
3 A similar approach is used by [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. They analyze frequencies of several words (e.g.
\worry", \hope", \fear" etc.) and nd high correlation between the frequencies of
emotional posts and S&amp;P500, DJIA, and VIX indexes.
be happy". The probable reason for that is the small number of words allowed
for a Twitter message (140 words).
        </p>
        <p>
          [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ] show that emoticons4 have a very good classi cation power and that
accuracy of emoticon-based sentiment classi cation exceeds 90% for tweets with
emoticons. Impressed by this result we extend our list with emoticons used
in [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ]. It should be mentioned that we distinguish di erent types of smiles.
For example, \:)", \:-)", and \:D" are not synonyms.
        </p>
        <p>
          Importantly, that Twitter lexicon contains a lot of abbreviations and slang
words, such as \LOL", \WTH"5. At the nal stage we add abbreviations
expressing emotional states from [
          <xref ref-type="bibr" rid="ref28">28</xref>
          ].
        </p>
        <p>Our list of emotional markers contains totally 175 items. We count the
number of posts with each emotional marker per day and consider it as emotional
marker frequencies. Before that all the tweets are transferred to the lower case.
The frequencies are included in (4) and (5) as additional regressors.
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>Granger Causality</title>
        <p>
          We examined the predictive causality6 relations between sentiment and log
returns, using the idea of the Granger test (see, for instance, [
          <xref ref-type="bibr" rid="ref29">29</xref>
          ]). Following the
methodology described in [
          <xref ref-type="bibr" rid="ref30">30</xref>
          ], we estimate (1) and (2).
        </p>
        <p>L
Rt = a0 + X
i=1</p>
        <p>L
Xt = ae0 + X
i=1</p>
        <p>L
iRt i + X j Xt j + "t;
j=1</p>
        <p>
          L
eiXt i + X
j=1
ej Rt j + "et;
(1)
(2)
where Rt is asset's returns, Xt | emotional marker, a0; i; j and their tilde
counterparts are parameters, t and et are uncorrelated error terms. We found
the optimal lag of each sentiment series Xt by varying the L parameter from 1 to
30, whereas in the works undertaken the lags for Granger test do not commonly
exceed 7 days [
          <xref ref-type="bibr" rid="ref11 ref22">11, 22</xref>
          ].
        </p>
        <p>
          The estimation of (1) and (2) allows us to select those emotional
markers which Granger-cause returns and simultaneously are not Granger-caused by
them. In fact we leave only those markers for which (1) is signi cant and (2)
is insigni cant on 5% level according to F-test. Thereby we prevent the reverse
causality problem, described in [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ].
4 Emoticon means \emotional icon" and usually denotes some combination of printed
symbols expressing person's feelings or mood.
5 \laughing out loud" and \what the hell"
6 \True causality" relations is rather a philosophical question, here we explore the
relations of preceding one time series to another, which are useful in establishing the
predictability.
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>ARMAX-GARCH Model and Model Testing</title>
        <p>
          To examine the impact of Twitter mood on the returns of stocks and stock
market indexes, this study uses the well-known ARMAX-GARCH model, controlling
for autocorrelation and conditional heteroskedasticity, see, for example, [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]. The
resulting ARMAX(p,q)-GARCH(r,m) model can be written as in (3).
        </p>
        <p>xt = E(xtjFt 1) + yt;
where E(xtjFt 1) is a conditional mean of daily return xt at time t
conditional on all available at t 1 information Ft 1, yt are innovations. Returns
xt are calculated as a logarithm of today price divided by yesterday price:
xt = log( PPtt 1 ). Conditional mean E(xtjFt 1) is modelled as ARMA(p,q), (4).</p>
        <p>p
E(xtjFt 1) = a0 + X
i=1</p>
        <p>q
X
j=1
ixt i +
j "t j +</p>
        <p>kXk;t;
n
X
k=1
(3)
(4)
(5)
where parameter i and j are the ith-order autoregressive (AR) and
jthorder moving average (MA) terms respectively; parameter k measures the
impact of additional regressor Xk on the index return. In our research emotional
marker frequencies play a role of the additional regressors Xk.</p>
        <p>Innovations yt are modeled as GARCH(r,m), (5).</p>
        <p>yt = t</p>
        <p>r
t2 = c0 + X
t; t</p>
        <p>2
i t i +
i=1
f ( );
m
X
j=1
j t2 j ;
where parameters i and j account for ARCH and GARCH e ects of ith and
jth orders respectively; t2 | volatility, t | error term, distributed according
to some distribution f with parameter set It is also possible to add Twitter
mood Xk to GARCH equation in order to measure the in uence of Twitter mood
on volatility.</p>
        <p>
          Traditional speci cations of ARMAX-GARCH imply normal or Student-t
distribution of the error term. These distributions is that they cannot capture
asymmetry in returns distribution. In order to eliminate this drawback, we
implemented the skewed normal and skewed Student's distributions for error term.
The distributions are modeled as special cases of generalized hyperbolic
distribution by [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ]. We also estimate ARMAX-GARCH with normal errors as a
benchmark.
        </p>
        <p>
          We choose the parameters p; q; r and m by means of Bayesian information
criteria (BIC) | the best speci cation corresponds to the minimal BIC.
Estimation is carried out by means of rugarch package by [
          <xref ref-type="bibr" rid="ref34">34</xref>
          ]. We employ Vuong
test for comparing models. Our choice is caused by the fact that this test can
be used for non-nested models in contrast to traditional likelihood ratio test.
The null hypothesis implies the equal goodness of t for the comparing models.
Since the observations in nancial time series are not typically independent we
use heteroskedasticity and autocorrelation consistent version of Vuong test [
          <xref ref-type="bibr" rid="ref35">35</xref>
          ].
        </p>
        <p>We use the mean squared error (MSE) and directional accuracy (DAC)
as measures of out-of-sample performance. The latter shows the percentage of
matches between returns and their forecast.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Data Description</title>
      <p>
        The data about eight assets, including S&amp;P500 and DJIA indexes; Apple,
Facebook, Google, JP Morgan Chase, P zer and Exxon Mobil stocks are obtained
from [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]. The period under consideration spanned 521 trading days and lasts
from February 13, 2013 to April 22, 2015.
      </p>
      <p>By making use of Twitter API, we downloaded 2,349,036,300 tweets over the
considered period. It's in average 3,098,992 tweets per day. The only restriction
made on downloaded posts is that they should be published by people located
in US. All the tweets were sorted by days and analyzed automatically in the
created JAVA application. For each day we calculated frequencies of posts with
each item from the emotional markers list, described in Sect. 2.1, and normalize
them by the number of tweets downloaded on each day.</p>
      <p>
        Most of the frequencies exhibited non-stationary behavior. On the other
hand, some frequencies (approximately 10% out of all) are di erence
stationary, i. e. have a unit root, which is con rmed by the augmented Dickey-Fuller
test [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ].
      </p>
      <p>
        If non-stationary regressors present in the ARMAX-GARCH model, then
conventional statistical measures, such as t-statistics or R-squared, are
inapplicable [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ]. The non-stationary emotional markers' frequencies are brought to
stationary series by means of either detrending (for trend stationary series) or
taking the rst di erence (for di erence stationary series). The repeated ADF
test rejects non-stationarity in all cases.
      </p>
      <p>The whole data set was divided into two subsamples: for in-sample and
outof-sample testing. We choose to use 100 days period for out-of-sample testing,
what gives approximatly 400 days to nd a model with a optimal t. It is worth
to mention that each emotional marker has its own optimal L parameter in (1)
and (2), meaning the time lag on which Granger causality takes place. Therefore
unique subsample, cut due to L, corresponds to each emotional marker and
estimation of baseline model for an asset is conducted on these subsamples.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Empirical Results</title>
      <p>Firstly we evaluate the causality relations between emotional markers and
returns by Granger test as explained in Sect. 2.2. Secondly we de ne three groups
of assets: indexes, emotion sensitive stocks and emotion insensitive stocks. The
groups include S&amp;P500 and DJIA; Apple, Facebook and Google; JP Morgan
Chase, P zer and Exxon Mobil correspondingly. For each group two
ARMAXGARCH models are estimated: a sentiment model, which contains emotional
marker in the mean equation (4), and a baseline model without additional
regressor in the mean equation.</p>
      <p>The estimation of (1) and (2) results in 17 emotional markers. We excluded
emotional markers which appeared very seldom and had many zeros.</p>
      <p>Almost each asset is Granger caused by gloom, except from jpm and pfe.
Hope and bad are Granger-valid for the half of assets, however they don't occur
among emotion sensitive assets. The other markers have frequencies two or one
and can be considered as speci c for some asset. For example, PFE is Granger
caused by cancer, XOM | by richer.</p>
      <p>We explored di erent speci cations of the ARMAX-GARCH model with p,
q, r and m, ranging from zero to three (except r, which cannot be smaller than
one).
4.1</p>
      <sec id="sec-4-1">
        <title>In-sample</title>
        <p>Firstly, we study the exploratory power of the emotional markers in nancial
time series modeling.</p>
        <p>The group of indexes consist of S&amp;P500 and DJIA has three common
emotional markers: hope, bad and gloom. The dynamics of DJIA is also a ected by
alas. Although, alas provide additional information by AIC and HQIC criteria,
but not according to a BIC. The emotional marker bad add information to
models with normal and skewed Student distributions. Speci cations which provide
better tting according to BIC in most cases have skewed normal distribution
for error term. It's worth mentioning that indexes have no GARCH-e ects in
this speci cations, because m parameter is equal to zero for the optimal models.</p>
        <p>The coe cients in the optimal models are signi cant on 5% level. Although,
emotional marker gloom have a positive e ect on the dynamics of the both
indexes', it a ects DJIA almost ten times stronger than S&amp;P500, see Table 1.
alas has substantial negative impact on DJIA log returns.</p>
        <p>The next group of assets, that we call emotional sensitive stocks, includes
AAPL, FB and GOOG. The group has more Granger-valid emotional markers
than the previous one, for example, awful, fear, frighten and already mentioned
bad and gloom.</p>
        <p>For emotional sensitive stocks sentiment models with skewed normal
distribution again performs better than baseline models. Normal distribution is also
presents among optimal speci cations. Skewed Student's distribution is included
in optimal speci cations only for ok 7 marker for AAPL stock returns. Vuong test
supports the alternative hypothesis that sentiment models has better t than
baseline ones, Table 1.</p>
        <p>Emotional markers associated with fear, i.e. fear itself and frighten exhibit
strong negative impact on returns. The same behavior is demonstrated by awful.
Interestingly that ok also has negative e ect but the size of the e ect is much
smaller than for fear marker.</p>
        <p>Looking forward to marker has substantial positive impact on AAPL and
GOOG stocks' returns. bad that is likewise among AAPL and GOOG
Grangervalid markers has minor positive e ect on returns in speci cations with normal
7 ok means \only kidding".
and skewed normal errors. gloom being common for all stocks in the considered
group is insigni cant on 5% level in optimal speci cations.</p>
        <p>As for the last group of emotion insensitive stocks normal and skewed normal
distributions similarly demonstrate better t, veri ed by Vuong test. Already
mentioned hope and frighten have signi cant positive and negative impact
correspondingly. For Exxon hope turns out to be insigni cant on 5% level.</p>
        <p>We found that emotion insensitive stocks have speci c emotional markers,
discovered by Granger test (1) and (2). They are cancer for P zer, br 8 for JP
Morgan and richer for Exxon Mobil. Although cancer marker is insigni cant
it helps to improve the predictive power comparing to the baseline model. JP
Morgan's speci c marker slightly decreases the returns. As opposed richer is
one of the strongest determinants of Exxon's returns growth. The other
important emotional markers for XOM are positively a ecting gloom and dark and
negatively a ecting sad.</p>
        <p>Our hypothesis is that emotion sensitive group of stocks is more a ected
by emotional markers than emotion insensitive group. The results evidence that
stocks in both groups are in uenced by emotional markers. Although, the tweets
we analyze are not restricted to those that regard to the economy, business
climate, world a airs, speci c businesses and, for example, includes tweets by
teenagers talking about regular things or events, we found that suggested
sentiment measurement do add information to ARMAX-GARCH model. One of the
possible ways to further research in this area is to organize ltering of
downloaded messages to measure sentiments of a more inclusive group, based on
context published in their posts (business or economics related).
* means signi cant on 1% level.</p>
        <p>p,q,r,m are corresponding parameters in (4) and (5).
8 br means \best regards".</p>
      </sec>
      <sec id="sec-4-2">
        <title>Out-of-sample</title>
        <p>100 observations are retained to evaluate the out-of-sample performance of
emotional markers. We calculate MSE and DAC (refer to Sect. 2.3 for details) as
measures of emotional markers' predictive power.</p>
        <p>The optimal models for index group demonstrate less successive predictive
performance, comparing to baseline models. hope marker is an exception,
providing smaller MSE for both indexes. In addition hope and bad markers with
normal and skewed Student's errors allow to increase directional accuracy of
DJIA and S&amp;P500 returns to 58% and 54% correspondingly.</p>
        <p>Directional accuracy for emotional sensitive group of assets is higher than
for the index group even in BIC selected models. The obtained DAC for optimal
models starts from 50% and peaks on 63% for frighten marker.</p>
        <p>It should be noted that k 9 being insigni cant on 5% level yield outstanding
out-of-sample results with smaller MSE and DAC equal to 57%{58%. It con rms
our suggestion of that the emotional markers which provide poor in-sample
performance can be successfully used in prediction models.</p>
        <p>Models directional accuracy in the last group of emotional insensitive stocks
varies from 47% to 56%. The same distributions, namely normal and skewed
normal, provide enhanced prediction comparing to baseline models. Emotional
markers which contribute to the out-of-sample performance most are br for JPM,
cancer for PFE and richer, hope and dark for XOM.</p>
        <p>Models which exhibit poorer performance in-sample demonstrate promising
out-of-sample results. We consider this as a motivation to nd optimal speci
cations by some predictive criteria, such as MSE or DAC, to obtain models with
increased predictive power.</p>
        <p>It's important to add that emotional markers being included in volatility
equation (5) are insigni cant on any reasonable signi cance level. We also
controlled the mean equation for day e ects and found no evidence of their presence
or their impact on the prediction ability.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>We started our research with a question: can Twitter data bring additional
information to the ARMAX-GARCH model? Being positive the answer is based
on the thoroughly elaborated methodology (see Sect. 2 for more details), which
includes collecting and preprocessing Twitter posts, applying some textual
analysis to the tweets, de ning the Granger causality relations and implementing the
output to the ARMAX-GARCH modeling. We wish to make the textual analysis
stage transparent and simple, thus we use parsimonious word count technique
to create so called emotional markers, which subsequently are used as the
determinants of the log returns dynamics in the ARMAX-GARCH model. We form
three groups of assets, namely indexes, emotion sensitive stocks and emotion
insensitive stocks.
9 k is short for \ok".</p>
      <p>Studying the explanatory power of constructed models we show that
emotional markers demonstrate smaller BIC and provide signi cant positive
increment to the likelihood function subject to Vuong test. In order to capture higher
order e ects of returns, such as skewness associated with the third moment of
returns' distribution, we implement skewed versions of normal and Student's
distributions for errors. In some cases, including Facebook, Google and JP Morgan,
the third moment e ects turn out to be insigni cant so normal distribution also
works well for these stocks.</p>
      <p>We nd evidence of that such emotions as fear and sorrow, represented by
markers fear, frighten and alas, have substantial negative impact on the
dynamics of both stocks and indexes. Negative in uence of sorrow is also con rmed by
sad for XOM. Looking forward to marker which corresponds to anticipation has
substantial positive impact on stocks' returns from emotional sensitive group.
The analysis of emotion insensitive group reveals the existence of speci c
emotional markers for the members of this group. Being negligible in the exploratory
sense they allow to increase the predictive ability of the ARMAX-GARCH model.</p>
      <p>We expect that the relationship between emotional markers and returns can
change over time. Firstly, it could happen because of some fundamental factors.
In a period of nancial stability, for example, emotions may play a smaller role
than during a downturn. And vice versa, the market response to similar nancial
news may be di erent depending on the mood prevailing in society.</p>
      <p>Secondly, the behavior of stock market players could change if they would
take in account information from emotional markers. Since we detect two kinds of
emotional markers (see 4.2) | those, which explain the returns well, and those,
which predict the returns, we expect that the changes in investors' behavior
should be based on the emotional markers of the second kind. On the other
hand \explaining" emotional markers should not change the behavior of stock
market players, because they seem to be an intrinsic characteristic of the market
and are unlikely to generate pro table trading strategy.</p>
      <p>In our further research we plan to move in two directions. Firstly, we will
distinguish periods when the stock market is emotional driven and news driven.
Secondly, we will monitor Twitter posts to see if there will be signi cant changes
in emotional marker frequencies, which could be a sign of manipulation.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Johnson</surname>
            ,
            <given-names>E.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tversky</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>A ect, generalization, and the perception of risk</article-title>
          .
          <source>Journal of personality and social psychology 45(1)</source>
          (
          <year>1983</year>
          )
          <fpage>20</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Isen</surname>
            ,
            <given-names>A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Patrick</surname>
            ,
            <given-names>R.:</given-names>
          </string-name>
          <article-title>The e ect of positive feelings on risk taking: When the chips are down</article-title>
          .
          <source>Organizational Behavior and Human Performance</source>
          <volume>31</volume>
          (
          <issue>2</issue>
          ) (
          <year>1983</year>
          )
          <volume>194</volume>
          {
          <fpage>202</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Schwarz</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clore</surname>
            ,
            <given-names>G.L.</given-names>
          </string-name>
          :
          <article-title>Mood, misattribution, and judgments of well-being: Informative and directive functions of a ective states</article-title>
          .
          <source>Journal of personality and social psychology 45(3)</source>
          (
          <year>1983</year>
          )
          <fpage>513</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Isen</surname>
            ,
            <given-names>A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Means</surname>
            ,
            <given-names>B.:</given-names>
          </string-name>
          <article-title>The in uence of positive a ect on decision-making strategy</article-title>
          .
          <source>Social cognition 2(1)</source>
          (
          <year>1983</year>
          )
          <volume>18</volume>
          {
          <fpage>31</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Nofsinger</surname>
            ,
            <given-names>J.R.</given-names>
          </string-name>
          :
          <article-title>Social Mood and Financial Economics</article-title>
          .
          <source>Journal of Behavioral Finance</source>
          <volume>6</volume>
          (
          <issue>3</issue>
          ) (
          <year>September 2005</year>
          )
          <volume>144</volume>
          {
          <fpage>160</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Ding</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fang</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zuo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <source>Stock Market Prediction based on Time Series Data and Market Sentiment</source>
          . (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Loewenstein</surname>
          </string-name>
          , G.:
          <article-title>Emotions in Economic Theory</article-title>
          and
          <string-name>
            <given-names>Economic</given-names>
            <surname>Behavior</surname>
          </string-name>
          .
          <source>The American Economic Review</source>
          <volume>90</volume>
          (
          <issue>2</issue>
          ) (
          <year>2000</year>
          )
          <volume>426</volume>
          {432 ArticleType: research-article / Issue Title:
          <article-title>Papers and Proceedings of the One Hundred Twelfth Annual Meeting of the American Economic Association / Full publication date</article-title>
          : May,
          <year>2000</year>
          / Copyright 2000 American Economic Association.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>McFarland</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>White</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Newth</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Mood acknowledgment and correction for the mood-congruency bias in social judgment</article-title>
          .
          <source>Journal of Experimental Social Psychology</source>
          <volume>39</volume>
          (
          <issue>5</issue>
          ) (
          <year>September 2003</year>
          )
          <volume>483</volume>
          {
          <fpage>491</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Saunders</surname>
          </string-name>
          ,
          <string-name>
            <surname>Jr.</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          :
          <article-title>Stock Prices and Wall Street Weather</article-title>
          .
          <source>The American Economic Review</source>
          <volume>83</volume>
          (
          <issue>5</issue>
          ) (
          <year>December 1993</year>
          )
          <volume>1337</volume>
          {
          <fpage>1345</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Hirshleifer</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shumway</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Good day sunshine: Stock returns and the weather</article-title>
          .
          <source>The Journal of Finance</source>
          <volume>58</volume>
          (
          <issue>3</issue>
          ) (
          <year>2003</year>
          )
          <volume>1009</volume>
          {
          <fpage>1032</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Bollen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mao</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zeng</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          :
          <article-title>Twitter mood predicts the stock market</article-title>
          .
          <source>Journal of Computational Science</source>
          <volume>2</volume>
          (
          <issue>1</issue>
          ) (
          <year>2011</year>
          ) 1{
          <fpage>8</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Nofer</surname>
            ,
            <given-names>D.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hinz</surname>
            ,
            <given-names>P.D.O.</given-names>
          </string-name>
          :
          <article-title>Using Twitter to Predict the Stock Market</article-title>
          .
          <source>Business &amp; Information Systems Engineering</source>
          <volume>57</volume>
          (
          <issue>4</issue>
          ) (jun
          <year>2015</year>
          )
          <volume>229</volume>
          {
          <fpage>242</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Rao</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Srivastava</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>Using twitter sentiments and search volumes index to predict oil, gold, forex and markets indices</article-title>
          . (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Siganos</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vagenas-Nanos</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Verwijmeren</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Facebook's daily sentiment and international stock markets</article-title>
          .
          <source>Journal of Economic Behavior &amp; Organization</source>
          <volume>107</volume>
          ,
          <string-name>
            <surname>Part</surname>
            <given-names>B</given-names>
          </string-name>
          (nov
          <year>2014</year>
          )
          <volume>730</volume>
          {
          <fpage>743</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Javed</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mantalos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Garch-type models and performance of information criteria</article-title>
          .
          <source>Communications in Statistics-Simulation and Computation</source>
          <volume>42</volume>
          (
          <issue>8</issue>
          ) (
          <year>2013</year>
          )
          <year>1917</year>
          {
          <fpage>1933</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Kearney</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Textual sentiment in nance: A survey of methods and models</article-title>
          .
          <source>International Review of Financial Analysis</source>
          <volume>33</volume>
          (may
          <year>2014</year>
          )
          <volume>171</volume>
          {
          <fpage>185</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Horv</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kokoszka</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Garch processes: structure and estimation</article-title>
          .
          <source>Bernoulli</source>
          <volume>9</volume>
          (
          <issue>2</issue>
          ) (
          <year>2003</year>
          )
          <volume>201</volume>
          {
          <fpage>227</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Prezioso</surname>
            ,
            <given-names>J.: Yom</given-names>
          </string-name>
          <string-name>
            <surname>Kippur War Tweet Prompts Higher Oil Prices</surname>
          </string-name>
          . http://www.huffingtonpost.com/
          <year>2013</year>
          /10/10/ yom-kippur
          <article-title>-war-tweet-oil-prices-traders_n_4079634</article-title>
          .
          <string-name>
            <surname>html</surname>
          </string-name>
          (
          <year>2013</year>
          ) Accessed:
          <fpage>2014</fpage>
          -01-22.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Selyukh</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Hackers send fake market-moving AP tweet on White House explosions j Reuters</article-title>
          . http://www.reuters.com/article/2013/04/23/ net-us
          <article-title>-usa-whitehouse-ap-</article-title>
          <string-name>
            <surname>idUSBRE93M12Y20130423</surname>
          </string-name>
          (
          <year>2013</year>
          ) Acessed:
          <fpage>2013</fpage>
          -09- 17.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lazer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Sentiment analysis of twitter feeds for the prediction of stock market movement</article-title>
          . workpaper, Stanford (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Porshnev</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Redkin</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shevchenko</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Improving Prediction of Stock Market Indices by Analyzing the Psychological States of Twitter Users</article-title>
          .
          <source>SSRN Scholarly Paper ID 2368151</source>
          , Social Science Research Network, Rochester,
          <string-name>
            <surname>NY</surname>
          </string-name>
          (
          <year>December 2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fuehres</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gloor</surname>
            ,
            <given-names>P.A.</given-names>
          </string-name>
          :
          <article-title>Predicting Stock Market Indicators Through Twitter \I hope it is not as bad as I fear"</article-title>
          .
          <source>The 2nd Collaborative Innovation Networks Conference - COINs2010</source>
          <volume>26</volume>
          (
          <issue>0</issue>
          ) (
          <year>2011</year>
          )
          <volume>55</volume>
          {
          <fpage>62</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Loughran</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McDonald</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>The use of word lists in textual analysis</article-title>
          .
          <source>Journal of Behavioral Finance</source>
          <volume>16</volume>
          (
          <issue>1</issue>
          ) (
          <year>2015</year>
          )
          <volume>1</volume>
          {
          <fpage>11</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Mayer</surname>
            ,
            <given-names>J.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gaschke</surname>
            ,
            <given-names>Y.N.:</given-names>
          </string-name>
          <article-title>The experience and meta-experience of mood</article-title>
          .
          <source>Journal of personality and social psychology 55(1)</source>
          (
          <year>1988</year>
          )
          <fpage>102</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Miller</surname>
            ,
            <given-names>G.A.</given-names>
          </string-name>
          :
          <article-title>Wordnet: a lexical database for english</article-title>
          .
          <source>Communications of the ACM</source>
          <volume>38</volume>
          (
          <issue>11</issue>
          ) (
          <year>1995</year>
          )
          <volume>39</volume>
          {
          <fpage>41</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Boia</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Faltings</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musat</surname>
            ,
            <given-names>C.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pu</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : A:)
          <article-title>is worth a thousand words: How people attach sentiment to emoticons and words in tweets</article-title>
          .
          <source>In: Social Computing (SocialCom)</source>
          , 2013 International Conference on,
          <source>IEEE</source>
          (
          <year>2013</year>
          )
          <volume>345</volume>
          {
          <fpage>350</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Schnoebelen</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Do you smile with your nose? Stylistic variation in Twitter emoticons</article-title>
          . (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28. :
          <article-title>The Online Slang Dictionary j Urban Thesaurus (aug</article-title>
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maekawa</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>On spurious granger causality</article-title>
          .
          <source>Economics Letters</source>
          <volume>73</volume>
          (
          <issue>3</issue>
          ) (
          <year>2001</year>
          )
          <volume>307</volume>
          {
          <fpage>313</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>S.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kim</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Investor sentiment from internet message postings and the predictability of stock returns</article-title>
          .
          <source>Journal of Economic Behavior &amp; Organization</source>
          <volume>107</volume>
          (
          <year>2014</year>
          )
          <volume>708</volume>
          {
          <fpage>729</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Brown</surname>
          </string-name>
          , G.W.,
          <string-name>
            <surname>Cli</surname>
          </string-name>
          , M.T.:
          <article-title>Investor sentiment and the near-term stock market</article-title>
          .
          <source>Journal of Empirical Finance</source>
          <volume>11</volume>
          (
          <issue>1</issue>
          ) (
          <year>2004</year>
          )
          <volume>1</volume>
          {
          <fpage>27</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Francq</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zakoian</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          , et al.:
          <article-title>Maximum likelihood estimation of pure garch and arma-garch processes</article-title>
          .
          <source>Bernoulli</source>
          <volume>10</volume>
          (
          <issue>4</issue>
          ) (
          <year>2004</year>
          )
          <volume>605</volume>
          {
          <fpage>637</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Barndor -Nielsen</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          :
          <article-title>Hyperbolic distributions and distributions on hyperbolae</article-title>
          .
          <source>Scandinavian Journal of statistics</source>
          (
          <year>1978</year>
          )
          <volume>151</volume>
          {
          <fpage>157</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Ghalanos</surname>
          </string-name>
          , A.:
          <article-title>rugarch: Univariate GARCH models</article-title>
          .
          <source>(2014) R package version 1</source>
          .3-
          <fpage>5</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Calvet</surname>
            ,
            <given-names>L.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fisher</surname>
          </string-name>
          , A.J.:
          <article-title>How to forecast long-run volatility: regime switching and the estimation of multifractal processes</article-title>
          .
          <source>Journal of Financial Econometrics</source>
          <volume>2</volume>
          (
          <issue>1</issue>
          ) (
          <year>2004</year>
          )
          <volume>49</volume>
          {
          <fpage>83</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36. : Yahoo! Finance. http://finance.yahoo.com (
          <year>2015</year>
          ) Accessed:
          <fpage>2014</fpage>
          -01-22.
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Dickey</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fuller</surname>
            ,
            <given-names>W.A.</given-names>
          </string-name>
          :
          <article-title>Distribution of the estimators for autoregressive time series with a unit root</article-title>
          .
          <source>Journal of the American statistical association</source>
          <volume>74</volume>
          (
          <year>366a</year>
          ) (
          <year>1979</year>
          )
          <volume>427</volume>
          {
          <fpage>431</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38.
          <string-name>
            <surname>Zhou</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shao</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          :
          <article-title>Inference for linear models with dependent errors</article-title>
          .
          <source>Journal of the Royal Statistical Society: Series B (Statistical Methodology)</source>
          <volume>75</volume>
          (
          <issue>2</issue>
          ) (
          <year>2013</year>
          )
          <volume>323</volume>
          {
          <fpage>343</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>