<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Comparison of the Predictions of Convolutional Neural Networks with Image Arguments and Long Short-Term Memory Neural Networks with Time-Series Arguments for Cryptocurrency Markets</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>A Misnik</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>S Krutalevich</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>S Prakapenka</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>P Borovykh</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>M Vasiliev</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Inter-state educational institution of higher education “Belarusian-Russian university”</institution>
          ,
          <addr-line>Mogilev</addr-line>
          ,
          <country country="BY">Belarus</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>RoninAI Lab</institution>
          ,
          <addr-line>New York</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <fpage>214</fpage>
      <lpage>222</lpage>
      <abstract>
        <p>Convolutional neural networks are currently very popular in a wide variety of applications. The aim of this article is to verify the reasonableness for using convolutional neural networks in cases when time-series data is available. The predictions of a convolutional neural network, that analyzes the graphical representation of a time-series are compared with the predictions of long shortterm memory network, that analyzes time-series data in numerical representation. We show how the accuracy of cryptocurrency predictions could be improved with time-series data inputs versus image arguments.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>Market prices of cryptocurrencies are subject to great volatility, partially due to
the absence of agreed-upon fundamentals to back up their price value. Thus, the
variety of psychological factors and emotional perception of the market situation by
the trader is very important when he decides whether to buy or sell a cryptocurrency.</p>
      <p>
        Every cryptocurrency exchange or analytical service has several basic elements,
shown on their index pages. The main one – is a price chart. An example of this chart
is shown in Figure 1. We believe that the appearance of this chart has a great
influence on a trader’s decision to buy or sell a cryptocurrency. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]
      </p>
      <p>For this study, we will compare prediction results made by CNN with chart
images used as input data to LSTM with time-series data used as input data. The
output will be the change in BTC market price for the next minute.</p>
      <p>
        We will use a statistical F-test to determine the quality of predictions. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]
      </p>
    </sec>
    <sec id="sec-2">
      <title>2 Experimental Setup</title>
      <p>For our setup, we used a server equipped with Intel® Core™ i7-6700 Quad-Core
CPU, 64 GB DDR4 RAM, 2 x 500 GB SATA SSD hard drives and GTX 1080 Ti
GPU. This setup with a powerful GPU allows for rapid model compilation and
training of the model with the data.</p>
      <p>We used the Keras library and the TensorFlow library to operate with neural
network models.</p>
      <p>The data itself is stored and grouped into CSV files. Every CSV file contains two
columns and 1440 rows. 1440 rows correspond to 1440 minutes in a 24-hour
timeframe. The first column includes the closing market price for each minute and the
second column represents a minute change of the market price.</p>
      <p>We had 525600 files with training examples in total, matching every minute
situation during the year. Thus, the critical F-test value using alpha=0.05 is 1.83.</p>
      <p>CNN</p>
      <p>First of all, we prepared training samples for CNN. To do it, we generated an
image for every CSV file. The example of such image is shown in Figure 2.
Our CNN consists of three convolutional layers and Multilayer perceptron.
The experimental results, using trained CNN are shown in Figure 3.</p>
      <p>Using trained CNN results, the calculated F-test value turned out to be -2.9.
Although the value of -2.9 is above critical, this level is still low.</p>
    </sec>
    <sec id="sec-3">
      <title>LSTM</title>
      <p>To train LSTM network we just fed the CSV files.</p>
      <p>Our LSTM network consists of one LSTM layer and three direct distribution
layers.</p>
      <p>The experimental results using trained LSTM are shown in Figure 4.</p>
      <p>Using trained LSTM results, the calculated F-test value turned out to be -1.5. The
value of -1.5 is below critical.
5</p>
    </sec>
    <sec id="sec-4">
      <title>Evolving LSTM</title>
      <p>4. Calculation of the coefficient of relative change in the linear component over
the period T by the formula:</p>
      <p>EL = a (1) * T * 100 / Emin, (2)</p>
      <p>The value of EL is relative and does not depend on the absolute value of the series.
If the quantity EL &gt; 0 then the linear component increases.</p>
      <p>5. To estimate the harmonic component of the series, we perform a Fourier
transform (FT) for the series E'.</p>
      <p>6. Determine the moduli of the oscillation amplitudes in the frequency domain
A(w). Carry out the filtering of frequencies according to the amplitude values.</p>
      <p>To analyze the efficiency of the proposed algorithm, we used MATLAB
environment.</p>
      <p>Step 1. The linear component is constant. The harmonic component is absent. The
results are shown in Figure 5. The value of the coefficient EL displayed on the second
chart. In this case, EL = 0.</p>
      <p>Step 2. The linear component grows. The harmonic component is absent. The
results are shown in Figure 5. The coefficient EL = 20%. The spectrum modules have
values in the low-frequency range (1-2 Hz.). It should be remembered that the main
frequency band for the module of the real sequence lies in the interval 0&lt;k &lt;= N / 2-1.</p>
      <p>Therefore, frequencies above 15 Hz in our example should be ignored. If it is
necessary to analyze higher frequencies, we will increase N - the number of sampling
points, Figure 6.</p>
      <p>Step 3. The linear component decreases. The harmonic component is absent. The
results are shown in Figure 7.</p>
      <p>Step 4. The linear component is absent. The harmonic component is present at a
frequency of 3 Hz - amplitude 20. The results are shown in Figure 8.</p>
      <p>Step 5. The linear component increases. The harmonic component is present at a
frequency of 3 Hz - an amplitude of 400. The results are shown in Figure 9.</p>
      <p>We applied the proposed algorithm to the data presented in Figure 1. The linear
component predicted an uptrend with a rate of 10.2% per period. Modules of
amplitudes of the harmonic components had an influence in frequencies of up to 10
Hz.</p>
      <p>Using trained LSTM with additional inputs results we conducted the F-test
resulting in the F-test value of -5.8. This value is above critical, and better than CNN.</p>
    </sec>
    <sec id="sec-5">
      <title>7 Conclusion</title>
      <p>In this paper we compared CNN and LSTM efficiency to process time-series data
in numerical and image form.</p>
      <p>In our experiment, CNN shows non-critical results in terms of F-test, while LSTM
with only one input – BTC market price, shows under critical results. But the
extension of inputs, based on series data analysis can improve LSTM performance to
the non-critical level, prevailing results produced by CNN.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>S.</given-names>
            <surname>Haykin</surname>
          </string-name>
          ,
          <source>Neural Networks and Learning Machines (3rd Edition)</source>
          ,
          <source>Prentice Hall</source>
          ,
          <year>2009</year>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Tax</surname>
          </string-name>
          , N.;
          <string-name>
            <surname>Verenich</surname>
            ,
            <given-names>I.; La</given-names>
          </string-name>
          <string-name>
            <surname>Rosa</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Dumas</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>"Predictive Business Process Monitoring with LSTM neural networks"</article-title>
          .
          <source>Proceedings of the International Conference on Advanced Information Systems</source>
          Engineering (CAiSE):
          <fpage>477</fpage>
          -
          <lpage>492</lpage>
          . arXiv:
          <volume>1612</volume>
          .02130 
          <article-title>Freely accessible</article-title>
          .
          <source>doi:10</source>
          .1007/978-3-
          <fpage>319</fpage>
          -59536-8_
          <fpage>30</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>A.</given-names>
            <surname>Misnik</surname>
          </string-name>
          <article-title>Neural network modeling of heat supply systems // "</article-title>
          <source>Neurocomputers: development, application" - 2012. №2</source>
          . - p
          <fpage>62</fpage>
          -
          <lpage>73</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>V.</given-names>
            <surname>Borisov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Misnik</surname>
          </string-name>
          <article-title>Combined neural network modeling for the operational management of complex systems / / Information technology</article-title>
          .
          <source>- 2012</source>
          . - No. 7. - P.
          <fpage>69</fpage>
          -
          <lpage>72</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Anton</given-names>
            <surname>Misnik</surname>
          </string-name>
          , Sergey Krutolevich, Siarhei Prakapenka,
          <source>Max Vasilyeu Neural Network Approximation Precision Change Analysis on Cryptocurrency Price</source>
          Prediction p.
          <fpage>96</fpage>
          -
          <lpage>101</lpage>
          <source>Proceedings of the II International Scientific and Practical Conference “Fuzzy Technologies in the Industry - FTI</source>
          <year>2018</year>
          ”
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Wierstra</surname>
            , Daan; Schmidhuber,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Gomez</surname>
            ,
            <given-names>F. J.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>"Evolino: Hybrid Neuroevolution/Optimal Linear Search for Sequence Learning"</article-title>
          .
          <source>Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI)</source>
          , Edinburgh:
          <fpage>853</fpage>
          -
          <lpage>858</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Stein</surname>
          </string-name>
          , Elias; Shakarchi,
          <string-name>
            <surname>Rami</surname>
          </string-name>
          (
          <year>2003</year>
          ),
          <source>Fourier Analysis: An introduction</source>
          , Princeton University Press, ISBN 978-0-
          <fpage>691</fpage>
          -11384-5.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Rahman</surname>
          </string-name>
          ,
          <string-name>
            <surname>Matiur</surname>
          </string-name>
          (
          <year>2011</year>
          ), Applications of Fourier Transforms to Generalized Functions, WIT Press,
          <source>ISBN 978-1-84564-564-9.</source>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Abarbanel</surname>
          </string-name>
          ,
          <source>Henry (Nov</source>
          <volume>25</volume>
          ,
          <year>1997</year>
          ).
          <article-title>Analysis of Observed Chaotic Data</article-title>
          . New York: Springer. ISBN 978-0387983721.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>