<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The prospects of Artificial Intelligence in a Court Information System</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Greece etroulinos@adjustice.gr</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Administrative Justice, Court Information System, IACCMS</institution>
          ,
          <addr-line>Artificial Intelligence</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Artificial Intelligence is a transformational force. The paper examines this technology in an information system for the judiciary. It particularly explores how artificial intelligence could be used in the Integrated Administrative Court Case Management System of Greece. We identify two broad categories for AI development at the current level of this system: court-focused development and litigant-focused development. We examine particular tools that could facilitate the adjudication of cases considering four types of users: judges, court officers, lawyers and self-represented litigants. We conclude that certain tools could be developed to offer assistance to the above mentioned users</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Artificial Intelligence (AI) is a technology, which will infiltrate
most aspects of our society. Although most people associate it
with machine learning, it is a much broader group of methods and
approaches. The enthusiasm of solving every problem in justice
through technology fostered the introduction of Information and
Communication Technologies (ICT) in the judiciary. Countries
introduced ICT in their justice systems in order to improve both
efficiency of justice and accessibility to justice. In this context,
policy makers examine how AI can be used in courts to facilitate
both the administration of justice and the adjudication of cases.
Observing this trend the European Commission for the Efficiency
of Justice of the Council of Europe has already adopted a text
setting out ethical principles relating to the use of AI in judicial
systems [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], which stands out among other similar European and
international texts [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] in that it identifies core principles to be
respected particularly in the field of AI and justice. Undoubtedly,
the development of AI tools will transform the process of
adjudication, because they will alter the way legal information is
used and communicated. Hence, the effects of the changes
introduced by AI have the potential of being much deeper and less
controllable. In examining the use of AI in a court information
system one has to address the question of what use can AI have
for courts; that is how AI can help parties of a case (litigants),
members of the registry (court officers) and judges. We assume
that AI for the judiciary should be ‘bespoke’. It should provide
solutions to the problems that a particular jurisdiction –using a
certain court information system- faces. The aim of this paper is
to examine the effective application of AI regarding the court
information system that was introduced in 2015 at the
administrative justice of Greece, the Integrated Administrative
Court Case Management System of Greece (IACCMS). Section 2
briefly introduces IACCMS and displays current and future
developments of the system, Section 3 presents potential AI
solutions for IACCMS and our concluding remarks are on Section
4.
2 Formation of the Integrated Administrative
      </p>
      <p>Court Case Management System of Greece
In this section we will introduce IACCMS, but firstly we will
provide some preliminary remarks about administrative justice in
Greece and the introduction of ICT in it. These observations are
necessary before assessing the possibilities of AI in the following
section.</p>
      <p>The Constitution of 1975 (revised in 1986, 2001, 2008 and 2019)
establishes three jurisdictions: civil, criminal and administrative.
Administrative justice, i.e. a court system that adjudicates on
disputes between the citizen and the administration, is organized
in three tiers: the courts of first instance, the courts of appeal and
the Council of the State (the Supreme Administrative Court), the
latter being responsible for the rational operation of
administrative justice. Furthermore, the General Commission of
the State for the Regular Administrative Courts, which is a
separate branch of senior administrative judges, monitors and
oversights the operation of administrative courts and assists them
without interfering with their judicial task. It is also the
competent authority (at operational level) that serves as an
intermediary between the Council of State and the rest of
administrative courts. Finally, the Ministry of Justice,
Transparency and Human Rights is entrusted, among other
competences, with the management of justice. It supervises the
administration of justice, dealing with organizational issues and
the infrastructure and it provides economic (through the budget
of the State) and administrative support to the judiciary.
After the re-establishment of administrative courts of first
instance and appeal in their current form (in 1985) and the transfer
of cases from the Council of State to them, the number of cases
that they adjudicate rose exponentially and as a result there were
delays in delivering justice. The Greek legislator adopted several
laws in order to speed up court proceedings in administrative
justice. In addition, the introduction of ICT in administrative
justice turned into a priority. From 2000 onwards the Council of
State started the computerization of its registrar for the workflow
of judicial proceedings before the court (case management) and
also the integration of existing applications. In 2006 the integrated
case management system of the Council of State was operational;
it contained the court’s jurisprudence, the workflows of the
registrar (computerization of proceedings), a management
information system (MIS) and a web site. On the other hand, the
computerization of administrative courts of first instance and
appeal was fragmented, since each court was perceived (from an
IT point of view) as an autonomous entity; that is each court was
responsible both for the administration of its data and for the
communication with external users, including other
administrative courts. The different information systems that the
courts had did not interoperate with information systems outside
of the judiciary (e.g. lawyers, public administration, citizens), thus
hindering the efficiency of justice. Furthermore, due to local
configuration of systems there was local implementation of work
flows, thus a need for an integrated electronic case management
system became evident. There were few digital archives and court
decisions were available only to the court that issued them, with
the exception of judgements of Council of State. Furthermore, the
lack of funds due to the drastic reduction in budgetary resources
made untenable the maintenance cost of infrastructure.
Beware of those issues the Ministry of Justice, Transparency and
Human Rights in its ‘Action Plan for e-justice and administrative
improvement’ [3, in Greek] decided that the Council of State
would lead the initiative to introduce IACCMS, which is
operational since 2015. For the purposes of this paper, we are
interested in three of the main components of IACCMS: i) the
court case management system, which coordinates the workflows
(business process) of all the courts of administrative justice, ii) the
uniform digital archive of all court decisions, accessible to all
judges and partially accessible (only of anonymized judgements)
to the general public and iii) a ‘one-stop-shop’ portal through
which external users can gather information from any court. Since
2018 IACCMS interoperates with the National Lawyers
Information System for the e-filing of cases (application to initiate
proceedings). In addition, this year (2020) IACCMS interoperates
with the information system of the Legal Council of the State (the
public body that defends the Administration before all courts) for
the e-filing of a case, the electronic delivery of court decisions and
for clearance of legal costs. Finally, articles 75 and 76 of law
4635/2019 stipulate that the communication between litigants and
administrative courts from 01.01.2021 will be by electronic means;
the law further establishes the electronic file of each case
(‘paperless court’).</p>
      <p>
        Bearing in mind the above-mentioned developments at
administrative justice in Greece, in the following section we will
display the AI tools that could be used at IACCMS.
3 Development possibilities of AI for IACCMS
of Greece
In recent years a lot of companies made investments to search the
potential of AI, with considerable results (e.g. IBM’s Watson and
Google’s Alpha Go). AI innovations provide services to end users
(e.g. Apple’s Siri and Amazon’s Alexa voice assistants,
userspecific content provided by Netflix etc.), though the fact that
these services are based on the collection and processing of user
generated data, is raising concerns about the protection of
personal data [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and generally about privacy in the digital age
[
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. However, it was the availability of massive amounts of
training data, along with breakthroughs in computational power,
improvements in machine learning algorithms and mobile
connectivity that fostered AI breakthroughs. The use of AI
technology for managing public services has the potential to make
public organizations more adaptive to a society with diverse and
changing needs and demands. AI will continue to transform
society, although there is skepticism about AI’s potential, due to
the fact that many of the grand claims made (e.g. autonomous
vehicles) have failed to become reality. The limits to the use of AI
are mainly due to the fact that the most widespread technique,
machine learning, is a powerful patent recognition tool, but lacks
fundamental cognitive abilities of the human brain. It is accurately
argued that “AI represents a concerted effort to understand the
complexity of human experience in terms of information
processes” [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Many stakeholders (litigants, lawyers, court
officers and judges) anticipate the introduction and development
of AI into the justice system, though each group expects different
results, which do not always converge. We identify two broad
categories: a) court-focused development of AI, i.e. tools that help
the justice system to improve its efficiency and quality and b)
litigant-focused development of A.I., i.e. tools that help either
selfrepresented litigants or lawyers to navigate legal processes; i.e. to
gather information about how the law applies to a particular case.
In the first category (court-focused development of AI), these
techniques could be used for court management purposes. For
example, an AI tool could scan and digitize documents submitted
by litigants, classify them into electronic files and match the
document of each litigant to corresponding e-files (creating new
e-files or linking to existing ones). It could further generate all
necessary court procedural documents and even distribute cases
to judges. IACCMS already has a court case management system
that generates some court procedural documents (namely, notices
and dockets). Since it is not yet mandatory to file a lawsuit by
electronic means, the workflow is still paper based, meaning that
regardless of the way a lawsuit is filed (paper or electronic form)
the court officer has to enter the data to the information system.
Law 4635/2019 stipulates that from 01.01.2021 the medium to
communicate with administrative courts will be electronic; AI
could be useful in automating the process of data entry. A
prerequisite is to create ontology of legal terms -a ‘Controlled
Legal Vocabulary’- that will provide the relevant metadata for the
legal annotation of each document perhaps using LegalDocML
(Akoma Ntoso); it would be beneficial to create an automatic
structuring and semantic indexing of legal documents written in
Greek [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The AI tool should process uniformly all unstructured
documents that are uploaded to IACCMS; it should further
automatically apply metadata and connect the document to a
particular electronic case [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. For this purpose and to further
enhance interoperability, some of the existing tools that EU
provides to its member states could be used such as Controlled
Vocabularies , LegiVoc , Vocbench and, for the documents that
public administration sends, LEOS . Since it is very challenging to
process a legal document not developed by a lawyer, it would be
helpful to consider the development of techniques that will help
self-represented litigants to present facts in a more structured
way,
Having established an AI system such as the one already
described, it could be further used to improve the quantitative
processing of e-files. For example, an AI tool could identify certain
legal features (information extraction) in each case, assign it to
different case management tracks according to its complexity and
also group cases. Thus, it could streamline the processing of
judicial procedures in adjudicating a case, while also reducing
court staff and judges’ workload. This system could also provide
useful information to citizens (apart from prospective litigants
and lawyers), such as the duration of judicial proceedings for
different categories of cases in a particular court, the number of
pending cases of a particular nature etc. Moreover, machine
learning could be applied to the analysis of legal documents so as
to support judges in the solving of a dispute. For example, it could
create summaries of both the facts of the case and the arguments
that each litigant made in the documents (lawsuit, submissions,
and memorandums) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. However, before rolling out such an AI
tool thorough assessing should be preceded, because AI cannot
(yet) understand the context of a document; in other words, it
cannot perform legal reasoning and therefore AI could be misled
by minor variances in the data that it applies [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. We
comprehend that although existing legal text analytics tools can
extract certain kinds of semantic legal information from legal
texts, they are not yet able to extract expert systems rules. It is
therefore necessary to further develop techniques that identify
argument related information in legal documents.
      </p>
      <p>
        Additionally, AI tools could be used for the further development
of the uniform digital archive of all court decisions in IACCMS.
This database is accessible only to judges of administrative justice
and it contains all the judgements of the Council of State and the
judgements of all administrative courts of first instance and
appeal since 2015 and for some courts since 2000. It could be useful
to develop an AI tool for the retrieval of decisions related to a
particular case. In order to succeed in this endeavor an imperative
condition is the unambiguous identification of each court
decision; i.e. to ‘label’ or ‘tag’ each judgment with the appropriate
metadata (in a project similar to the one mentioned earlier about
legal documents). In the case of court decisions there is already in
place a useful tool provided by EU, the European Case Law
Identifier (ECLI) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] that could be defined as HTTP-URI. The
judgments of the Council of State already use ECLI, and its
obligatory metadata. The potential is to use ECLI to all court
decisions of administrative justice and furthermore use at least
two of the optional metadata of this tool. Particularly, the field
“dcterms: abstract” contains a summary of the court decision and
the field “dcterms: description” contains descriptive elements, like
keywords. Both of these fields could be filled using the technique
of legal text analytics, which was previously described, i.e. an AI
tool that is able to ‘read’ the relevant parts of a court decision and
on the one hand create a summary of the judgement and on the
other hand apply the appropriate terms of the ‘Controlled Legal
Vocabulary’. It would further be desirable to create an AI tool
capable of anonymizing or pseudonymizing a court decision
before uploading it at the portal of IACCMS, where it would be
accessible for everyone to access. This tool should be able to
recognize natural persons and anonymize or pseudonymize their
personal data, while preserving the accuracy of the court decision.
Regarding the second category (litigant-focused development of
A.I.), AI could be used to provide relevant information to external
users of IACCMS. For example, using a question answering
system [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], citizens, self-represented litigants as well as lawyers
could gather information about the jurisprudence of a particular
category of cases (landmark decisions). Usually, prospective
litigants prior to filing a claim to initiate legal proceedings need
information such as the extent of their rights, court costs, length
of proceedings, the necessary procedural steps to be followed etc.
European judicial bodies of the Council of Europe encourage the
dissemination of information to citizens by courts in order to
facilitate access to justice [13 and 14]. The EU is consolidating
relevant information about member states in the European
ejustice portal . In order to provide personalized information to
self-represented litigants and lawyers the development of an
interactive information system that maintains dynamic
information (a difficult task, since courts are subject to almost
continuous change of the law) at the portal of IACCMS is
necessary. In a simplified form such a system could assist the
prospective self-represented litigant or the lawyer through a
dynamic questionnaire (dialogue modelling). Moreover, a
conversational bot (Chabot) could be developed to enable users to
interface with it by voice and language, as long as it is able to
analyze structured and unstructured data (text and human
speech). The advantage of the development of such an AI tool is
that it can improve its efficiency by learning from the recorded
dialogues, thus each time finding a more suitable answer to the
question posed. Obviously, sufficient safeguards are needed for
the protection of personal data of the users in the recorded
dialogues. The goal is to navigate the user to the ‘customized’
information that he seeks and only in rare cases direct the user to
a court officer who will provide the necessary information. To this
end the system should be simple enough for a user with basic
technological literacy to use; a complex system may delay the
expected advantages especially for self-represented litigants,
hence the testing phase with stakeholders is important. There is
currently significant attention on developing tools to assist people
in resolving legal disputes [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], however, an AI tool to predict the
outcome of court cases or even to analyze the quality of a legal
claim and evidence to be submitted would be out of the scope of
IACCMS, because the judiciary should not provide legal advice.
Besides, such AI tools, at the current stage of development, can
follow the letter of the law while disregarding its spirit, since they
can extract explicit, not implicit, information and they lack human
qualities such as empathy.
4
      </p>
      <p>
        Conclusion
Legal systems can be improved by the introduction of AI, which
has the ability to bring change and benefits to society; it notably
has much to offer to individuals involved in court cases and the
justice system as a whole, though caution is needed for the impact
that AI could have on human rights [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Considering the
prospects and limitations of AI we explored the question of how
AI can facilitate the adjudication of cases, focusing on the specific
uses of AI for IACCMS regarding four types of users: judges, court
officers, lawyers and self-represented litigants. We understand
that new tools could be built to help judges and court officers with
the administration of justice: to facilitate the workflow of the
registry of courts and to provide useful information to judges
about the cases. We further conclude that AI tools could be
developed to offer assistance to litigants and their lawyers in
navigating legal processes, namely to help parties to gather
information prior to initiating legal proceedings before an
administrative court. However, there are limitations to the
introduction of AI in the justice system, since AI “should not
compromise the human and symbolic faces of justice. If justice is
perceived by the users as purely technical, without its real and
fundamental function, it risks being dehumanized. Justice is and
should remain humane as it primarily deals with people and their
disputes”. [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <article-title>[1] Council of Europe, European Commission for the Efficiency of Justice, (</article-title>
          <year>2018</year>
          ),
          <article-title>European ethical Charter on the use of Artificial Intelligence in judicial systems and their environment, as adopted at the 31st plenary meeting of the CEPEJ on 3-4 December 2018</article-title>
          , Retrieved June 17,
          <year>2020</year>
          from https://rm.coe.
          <article-title>int/ethicalcharter-en-for-</article-title>
          <string-name>
            <surname>publication-</surname>
          </string-name>
          4
          <string-name>
            <surname>-</surname>
          </string-name>
          december-2018
          <source>/16808f699c</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>T.</given-names>
            <surname>Dutton</surname>
          </string-name>
          (
          <year>2018</year>
          ),
          <article-title>An Overview of National AI Strategies</article-title>
          , Medium, 28 June 2018. Retrieved June 17,
          <year>2020</year>
          from https://medium.com/politics
          <article-title>-ai/an-overviewofnational-ai-strategies-2a70ec6edfd</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <article-title>[3] Ministry of Justice, Transparency and Human Rights (April 2014), Σχέδιο Δράσης για την Ηλεκτρονική Δικαιοσύνη και τη Διοικητική Αναβάθμιση, [Action Plan for ejustice and administrative improvement</article-title>
          , in Greek],
          <source>9th edition</source>
          ,.
          <source>Retrieved September 9</source>
          ,
          <year>2019</year>
          from http://www.ministryofjustice.gr/site/LinkClick.aspx?fileticket=
          <source>ENzZ1R6Y5fs% 3d&amp;tabid=253</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          (
          <year>2020</year>
          ),
          <article-title>White paper on artificial Intelligence - A European approach to excellence and trust</article-title>
          ,
          <volume>19</volume>
          .2.2020 COM(
          <year>2020</year>
          )
          <article-title>65 final</article-title>
          . Retrieved June 17,
          <year>2020</year>
          from https://ec.europa.eu/info/sites/info/files/commission-whitepaper
          <article-title>-artificial-intelligence-feb2020_en</article-title>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Becker</surname>
          </string-name>
          (
          <year>2019</year>
          ),
          <article-title>Privacy in the digital age: comparing and contrasting individual versus social approaches towards privacy</article-title>
          ,
          <source>Ethics and Information Technology</source>
          <volume>21</volume>
          :
          <fpage>307</fpage>
          -
          <lpage>317</lpage>
          , https://doi.org/10.1007/s10676-019-09508-z)
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Virginia</surname>
            <given-names>Dignum</given-names>
          </string-name>
          , (
          <year>2019</year>
          ),
          <source>Responsible Artificial Intelligence</source>
          .
          <article-title>How to develop and use AI in a responsible way</article-title>
          . Springer.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Koniaris</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Papastefanatos</surname>
            <given-names>G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Vassiliou</surname>
            <given-names>Υ.</given-names>
          </string-name>
          , (
          <year>2016</year>
          ),
          <article-title>Towards Automatic Structuring and Semantic Indexing of Legal Documents</article-title>
          .
          <source>In: Proceedings of the 20th Pan-Hellenic Conference on Informatics, ACM</source>
          ,
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . https://doi.org/10.1145/3003733.3003801
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Branting</surname>
            <given-names>LK</given-names>
          </string-name>
          , (
          <year>2016</year>
          ),
          <article-title>Vocabulary reduction, text excision, and procedural-context features in judicial document analytics</article-title>
          .
          <source>In Proceedings of the workshop on legal text</source>
          , document, and
          <article-title>corpus analytics (LTDCA-</article-title>
          <year>2016</year>
          ), pp
          <fpage>30</fpage>
          -
          <lpage>36</lpage>
          . Retrieved June 17,
          <year>2020</year>
          from http://law-and
          <article-title>-big-data</article-title>
          .org/LTDCA_2016_Workshop_Report.pdf
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Chen</surname>
            <given-names>Y.-C.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Bansal</surname>
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2018</year>
          ).
          <article-title>Fast abstractive summarization with reinforceselected sentence rewriting</article-title>
          .
          <source>In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Long Papers)</source>
          , pages
          <fpage>675</fpage>
          -
          <lpage>686</lpage>
          , Melbourne, Australia,
          <source>July 15 - 20</source>
          ,
          <year>2018</year>
          , Retrieved June 17,
          <year>2020</year>
          from https://www.aclweb.org/anthology/P18-1063.pdf DOI:
          <volume>10</volume>
          .18653/v1/
          <fpage>P18</fpage>
          -1063)
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Robin</surname>
            <given-names>J. and Liang P.</given-names>
          </string-name>
          , (
          <year>2017</year>
          ),
          <source>Adversarial Examples for Evaluating Reading Comprehension Systems, July</source>
          <volume>23</volume>
          ,
          <year>2017</year>
          , Retrieved June 17,
          <year>2020</year>
          from https://arxiv.org/pdf/1707.07328.pdf.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <article-title>Council conclusions inviting the introduction of the European Case Law Identifier (ECLI) and a minimum set of uniform metadata for case law</article-title>
          .
          <source>Official Journal of the European Union</source>
          ,
          <year>2011</year>
          /C 127/01.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <surname>Prager</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brown</surname>
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Coden</surname>
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Radev</surname>
            <given-names>D.</given-names>
          </string-name>
          , (
          <year>2000</year>
          ),
          <article-title>Question-answering by predictive annotation</article-title>
          ,
          <source>In Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval</source>
          ,
          <year>July 2000</year>
          Pages
          <fpage>184</fpage>
          -191 https://doi.org/10.1145/345508.345574
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13] Council of Europe, Consultative Council of European Judges, Opinion No.
          <volume>7</volume>
          (
          <issue>2005</issue>
          )
          <article-title>of CCJE to the attention of the Committee of Ministers of the Council of Europe on “Justice and Society” adopted by the CCJE at its 6th meeting (Strasbourg</article-title>
          ,
          <fpage>23</fpage>
          -
          <lpage>25</lpage>
          November
          <year>2005</year>
          ), Retrieved June 17,
          <year>2020</year>
          from https://rm.coe.
          <article-title>int/compilation-of-opinions-of-the-consultative-council-ofeuropean-judges/168074fabc#_Toc493252563</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <article-title>Council of Europe, European Commission for the Efficiency of Justice, (</article-title>
          <year>2017</year>
          ),
          <article-title>Guidelines on how to drive change towards cyberjustice - Stock-taking of tools deployed and summary of good practices</article-title>
          ,
          <source>Retrieved June 17</source>
          ,
          <year>2020</year>
          from https://edoc.coe.int/en/efficiency
          <article-title>-of-justice/7501-guidelines-on-how-to-drivechange-towards-cyberjustice-stock-taking-of-tools-deployed-and-summaryof-good-practices</article-title>
          .html )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Aletras</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsarapatsanis</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Preoţiuc-Pietro D</surname>
          </string-name>
          . and
          <string-name>
            <surname>Lampos</surname>
            <given-names>V.</given-names>
          </string-name>
          , (
          <year>2016</year>
          ),
          <article-title>Predicting judicial decisions of the European Court of Human Rights: A natural language processing perspective</article-title>
          ,
          <source>PeerJ Computer Science</source>
          , Vol.
          <volume>2</volume>
          , p.
          <fpage>e93</fpage>
          , http://dx.doi.org/10.7717/peerj-cs.
          <volume>93</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Council</surname>
            <given-names>of Europe</given-names>
          </string-name>
          , (
          <year>2020</year>
          ),
          <string-name>
            <surname>Recommendation</surname>
            <given-names>CM</given-names>
          </string-name>
          /Rec(
          <year>2020</year>
          )
          <article-title>1 of the Committee of Ministers to member States on the human rights impacts of algorithmic systems, Adopted by the Committee of Ministers on 8 April 2020 at the 1373rd meeting of the Ministers' Deputies</article-title>
          , Retrieved June 17,
          <year>2020</year>
          from https://search.coe.int/cm/pages/result_details.
          <source>aspx?objectid=09000016809e115 4</source>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17] Council of Europe, Consultative Council of European Judges, (
          <year>2011</year>
          ), Opinion No.
          <volume>14</volume>
          (
          <year>2011</year>
          )
          <article-title>of the CCJE “Justice and information technologies (IT)” Adopted by the CCJE at its 12th plenary meeting (Strasbourg, 7-9</article-title>
          <issue>November 2011</issue>
          ), Retrieved June 17,
          <year>2020</year>
          from https://rm.coe.
          <source>int/168074816b.</source>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>