<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Benchmarking between the DQL Index and the Web Application Accessibility Index using Automatic Test Tools</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tetyana Zhyrova</string-name>
          <email>zhyrova@knute.edu.ua</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nataliia Kotenko</string-name>
          <email>kotenkono@knute.edu.ua</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bohdan Bebeshko</string-name>
          <email>b.bebeshko@knute.edu.ua</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Karyna Khorolska</string-name>
          <email>k.khorolska@knute.edu.ua</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Svitlana Shevchenko</string-name>
          <email>s.shevchenko@kubg.edu.ua</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Borys Grinchenko Kyiv University</institution>
          ,
          <addr-line>18/2 Bulvarno-Kudriavska str., Kyiv, 04053</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>State University of Trade and Economics</institution>
          ,
          <addr-line>19 Kioto str., Kyiv, 02000</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>110</fpage>
      <lpage>116</lpage>
      <abstract>
        <p>Every day, humanity is witnessing digital transformation, which involves implementing digital technologies to transform business processes and services from non-digital to digital. The success of this transformation is measured by the Digital Quality of Life (DQL) Index, and VPN service provider Surfshark publishes the study results. As Index DQL grows, so does the number of users because digital accessibility is becoming more popular daily. The increase in digital information, the continuous development of IT, and the transition of life online require software to be accessible to people with disabilities. There is a question about the correlation between software availability level and Index DQL. This research is dedicated to the solution to this issue. Ten European countries were randomly selected, and automated testing of the accessibility of government websites was carried out using the following tools: Tenon, Wave, and SiteImprove. The term Web application accessibility index was defined. For the first time, an analysis of the correspondence between Index DQL indicators and the web application accessibility index was carried out. Even though the EU countries and their partner states are constantly working to improve conditions for people with disabilities, a high DQL Index does not indicate a high level of accessibility of state websites, which was confirmed by the study.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Digital quality of life</kwd>
        <kwd>accessibility testing</kwd>
        <kwd>automatic test tools</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Every day, humanity is witnessing digital
transformation, which involves implementing
digital technologies to transform business
processes and services from non-digital to digital.
This includes, among other things, moving data to
the cloud, using technology devices and tools for
communication and collaboration, and
automating processes. Digital transformation
makes life easier and helps quickly solve many
problems. It is intended to improve the quality of
digital life that spending on digital transformation
technologies and services is constantly increasing
worldwide, as evidenced by the Statista website
(see Fig. 1) [[1]–4].</p>
      <p>Digital transformation means implementing
digital technologies to transform business
processes and services from non-digital to digital.
Digital services are benefiting in almost every
field of activity. The availability of the Internet
and digital spaces has led to the emergence of
ecommerce services and various options for
working on the Internet. This includes, among
other things, moving data to the cloud, using
technological devices and tools for
communication and collaboration, and
automating processes [5]. High digital quality of
life facilitates and accelerates the resolution of
several issues by citizens of one or another
country. The Digital Quality of Life (DQL) Index
is calculated by looking at the impact of five core
pillars:
1. Internet Affordability: This pillar determines
how long an individual has to work to afford
the internet, specifically the cheapest mobile
and broadband internet.
2. Internal Quality: this pillar determines the
stability and speed of the internet for both
mobile data and broadband. It also considers
the growth of speed and strength.
3. Electronic Infrastructure: this pillar measures
how developed a country’s e-infrastructure is.
Better infrastructure results in smooth online
experiences such as banking, shopping,
entertainment, education, etc.
4. Electronic Security is a measure of a nation’s
cyber security and includes various strategies
the country has developed to decrease
cybercrimes and protect the privacy of its people.
5. Electronic Government is the pillar that
reviews the advancements of the government
in the digital sector. This results in lesser
corruption, better transparency for the public,
and efficient public services [5].</p>
      <p>3
s
r
a
llo2.5
d
.
.S 2
U
n
lio1.5
l
i
r
t
in 1
g
n
i
nd0.5
e
p
S 0
0.96
1
1.18
1.31</p>
      <p>According to a study published by the VPN
service provider Surfshark, there is a
corresponding distribution of DQL among the
countries of the world and Europe (see Fig. 2).</p>
      <p>
        The Digit
        <xref ref-type="bibr" rid="ref32">al Quality of Life 2021</xref>
        index
analyses 110 countries worldwide in terms of five
core pillars: internet affordability, internet quality,
e-infrastructure, e-security, and e-government.
These pillars consist of 14 indicators that are
interrelated and work together to measure the
overall digital quality of life [5]. Countries were
evaluated based on index scores with the best
possible value equal to one. Denmark is the best
at 0.83, followed by South Korea (0.76), Finland
(0.76), Israel (0.74), the United States of America
(0.74), and Singapore (0.72). Ukraine ranks only
47th in this ranking.
      </p>
      <p>2.1
2.4
2.8
1.5
1.8
2017
2018
2019
2020
2021* 2022* 2023* 2024* 2025*</p>
      <p>With the growth of DQL, the number of users
of government Internet applications is growing,
among which a particular share is occupied by
people with special needs, whose number is
constantly increasing. Such applications have
several requirements. Note that to solve these
issues, on October 26, 2016, the EU Parliament
and the Council of the European Union passed the
EU Web Accessibility Directive, and on June 7th,
2019, the European Union formally adopted the
European Accessibility Act. The Directive aims to
create a more standardized and harmonized
framework around the accessibility of websites
and mobile applications of public sector bodies
[6]. The Directive complements the European
Accessibility Act, which covers a wide range of
products and services also in the private sector.
Further European legislation supports people with
disabilities in other areas, including electronic
communications, audio-visual media services,
eBooks, eCommerce, and ICT equipment [7].
Following the specified directive, the following
terms were established: on September 23, 2019,
all new public sector websites and apps were
required to conform to the directive; by
September 23, 2020, all new and existing public
websites must conform to the directive; by June
23, 2021, all new and existing mobile apps must
conform to the directive [6]. Thus, the question
arises about the relationship between the DQL
index and the availability of web applications of
state importance.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Works</title>
      <p>The issue of software availability is quite
broad and multifaceted. It has worried several
scientists but is still not revealed and not
completed. Scientists: M. Goldberg [8], M.
Campoverde-Molina 9, K. Ordonez 10, G. E.
Constain 11, J.S. Silva 12, K. Brown [13]3,
M. Sashnova [[14]], etc. Nielsen Norman Group
[[15]], which is a world leader in user experience
research, needs special attention. For the past few
years, their research has focused on website
accessibility.</p>
      <p>Several scientists are working on the issue of
inclusive software: A. Savidis [[16]], J.
OheneDzhan [[17]], I. Niculescu [[18]], K.M. Martinez
[[19]], V. Boronos [20] and others. A small
number of publications are devoted to studying
the digital quality of life.</p>
      <p>The analysis of publications in this direction
showed that:
1. There are no clear and unambiguous
definitions of such concepts as “disability,”
“accessibility,” “person with disabilities,” or
“person with special needs,” which has some
ambiguity in research and needs clarification
and agreement at the global level.
2. There are no clear definitions and concepts of
such terms as “accessibility web design,”
“inclusive software,” or “universal web
design.”
3. To ensure a high level of content accessibility
for people with disabilities, WAI (Web
Accessibility Initiative), within the framework
of the World Wide Web Consortium (W3C),
developed the Web Content Accessibility
Guidelines (WCAG) standard. Version
WCAG 2.1 was adopted as the standard of the
European Union EN 301 549 [21]. The
recommendations for ensuring the
accessibility of web content are the most
universal, and many countries have adapted
these requirements to their laws.
4. There are many programs for automated web
application accessibility testing. In the vast
majority, they do not check all WCAG 2.1
requirements, so there is a need for several
automatic testing tools.
5. No scientific publications highlight the issue
of the DQL Index, its factors, the relationship
between the DQL Index, the availability of
web applications, etc.</p>
      <p>Therefore, the study of scientific and practical
literature, publications, and publications on the
Internet proved that the issue of the relationship
between the level of accessibility of software and
the Digital Quality of Life index needs thorough
research and analysis, and there is also a need to
improve accessibility testing standards. Thus, this
article aims to analyze accessibility standards,
research existing automated web application
accessibility testing tools, and correlate test
results with the Digital Quality of Life index.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Index Correspondence Research</title>
      <p>
        By Directive (EU) 2016/2102 Of The
European Parliament And Of The Council of 26
        <xref ref-type="bibr" rid="ref43">October 2016</xref>
        on the accessibility of the websites
and mobile applications of public sector bodies
[22], it is the applications of public sector bodies
that require accessibility.
      </p>
      <p>The standard contains a number of
recommendations on what needs to be done to
make the web-content accessible to people with
disabilities. Recommendations are grouped
according to four principles: perception,
manageability, comprehensibility and reliability.
These recommendations are called success
criteria, and according to them, the application
can receive one of three levels: A, AA or AAA.
Accessibility testing at the appropriate level is
performed by automated systems and testers who
check whether the content of the site meets the
relevant criteria and assess the usability of the
platform [[23]3].</p>
      <p>The Accessibility Conformance Testing
(ACT) Rules Format 1.0 defines a format for
writing accessibility test rules. These test rules can
be used for developing automated testing tools
and manual testing methodologies. It provides a
common format that enables any party involved in
accessibility testing to document and share their
testing procedures in a robust and understandable
manner. This enables transparency and
harmonization of testing methods, including
methods implemented by accessibility test tools
[[24]].</p>
      <p>There is a range of tools for automated testing,
including Google ADT, Tenon, aXe, Wave,
SiteImprove, and others. We have chosen the
following tools for automated testing of the
availability of government websites: Tenon,
Wave, and SiteImprove. This choice is due to the
GDS accessibility team’s audit of the most used
accessibility tools [[25]].</p>
      <p>Technology is constantly changing, so the web
application's user experience will vary depending
on the technical capabilities of browsers and
devices. Not all browsers display web pages the
same way. There are often noticeable differences
in how browsers handle technologies like CSS,
HTML, and JavaScript. Because, according to
statistics provided on the Statcounter GlobalStats
website, the browser market share in Europe was
distributed as follows: Chrome 59.29%, Safari
19.97%, Edge 5.86%, Firefox 5.83%, Samsung
Internet 3.62%, Opera 3.02% [[26]]. That is why,
within the framework of this study, testing the
availability of web applications of state
importance was carried out in Google Chrome.</p>
      <p>We have chosen 10 European countries
randomly to ensure the sample’s
representativeness: Denmark, Switzerland,
United Kingdom of Great Britain and Northern
Ireland, Luxembourg, Poland, Italy, Greece,
Ukraine, Albania, Montenegro [27–36].</p>
      <p>Table 1 contains the results of testing the
accessibility of Government website home pages
with the appropriate automated testing tools.</p>
      <p>Testing of Siteimprove Browser Extensions
was carried out according to the following
criteria:
 Error. Occurrences of an issue that have been
automatically determined to be in
contravention of the Web Content
Accessibility Guidelines (WCAG) 2.
 Warning. Occurrences of an issue that have
been automatically determined to be in
contravention of best practices under the Web
Content Accessibility Guidelines (WCAG) 2.
 Review. Issues that cannot be checked
automatically but requires a manual inspection
to determine if each item lives up to the
success criteria.</p>
      <p>Testing of WAVE Browser Extensions was
carried out according to the following criteria:
 Error. Occurrences of an issue which have
been automatically determined to be in
contravention of the Web Content
Accessibility Guidelines (WCAG) 2.
 Contrast Errors. Text is present that has a
contrast ratio less than 4.5:1, or large text
(larger than 18 point or 14 point bold) has a
contrast ratio less than 3:1. WCAG requires
that page elements have both foreground AND
background colors defined (or inherited) that
provide sufficient contrast. When text is
presented over a background image, the text
must have a background color defined
(typically in CSS) that provides adequate text
contrast when the background image is
disabled or unavailable. WAVE does not
identify contrast issues in text with CSS
transparency, gradients, or filters.
 Alerts. Occurrences of an issue that have been
automatically determined to be in
contravention of best practices under the Web
Content Accessibility Guidelines (WCAG) 2.
 Structural Elements. The number of structural
elements on the page, such as headings of
different levels, ordered lists and unordered
lists, navigation, etcetera.</p>
      <p>Tenon testing was carried out according to the
following criteria: Total Issues, Error Density.</p>
      <p>Where n is the number of evaluation criteria of
the web application, E is the number of elements
Tenon
g
n
i
n
r
a
W
w
e
i
v
e</p>
      <p>R
that have been checked, k is the number of errors
for each criterion.</p>
      <p>Fig. 4 shows an infographic that demonstrates
the correspondence between the DQL Index and
the accessibility index of the home pages of the
Government website.</p>
      <p>According to the results of this study, it can be
concluded that there is no correspondence
between these indices.</p>
      <p>64</p>
      <p>37
22
16</p>
      <p>78
11</p>
      <sec id="sec-3-1">
        <title>Montenegro</title>
      </sec>
      <sec id="sec-3-2">
        <title>Albania</title>
      </sec>
      <sec id="sec-3-3">
        <title>Ukraine</title>
      </sec>
      <sec id="sec-3-4">
        <title>Greece</title>
      </sec>
      <sec id="sec-3-5">
        <title>Italy</title>
      </sec>
      <sec id="sec-3-6">
        <title>Poland</title>
      </sec>
      <sec id="sec-3-7">
        <title>Luxembourg</title>
      </sec>
      <sec id="sec-3-8">
        <title>Great Britain</title>
      </sec>
      <sec id="sec-3-9">
        <title>Switzerland Denmark 0.06 0.04</title>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>The DQL index is calculated by analyzing the
impact of five main components: Internet
accessibility, Internet quality, e-infrastructure,
esecurity, and e-government. It does not consider
the accessibility requirements of digital products,
in particular web pages. It should be noted that EU
countries and their partner states are constantly
working to improve conditions for people with
disabilities, but the DQL Index does not indicate
a high level of accessibility of state websites. This
is evidenced by the results of the conducted
research. For the first time, an analysis of the
correspondence between Index DQL indicators
and the web application accessibility index was
carried out. Even though the EU countries and
their partner states are constantly working to
improve conditions for people with disabilities, a
high DQL Index does not indicate a high level of
accessibility of state websites, which was
confirmed by the study.</p>
    </sec>
    <sec id="sec-5">
      <title>5. References</title>
      <p>[1] Spending on Digital Transformation
Technologies and Services Worldwide from
2017 to 2025, https://www.statista.com/
statistics/870924/worldwide-digitaltransformation-market-size/.
[2] M. Vladymyrenko, et al., Analysis of
Implementation Results of the Distributed
Access Control System, in VI In-ternational
Scientific and Practical Conference
Problems of Infocommunications. Science</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <source>and Technology</source>
          ,
          <year>2019</year>
          , pp.
          <fpage>39</fpage>
          -
          <lpage>44</lpage>
          . doi:
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          10.1109/picst47496.
          <year>2019</year>
          .
          <volume>9061376</volume>
          . [3]
          <string-name>
            <given-names>I.</given-names>
            <surname>Bogachuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Sokolov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Buriachok</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          munications.
          <source>Science and Technology</source>
          ,
          <year>2018</year>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          pp.
          <fpage>581</fpage>
          -
          <lpage>585</lpage>
          . doi:
          <volume>10</volume>
          .1109/infocommst.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <year>2018</year>
          .
          <volume>8632151</volume>
          . [4]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Sadykov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Sokolov</surname>
          </string-name>
          , P. Skladannyi,
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Electronics</surname>
          </string-name>
          ,
          <year>2021</year>
          , pp.
          <fpage>22</fpage>
          -
          <lpage>25</lpage>
          . doi:
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          10.1109/UkrMiCo52950.
          <year>2021</year>
          .
          <volume>9716700</volume>
          . [5] 2021 Digital Quality of Life Index,
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          https://surfshark.com/dql2021. [6]
          <string-name>
            <given-names>EU</given-names>
            <surname>Web Accessibility</surname>
          </string-name>
          Compliance and
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          legislation/. [7]
          <string-name>
            <given-names>Web</given-names>
            <surname>Accessibility</surname>
          </string-name>
          https://digital-
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          accessibility. [8]
          <string-name>
            <given-names>M.</given-names>
            <surname>Goldberg</surname>
          </string-name>
          , et al.,
          <source>Are Accessible Software</source>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Technology</surname>
          </string-name>
          ,
          <volume>34</volume>
          :
          <fpage>1</fpage>
          ,
          <issue>2022</issue>
          , pp.
          <fpage>61</fpage>
          -
          <lpage>63</lpage>
          , doi:
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          10.1080/10400435.
          <year>2021</year>
          .
          <volume>2024627</volume>
          . [9]
          <string-name>
            <given-names>M.</given-names>
            <surname>Campoverde-Molina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Luján-Mora</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Access</surname>
          </string-name>
          , vol.
          <volume>9</volume>
          ,
          <issue>2021</issue>
          , pp.
          <fpage>139576</fpage>
          -
          <lpage>139593</lpage>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <source>doi: 10</source>
          .1109/ACCESS.
          <year>2021</year>
          .
          <volume>3116100</volume>
          . [10]
          <string-name>
            <given-names>K.</given-names>
            <surname>Ordonez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hilera</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cueva</surname>
          </string-name>
          , Model-
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <source>Univ Access Inf Soc 21</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>295</fpage>
          -
          <lpage>324</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <source>doi: 10.1007/s10209-020-00751-6</source>
          . [11]
          <string-name>
            <given-names>G. E.</given-names>
            <surname>Constain</surname>
          </string-name>
          , et al.,
          <article-title>Framework for the</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          <string-name>
            <surname>from the</surname>
            <given-names>HCI</given-names>
          </string-name>
          ,
          <year>2022</year>
          17th Iberian Conference
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          <source>(CISTI)</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          . doi:
          <volume>10</volume>
          .23919/
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          <string-name>
            <surname>CISTI54924.</surname>
          </string-name>
          <year>2022</year>
          .
          <volume>9820360</volume>
          . [12]
          <string-name>
            <given-names>J. S.</given-names>
            <surname>Silva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gonçalves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Branco</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <source>Access in the Information Society 18</source>
          ,
          <year>2019</year>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          pp.
          <fpage>703</fpage>
          -
          <lpage>716</lpage>
          . doi:
          <volume>10</volume>
          .1007/s10209-019-
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          00688-
          <fpage>5</fpage>
          [13]
          <string-name>
            <given-names>K.</given-names>
            <surname>Brown</surname>
          </string-name>
          , et al.,
          <article-title>Students with Disabilities as</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          <source>for Students as Partners</source>
          ,
          <volume>4</volume>
          (
          <issue>2</issue>
          ),
          <year>2020</year>
          , pp.
          <fpage>97</fpage>
          -
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          109. doi:
          <volume>10</volume>
          .15173/ijsap.v4i2.
          <fpage>4051</fpage>
          . [14]
          <string-name>
            <given-names>M.</given-names>
            <surname>Sashnova</surname>
          </string-name>
          , et al.,
          <source>Detection of</source>
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          <string-name>
            <surname>Technology</surname>
          </string-name>
          ,
          <volume>99</volume>
          (
          <issue>12</issue>
          ),
          <year>2021</year>
          , pp.
          <fpage>2845</fpage>
          -
          <lpage>2857</lpage>
          . [15] Nielsen Norman Group,
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          https://www.nngroup.com/. [16]
          <string-name>
            <given-names>A.</given-names>
            <surname>Savidis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Stephanidis</surname>
          </string-name>
          , Inclusive
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          vol.
          <volume>18</volume>
          , no.
          <issue>1</issue>
          ,
          <issue>2006</issue>
          , pp.
          <fpage>71</fpage>
          -
          <lpage>116</lpage>
          . doi:
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          10.1016/j.intcom.
          <year>2005</year>
          .
          <volume>06</volume>
          .005. [17]
          <string-name>
            <given-names>J.</given-names>
            <surname>Ohene-Djan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Shipsey</surname>
          </string-name>
          , Principles for
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          <string-name>
            <surname>Technologies</surname>
          </string-name>
          , in 2018 Eighth IEEE
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          <string-name>
            <given-names>Learning</given-names>
            <surname>Technologies</surname>
          </string-name>
          ,
          <year>2008</year>
          , pp.
          <fpage>989</fpage>
          -
          <lpage>990</lpage>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          <source>doi: 10</source>
          .1109/ICALT.
          <year>2008</year>
          .
          <volume>254</volume>
          . [18]
          <string-name>
            <given-names>I.</given-names>
            <surname>Niculescu</surname>
          </string-name>
          , et al.,
          <source>Towards Inclusive</source>
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          <string-name>
            <given-names>A</given-names>
            <surname>Case-Study</surname>
          </string-name>
          at Windows, in 2021
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          /ACM 43` International Conference on
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          <source>in Practice (ICSE-SEIP)</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>180</fpage>
          -
          <lpage>187</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          <source>doi: 10</source>
          .1109/icse-seip52600.
          <year>2021</year>
          .
          <volume>00027</volume>
          . [19]
          <string-name>
            <surname>C. M. Martínez</surname>
          </string-name>
          , et al.,
          <source>Responsive Inclusive</source>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          <string-name>
            <surname>Soc.</surname>
          </string-name>
          ,
          <year>2022</year>
          . doi:
          <volume>10</volume>
          .1007/s10209-022-00893-
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          9. [20]
          <string-name>
            <given-names>V.</given-names>
            <surname>Boronos</surname>
          </string-name>
          , et al.,
          <source>Digital transformation of</source>
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          <string-name>
            <given-names>Economic</given-names>
            <surname>Annals-XXI</surname>
          </string-name>
          ,
          <volume>172</volume>
          (
          <issue>7-8</issue>
          ),
          <year>2018</year>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          pp.
          <fpage>38</fpage>
          -
          <lpage>43</lpage>
          . doi:
          <volume>10</volume>
          .21003/ea.V172-
          <volume>07</volume>
          . [21]
          <article-title>Countries that Have Adopted WCAG</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          <string-name>
            <surname>Standards</surname>
          </string-name>
          , https://www.3playmedia.com/
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          standards-map/. [22]
          <string-name>
            <surname>Directive</surname>
          </string-name>
          (EU)
          <year>2016</year>
          /2102 Of The European
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          <source>Parliament And Of The Council of 26</source>
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          <source>October</source>
          <year>2016</year>
          , https://eur-lex.europa.eu/
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          32016L2102&amp;from=EN. [23]
          <string-name>
            <given-names>T.</given-names>
            <surname>Zhyrova</surname>
          </string-name>
          , et al.,
          <source>Testing the Accessibility</source>
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          <string-name>
            <given-names>and Information</given-names>
            <surname>Technologies</surname>
          </string-name>
          , no.
          <issue>3</issue>
          ,
          <year>2021</year>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref46">
        <mixed-citation>
          pp.
          <fpage>89</fpage>
          -
          <lpage>95</lpage>
          . doi:
          <volume>10</volume>
          .31891/CSIT. [24]
          <string-name>
            <given-names>Web</given-names>
            <surname>Content Accessibility Guidelines</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref47">
        <mixed-citation>
          https://www.w3.org/. [25]
          <string-name>
            <given-names>Accessibility</given-names>
            <surname>Tool</surname>
          </string-name>
          Audit, https://alphagov.
        </mixed-citation>
      </ref>
      <ref id="ref48">
        <mixed-citation>github.io/accessibility-tool-audit/. [26] Browser Market Share in Europe, August</mixed-citation>
      </ref>
      <ref id="ref49">
        <mixed-citation>2022, https://gs.statcounter.com/browser-</mixed-citation>
      </ref>
      <ref id="ref50">
        <mixed-citation>
          market-share/all/europe. [27]
          <string-name>
            <given-names>Denmark</given-names>
            <surname>Government Official Website</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref51">
        <mixed-citation>
          https://denmark.dk/. [28]
          <string-name>
            <given-names>Switzerland</given-names>
            <surname>Government Official Website</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref52">
        <mixed-citation>
          https://www.admin.ch/gov/en/start.html. [29]
          <article-title>The United Kingdom of Great Britain and</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref53">
        <mixed-citation>
          <string-name>
            <surname>Website</surname>
            , https://www.gov.uk/. [30]
            <given-names>Luxembourg</given-names>
          </string-name>
          <string-name>
            <surname>Government Official Website</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref54">
        <mixed-citation>
          https://gouvernement.lu/en.html. [31]
          <string-name>
            <given-names>Poland</given-names>
            <surname>Government Official Website</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref55">
        <mixed-citation>
          https://www.gov.pl/. [32]
          <string-name>
            <given-names>Italy</given-names>
            <surname>Government</surname>
          </string-name>
          Official Website
        </mixed-citation>
      </ref>
      <ref id="ref56">
        <mixed-citation>
          https://www.governo.it/en. [33]
          <string-name>
            <given-names>Greece</given-names>
            <surname>Government</surname>
          </string-name>
          Official Website
        </mixed-citation>
      </ref>
      <ref id="ref57">
        <mixed-citation>
          https://www.gov.gr/en/sdg/. [34]
          <string-name>
            <given-names>Ukraine</given-names>
            <surname>Government</surname>
          </string-name>
          Official Website
        </mixed-citation>
      </ref>
      <ref id="ref58">
        <mixed-citation>
          https://www.rada.gov.ua/. [35]
          <string-name>
            <given-names>Albania</given-names>
            <surname>Government</surname>
          </string-name>
          Official Website
        </mixed-citation>
      </ref>
      <ref id="ref59">
        <mixed-citation>
          https://www.kryeministria.al/en/. [36]
          <string-name>
            <given-names>Montenegro</given-names>
            <surname>Government Official Website</surname>
          </string-name>
          ,
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>