<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshop on Cloud Technologies in Education, December</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Integrating digital competencies of researchers into Ph.D. curricula: a case study on open science education</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Olena Kuzminska</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mary Mazorchuk</string-name>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nataliia Morze</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Maria Prokopchuk</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hanna Danylchuk</string-name>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Academy of Cognitive and Natural Sciences</institution>
          ,
          <addr-line>54 Universytetskyi Ave., Kryvyi Rih, 50086</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Borys Grinchenko Kyiv Metropolitan University</institution>
          ,
          <addr-line>18/2 Bulvarno-Kudriavska Str., Kyiv, 04053</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Kryvyi Rih State Pedagogical University</institution>
          ,
          <addr-line>54 Universytetskyi Ave., Kryvyi Rih, 50086</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>National University of Life and Environmental Sciences of Ukraine</institution>
          ,
          <addr-line>15 Heroyiv Oborony Str., Kyiv, 03041</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>The Bohdan Khmelnytsky National University of Cherkasy</institution>
          ,
          <addr-line>81 Shevchenko Blvd., Cherkasy, 18031</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>Ukrainian Center for Education Quality Assessment</institution>
          ,
          <addr-line>5 Volodymyra Vynnychenka Str., Kyiv, 04053</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <volume>22</volume>
      <issue>2023</issue>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>The openness of science is gaining momentum in the digital era, prompting new visions, research methods, and innovations at universities. While the study of open science postulates and practices can expand the capabilities of future scholars, digital ones included, to provide a tentative action plan for research digitalization, foster cooperation, and transparency, improve research reproducibility, as well as enhance its visibility and significance, this issue, however, often remains overlooked when training specialists in higher education institutions. In an efort to combine the research practice of open science and the practice of training Ph.D. students in higher education institutions of Ukraine, we developed the elective training module “Digital technologies in modern scientific research: learning Open Science” in compliance with DACUM methodology. In our study, in terms of labor market requirements, we are guided by the need to train researchers capable of efective realization in the context of digital open science and explore the descriptors of researchers' digital competence (Jisc Researcher) as an expected outcome of postgraduate studies at universities. Results of experimental inspection of the developed module application in the process of master students learning at Borys Grinchenko Kyiv Metropolitan University have confirmed the relevance of its development and application while allowing to pinpoint certain problems. Accordingly, the prospects of further studies include bolstering the practical component of training and strengthening horizontal connections between universities and project teams in order for the Ph.D. students to gain the experience of scientific research digitalization and create the environment for Ph.D. students to form digital competencies in regards to digital proficiency, productivity, identity, and wellbeing.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;open science</kwd>
        <kwd>digital capabilities</kwd>
        <kwd>digital competence of future researchers</kwd>
        <kwd>Ph</kwd>
        <kwd>D</kwd>
        <kwd>student training</kwd>
        <kwd>higher education</kwd>
        <kwd>empirical research</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Recognition of open science [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] as one of the freedoms of the open world in European Research Area
(ERA) and European Higher Education Area (EHEA) incentivizes European Universities to cooperate
[
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and highlights the necessity of digital transformation of higher education institutions’ scientific
activity [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Herewith, one should regard the digital transformation of scientific activities as one of the
interrelated dimensions (research, teaching, business process, human resource, curricula, infrastructure,
administration, marketing, information) of digital transformation in higher education institutions [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>
        Theoretical principles and practices of open digital science application in higher education institutions
have been extensively studied. Generalized results regarding the application of open science in 272
institutions of higher education from 36 European countries are cited in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Local studies are also
worth exploring.
      </p>
      <p>
        Analysis of policy and application models of European Open Science Cloud (EOSC) as European
Cloud University Platform are presented in integration research [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], particularly, the development of
the digital innovation ecosystem of the university is identified as one of the core integration problems
identified. The impact of digital technologies and open science principles in universities (i.e., open
data sharing, open access publication, open repositories, open physical laboratories, common design
and interdisciplinary research platforms) for sustainable development is explored in [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Design and
reflection of Learning Open Science in education institutions in Germany are presented in [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. A
management aspect of this phenomenon also plays a major part. For example, finnish researchers
present in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] a generalized model of managing open science and innovation in universities in the
digital world. While for Ukraine, this issue is pivotal in the context of post-war recovery [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        As open science in the document by European Commission “Open innovation, open science, open
to the world – a vision for Europe” [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] is regarded as a new approach to the scientific process based
on cooperative work and new ways of difusing knowledge by using digital technologies and new
collaborative tools, the need to train competitive specialists in universities is emphasized considering
that scientific research and its digitalization are coming to prominence [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Furthermore, in addition
to building (or upgrading) digital institutional education environments [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], we should invest in the
development of digital capabilities and competences, namely of young researchers (focus of the present
study) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. With view of the above it is imperative to consider and cultivate digital capabilities both on
individual and institutional level [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. The latter is pursuant to Digital Education Action Plan (2021-2027)
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>In this context, it is crucial to emphasize the role of two stakeholders: future researchers with high
degree of preparedness to efective realization in the context of digital open science and university,
compliant with requirements of European Research Area (ERA) and European Higher Education Area
(EHEA).</p>
      <p>
        Among other aspects, this involves a change in the learning model. The new model should focus
on the cultivating digital capabilities of future researchers and the inclusion of digital competence in
curricula [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>Therefore, the objective of this study is to determine requirements to Ph.D. students’ results and
curricula in higher education (HE) in the context of the open science development and to field-test their
efectiveness by the degree of formation of digital competence of researchers.</p>
      <p>Research questions:
1. Is it feasible to determine the digital capabilities of researchers in institutions of higher education?
2. How are the digital capabilities of researchers integrated in the training programs for Ph.D.</p>
      <p>students in higher education institutions?
3. How does the learning model, focused on the development of digital capabilities of future
researchers, impact the development of digital competence of Ph.D. students?</p>
    </sec>
    <sec id="sec-2">
      <title>2. Theoretical background</title>
      <sec id="sec-2-1">
        <title>2.1. Defining the digital competencies of future researchers</title>
        <p>
          In this study, we relied on a phenomenological approach that reflects the requirements for digital
competence of future researchers. For this purpose, an analysis of existing models of digital (information
and communication) competences was carried out, in particular, the following documents and cases of
their application in the process of training specialists were analyzed:
• The European Computer Driving License (ECDL, https://icdleurope.org/); ECDL certificate is
recognized by all the European Union countries [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ];
• The European e-Competence Framework (e-CF, https://ecfexplorer.itprofessionalism.org/)
represents a structure that can be used both by companies that produce ICT services and products,
and by institutions that use ICT in their core activities [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ];
• Digital Competence Framework (DigComp, https://joint-research-centre.ec.europa.eu/digcomp_en)
is an efective tool for implementing the Digital Education Action Plan in diferent countries
(2021-2027) [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]; in this study we explore Digital Competence Framework for Citizens, namely,
the updated version The Digital Competence Framework for Citizens: DigComp 2.2 [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ];
• Digital profile of a researcher in higher education [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ], as the structure element of digital
capabilities Jisc (https://digitalcapability.jisc.ac.uk/what-is-digital-capability/), that focuses on digital
capabilities relevant for both young and experienced scholars of higher education.
        </p>
        <p>
          At the same time, it should be noted that today an increasing number of researchers and practicing
educators are turning to the application of the DigComp framework for the formation of educational
policies, planning of training and assessment of the formation of digital skills [
          <xref ref-type="bibr" rid="ref22 ref23">22, 23</xref>
          ]. There are also
recommendations for the correlation of the mentioned frames: ECDL and DigComp [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] as well as e-CF
and DigComp [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. This helps, for example, to determine the continuity and enhancing efect of ECDL
and DigComp when planning the curriculum or the correlation of general requirements for the digital
competence of citizens (DigComp) and IT professionals (e-CF). The latter permits to demonstrate the
continuity of certain skills when moving from the competencies expected of citizens to the competencies
that IT professionals should possess. Since none of the 30 profiles of IT specialists identified by e-CF as
of 2018, which are used for drawing up educational programs [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], corresponds to the target audience
(Researchers) identified in this study, it is not worthwhile to use the profiles of these specialists.
        </p>
        <p>
          Therefore, taking DigComp 2.2 [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ] as a basis, we continued our research on the description of the
profiles of subjects acquiring these competencies: by analogy with e-CF, [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], we compared the groups
of competencies of the DigComp 2.2 framework and the Jisc researcher profile (figure 1).
        </p>
        <p>This mapping showed that at the highest level of generalization, Jisc Researcher follows DigComp
2.2, as each of the 5 groups of competencies of DigComp 2.2 can be cross-referenced to the six groups
of Jisc Researcher. Full or partial similarity of the defined competencies (marked with the same color) is
shown in figure 2.</p>
        <p>At the same time, it should be noted that the requirements for the digital competence of researchers
have a specialized focus and a wider scope (15 detailed descriptors – a total of 64, against 21 in DigComp
2.2). That is why correlation shown in figure 2 is a certain generalization, since the decomposition of
the Jisc Researcher descriptors and conducting additional analysis constitute the basis for determining
the specific requirements for researchers that follow the basic ones. For example, Information literacy
of the researcher (J2.1) is an extension of the equivalent category DigComp 2.2 (D1.3), in particular, in
terms of the development of a personal digital environment adapted to scientific interests and needs
(J2.1.5).</p>
        <p>As Jisc Researcher focuses on the digitization of research, specific descriptors are also highlighted, in
particular:
J1.2. Digital productivity, containing requirements related to the quality and productivity of scientific
research;
J2.2. Data literacy as a proven ability to manage research data;
J3.2. Digital research, in particular in the part of solving problems (full name of the descriptor – Digital
research&amp; problem-solving), which correlates with the corresponding descriptor DigComp 2.2,
since the ability to solve problems belongs to key competencies;
J5.2. Digital teaching is understood primarily as digital mentoring, which is clarified through the
decomposition of descriptors.</p>
        <p>However, the researcher’s digital profile does not specify requirements for solving problems
related to setup, safe use, and technical support for research, programming, and community outreach.
These competencies should be formed at the basic level in every citizen pursuant to the DigComp 2.2
framework.</p>
        <p>Therefore, the presented analysis is a reason to adopt the Jisc Researcher profile as a basis for
determining the requirements for digital competence (following the DigComp 2.2 framework) of future
researchers.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. A curriculum development using DACUM</title>
        <p>
          Since the integration of digital and professional competences into educational curricula is most
extensively studied in the training programs of future IT specialists, in this study we will try to scale
the developed methods, in particular [
          <xref ref-type="bibr" rid="ref17 ref19">17, 19</xref>
          ], to the design of programs for the training of future
researchers at universities.
        </p>
        <p>
          In this context, attention should be drawn to the use of a systematic approach as DACUM
(Development of the curriculum) to integrate the pragmatic perception of industry practitioners and strict
prescriptions of instructors in academic curriculum [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. In our research, in terms of labor market
requirements, we focus on the training needs of researchers capable of efective implementation in
the conditions of digital open science, and we consider the descriptors of the digital competence of
researchers (Jisc Researcher) as the expected results of postgraduate studies at universities. It should
also be noted that the definition of learning objectives and expected results, for example, using e-CF
profiles [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], for the design of educational programs, individual courses or modules requires further
modifications and (or) the introduction of sub-competencies. In this process, it is advisable to use
the recommendations of DACUM both regarding the selection of experts and the algorithm of their
activities [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ].
        </p>
        <p>Therefore, in order to achieve the goals of our research, namely, to determine the requirements for
the results and training programs of Ph.D. students in higher education (HE) in the context of the
development of open science, as well as to confirm the efectiveness of their application in accordance
with the level of formation of the digital competence of researchers, we formulated the following tasks:
1. Determine the feasibility of using the Jisc Researcher profile as a basis for determining the
requirements (in terms of competencies) for the learning outcomes of Ph.D. students in higher
education (HE) as future digital researchers (corresponds to the Job/task analysis stage of the
DACUM process implementation);
2. Analyze the educational programs of the university (on the example of Borys Grinchenko Kyiv
Metropolitan University) regarding the formation of digital competencies of researchers and
to develop a training module to ensure their formation (corresponds to the Education /training
program development stage of the DACUM process implementation);
3. To determine the efectiveness of the application of the author’s educational module through the
Assessment of digital researcher level of Ph.D. students of the 2nd year of study based on the Jisc
Researcher profile and compare the results of the experimental (undergoing training according to
the author’s module) and control groups (corresponds to the Validation stage of the DACUM process
implementation).</p>
        <p>
          It should be noted that the results of the stages of the DACUM process [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ] are presented in sections:
2.1 – preparation for job analysis, 4.1 – task analysis, 4.2 – education/training program development,
4.3 – validation/verification of the efectiveness of the developed program.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Research design</title>
      <p>The undertaken study can be classified as empirical, therefore it is based on the methods of empirical
research, namely: observation, survey (conversation, interview, questionnaire), expert assessment,
content analysis, study and generalization of pedagogical experience.</p>
      <p>
        As a basis, we employed the DACUM methodology, which is used to determine the competencies that
should be integrated in the training program of specialists of a specific profession [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. The efectiveness
of this technique is based on three premises: (I) Experienced workers can describe their work better than
anyone else; (II) Any job can be efectively described in terms of the competencies or tasks performed
by successful workers in that profession; (III) It is appropriate to describe the specific knowledge, skills,
attitudes, and tools that employees need to perform their tasks properly. Accordingly, it is necessary to
select two main groups of experts:
• 5-9 specialists, in our case, they are experts in digital open science and communication, from
the number of scientific and pedagogical workers of higher education institutions and research
institutions (I group, engaged for the implementation of the I and II tasks of the research);
• PhD students of a higher education institution (II group) who are involved in determining the
efectiveness (implementation of the III research task) of educational solutions proposed by
experts.
      </p>
      <p>
        Therefore, in order to determine the most significant criterion indicators for evaluating the digital
competence of a Ph.D. Student based on the Jisc Researcher (I research task), 9 international experts
were involved, in particular, among the participants of the European project called IRNet, whose
cooperation is ongoing [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. The selection of experts was carried out in accordance with the task of the
research and the object of evaluation. The main criterion for the selection of experts was professional
competence in the field of expert assessment, which was determined by their ability to adequately
assess the digital competences of researchers in accordance with the field of professional activity, as
well as the educational curricula created for their formation.
      </p>
      <p>The experts were sent questionnaires to evaluate each of the 15 defined Jisc Researcher criterion
indicators (figure 2) on a four-point significance scale (1 – not significant, 2 – slightly significant, 3 –
significant, 4 – highly significant). The indicator was considered important if the value of the average
rank was more than 2. The consistency of the opinions of the group of experts was checked according
to the Kendall rank correlation coeficient.</p>
      <p>
        To fulfill the second task of the research, content analysis was used to compare curricula for the
inclusion of digital competencies of researchers in the training plans of Ph.D. students of Ukrainian
higher education institutions, DACUM method – for Curriculum Design [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], and expert evaluation
method – for evaluating the content and expected results (in terms of competencies) of the author’s
module “Digital technologies in modern scientific research: learning Open Science”. Expert evaluation
will be carried out by the same 9 experts who volunteered to work on the 1st task of the research.
      </p>
      <p>
        To implement the third task of the research, we conducted a statistical survey. The Google form,
developed in the process of implementing the previous study [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], was reused (https://docs.google.
com/forms/d/e/1FAIpQLSdrO8MYhVJNvh72cqjZhyH9VQMl1kPBiFiHkORM7_o70JkfiQ/viewform) to
determine the diference in the level of formation of digital competence of researchers according to the
level of intervention at the level of training programs in accordance with the Jisc recommendations
[
        <xref ref-type="bibr" rid="ref21">21</xref>
        ].
      </p>
      <p>
        89 Ph.D. students of the second year of study at the Borys Grinchenko Kyiv Metropolitan University
took part in the survey, 46 of them studied the author’s module (II group, experimental), 43 did not (I
group, control). The homogeneity of the groups prior to specialized training (conducted according to
the methodology and materials presented in [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]) is confirmed by the criteria of the Chi-Square Test
of Independence and Mann-Whitney U Test regarding the similarity of distributions by gender, areas
of study and age [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. The processing and analysis of the results of the study involved the use of the
Likert scale. Non-parametric methods of data analysis using SPSS statistical data processing tools were
used for data processing [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ].
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Results of research</title>
      <sec id="sec-4-1">
        <title>4.1. Expert evaluation of criterion indicators for evaluating the digital competence of Ph.D. students based on Jisc Researcher</title>
        <p>As a result of the expert evaluation of the criterion indicators for evaluating the digital competence of
Ph.D. Students based on Jisc Researcher, the importance of the selected criteria (indicators) turned out
to be varied. But all the determined criterion indicators (table 1) turned out to be significant, which
indicates the correctness of the application of the Jisc Researcher model for determining the level of
digital competence of Ph.D. students.
Sum
Mean rank</p>
        <p>We used Kendall’s Coeficient of Concordance for estimating the degree of agreement among experts
when rating items (figure 3). These results were obtained using SPSS. A value of 0.522 indicates moderate
agreement among the 9 experts in ranking the importance of competence in the given scale and level of
agreement observed among the experts is statistically significant (p-value&lt;0.05). The Chi-Square value
of 65.834 with 14 degrees of freedom indicates that there is a significant association among the ranked
items, suggesting that the experts’ rankings are not likely to be random.</p>
      </sec>
      <sec id="sec-4-2">
        <title>4.2. Integration of digital capabilities of researchers into training programs for Ph.D.</title>
        <p>students in institutions of higher education as examplified by Borys Grinchenko</p>
      </sec>
      <sec id="sec-4-3">
        <title>Kyiv Metropolitan University</title>
        <p>
          Taking the experience of Integrating Digital Competence in Higher Education Curricula as a basis
[
          <xref ref-type="bibr" rid="ref17">17</xref>
          ], we carried out a comparative analysis of educational programs for Ph.D. students in Ukrainian
institutions of higher education in general and at Borys Grinchenko Kyiv Metropolitan University in
particular.
        </p>
        <p>As a result, it should be noted that the digital capabilities of future doctors of philosophy are
purposefully formed by teaching the mandatory subject “Scientific Research Strategies”. In accordance
with the II task of the research, the module “Digital technologies in modern scientific research: learning
Open Science” (2 credits, 60 hours) was additionally developed, it is mainly aimed at the formation of
the ability to use digital technologies in modern scientific research, starting from their formulation and
the construction of appropriate information models and ending with the interpretation of the results
obtained with the help of a computer. The main content of the module, examples of digital tools studied
by Ph.D. students, and a list of Jisc Researcher competencies that are formed when studying each topic
are shown in table 2.</p>
        <p>The importance of the Jisc Researcher indicators from the point of view of inclusion in the curriculum
of the author’s module was confirmed by the results of the expert evaluation, similar to section 4.1.
Kendall’s Coeficient of Concordance is equal to 0.714, which indicates strong agreement among the
9 experts in ranking the importance of inclusion in the curriculum in the given scale. The level of
agreement observed among the experts is statistically significant (p-value&lt;0.05).</p>
        <p>
          At the same time, it should be noted that, according to experts (corresponds to [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]), the formation
of digital individual components of a researcher’s digital competence, primarily in terms of scientific
proficiency and productivity (indicators of group J1) and identity and well-being (indicators of group
J6), also requires the involvement of Ph.D. students in real scientific research and projects. Therefore,
these and some others, for example J3.2, J3.3 and J4.3, competences within the optional module can be
formed only at the basic level.
        </p>
      </sec>
      <sec id="sec-4-4">
        <title>4.3. Experimental verification of the efectiveness of the proposed decision</title>
        <p>Comparing the results of the survey of the participants of the experimental group (46 students who
studied the author’s module) and the control group (43 students who did not study the author’s module),
it should be noted that the students of the experimental group showed better results overall (figure 4).
We used the Independent-Sample Median Test to compare the medians of two independent groups
(Group 1 – control group and Group 2– experimental group), because this test allows us to compare two
independents group with non-normal distributions of rates. The test statistics value = 20.9 indicates
that we have a substantial diference in the medians of the two groups and this diference in medians is
statistically significant (p-value&lt;0.05) (figure 4). So, we reject the null hypothesis. The likelihood of
observing such a significant diference due to random chance alone is extremely low.</p>
        <p>
          If we take into account the lack of formation of certain groups of indicators of digital competence of
future researchers, defined in [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], in order to confirm the influence of the author’s methodology (design
and application in the process of training Ph.D. students of the selective module “Digital technologies
in modern scientific research: learning Open Science”) on the formation of a certain competence in the
experimental group, an additional comparison of competencies was carried out, according to research
related to digitization, in particular, in terms of finding ICT solutions to problems that arise in the
course of research and scholarly activity (J1.2.2); understanding how digital technologies are changing
the field of research with respect to questions and challenges, methods, theories and values (J3.2.6),
developing and projecting a positive digital identity or identities as a researcher (J6.1.1) and academic
integrity J2.2.3 (apply to the relevant ethical bodies for permission to collate and use research data). For
this comparison, we used Independent-Samples Mann-Whitney U test, which allows for comparison
of diferences between two independent groups when the dependent variable is either ordinal or
continuous but not normally distributed, what we had in our cases. Therefore, the self-assessment of the
Ph.D. students experimental and control groups for component J1.2.2 Jisc Researcher shows us that we
have a significant diference between rates (p-values&lt;0.05) for Mann-Whitney test statistic =1597.0. The
experimental group have a higher mean rank of rates (58.22) than the control group (30.86) (figure 5).
        </p>
        <p>We have similar results with diferences between experimental and control group for J3.2.6 Jisc
Researcher component. This test also found a significant diference (p-value = 0.000) for Mann-Whitney
test statistic =1560.0 The experimental group have a higher mean rank of rates (57.41) than the control
group (31.72) (figure 6).</p>
        <p>For J2.2.3 Jisc Researcher component experimental group of Ph.D. students shows us higher results
too, and this result is statistical significant (p-value = 0.000) for Mann-Whitney test statistic =1570.0
(figure 7). Mean rank for experimental group = 57.63, for control group – 31.49.</p>
        <p>The diference between group in direction of self-assessment of the J6.1.1 Jisc Researcher component
formation is significant too. We found Mann-Whitney test statistic =1536.0 (p-value = 0.000) (figure 8).
Mean rank for experimental group = 56.90, for control group – 33.27.</p>
        <p>
          The comparisons drawn (figures 5-8) speak in favor of the application of the developed methodology
for the competence enhancement of educational programs or, as in this case, the development of the
selective module “Digital technologies in modern scientific research: learning Open Science”. At the
same time, based on the results of additional in-depth interviews with the students of the experimental
group, the need was detected (corresponds to the results of the expert evaluation (section 4.2 of the
study) and similar training practices for using Open Science [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]) to develop modules for expanding skills
in digitalization of conducting scientific research This can be implemented by enhancing (competence
and technology-wise) courses available in the training program for Ph.D. students or introducing into
the educational program a scientific research practicum similar to the programs of European universities,
within the framework of which Ph.D. students join real projects implemented in universities.
        </p>
        <p>
          However, taking into account the suficient level of digital skills and capabilities of students of this
higher education institution, which is confirmed by previous studies [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ], the prospects for further
research include the development of horizontal scientific connections, the organization of projects and
research, including international ones. This will help the true inclusion of future researchers in the
European Research Area for the efective realization of Open Science principles.
        </p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>Recognition of open science postulates promotes new visions, principles and methods of conducting
research and implementing innovations at universities, consequently bringing the need of the
highquality training of future researchers to the foreground.</p>
      <p>Analysis of research results and practical cases is basis for determining some key benefits of studying
open science for Ph.D. students:
• access to knowledge: open science promotes the unrestricted sharing of research findings, datasets,
and methodologies;
• collaboration and networking opportunities: open science encourages collaboration among
researchers from diferent institutions and disciplines;
• enhanced reproducibility and transparency: Ph.D. students can ensure the reproducibility of their
own research and contribute to the credibility of the scientific community as a whole; transparent
research practices also allow for better peer review, and validation of findings, which strengthens
the overall scientific rigor;
• increased visibility and impact: publishing research openly can significantly enhance its read,
and cited by other researchers, attract potential collaborators and funding opportunities, and
ultimately increase the impact of their research</p>
      <p>Among the ways to ensure realization of the specified benefits is the learning model orientation
towards cultivation of digital capabilities of future researchers and inclusion of digital competence in
the curriculum.</p>
      <p>Following the analysis of the source database with the subsequent expert evaluation via engaging
international experts, we:
• substantiated the expediency of applying descriptors Jisc Researcher to determine the
requirements to digital competence of the future researchers;
• determined the need (the practice of implementing open science is impossible without the
formation of digital skills) for inclusion of digital competencies of researchers in the curricula
for Ph.D. students and developed the training module “Digital technologies in modern scientific
research: learning Open Science”;
• completed experimental examination of efectiveness of this module application (as elective)
when training PhD students at Borys Grinchenko Kyiv Metropolitan University.</p>
      <p>Results of self-assessment of the level of formation of the digital competence of researchers among
Ph.D. students who studied under the module “Digital technologies in modern scientific research:
learning Open Science” confirm the efectiveness of the education solution proposed by the authors
while isolating certain issues regarding modelling or reproducing of open science practices in the
training process of Ph.D. students. The latter paves way for determining the areas for further studies,
which include:
• expanding horizontal connections between universities and project teams for the Ph.D. students
to gain the experience of scientific research digitalization and creating the environment for them
to form digital competencies regarding digital proficiency, productivity, identity and wellbeing;
• management of changes on the level of monitoring and updating curricula as well as development
of digital ecosystem of a university, while also ensuring that the Ph.D. students are trained to be
digital scholars;
• exploration of innovations, in particular those linked to the development of artificial intelligence
in combination with adhering to the principles of academic integrity and ethics of conducting
scientific research.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>UNESCO</surname>
          </string-name>
          , Recommendation on Open Science,
          <year>2021</year>
          . URL: https://unesdoc.unesco.org/ark:/48223/ pf0000379949.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M.</given-names>
            <surname>Whittle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Rampton</surname>
          </string-name>
          ,
          <article-title>Towards a 2030 vision on the future of universities in Europe - Publications Ofice, Directorate-General for Research and Innovation</article-title>
          , European Commission, Brussels,
          <year>2020</year>
          . doi:
          <volume>10</volume>
          .2777/510530.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3] Europian University Association, Universities without walls.
          <source>A vision for</source>
          <year>2030</year>
          ,
          <year>2021</year>
          . URL: https://eua.eu/downloads/publications/universities%20without
          <source>%20walls%20%20a%20vision% 20for%202030.pdf.</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L. M. C.</given-names>
            <surname>Benavides</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Tamayo Arias</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. D. Arango Serna</surname>
            ,
            <given-names>J. W. Branch</given-names>
          </string-name>
          <string-name>
            <surname>Bedoya</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Burgos</surname>
          </string-name>
          ,
          <article-title>Digital transformation in higher education institutions: A systematic literature review</article-title>
          ,
          <source>Sensors</source>
          <volume>20</volume>
          (
          <year>2020</year>
          )
          <article-title>3291</article-title>
          . doi:
          <volume>10</volume>
          .3390/s20113291.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>R.</given-names>
            <surname>Morais</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Saenen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Garbuglia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Berghmans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Gaillard</surname>
          </string-name>
          ,
          <article-title>From principles to practices: Open Science at Europe's universities. 2020-2021 EUA Open Science Survey results</article-title>
          ,
          <year>2021</year>
          . URL: https: //eua.eu/downloads/publications/2021
          <source>%20os%20survey%20report.pdf.</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J. R. L.</given-names>
            <surname>Kaivo-oja</surname>
          </string-name>
          , J.
          <string-name>
            <surname>Stenvall</surname>
            ,
            <given-names>A Critical</given-names>
          </string-name>
          <string-name>
            <surname>Reassessment</surname>
          </string-name>
          <article-title>: The European Cloud University Platform and New Challenges of the Quartet Helix Collaboration in the European University System, European Integration Studies (</article-title>
          <year>2022</year>
          )
          <fpage>9</fpage>
          -
          <lpage>23</lpage>
          . doi:
          <volume>10</volume>
          .5755/j01.eis.
          <volume>1</volume>
          .16.31353.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vicente-Saez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gustafsson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Martinez-Fuentes</surname>
          </string-name>
          ,
          <article-title>Opening up science for a sustainable world: An expansive normative structure of open science in the digital era</article-title>
          ,
          <source>Science and Public Policy</source>
          <volume>48</volume>
          (
          <year>2021</year>
          )
          <fpage>799</fpage>
          -
          <lpage>813</lpage>
          . doi:
          <volume>10</volume>
          .1093/scipol/scab049.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>I. Steinhardt</surname>
          </string-name>
          ,
          <article-title>Learning Open Science by doing Open Science. A reflection of a qualitative research project-based seminar</article-title>
          ,
          <source>Education for Information</source>
          <volume>36</volume>
          (
          <year>2020</year>
          )
          <fpage>263</fpage>
          -
          <lpage>279</lpage>
          . doi:
          <volume>10</volume>
          .3233/EFI-190308.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vicente-Saez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gustafsson</surname>
          </string-name>
          ,
          <string-name>
            <surname>L. Van den Brande</surname>
          </string-name>
          ,
          <article-title>The dawn of an open exploration era: Emergent principles and practices of open science and innovation of university research teams in a digital world</article-title>
          ,
          <source>Technological Forecasting and Social Change</source>
          <volume>156</volume>
          (
          <year>2020</year>
          )
          <article-title>120037</article-title>
          . doi:
          <volume>10</volume>
          .1016/j. techfore.
          <year>2020</year>
          .
          <volume>120037</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>I.</given-names>
            <surname>Drach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Borodiyenko</surname>
          </string-name>
          ,
          <string-name>
            <surname>O. Petroye,</surname>
          </string-name>
          <article-title>Innovations in university management as a prerequisite for the development of competitiveness of the ukrainian economy during the post-war period</article-title>
          ,
          <source>Financial and Credit Activity Problems of Theory and Practice</source>
          <volume>3</volume>
          (
          <year>2022</year>
          )
          <fpage>200</fpage>
          -
          <lpage>207</lpage>
          . doi:
          <volume>10</volume>
          .55643/ fcaptp.3.44.
          <year>2022</year>
          .
          <volume>3773</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          and
          <article-title>Directorate-General for Research and Innovation, Europe's future - Open innovation, open science, open to the world - Reflections of the Research, Innovation and Science Policy Experts (RISE) High Level Group</article-title>
          , Publications Ofice,
          <year>2017</year>
          . doi:
          <volume>10</volume>
          .2777/348700.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <source>[12] Digital science in Horizon</source>
          <year>2020</year>
          ,
          <year>2024</year>
          . URL: https://ec.europa.eu/digital-single-market/en/news/ digital-science-horizon-
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>O.</given-names>
            <surname>Kuzminska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mazorchuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Morze</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Kobylin</surname>
          </string-name>
          ,
          <article-title>Digital Learning Environment of Ukrainian Universities: The Main Components to Influence the Competence of Students and Teachers</article-title>
          , in: V.
          <string-name>
            <surname>Ermolayev</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          <string-name>
            <surname>Mallet</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Yakovyna</surname>
            ,
            <given-names>H. C.</given-names>
          </string-name>
          <string-name>
            <surname>Mayr</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . Spivakovsky (Eds.), Information and Communication Technologies in Education, Research, and Industrial Applications, Springer International Publishing, Cham,
          <year>2020</year>
          , pp.
          <fpage>210</fpage>
          -
          <lpage>230</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -39459-2_
          <fpage>10</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>O.</given-names>
            <surname>Kuzminska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Morze</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Varchenko-Trotsenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Boiko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Prokopchuk</surname>
          </string-name>
          , Digital Competence of Future Researchers: Empirical Research of PhD Students of Ukrainian University, in: Digital Humanities Workshop, DHW 2021,
          <article-title>Association for Computing Machinery</article-title>
          , New York, NY, USA,
          <year>2022</year>
          , p.
          <fpage>177</fpage>
          -
          <lpage>184</lpage>
          . doi:
          <volume>10</volume>
          .1145/3526242.3526258.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>O.</given-names>
            <surname>Kuzminska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mazorchuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Morze</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Smyrnova-Trybulska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Stec</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Gutiérrez-Esteban</surname>
          </string-name>
          ,
          <article-title>Graduate students' attitudes to the development of digital opportunities at the level of individuals and educational organisations</article-title>
          , in: E.
          <string-name>
            <surname>Smyrnova-Trybulska</surname>
          </string-name>
          (Ed.),
          <article-title>E-learning in the Transformation of Education in Digital Society</article-title>
          , volume
          <volume>14</volume>
          of E-learning,
          <source>Katowice-Cieszyn</source>
          ,
          <year>2022</year>
          , p.
          <fpage>191</fpage>
          -
          <lpage>204</lpage>
          . URL: https://us.edu.pl/wydzial/wsne/wp-content/uploads/sites/20/Bez-kategorii/el-2022
          <source>-14-14</source>
          . pdf. doi:
          <volume>10</volume>
          .34916/el.
          <year>2022</year>
          .
          <volume>14</volume>
          .14.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>Digital</given-names>
            <surname>Education Action Plan</surname>
          </string-name>
          (
          <year>2021</year>
          -2027),
          <year>2024</year>
          . URL: https://education.ec.europa.eu/focus-topics/ digital-education/action-plan.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Sánchez-Caballé</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. Gisbert</given-names>
            <surname>Cervera</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. M.</given-names>
            <surname>Esteve-Mon</surname>
          </string-name>
          ,
          <article-title>Integrating Digital Competence in HigherEducation Curricula: An Institutional Analysis</article-title>
          ,
          <source>Educar</source>
          <volume>57</volume>
          (
          <year>2021</year>
          )
          <fpage>241</fpage>
          -
          <lpage>258</lpage>
          . doi:
          <volume>10</volume>
          .5565/ rev/educar.1174.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Ł. Tomczyk</surname>
          </string-name>
          ,
          <article-title>Declared and Real Level of Digital Skills of Future Teaching Staf</article-title>
          ,
          <source>Education Sciences</source>
          <volume>11</volume>
          (
          <year>2021</year>
          )
          <article-title>619</article-title>
          . doi:
          <volume>10</volume>
          .3390/educsci11100619.
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>M.</given-names>
            <surname>Spruit</surname>
          </string-name>
          ,
          <article-title>Information security education based on job profiles and the e-CF, Higher Education, Skills and Work-Based Learning 12 (</article-title>
          <year>2022</year>
          )
          <fpage>294</fpage>
          -
          <lpage>308</lpage>
          . doi:
          <volume>10</volume>
          .1108/HESWBL-09-2020-0208.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vuorikari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Kluzer</surname>
          </string-name>
          , Y. Punie, DigComp
          <volume>2</volume>
          .
          <article-title>2: The Digital Competence Framework for CitizensWith new examples of knowledge, skills and attitudes</article-title>
          ,
          <source>Technical Report EUR 31006 EN</source>
          , Joint Research Centre (Seville site),
          <source>Luxembourg</source>
          ,
          <year>2022</year>
          . doi:
          <volume>10</volume>
          .2760/490274.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <article-title>Researcher profile: Six elements of digital capabilities</article-title>
          ,
          <year>2019</year>
          . URL: https://repository.jisc.ac.uk/ 7386/1/BDCP-Researcher-Profile-
          <volume>300419</volume>
          .pdf.
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>O.</given-names>
            <surname>Kuzminska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mazorchuk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Morze</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Pavlenko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Prokhorov</surname>
          </string-name>
          ,
          <article-title>Study of Digital Competence of the Students and Teachers in Ukraine</article-title>
          , in: V.
          <string-name>
            <surname>Ermolayev</surname>
            ,
            <given-names>M. C.</given-names>
          </string-name>
          <string-name>
            <surname>Suárez-Figueroa</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Yakovyna</surname>
            ,
            <given-names>H. C.</given-names>
          </string-name>
          <string-name>
            <surname>Mayr</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Nikitchenko</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          . Spivakovsky (Eds.), Information and Communication Technologies in Education, Research, and Industrial Applications, Springer International Publishing, Cham,
          <year>2019</year>
          , pp.
          <fpage>148</fpage>
          -
          <lpage>169</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>030</fpage>
          -13929-
          <issue>2</issue>
          _
          <fpage>8</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>A. L. E.</given-names>
            <surname>Sánchez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. M. E.</given-names>
            <surname>Escaño</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. O.</given-names>
            <surname>Carmona</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. R.</given-names>
            <surname>Andrés</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. B.</given-names>
            <surname>Mora</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. B.</given-names>
            <surname>Olave</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Digital</given-names>
            <surname>Competences</surname>
          </string-name>
          .
          <article-title>The challenge of their acquisition and verification in the University Degree</article-title>
          , in: 2022 Congreso de Tecnología, Aprendizaje y Enseñanza de
          <article-title>la Electrónica (XV Technologies Applied to Electronics Teaching Conference)</article-title>
          , IEEE,
          <year>2022</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . doi:
          <volume>10</volume>
          .1109/TAEE54169.
          <year>2022</year>
          .
          <volume>9840546</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>R. B.</given-names>
            <surname>Baker</surname>
          </string-name>
          ,
          <source>The Student Experience: How Competency-Based Education Providers Serve Students</source>
          ,
          <source>Technical Report</source>
          , American Enterprise Institute,
          <year>2015</year>
          . URL: https://www.aei.org/research-products/
          <article-title>report/ the-student-experience-how-competency-based-education-providers-serve-students/.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vuorikari</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Punie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. Carretero</given-names>
            <surname>Gomez</surname>
          </string-name>
          , G. Van Den Brande, DigComp
          <volume>2</volume>
          .
          <article-title>0: The digital competence framework for citizens</article-title>
          .
          <source>Update phase 1: The conceptual reference model</source>
          ,
          <source>Technical Report EUR 27948 EN</source>
          , Joint Research Centre (Seville site),
          <source>Luxembourg</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>L.</given-names>
            <surname>Halawi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. M.</given-names>
            <surname>Kappers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Glassman</surname>
          </string-name>
          ,
          <article-title>From enrollment to employment: A DACUM approach to Information Systems and Information Security and Assurance curriculum design</article-title>
          ,
          <source>Issues in Information Systems</source>
          <volume>17</volume>
          (
          <year>2016</year>
          )
          <fpage>218</fpage>
          -
          <lpage>226</lpage>
          . URL: https://commons.erau.edu/cgi/viewcontent.cgi? article=1346&amp;context=publication.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>K.-Y. Kim</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Surendran</surname>
          </string-name>
          ,
          <article-title>Information Security Management Curriculum Design: A Joint Industry</article-title>
          and Academic Efort,
          <source>Journal of Information Systems Education</source>
          <volume>13</volume>
          (
          <year>2002</year>
          )
          <fpage>227</fpage>
          -
          <lpage>236</lpage>
          . URL: https: //aisel.aisnet.org/jise/vol13/iss3/10/.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>D. J.</given-names>
            <surname>Sheskin</surname>
          </string-name>
          ,
          <article-title>Handbook of parametric and nonparametric statistical procedures, 5 ed</article-title>
          .,
          <source>Chapman</source>
          and Hall/CRC,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>R.</given-names>
            <surname>Levesque</surname>
          </string-name>
          ,
          <article-title>SPSS Programming and Data Management: A Guide for SPSS and</article-title>
          SAS Users, 4 ed., SPSS Inc.,
          <year>2007</year>
          . URL: https://www.uni-muenster.de/imperia/md/content/ziv/service/software/spss/ handbuecher/englisch/spss_programming_and
          <article-title>_data_management_4th_edition</article-title>
          .pdf.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>O. H.</given-names>
            <surname>Kuzminska</surname>
          </string-name>
          ,
          <article-title>Selecting tools to enhance scholarly communication through the life cycle of scientific research</article-title>
          ,
          <source>Educational Technology Quarterly</source>
          <year>2021</year>
          (
          <year>2021</year>
          )
          <fpage>402</fpage>
          -
          <lpage>414</lpage>
          . doi:
          <volume>10</volume>
          .55056/etq. 19.
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>M.</given-names>
            <surname>Marienko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Shyshkina</surname>
          </string-name>
          ,
          <article-title>The Design and Implementation of the Cloud-Based System of Open Science for Teachers' Training</article-title>
          , in: M. E. Auer,
          <string-name>
            <given-names>W.</given-names>
            <surname>Pachatz</surname>
          </string-name>
          , T. Rüütmann (Eds.),
          <source>Learning in the Age of Digital and Green Transition</source>
          , Springer International Publishing, Cham,
          <year>2023</year>
          , pp.
          <fpage>337</fpage>
          -
          <lpage>344</lpage>
          . doi:
          <volume>10</volume>
          .1007/978-3-
          <fpage>031</fpage>
          -26876-2_
          <fpage>31</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>