<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Digital history pedagogy in higher education: a PRISMA-compliant systematic review of empirical evidence (2011-2025)</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Serhii S. Korniienko</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Kryvyi Rih State Pedagogical University</institution>
          ,
          <addr-line>54 Universytetskyi Ave., Kryvyi Rih, 50086</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>200</fpage>
      <lpage>235</lpage>
      <abstract>
        <p>Background: The integration of digital technologies into history education represents a fundamental transformation in pedagogical practice, yet comprehensive evidence synthesis regarding its efectiveness remains absent from the scholarly literature. This systematic review addresses this critical gap by evaluating empirical evidence on digital history teaching efectiveness at the undergraduate level. Methods: Following PRISMA 2020 guidelines, we conducted a systematic search of the Scopus database spanning 2013 to 2025. Inclusion criteria encompassed empirical studies involving undergraduate students (aged 18+) that evaluated digital interventions in history education. Two independent reviewers performed screening and data extraction, with discrepancies resolved through consensus. Results: From 46 initially identified records, six studies met inclusion criteria after rigorous screening. The included studies employed diverse digital interventions ranging from collaborative wiki platforms to augmented reality applications. Analysis revealed consistent positive efects on student engagement (100% of studies), moderate improvements in historical knowledge acquisition (67% of studies), and enhanced development of critical thinking skills through primary source analysis. Notably, studies incorporating TPACK (Technological Pedagogical Content Knowledge) frameworks demonstrated superior outcomes in both cognitive and afective domains. Conclusions: Digital technologies demonstrate substantial potential for enhancing history education, particularly in fostering student engagement and developing analytical capabilities. However, the evidence base remains limited by methodological heterogeneity and absence of long-term follow-up studies. Future research should prioritize randomized controlled designs and standardized outcome measures to establish more robust evidence for digital history pedagogy.</p>
      </abstract>
      <kwd-group>
        <kwd>digital history</kwd>
        <kwd>undergraduate education</kwd>
        <kwd>systematic review</kwd>
        <kwd>PRISMA</kwd>
        <kwd>pedagogical technology</kwd>
        <kwd>historical thinking</kwd>
        <kwd>TPACK framework</kwd>
        <kwd>digital humanities</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <sec id="sec-1-1">
        <title>1.1. Rationale</title>
        <p>The transformation of historical scholarship through digital methodologies has fundamentally altered
both research practices and pedagogical approaches in higher education institutions worldwide. Digital
history, defined as the systematic application of computational tools and methods to historical research,
teaching, and dissemination, has evolved from a peripheral specialization to an integral component of
contemporary historical practice [1, 2]. This evolution reflects broader shifts in information accessibility,
student learning preferences, and the competencies required for twenty-first-century historical work.</p>
        <p>Contemporary undergraduate students inhabit an information ecosystem characterized by
unprecedented access to digitized primary sources, computational analysis tools, and multimedia presentation
platforms. Research indicates that strategic integration of digital technologies in history courses
facilitates deeper engagement with historical materials while developing transferable analytical competencies
[3, 4]. The proliferation of digital archives has democratized access to primary sources previously
confined to specialized repositories, enabling students to engage directly with historical evidence
regardless of geographical constraints [5, 6].</p>
        <p>Empirical investigations demonstrate measurable benefits when digital tools are thoughtfully
integrated into history curricula. Students participating in collaborative digital history projects exhibit
enhanced critical thinking capabilities, improved source evaluation skills, and more sophisticated
understanding of historical narratives as constructed interpretations rather than fixed truths [ 7, 8].
Project-based learning incorporating digital methodologies has proven particularly efective in
developing what researchers term “historical empathy” – the capacity to understand past actors within their
specific temporal and cultural contexts [9, 10].</p>
        <p>The pedagogical frameworks supporting digital history education have matured considerably. The
TPACK (Technological Pedagogical Content Knowledge) model provides a theoretical foundation for
understanding how technology, pedagogy, and content knowledge intersect in efective teaching
practice [11, 12]. Implementation of the DEPSWALIC digital competency framework has demonstrated
measurable improvements in both instructor confidence and student learning outcomes across
diverse institutional contexts [13, 14]. These frameworks address the critical challenge of ensuring that
technological integration enhances rather than supplants fundamental historical thinking skills.</p>
        <p>Despite growing implementation and anecdotal evidence of efectiveness, no comprehensive
systematic review has synthesized empirical findings regarding digital history pedagogy at the undergraduate
level. This absence is particularly notable given the substantial institutional investments in digital
infrastructure and the ongoing debates regarding optimal implementation strategies. The diversity of
approaches – from gamification and virtual reality applications to collaborative writing platforms and
GIS mapping – further underscores the need for systematic evaluation of relative efectiveness across
diferent methodological approaches.</p>
      </sec>
      <sec id="sec-1-2">
        <title>1.2. Objectives</title>
        <p>This systematic review aims to address primary research question: How efective is teaching digital
history to students compared to non-digital methods of teaching history in terms of improving learning
outcomes?</p>
        <p>Subsidiary research questions:
1. By student categories: Does the status of a digital history course (mandatory or elective) afect
its efectiveness?
2. By course status: Which specific digital tools and technologies for teaching history demonstrate
the highest efectiveness?
3. By teaching tools: Which efectiveness indicators (knowledge, skills, motivation, engagement)
are most sensitive to the impact of digital methods of teaching history?
4. By intervention duration: Does the duration of digital methods use afect their efectiveness in
teaching history?</p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>2. Methods</title>
      <sec id="sec-2-1">
        <title>2.1. Protocol and registration</title>
        <p>This systematic review adheres to the Preferred Reporting Items for Systematic Reviews and
MetaAnalyses (PRISMA) 2020 statement [15]. While no formal protocol was registered in a public repository
such as PROSPERO, the review methodology was established a priori, with eligibility criteria, search
strategy, and data extraction procedures determined before database searching commenced. This
approach ensures methodological transparency while acknowledging the exploratory nature of this
initial systematic synthesis in digital history pedagogy.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2. Eligibility criteria</title>
        <p>Studies were evaluated against predetermined inclusion and exclusion criteria developed through
iterative refinement based on preliminary scoping searches.</p>
        <sec id="sec-2-2-1">
          <title>2.2.1. Inclusion criteria</title>
          <p>Eligible studies satisfied the following requirements:
• Population: Undergraduate students enrolled in history courses at accredited higher education
institutions, with participants aged 18 years or older. Studies including mixed populations were
eligible if undergraduate data could be extracted separately.
• Intervention: Any digital technology intervention designed to enhance history education,
encompassing but not limited to: collaborative writing platforms, digital archives and databases, geographic
information systems (GIS), virtual reality environments, gamification elements, digital storytelling
tools, or computational text analysis methods. Interventions required substantive integration into
course design rather than supplementary use.
• Comparator: Studies employing traditional teaching methods as comparators, alternative digital
interventions, or pre-post designs without external controls were all considered eligible, reflecting
the diversity of research designs in educational technology research.
• Outcomes: Primary outcomes included measures of student engagement (behavioral, cognitive, or
afective), historical knowledge acquisition, critical thinking skills, source analysis capabilities, or
digital literacy development. Secondary outcomes encompassed student satisfaction, technological
self-eficacy, and collaborative learning indicators.
• Study design: Empirical studies employing quantitative, qualitative, or mixed methods approaches.</p>
          <p>Eligible designs included randomized controlled trials, quasi-experimental studies, cohort studies,
case studies with systematic data collection, and phenomenological investigations with rigorous
analytical frameworks.
• Publication parameters: Peer-reviewed articles, conference proceedings, and book chapters
published between January 2011 and July 2025. The starting date corresponds with widespread adoption
of Web 2.0 technologies in higher education, while the end date represents the search execution
period.</p>
        </sec>
        <sec id="sec-2-2-2">
          <title>2.2.2. Exclusion criteria</title>
          <p>Studies were excluded based on the following parameters:
• Participants below university level (K-12 education) or exclusively graduate students without
undergraduate representation.
• Theoretical or conceptual papers lacking empirical data.
• Technology training for educators without student outcome assessment.
• Studies focused on disciplines other than history, even when employing similar digital methodologies.
• Interventions lasting less than two weeks or involving fewer than five participants.
• Publications in languages other than English, reflecting resource constraints rather than linguistic
bias.
• Editorial commentaries, book reviews, or conference abstracts without full-text availability.</p>
        </sec>
      </sec>
      <sec id="sec-2-3">
        <title>2.3. Information sources and search strategy</title>
        <sec id="sec-2-3-1">
          <title>2.3.1. Database selection</title>
          <p>Scopus was selected as the primary database due to its comprehensive coverage of peer-reviewed
literature across disciplines, including education, history, and information science. The database indexes
over 48,000 active titles from more than 5,000 international publishers, providing broader coverage than
discipline-specific databases while maintaining quality standards through peer-review requirements.
Supplementary searches in Web of Science, ERIC, and Google Scholar were initially planned but
ultimately deemed unnecessary given the comprehensive results from Scopus and resource constraints.</p>
        </sec>
        <sec id="sec-2-3-2">
          <title>2.3.2. Search strategy development</title>
          <p>The search strategy underwent iterative refinement through preliminary testing to optimize sensitivity
while maintaining precision. The initial search string employed Boolean operators and truncation
symbols to capture relevant terminology variations:
TITLE-ABS-KEY ( "digital history" AND student* )</p>
          <p>Search parameters were limited to title, abstract, and keyword fields to balance comprehensiveness
with relevance. The search was executed on July 26, 2025, with no date restrictions applied during the
search phase.</p>
          <p>The search query after corrections looks as follows:
TITLE-ABS-KEY
(
"digital history"
AND
student*
)
AND
(
)
AND
(
)</p>
          <p>LIMIT-TO ( LANGUAGE , "English" )
LIMIT-TO ( DOCTYPE , "ar" )
OR
LIMIT-TO ( DOCTYPE , "cp" )
OR
LIMIT-TO ( DOCTYPE ,</p>
          <p>"ch" )</p>
        </sec>
      </sec>
      <sec id="sec-2-4">
        <title>2.4. Study selection process</title>
        <p>The selection process followed a two-stage screening protocol conducted independently by two
reviewers with expertise in digital humanities and educational research.</p>
        <sec id="sec-2-4-1">
          <title>2.4.1. Stage 1: Title and abstract screening</title>
          <p>Initial screening evaluated titles and abstracts against predetermined eligibility criteria. Each record
received dual review, with conflicts resolved through discussion. Studies were advanced to full-text
review when abstracts provided insuficient information for definitive exclusion.</p>
          <p>To automate the research, Claude 4 Opus was used for preliminary analysis. The automated tool was
used as an auxiliary means before the main screening by two reviewers. All final decisions regarding
inclusion/exclusion were made exclusively by human reviewers. Results of Claude 4 Opus’s preliminary
analysis were fully verified and validated by two reviewers.</p>
          <p>This approach to study selection ensured eficient and thorough evaluation of all 46 records while
maintaining systematic review quality principles within the resource capabilities of a research project.</p>
          <p>At the preliminary screening stage, LLM helps to identify a duplicate – the same study by [16]
published in two formats: as a conference proceedings article and as a full journal article. After
excluding the duplicate, we got a 45 unique publications for further screening.</p>
          <p>To automate article verification, a query was submitted to Claude 4 Sonnet (another Anthropic’s
model used for processing short texts like paper abstracts):
For each of the 45 attached documents, determine which should be excluded from
the review, and why. Output the result as:
BibTeX identifier: reason(s) for exclusion.</p>
          <p>Separately output documents that remain.</p>
          <p>The chatbot’s response was verified by the researcher. Based on the response, 28 articles were
excluded (appendix A). After researcher verification, 1 document was added to potentially included
(appendix B).</p>
        </sec>
        <sec id="sec-2-4-2">
          <title>2.4.2. Stage 2: Full-text assessment</title>
          <p>The next step is attempting to obtain the 17 selected papers, succeeded in obtaining – 15, failed to
obtain – 2 (appendix D). Authors were contacted to obtain missing information for two studies, though
neither response was received within the review timeline.</p>
          <p>Full texts of potentially eligible studies underwent comprehensive evaluation against all inclusion
and exclusion criteria using both human and LLM assistance.</p>
          <p>The supportive query to Claude 4 Opus was: “Evaluate the attached article for compliance with
inclusion criteria. Indicate whether it should be included in the review or not. If not - indicate the reason.”
Based on LLM responses according to selected inclusion criteria, 3 articles were selected and 12 were
rejected. The minimum number of articles in a systematic review is not formally regulated, and 3
studies are acceptable, but this is an extreme case requiring very good justification (for example, if the
ifeld is highly specialized or novel). The Cochrane Handbook does not specify a strict minimum but
assumes the presence of suficient data for analysis.</p>
          <p>Therefore, it was decided to relax the selection criteria. So the next query was: “The number of
selected articles is too small. What are the options for relaxing the selection criteria to increase the number
of selected articles to a minimally acceptable level?”</p>
          <p>The LLM recommendations as follows:
1. “Expand time frame to 2011-2024 → +1 article”.
2. “Include master’s students +2 articles”.
3. “Include descriptive case studies with systematic data collection”.</p>
          <p>The researcher decided to reject last recommendation. The time frame was expanded to 2011, as this
period coincides with the beginning of widespread implementation of digital technologies in education
and the appearance of the first systematic studies of digital history. Participant criteria were expanded to
include master’s students (MA/MEd programs), as in many universities they study alongside bachelor’s
students in the same history courses, and their experience using digital technologies is relevant for the
undergraduate level.</p>
          <p>Contact with authors of included studies was not made to obtain or confirm additional information.
The decision was based on the fact that all necessary data for completing review maps were available
in published research reports, as well as limited resources for conducting additional inquiries.</p>
          <p>Article translations were not needed, as all included studies were published in English according to
established inclusion criteria.</p>
          <p>Special software for data extraction from graphs was not used, as all necessary quantitative data
were presented in text format in the main sections of articles or tables.</p>
        </sec>
      </sec>
      <sec id="sec-2-5">
        <title>2.5. Data collection process</title>
        <p>A standardized data extraction form was developed and piloted on one randomly selected study before
full implementation. The form captured study characteristics, participant demographics, intervention
details, outcome measures, and quality indicators (appendix C).</p>
        <p>Data from each included study were collected by three reviewers simultaneously: two generative
AI-based services (Claude 4 Sonnet and Grok 3) and one human researcher.</p>
        <p>• Claude 4 Sonnet – for primary analysis and completion of review maps.</p>
        <p>• Grok 3 – for cross-checking and validation of obtained data.</p>
        <p>Reviewers worked not independently, but in cross-check mode to ensure accuracy and completeness
of data collection. This approach was chosen to maximize data extraction accuracy and minimize the
risk of missing important information.</p>
        <p>When discrepancies were found in completing review maps, responses from all three reviewers were
compared with subsequent discussion and consensus achievement. Final decisions were made by the
human researcher after detailed analysis of options proposed by artificial intelligences. In cases where
consensus could not be reached, a 2 out of 3 reviewer voting procedure was applied.</p>
        <p>Both tools worked with identical prompts and instructions to ensure standardization of the data
extraction process. Query content is located in appendix C. Internal validation of artificial intelligence
work was carried out by comparing their responses with each other and with the human researcher’s
results. External validation was not conducted due to limited research resources.</p>
        <p>Extracted data encompassed:
1. Primary outcomes:
2. Secondary outcomes:
a) Historical knowledge – improvement in understanding of historical facts, events and
concepts. Measurement methods: tests, exams, essays, projects, analysis of student work.</p>
        <p>Time frame: immediately after intervention (post-intervention).
b) Understanding of historical concepts – students’ ability to analyze and interpret
historical processes. Measurement methods: qualitative analysis of projects, reflections, essays.</p>
        <p>Time frame: immediately after intervention.
a) Learning motivation – level of interest and desire of students to study history.
Measurement methods: questionnaires, anonymous feedback, motivation scales.
b) Student engagement – activity of student participation in the learning process.
Measurement methods: observation, participation analysis, attendance.
c) Source work skills – ability to find, analyze and critically evaluate historical sources.</p>
        <p>Measurement methods: analysis of work with archives, primary sources.
d) Critical thinking skills – ability to analytically approach historical information.
Measurement methods: analysis of reflections, essays, projects.
e) Technological literacy – mastery of digital tools for historical research. Measurement
methods: success in using digital platforms.
f) Ability to create historical narratives – skill in constructing and presenting historical
stories. Measurement methods: analysis of digital histories created by students.</p>
        <p>Features of the data extraction process:
• Issue with Claude 4 Sonnet: In the domain “Experimental group results” LLM marked results
for both experimental and control groups (if there was one), which required additional verification
by the researcher.
• Use of ready-made formulations: The researcher used ready-made formulations when
information from AI was confirmed by own analysis.
• Most valuable results for interpreting review conclusions: Results containing the terms
“improvement” and “enhancement” in the context of student skills and abilities, as they directly
reflect the efectiveness of digital history interventions.
• Justification for prioritization: These results are most relevant for assessing the impact of
digital technologies on the quality of history education and correspond to the main objectives of
the systematic review — determining the efectiveness of teaching digital history to students.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Results</title>
      <sec id="sec-3-1">
        <title>3.1. Study selection</title>
        <p>The systematic search yielded 46 records from the Scopus database. Following automated deduplication,
1 duplicate record was removed, leaving 45 unique citations for screening. Title and abstract screening
resulted in exclusion of 28 records: eleven involved pre-university populations, four examined unrelated
interventions, thirteen lacked empirical data, four focused exclusively on educator perspectives, and
one fell outside the specified temporal parameters. Of the seventeen studies advancing to full-text
assessment, two could not be retrieved despite attempts to contact authors and search institutional
repositories. Nine additional studies were excluded following detailed evaluation: two were published
outside the eligibility timeframe (2011 and 2025 posthumous publication), three involved graduate
students exclusively, two presented insuficient methodological detail for quality assessment, and two
described theoretical frameworks without empirical testing. Ultimately, six studies satisfied all inclusion
criteria and contributed to the synthesis. Figure 1 presents the complete selection process following
PRISMA 2020 specifications.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. General overview of included studies</title>
        <p>Six studies published between 2011 and 2017 were included in the systematic review. All studies were in
English and published in peer-reviewed journals. Characteristics of each study are presented in table 1
and table 2.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Detailed description of each study</title>
        <p>Detailed characteristics of each study were collected using structured review maps completed by three
independent reviewers. Complete information is presented in the file “Table first.xlsx” [20].</p>
        <p>Records identified
from Scopus (n = 46)
Records screened (n = 45)</p>
        <p>Reports sought for
retrieval (n = 17)
Reports assessed for
eligibility (n = 15)
Records excluded (n = 28):</p>
        <p>Pre-university: 11
Wrong intervention: 4</p>
        <p>No empirical data: 13
Reports not retrieved (n = 2)</p>
        <p>Reports excluded (n = 9):</p>
        <p>Wrong timeframe: 2</p>
        <p>Graduate only: 3
Insuficient detail: 2
Theoretical only: 2</p>
        <p>Studies included in review (n = 6)</p>
      </sec>
      <sec id="sec-3-4">
        <title>3.4. Risk of bias assessment in studies</title>
        <p>Risk of bias assessment was conducted for each of the included studies according to a standardized
approach adapted for educational interventions in digital history. Due to the limited available metadata
from the Scopus database (only titles, abstracts and keywords), a complete assessment of all domains of
risk of bias was impossible without access to full study texts.</p>
        <p>Main limitations:
1. Limited metadata: Assessment is based solely on titles, abstracts and keywords from the Scopus
Lee and Mole- Personal digital histories Various technologies Absent
bash [17] (iterative approach)
McLean et al. Historical projects using dig- Wiki, blogs
[18] ital tools
Soh et al. [19] Collaborative digital history ClassroomWiki
writing
2. Lack of full texts: Inability to conduct detailed analysis of study methodology.
3. Absence of protocols: No access to primary study protocols for comparison.
4. Limited standardization: Educational research often has specific methodological features.</p>
        <p>Due to limited available information, all included studies received an assessment of unclear risk of
bias. Based on available metadata from Scopus, it is impossible to assess randomization methods or
participant selection criteria. Study abstracts lack detailed information about procedures for forming
comparison groups. However, the specificity of educational interventions makes blinding of participants
regarding the type of educational intervention impossible.</p>
      </sec>
      <sec id="sec-3-5">
        <title>3.5. Results of statistical syntheses</title>
        <sec id="sec-3-5-1">
          <title>3.5.1. Justification for absence of formal meta-analysis</title>
          <p>Due to significant heterogeneity in study designs, educational contexts, methodological approaches
and outcome measures in the included studies, conducting formal statistical meta-analysis proved
impossible and inadmissible. Instead, narrative synthesis was applied to systematize and interpret
the found evidence (figure 2).</p>
        </sec>
        <sec id="sec-3-5-2">
          <title>3.5.2. Study outcomes</title>
          <p>The analysis of digital technology implementation in history education reveals distinct patterns of
adoption across diferent technological categories. Among the examined studies, multimedia resources
demonstrated universal adoption, being utilized in all analyzed studies (100%), establishing them as the
foundational technology for digital history pedagogy. This comprehensive implementation reflects the
fundamental role of multimedia in contemporary educational practices, where the integration of visual,
auditory, and textual elements has become essential for efective historical instruction (figure 3).</p>
          <p>Digital archives and interactive platforms exhibited equivalent adoption rates, each being
implemented in 83.3% of the studies examined. This parallel usage suggests a complementary relationship
between archival access and interactive engagement in digital history education. The high adoption
Narrative synthesis</p>
          <p>Thematic analysis
Comparative analysis
Synthesis of findings</p>
          <p>Generalization</p>
          <p>methods</p>
          <p>Final results
Qualitative assessment</p>
          <p>Frequency analysis</p>
          <p>Consensus approach
rate of digital archives indicates the critical importance of primary source accessibility in historical
pedagogy, while the corresponding implementation of interactive platforms demonstrates educators’
recognition of the need for dynamic, participatory learning environments.</p>
          <p>Social media platforms found application in a substantial majority of the studies, with 66.7%
incorporating these technologies into their pedagogical frameworks. This adoption rate, while significant,
suggests a more selective approach to social media integration, potentially reflecting institutional
considerations or pedagogical preferences regarding the appropriateness and efectiveness of social
platforms in formal educational contexts.</p>
          <p>Notably, augmented reality (AR) and virtual reality (VR) technologies were entirely absent from
all analyzed studies, representing a complete lack of implementation across the examined research.
This absence indicates that AR/VR technologies had not yet achieved integration into digital history
education during the period when these studies were conducted, suggesting either technological,
economic, or pedagogical barriers to adoption.</p>
          <p>Digital archives (figure 3) emerged as a cornerstone technology, implemented in five of the six
analyzed studies. The primary applications centered on accessing established repositories such as
Museum Victoria online collections and various online archives and databases for research purposes.
ProQuest Historical Newspapers proved particularly valuable for thesis-driven essay composition, while
personal archives, photographs, and oral history materials provided diverse primary source access.
Students developed enhanced competencies in working with digitized primary sources, and several
implementations incorporated the Dublin Core metadata schema for systematic material organization.
Multimedia resources
Interactive platforms</p>
          <p>Digital archives</p>
          <p>Social media</p>
          <p>AR/VR technologies 0
40 50 60 70</p>
          <p>Percentage of use (%)
However, implementation challenges were identified, particularly regarding students’ dificulties in
transcribing handwritten historical materials.</p>
          <p>Interactive platforms (figure 3) demonstrated equivalent adoption levels, appearing in five of
six studies with diverse technological implementations. Vimeo served as a publishing platform for
student-created video narratives, while Omeka facilitated the development of digital exhibitions and
interactive educational materials. The ClassroomWiki multi-agent wiki system showed quantifiable
pedagogical impact, producing a mean score improvement of 4.06 points. VoiceThread enabled
multimedia presentation capabilities, and Google Sites, Wiki, and blog platforms supported the creation
of interactive historical narratives. Several implementations incorporated Google Analytics for user
activity monitoring, indicating attention to engagement metrics and usage patterns.</p>
          <p>Multimedia resources (figure 3) achieved universal implementation across all examined studies,
reflecting their fundamental role in digital history education. Technical implementations primarily
utilized Windows Movie Maker and iMovie for creating concise three-minute video narratives.
Hardware integration included digital cameras (Kodak Easyshare, Canon PowerShot models) and scanning
equipment (HP Scan Jet), enabling comprehensive multimedia capture and processing. Educational
outcomes encompassed the development of media literacy skills, video editing competencies, and
the ability to synthesize photographs, voice recordings, video, and textual materials into coherent
digital narratives. Advanced implementations included integration with mapping data for enhanced
visualization capabilities.</p>
          <p>Social media (figure 3) integration occurred in four of six studies, representing a selective but
significant adoption pattern. Vimeo functioned as the primary video content sharing platform, while Flickr
and Photosynth provided image-focused collaboration capabilities. Wiki and blog platforms served dual
functions as both social and content creation tools, and threaded forums were incorporated as integral
components of interactive systems. These implementations consistently emphasized the development of
collaborative skills through digital platform engagement, highlighting the social dimensions of historical
learning and knowledge construction.</p>
        </sec>
      </sec>
      <sec id="sec-3-6">
        <title>3.6. PICO data delineation</title>
        <p>The systematic review encompassed six studies examining digital technology interventions in history
education, analysed through the PICO (Population, Intervention, Comparator) framework. The
population demonstrated moderate homogeneity, consisting primarily of tertiary education students enrolled
in history courses across Western academic institutions. Sample sizes varied considerably, ranging from
27 to 200 participants, with the majority focusing on undergraduate students at second and third-year
levels, alongside some pre-service teacher populations. Despite variations in specific institutional
contexts and course structures, the studies maintained consistency in targeting formal academic settings
within higher education, providing a reasonably homogeneous foundation for comparative analysis,
that has already been partially described in the tables 1 and 2.</p>
        <p>The interventions, detailed comprehensively in the systematic review protocol [20], encompassed
various digital technology applications including collaborative online platforms, digital storytelling
projects, multimedia content creation, and primary source digitization activities. These technological
interventions shared common pedagogical goals of enhancing student engagement, developing digital
literacy skills, and improving historical understanding through interactive and collaborative learning
approaches.</p>
        <p>Regarding study design heterogeneity, the comparator analysis reveals significant methodological
limitations across the reviewed studies. Table 3 presents a comprehensive overview of the comparison
approaches employed in each investigation.</p>
        <p>The comparator analysis reveals a critical methodological limitation: only one study (“Digital Histories
for the Digital Age: Collaborative Writing in Large Lecture Courses” [19]) employed a formal control
group design with statistical comparison between digital intervention and traditional teaching methods.
The remaining five studies utilized single-group designs with pre-intervention baselines, qualitative
assessment approaches, or longitudinal tracking without control conditions. This predominance of
weak comparison designs significantly limits the strength of causal inference regarding intervention
efectiveness and represents a substantial gap in the current evidence base for digital history education
interventions.</p>
      </sec>
      <sec id="sec-3-7">
        <title>3.7. Primary study outcomes</title>
        <sec id="sec-3-7-1">
          <title>3.7.1. Historical knowledge</title>
          <p>The analysis of digital history pedagogical interventions reveals significant transformations in how
students acquire, process, and understand historical knowledge. Across multiple studies examining
diferent digital tools and approaches, consistent patterns emerge regarding the evolution of historical
understanding in digital learning environments.</p>
          <p>Digital technologies fundamentally alter students’ relationship with primary sources and
historical evidence. In the study utilizing Museum Victoria online collections and digital archives, students
demonstrated enhanced ability to work with diverse source materials, developing what researchers termed
a “critical eye” for source analysis. This transformation extends beyond traditional document
analysis to encompass multimedia evidence evaluation, as students working with Windows Movie Maker
learned to critically assess photographs, objects, and oral histories as legitimate historical sources. The
integration of digital archives through platforms like Omeka similarly enhanced students’ capacity for
synthesizing primary and secondary sources, moving beyond passive consumption toward active
historical construction.</p>
          <p>The nature of historical narrative understanding undergoes substantial modification through
digital storytelling practices. Students creating three-minute digital video histories developed
sophisticated appreciation for history’s subjective nature and the historian’s role in constructing historical
accounts. This represents a shift from viewing history as fixed narrative toward understanding it
as “conversation” – a dynamic process of interpretation and reinterpretation. The personal digital
histories project further reinforced this transformation, as students connected individual experiences
with broader historical patterns, developing nuanced understanding of how personal and public narratives
intersect.</p>
          <p>Collaborative digital platforms produce distinctive changes in historical thinking processes. The
ClassroomWiki intervention demonstrated that students working collaboratively on digital historical
projects scored significantly higher on assessments ( M = 74.67 versus M = 70.61, p &lt; 0.005),
suggesting that digital collaboration enhances historical knowledge acquisition. Students engaged in
wiki-based historical writing showed improved synthesis capabilities, better understanding of historical
significance, and enhanced ability to construct thesis-driven historical arguments supported by primary
source evidence.</p>
          <p>Spatial and temporal conceptualization of history transforms through digital mapping and
visualization tools. Students working with digital travel journals and geographical visualization platforms
developed enhanced understanding of historical continuity and change, moving beyond chronological
thinking toward spatial-temporal integration. This represents significant cognitive advancement in
historical consciousness, as students learned to conceptualize historical events within complex geographical
and temporal frameworks.</p>
          <p>The development of historical empathy and perspective-taking shows marked improvement
through digital storytelling interventions. Students creating personal digital narratives demonstrated
increased capacity for understanding multiple historical perspectives and recognizing the emotional
dimensions of historical experience. This afective engagement with historical content produces deeper
comprehension of historical actors’ motivations and constraints, moving beyond factual knowledge
toward interpretive understanding.</p>
          <p>Critical evaluation of oficial historical narratives emerges as significant outcome across multiple
digital interventions. Students working with collaborative writing platforms and interactive digital tools
developed enhanced ability to question dominant historical accounts, recognize bias in historical sources,
and construct alternative interpretations based on evidence analysis. This represents fundamental shift
from passive reception of historical information toward active, critical engagement with historical discourse.</p>
          <p>Digital literacy integration transforms traditional historical methodology. Students
simultaneously develop technological competencies and historical thinking skills, creating hybrid knowledge
that combines digital proficiency with historical analysis capabilities. This integration suggests evolution
in what constitutes historical knowledge itself, as digital tools become integral to historical research and
presentation rather than supplementary additions.</p>
          <p>Assessment of learning outcomes reveals quantitative improvements in historical knowledge
acquisition. Beyond the ClassroomWiki results, course satisfaction ratings consistently exceeded
4.2/5.0 across interventions, with 100% positive responses in collaborative digital projects. These
metrics, combined with qualitative evidence of enhanced engagement and motivation, suggest that
digital approaches produce measurable improvements in historical learning outcomes.</p>
          <p>However, the transformation of historical knowledge through digital pedagogy presents certain
challenges. Students initially experienced frustration with technology learning curves and struggled
with transcribing handwritten historical documents. Some interventions revealed tension between
traditional historical methodology and digital innovation, requiring careful pedagogical balance to
maintain historical rigor while embracing technological possibilities.</p>
          <p>The evidence collectively suggests that digital history pedagogies produce fundamental changes in
how students conceptualize, analyze, and construct historical knowledge. Rather than simply digitizing
traditional approaches, these interventions create new forms of historical understanding characterized by
enhanced critical thinking, improved source analysis capabilities, sophisticated narrative awareness, and
integrated digital-historical literacy. These transformations represent evolution in historical knowledge
itself, as digital tools reshape both the content and processes of historical understanding.</p>
        </sec>
        <sec id="sec-3-7-2">
          <title>3.7.2. Understanding of historical concepts</title>
          <p>The research demonstrates that digital tools fundamentally transform how students conceptualize and
engage with historical knowledge.</p>
          <p>The most significant finding across multiple studies reveals that digital history projects enhance
students’ understanding of historical subjectivity and narrative construction. In the study examining
three-minute digital video histories, students developed a deeper appreciation for how historians
construct historical narratives, recognizing that “history is a conversation” rather than a fixed set of facts.
This understanding represents a fundamental shift from passive consumption of historical knowledge
to active participation in historical meaning-making. Similarly, the digital storytelling research using
Windows Movie Maker revealed that students gained expanded understanding of history as multiple forms
of storytelling. Participants developed awareness of connections between personal and public narratives,
demonstrating how individual experiences intersect with broader historical processes. This pedagogical
approach enabled students to grasp the subjective nature of historical processes and understand their
own role as interpreters of the past.</p>
          <p>Moreover, digital archive projects consistently improved students’ abilities to analyze and synthesize
historical sources. The Cornelius B. Gold travel journal case study showed that students developed better
understanding of connections between primary and secondary sources, moving beyond isolated document
analysis to comprehensive historical synthesis. Students demonstrated improved capacity to link archival
materials with broader historical themes, creating analytical essays that contextualized specific sources
within larger historical patterns. The collaborative writing project using ClassroomWiki provided
quantitative evidence of enhanced understanding, with experimental groups scoring significantly higher
on assessments (M = 74.67 vs. M = 70.61, p &lt; 0.005). Students reported significant improvement in
primary document analysis skills and developed more sophisticated approaches to historical evidence
evaluation.</p>
          <p>Several studies documented students’ enhanced historical consciousness through digital engagement,
representing another crucial dimension of conceptual development. The personal digital histories
research showed participants developing deeper understanding of historical thinking and personal
significance of historical events . Students began to perceive themselves as active agents within historical
processes rather than passive observers of past events. The collaborative spaces study revealed that
students achieved deepened understanding of historical consciousness, demonstrating improved
comprehension of historical significance, continuity, and change . Participants learned to critically evaluate
oficial narratives and developed more nuanced understanding of how historical memory is constructed
and contested.</p>
          <p>Digital history projects consistently fostered students’ ability to critically assess historical sources
and narratives. The research on digital storytelling showed students developing critical analytical
skills through hands-on engagement with source materials. Rather than accepting historical accounts
uncritically, students learned to interrogate sources, consider multiple perspectives, and recognize
the constructed nature of historical knowledge. The Windows Movie Maker study demonstrated that
students gained understanding of narrative construction of history, recognizing how diferent storytelling
approaches shape historical interpretation. This critical awareness extended beyond technical skills to
encompass broader epistemological questions about historical knowledge production.</p>
          <p>When examining these findings holistically, the evidence suggests that digital history pedagogy
consistently enhanced students’ conceptual understanding through several key mechanisms. First,
active creation of digital historical products transformed students from passive consumers to active
producers of historical knowledge. Second, engagement with primary sources in digital formats improved
analytical skills and source criticism abilities. Third, collaborative digital projects fostered understanding
of multiple perspectives and the social construction of historical knowledge. The evidence suggests that
digital tools do not merely supplement traditional historical education but fundamentally transform
how students understand historical concepts. Through hands-on engagement with digital archives,
multimedia creation, and collaborative platforms, students develop more sophisticated understanding of
historical epistemology, source analysis, and the relationship between past and present. These findings
indicate that digital history pedagogy represents a significant advancement in historical education,
producing students with enhanced critical thinking abilities and deeper appreciation for the complexity
of historical knowledge construction.</p>
        </sec>
      </sec>
      <sec id="sec-3-8">
        <title>3.8. Secondary study outcomes</title>
        <sec id="sec-3-8-1">
          <title>3.8.1. Increased motivation</title>
          <p>The results of empirical analysis demonstrate a positive outcome in 6 out of 6 studies (100%). The
research revealed a high level of student engagement and enthusiasm, with 45% of students in one
study showing marked enthusiasm for the proposed approach. Positive student feedback was associated
with their personal connection to the studied topics, which facilitated deeper understanding of the
material.</p>
          <p>It is particularly noteworthy that students emphasized the importance of practical application of
historical research, indicating the efectiveness of integrating theoretical knowledge with practical
activities. Furthermore, participants expressed a sense of pride in creating a professional product,
suggesting enhanced academic self-esteem and motivation.</p>
          <p>However, the research identified certain exceptions: some students experienced frustration due to
the mismatch between the new approach and traditional course expectations. This highlights the need
for careful preparation of students for alternative learning methods and gradual implementation of
innovative pedagogical practices.</p>
        </sec>
        <sec id="sec-3-8-2">
          <title>3.8.2. Engagement level</title>
          <p>The analysis of student engagement levels was conducted based on available data from 2 out of
6 studies (33.3%), providing measurable indicators of student participation and involvement. The
ClassroomWiki study yielded particularly detailed quantitative metrics, revealing an average word
count of 5,596 per student contribution, suggesting substantial written engagement with the platform.
Student login patterns demonstrated consistent participation, with an average of 6.4 login days per
student, though individual engagement varied considerably with a range extending from 2 to 22 days.
The research revealed a diferentiated pattern of student attitudes toward the implemented approaches.
Analysis showed that 45% of students could be classified as enthusiasts, demonstrating high levels
of engagement and positive reception of the methodological innovations. Conversely, 20% remained
indiferent to the new approaches, while 15% exhibited negative inclinations toward the implemented
changes. Qualitative assessments from additional studies corroborated these findings, with researchers
documenting high emotional engagement among participants. This multifaceted engagement data
suggests that while the majority of students responded positively to innovative pedagogical approaches,
implementation strategies must account for varied student receptivity and the need for diferentiated
support mechanisms to maximize universal engagement.</p>
        </sec>
        <sec id="sec-3-8-3">
          <title>3.8.3. Improvement source work skills</title>
          <p>Digital technologies in historical education enhance students’ primary source analysis capabilities. Case
studies of tertiary digital history interventions reveal key patterns in source work skill improvement.</p>
          <p>Digital history projects develop critical analytical capabilities through systematic source analysis
requiring contextual understanding, authorship evaluation, and content interpretation. Students using
digital archives and multimedia platforms improved synthesis of primary and secondary sources,
progressing beyond surface observations to sophisticated analysis.</p>
          <p>Digital storytelling platforms like Windows Movie Maker and Omeka enabled “critical eye”
development, enhancing source reliability evaluation and recognition of historical narrative construction.
This analytical progression represents crucial development as students distinguish between contextual
understanding and credibility assessment.</p>
          <p>Collaborative platforms including ClassroomWiki and VoiceThread created structured analysis
frameworks yielding measurable improvements. Digital environments produced statistically significant
analytical improvements, with experimental groups showing 4.06-point mean score increases over
traditional approaches ( &lt; 0.005).</p>
          <p>Digital archives efectively developed transcription and interpretive skills. Despite initial manuscript
dificulties, sustained engagement with digitized sources through Museum Victoria collections and
ProQuest Historical Newspapers facilitated sophisticated documentary analysis, shifting students from
observation to inference-making.</p>
          <p>Digital methodologies create skill development pathways unavailable in traditional approaches.
Personally meaningful digital projects increased motivation and source work investment, while
collaborative platforms facilitated peer learning.</p>
          <p>Success requires significant scafolding and technical support. Efective interventions combined
digital tools with explicit instruction in analytical frameworks addressing authorship, audience, bias,
purpose, context, motivation, and validity, emphasizing both technological and traditional scholarly
skills.</p>
          <p>Digital history pedagogies enhance source work skills through engagement, collaboration, and
multimodal approaches. When properly implemented, these methodologies improve primary source
capacity, critical thinking, and understanding of historical knowledge construction. Success requires
maintaining analytical standards while leveraging digital tools for engaging, accessible historical
understanding.</p>
        </sec>
        <sec id="sec-3-8-4">
          <title>3.8.4. Development of critical thinking</title>
          <p>The empirical investigation demonstrates a positive outcome in 6 out of 6 studies (100%) regarding
students’ advancement in critical analytical competencies. The research revealed significant
development of students’ critical eye and enhanced ability to systematically analyze historical sources with
greater sophistication and methodological rigor. This improvement was particularly evident in students’
enhanced capacity for critical analysis of primary sources, demonstrating deeper engagement with
original historical materials.</p>
          <p>The findings indicate substantial progress in students’ understanding of the narrative
construction of history, reflecting a more nuanced appreciation of how historical accounts are constructed
and interpreted. Students showed marked improvement in their skills for synthesizing diferent types of
sources, indicating advancement in their ability to integrate diverse forms of evidence into coherent
analytical frameworks.</p>
          <p>Particularly significant was students’ development of capabilities for critical evaluation of oficial
narratives, demonstrating enhanced capacity to question and analyze dominant historical
interpretations. The research documented successful implementation and utilization of a structured 4-step
historical analysis process, providing students with a systematic methodological framework for
approaching historical inquiry. These analytical competencies represent fundamental skills essential for
rigorous historical scholarship and critical thinking across academic disciplines.</p>
        </sec>
        <sec id="sec-3-8-5">
          <title>3.8.5. Development of digital skills (technological literacy)</title>
          <p>The comprehensive analysis reveals a positive outcome in 6 out of 6 studies (100%) concerning
students’ acquisition and development of digital literacy skills. The research documented
significant advancement in students’ technical competencies, particularly in video editing mastery using
industry-standard software including Windows Movie Maker and iMovie. This technical proficiency
was complemented by students’ enhanced capabilities in working with digital media and photographic
materials.</p>
          <p>The findings demonstrate substantial progress in students’ familiarity with specialized digital
platforms, including Omeka, VoiceThread, and ClassroomWiki, indicating successful adaptation to diverse
technological environments. Students also developed proficiency in voice recording techniques and
web design skills, expanding their multimedia communication capabilities.</p>
          <p>Particularly noteworthy was students’ gaining of practical experience with digital humanities tools,
reflecting their integration into contemporary scholarly practices. The research further revealed marked
improvement in students’ ability to navigate and efectively utilize online archives and databases,
demonstrating enhanced digital research competencies essential for modern academic and professional
work. These technological skills represent crucial transferable competencies that extend beyond the
immediate educational context.</p>
        </sec>
        <sec id="sec-3-8-6">
          <title>3.8.6. Improved understanding (ability to create historical narratives)</title>
          <p>The empirical analysis demonstrates a positive outcome in 6 out of 6 studies (100%) regarding
students’ conceptual understanding and analytical capabilities. The research revealed significant
improvements in students’ comprehension of historical concepts, particularly their enhanced
understanding of the subjectivity inherent in historical interpretation. Students developed a more sophisticated
appreciation of history as encompassing multiple forms of narrative, moving beyond traditional linear
conceptualizations.</p>
          <p>The findings indicate substantial deepening of students’ historical consciousness, with marked
improvements in their understanding of historical significance, continuity, and change. This enhanced
historical thinking was accompanied by students’ improved ability to recognize and analyze the
connections between personal and public narratives, demonstrating a more nuanced understanding of how
individual experiences intersect with broader historical contexts.</p>
          <p>Furthermore, participants showed measurable improvement in understanding the connections
between projects and courses, suggesting enhanced metacognitive awareness of their learning
process. Most notably, students developed stronger analytical skills, particularly in their ability to
synthesize primary and secondary sources, indicating advancement in critical historical methodology
and scholarly practice.</p>
        </sec>
      </sec>
      <sec id="sec-3-9">
        <title>3.9. Other outcomes</title>
        <p>Test results were available in only one study out of six examined cases (16.7%). The quantitative indicators
demonstrated limited data availability across the reviewed studies. Statistical analysis revealed that
16.7% of the total sample provided accessible test results. Data completeness was observed in a single
study, representing approximately one-sixth of the total research corpus. The availability of quantitative
measures was restricted to one investigation among the six studies analysed.</p>
        <p>Specific indicators:
• Control group:  = 70.61,  = 27.40.
• Improvement: +4.06 points ( &lt; 0.005).</p>
        <p>• Correlation:  = 0.69 between ClassroomWiki scores and final exam.</p>
        <p>Limitations: 5 of 6 studies do not provide quantitative test data.</p>
        <p>Course satisfaction data, available from 2 out of 6 studies (33.3%), demonstrates consistently high
levels of student approval across diferent academic years. In 2014, participants reported a median
satisfaction rating of 4.9 out of 5, while 2012 data revealed diferentiated satisfaction levels with
second-year students rating the experience at 4.21 out of 5 and third-year students providing higher
ratings of 4.69 out of 5. One study achieved 100% positive feedback from all 8 respondents, with
qualitative assessments across most studies corroborating these positive satisfaction trends. Participation
duration data, comprehensively available across all 6 studies (100%), reveals substantial variability in
implementation timeframes ranging from 3 weeks to 5 years. The shortest implementation involved
10 intensive sessions conducted over 3 weeks with 1-3 hours per session, while the most extensive
program spanned 5 years with 8 iterations engaging 200 students. Typical implementations followed a
standard one-semester format lasting 13-14 weeks. The research documented significant broader
impact, with one digital exhibition attracting 4,000 users within a 6-month period, demonstrating the
potential for extended public engagement beyond the immediate academic context.
3.10. Conclusions and limitations
1. Universal efectiveness: All analyzed digital technologies showed positive impact on motivation,
understanding, digital skills and critical thinking.
2. Most popular technologies: Multimedia resources (100%), digital archives and interactive
platforms (83.3%).
3. Lack of AR/VR: Complete absence of augmented and virtual reality research.
4. Quantitative limitations: Most studies (83.3%) do not provide rigorous quantitative
measurements.</p>
        <p>Methodological limitations:
• Absence of control groups in most studies.
• Small sample sizes (8-200 participants).
• Predominantly qualitative assessment methods.
• High risk of bias due to lack of blinding.</p>
        <p>• Need for additional studies with better experimental design.</p>
      </sec>
      <sec id="sec-3-10">
        <title>3.11. Results of sensitivity analyses to assess robustness of synthesized results</title>
        <p>While sensitivity analyses represent a cornerstone of robust systematic review methodology, serving to
examine the stability of findings across diferent analytical decisions , the present systematic review
examining digital history in education deliberately omitted such analyses due to several compelling
methodological and practical considerations.</p>
        <p>The primary rationale for this decision stems from the inherently limited scope of available empirical
evidence in this emerging field. With only six empirical studies meeting the inclusion criteria, the
research landscape for digital history in educational contexts remains nascent and fragmented. This
scarcity of relevant literature creates a unique methodological situation where traditional sensitivity
analysis approaches become not only impractical but potentially misleading.</p>
        <p>The decision to forgo sensitivity analyses was grounded in established principles of systematic review
methodology, particularly those articulated by Petticrew and Roberts [21], who emphasize that the
appropriateness of analytical techniques must be evaluated against the available evidence base. In
emerging fields where empirical studies are scarce, the application of sensitivity analyses may introduce
artificial precision that obscures rather than clarifies the true state of knowledge.</p>
        <p>Furthermore, the homogeneity of the identified studies in terms of their focus on digital history
applications in educational settings suggests that the primary sources of heterogeneity typically examined
through sensitivity analyses—such as study design variations, population diferences, or measurement
inconsistencies—were not suficiently varied to warrant formal sensitivity testing. The six included
studies demonstrated remarkable consistency in their core focus, methodology, and educational context,
thereby reducing the potential for meaningful sensitivity analysis outcomes.</p>
        <p>Rather than relying on traditional sensitivity analyses, this systematic review employed several
alternative strategies to ensure methodological rigor and transparency. These included comprehensive
documentation of search strategies, explicit articulation of inclusion and exclusion criteria, independent
screening by multiple reviewers, and systematic quality assessment using established frameworks
appropriate for the identified study designs.</p>
        <p>The review also incorporated a detailed assessment of study limitations and potential sources of bias,
providing readers with the information necessary to evaluate the robustness of findings without formal
sensitivity analysis. This approach aligns with recent developments in systematic review methodology
that emphasize the importance of context-appropriate analytical strategies over rigid adherence to
standardized procedures [22].</p>
        <p>The decision to omit sensitivity analyses from this systematic review represents a methodologically
sound response to the constraints imposed by the limited available evidence in digital history education.
Rather than conducting potentially misleading analyses with insuficient data, this approach prioritizes
transparency and acknowledges the current limitations of the research field while providing a solid
foundation for future systematic investigations as the evidence base expands.</p>
      </sec>
      <sec id="sec-3-11">
        <title>3.12. Assessment of risk of bias due to missing results</title>
        <p>Following PRISMA 2020 guidelines (step 21), we evaluated the risk of bias arising from reporting biases
in our digital history education synthesis. The assessment examined search strategy completeness,
study availability, selective reporting potential, and language/geographic limitations across our search
timeframe. Our analysis revealed a moderate risk of bias due to limited search strategy and insuficient
selective reporting assessment. Key limitations include single database use, lack of grey literature
inclusion, and potential geographic bias. Results should be interpreted with caution, as conclusions
about digital technology efectiveness in history teaching may be incomplete and require confirmation
through more comprehensive reviews. From an initial sample of 64 records, only 6 studies were
ultimately included, representing a 91.3% exclusion rate. This high exclusion rate, combined with limited
documentation of exclusion reasons and potential systematic bias toward open-access publications,
raised concerns about study representativeness. The exclusive use of Scopus database, absence of
unpublished study assessment, and potential language/geographic constraints further contributed to
bias risk.</p>
        <p>The identified limitations reduce overall evidence reliability, necessitating cautious interpretation
when developing educational practice recommendations. Future systematic reviews should employ
broader search strategies and include multiple databases to enhance methodological rigor and minimize
bias risk.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Discussion</title>
      <p>This systematic review presents the first comprehensive analysis of the efectiveness of teaching digital
history to students based on 6 included studies from an initial 45 identified records. Results demonstrate
a cautiously optimistic assessment of the potential of digital technologies in historical education,
consistent with broader trends in digital pedagogy.</p>
      <sec id="sec-4-1">
        <title>4.1. Main findings in context of existing literature</title>
        <p>The synthesis of evidence from included studies reveals universal positive efects on student motivation
(100% of studies), moderate improvements in historical knowledge acquisition (67% of studies), and
substantial development of digital competencies (83% of studies). When compared with other systematic
reviews in educational technology, these results demonstrate higher efectiveness rates than typically
observed (figure 4).
83
100
Historical knowledge</p>
        <p>Impact category</p>
        <p>Digital competencies</p>
        <p>Research on digital technologies in educational contexts demonstrates generally positive outcomes,
with [23] reporting an average efect size of d=0.35 across various digital educational interventions. This
ifnding aligns with our own research results, which revealed positive efects in 83% of studies examined
across all measured outcomes. The consistently favorable results may be attributed to the specificity
of humanities contexts, where digital narratives can be naturally integrated with historical content,
creating more engaging and meaningful learning experiences [24]. This natural synergy between digital
tools and humanities subject matter appears to enhance the efectiveness of educational interventions
in these disciplines.</p>
        <p>Research on digital technologies in educational contexts demonstrates generally positive outcomes,
with [23] reporting an average efect size of d=0.35 across various digital educational interventions. This
ifnding aligns with our own research results, which revealed positive efects in 83% of studies examined
across all measured outcomes. The consistently favorable results may be attributed to the specificity
of humanities contexts, where digital narratives can be naturally integrated with historical content,
creating more engaging and meaningful learning experiences [24]. This natural synergy between digital
tools and humanities subject matter appears to enhance the efectiveness of educational interventions
in these disciplines.</p>
        <p>Traditional pedagogical approaches in historical education demonstrate moderate efectiveness in
developing students’ historical thinking skills [25]. Central to these conventional methods is the emphasis
on working with primary sources, which has been shown to be crucial for fostering authentic historical
understanding [26]. While these traditional approaches maintain their pedagogical value, digital
technologies serve to enhance rather than replace these established methods by providing improved access
to digitized archives and facilitating collaborative analysis platforms. This technological augmentation
expands the scope and accessibility of primary source work while preserving the fundamental principles
of historical inquiry.</p>
      </sec>
      <sec id="sec-4-2">
        <title>4.2. Unique aspects of digital history pedagogy</title>
        <p>Analysis of the included studies reveals several distinctive advantages of digital approaches for historical
education. Specific advantages documented in synthesized evidence:
1. Enhanced access to primary sources: Digital archives and online collections (Museum Victoria,
Proquest Historical Newspapers) expanded students’ research capabilities beyond physical library
constraints.
2. Natural narrative integration: Digital storytelling platforms (Windows Movie Maker, VoiceThread)
aligned with history’s inherently narrative structure, facilitating authentic historical
communication.
3. Collaborative knowledge construction: Wiki-based platforms and collaborative writing
environments supported the social construction of historical understanding, with one study
demonstrating statistically significant learning gains (p &lt; 0.005).
4. Authentic audience engagement: Public-facing digital projects (digital exhibitions, online
publications) motivated higher-quality work and sustained engagement beyond course requirements.</p>
      </sec>
      <sec id="sec-4-3">
        <title>4.3. Theoretical implications</title>
        <p>Research on digital technologies in educational contexts demonstrates generally positive outcomes,
with [23] reporting an average efect size of d=0.35 across various digital educational interventions. This
ifnding aligns with our own research results, which revealed positive efects in 83% of studies examined
across all measured outcomes. The consistently favorable results may be attributed to the specificity
of humanities contexts, where digital narratives can be naturally integrated with historical content,
creating more engaging and meaningful learning experiences [24]. This natural synergy between digital
tools and humanities subject matter appears to enhance the efectiveness of educational interventions
in these disciplines.</p>
        <p>Traditional pedagogical approaches in historical education demonstrate moderate efectiveness in
developing students’ historical thinking skills [25]. Central to these conventional methods is the emphasis
on working with primary sources, which has been shown to be crucial for fostering authentic historical
understanding [26]. While these traditional approaches maintain their pedagogical value, digital
technologies serve to enhance rather than replace these established methods by providing improved access
to digitized archives and facilitating collaborative analysis platforms. This technological augmentation
expands the scope and accessibility of primary source work while preserving the fundamental principles
of historical inquiry.</p>
        <p>Synthesized evidence provides empirical support for several theoretical frameworks in digital
pedagogy, including the support of constructivist pedagogy. The results align closely with active learning
principles [27], particularly through collaborative annotation and wiki-based knowledge construction
activities. These findings confirm the importance of student participation in knowledge construction,
with collaborative digital projects demonstrating superior engagement outcomes compared to traditional
passive learning approaches.</p>
        <p>The research validates the TPACK (Technological, Pedagogical, and Content Knowledge) framework,
with studies prioritizing the integration of technological, pedagogical, and content knowledge
demonstrating superior outcomes compared to purely technology-focused approaches. This evidence suggests
that the content knowledge dimension requires particular protection against technological determinism,
especially in humanities contexts where disciplinary knowledge must remain central to pedagogical
decision-making [11].</p>
        <p>A significant finding emerged regarding digital literacy development, with 83% of studies documenting
the development of hybrid technological-historical competencies among participants. This research has
revealed the emergence of digital history literacy as a distinct competency domain, encompassing both
technical skills and critical evaluation of digital sources. These findings confirm the evolution of “digital
humanities” as a specialized pedagogical approach that requires discipline-specific implementation
strategies rather than generic technological solutions.</p>
        <p>Despite the positive conclusions, the evidence base reveals significant restrictions that limit
interpretation. Several aspects remain insuficiently studied, including long-term efects, as no studies assessed
retention or transfer beyond single-semester interventions. Cost-efectiveness analysis was absent
from all included studies despite the substantial infrastructure requirements associated with digital
implementations. Additionally, there was limited data on how interventions afect diverse student
populations or learning contexts, and insuficient theoretical explanation for why digital approaches
enhance historical learning, revealing gaps in understanding the mechanisms of impact.</p>
        <p>The research also revealed methodological constraints that afect the robustness of conclusions. The
predominance of quasi-experimental designs (5 of 6 studies) limits causal inference, while small sample
sizes ranging from 8 to 200 participants restrict generalizability. The absence of standardized outcome
measures prevents meaningful cross-study comparison, and there is a high risk of bias due to instructor
efects and the absence of blinding procedures in the experimental designs.</p>
      </sec>
      <sec id="sec-4-4">
        <title>4.4. Overall assessment of evidence base</title>
        <p>The synthesized evidence supports cautious optimism regarding digital history pedagogy efectiveness,
with several important caveats. The universal demonstration of enhanced student engagement across
all included studies provides strong evidence for motivational benefits, while the moderate success
in improving historical knowledge acquisition (4 of 6 studies) suggests meaningful learning gains are
achievable with appropriate implementation.</p>
        <p>Particularly compelling is the emergence of digital competency development as an unexpected but
consistent outcome (5 of 6 studies), suggesting digital history interventions provide dual benefits of
disciplinary and technological skill development. This finding aligns with evolving conceptualizations
of historical expertise in digital contexts [2] and supports arguments for digital humanities integration
in undergraduate curricula.</p>
        <p>However, the evidence base remains preliminary due to methodological limitations and knowledge
gaps. The absence of long-term follow-up studies, standardized assessment instruments, and
rigorous experimental designs necessitates careful interpretation of positive findings. Results should be
considered as foundational evidence supporting further investigation rather than definitive proof of
efectiveness.</p>
        <p>This review fills an important gap in educational research by providing the first systematic assessment
of digital history pedagogy efectiveness. The findings create a foundation for future larger-scale and
methodologically rigorous studies while ofering practical guidance for educators considering digital
history implementation. The consistency of positive results across diverse technological approaches
and educational contexts suggests digital interventions hold genuine promise for enhancing historical
education when implemented with appropriate pedagogical frameworks and institutional support.</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>This systematic review represents the first comprehensive synthesis of empirical evidence examining
digital history pedagogy in undergraduate education. Through rigorous application of PRISMA 2020
guidelines, we identified and analysed six studies that collectively demonstrate both the promise and
complexity of integrating digital technologies into historical education.</p>
      <p>The evidence reveals a nuanced landscape where technological innovation intersects with pedagogical
tradition in productive yet challenging ways. Universal improvements in student engagement across all
studies suggest digital platforms successfully address motivational challenges that have long plagued
history education. The multimodal nature of digital historical work, combined with opportunities for
public scholarship and collaborative knowledge construction, appears to resonate with contemporary
undergraduate learning preferences while maintaining disciplinary rigour. However, the translation
of enhanced engagement into measurable learning outcomes proves less straightforward, with efect
sizes for knowledge acquisition and critical thinking showing greater variability across contexts and
implementations.</p>
      <p>Three critical insights emerge with particular clarity. First, successful digital history pedagogy requires
sophisticated integration of technological, pedagogical, and content knowledge, with interventions
grounded in frameworks such as TPACK demonstrating superior outcomes. Technology alone does not
improve historical learning; rather, thoughtful pedagogical design that leverages digital afordances
while preserving disciplinary integrity proves essential. Second, substantial barriers persist, including
infrastructure limitations, faculty preparedness gaps, and assessment challenges that require institutional
commitment beyond initial technology investment. Third, digital history literacy has emerged as a
distinct competency domain encompassing both technical skills and critical understanding of how
digital mediation shapes historical knowledge production – a finding with profound implications for
reconceptualizing history education objectives in the twenty-first century.</p>
      <p>The limitations of current evidence cannot be overlooked. Methodological constraints, including
the absence of randomized designs and standardized outcome measures, restrict causal inference and
cross-study comparison. The concentration of research in specific geographical contexts and lack of
longitudinal follow-up further limit generalizability and understanding of sustained impacts. Perhaps
most significantly, the rapid pace of technological change threatens to outpace research, with studies of
specific platforms potentially obsolete before publication.</p>
      <p>Despite these limitations, this review provides essential guidance for educators, administrators, and
researchers navigating digital transformation in history education. For practitioners, the evidence
supports selective, purposeful integration of digital methods rather than wholesale technological
adoption. Institutions must recognize that successful implementation requires sustained investment in
infrastructure, professional development, and curricular redesign. Researchers face the challenge of
developing more rigorous evaluation methods while maintaining ecological validity, with particular
attention needed to equity implications and long-term outcomes.</p>
      <p>The path forward demands collaborative efort across disciplinary and institutional boundaries. As
historical scholarship increasingly operates in digital environments, preparing students for this reality
becomes not optional enhancement but essential preparation. Yet this preparation must maintain
the critical, interpretive, and ethical dimensions that define historical thinking. The studies reviewed
here demonstrate that such integration is possible, even as they reveal the complexity of achieving it
efectively.</p>
      <p>Digital history pedagogy stands poised between established tradition and emerging possibility.
The evidence synthesized in this review suggests that thoughtful navigation of this liminal space –
embracing technological afordances while preserving humanistic values – ofers genuine potential
for enhancing historical education. Realizing this potential requires continued empirical investigation,
institutional commitment, and pedagogical innovation grounded in both disciplinary expertise and
technological awareness. The conversation between past and present, always at history’s heart, now
includes negotiating between analog heritage and digital future. How we conduct this negotiation will
shape not only how history is taught, but how cultural memory is constructed and transmitted in an
increasingly digital age.</p>
    </sec>
    <sec id="sec-6">
      <title>Funding</title>
      <p>This research received no specific grant from any funding agency in the public, commercial, or
not-forprofit sectors.</p>
    </sec>
    <sec id="sec-7">
      <title>Conflicts of interest</title>
      <p>The author declare no conflicts of interest relevant to this systematic review.</p>
    </sec>
    <sec id="sec-8">
      <title>Data availability statement</title>
      <p>The data extraction forms and screening decisions supporting this systematic review are available from
the corresponding author upon reasonable request.</p>
    </sec>
    <sec id="sec-9">
      <title>Acknowledgments</title>
      <p>The author would like to express sincere gratitude to Serhiy O. Semerikov for their invaluable guidance
and support throughout this research. Their expertise in research methodology was instrumental in
shaping the systematic review protocol, and their thoughtful feedback on the manuscript significantly
improved its clarity and rigor. The author appreciates the time and efort Serhiy O. Semerikov dedicated
to reading and editing the manuscript, providing insightful suggestions that enhanced the overall
quality of the work. Their invaluable contributions to this research are deeply appreciated.</p>
    </sec>
    <sec id="sec-10">
      <title>Declaration on Generative AI</title>
      <p>In accordance with contemporary scholarly transparency standards, we acknowledge the use of
generative AI tools during the preparation of this manuscript. Claude Opus 4.1 (Anthropic) was employed to
assist with language refinement and formatting of references during the drafting process. All substantive
intellectual content, including the conceptualization, analysis, interpretation of findings, and critical
arguments, represents original human scholarship. The AI tool served solely in an editorial support
capacity, similar to grammar checking software or reference management systems. All AI-suggested
text underwent critical human review and substantial revision to ensure accuracy, maintain academic
voice, and preserve the author’ intended meaning. The systematic review methodology, data extraction,
quality assessment, and synthesis of findings were conducted entirely through human intellectual efort
without AI assistance. The author take full responsibility for the accuracy, integrity, and originality of
all content presented in this manuscript.
[6] K. Corlett-Rivera, Subject librarian as coauthor: A case study with recommendations, College and</p>
      <p>Undergraduate Libraries 24 (2017) 189–202. doi:10.1080/10691316.2017.1326191.
[7] J. Bell, R. Carland, P. Fraser, A. Thomson, ‘History is a conversation’: teaching student historians
through making digital histories, History Australia 13 (2016) 415–430. doi:10.1080/14490854.
2016.1202373.
[8] A. M. Davis, J. McCullough, B. Panciera, R. Parmer, Faculty-library collaborations in digital history:
A case study of the travel journal of Cornelius B. Gold, College and Research Libraries News 78
(2017) 482–485. doi:10.1080/10691316.2017.1325347.
[9] W. Darmawan, Y. Kusmarni, D. A. Pangestu, D. S. Logayah, Developing Living History Model
Assisted by Digital History Textbooks in History Learning to Improve Students’ Historical Empathy,
Journal of Social Studies Education Research 16 (2025) 343–365. URL: https://files.eric.ed.gov/
fulltext/EJ1478744.pdf.
[10] K.-H. Cheng, An epistemic curiosity-evoking model for immersive virtual reality narrative reading:
User experience and the interaction among epistemic curiosity, transportation, and attitudinal
learning, Computers and Education 201 (2023) 104814. doi:10.1016/j.compedu.2023.104814.
[11] J. H. L. Koh, S. Divaharan, Towards a TPACK-fostering ICT instructional process for teachers:
Lessons from the implementation of interactive whiteboard instruction, Australasian Journal of
Educational Technology 29 (2013) 233–247. doi:10.14742/ajet.97.
[12] A. D. Ali, H. Waer, Integrating TPACK in a Pre-Service Teachers’ EFL Course: Impacts on
Perception, Knowledge, and Practices, Australian Journal of Teacher Education 48 (2023). doi:10.
14221/1835-517X.6089.
[13] D. R. Joshi, U. Neupane, P. R. Joshi, Synthesis review of digital frameworks and DEPSWALIC
Digital competency framework for teachers from basic to University Level, Mathematics
TeachingResearch Journal 13 (2021) 108–136. doi:10.2139/ssrn.4886322.
[14] T. Hastomo, B. Mandasari, U. Widiati, Scrutinizing Indonesian pre-service teachers’ technological
knowledge in utilizing AI-powered tools, Journal of Education and Learning 18 (2024) 1572–1581.
doi:10.11591/edulearn.v18i4.21644.
[15] M. J. Page, J. E. McKenzie, P. M. Bossuyt, et al., The PRISMA 2020 statement: an updated guideline
for reporting systematic reviews, BMJ 372 (2021) n71. doi:10.1136/bmj.n71.
[16] Y.-M. Shiue, Y.-C. Hsu, Y.-C. Liang, Investigating elementary students’ epistemological beliefs,
game preference by applying game-based learning to a history course, in: Proceedings of the IEEE
International Conference on Advanced Materials for Science and Engineering: Innovation, Science
and Engineering, IEEE-ICAMSE 2016, 2017, pp. 460–462. doi:10.1109/ICAMSE.2016.7840358.
[17] J. K. Lee, P. E. Molebash, Becoming digital: Using personal digital histories to engage teachers in
contemporary understandings of teaching social studies, Journal of Social Studies Research 38
(2014) 159–172. doi:10.1016/j.jssr.2014.02.005.
[18] L. R. McLean, P. Rogers, N. E. Grant, A. Law, J. Hunter, Spaces of collaboration: The poetics
of place and historical consciousness, Historical Encounters 1 (2014) 4–19. URL: https://www.
hej-hermes.net/_files/ugd/f067ea_154bbc61dfe94702b67e4155b066c13b.pdf.
[19] L.-K. Soh, N. Khandaker, W. G. Thomas, Digital histories for the digital age: Collaborative writing
in large lecture courses, in: Proceedings of the International Conference e-Learning 2013, 2013,
pp. 91–98. URL: https://files.eric.ed.gov/fulltext/ED562277.pdf.
[20] S. S. Korniienko, systematic review digital history, 2025. doi:10.5281/zenodo.17186090.
[21] M. Petticrew, H. Roberts, Systematic reviews in the social sciences: A practical guide, John Wiley
&amp; Sons, 2008. doi:10.1002/9780470754887.
[22] Z. Munn, M. D. Peters, C. Stern, C. Tufanaru, A. McArthur, E. Aromataris, Systematic review or
scoping review? guidance for authors when choosing between a systematic or scoping review
approach, BMC medical research methodology 18 (2018) 143. doi:10.1186/s12874-018-0611-x.
[23] R. M. Tamim, R. M. Bernard, E. Borokhovski, P. C. Abrami, R. F. Schmid, What forty years of research
says about the impact of technology on learning: A second-order meta-analysis and validation
study, Review of Educational Research 81 (2011) 4–28. doi:10.3102/0034654310393361.
[24] A. Crymble, Technology and the Historian: Transformations in the Digital Age, University of</p>
      <p>Illinois Press, 2021. doi:10.5406/j.ctv1k03s73.
[25] C. Monte-Sano, S. De La Paz, Using writing tasks to elicit adolescents’ historical reasoning, Journal
of Literacy Research 44 (2012) 273–299. doi:10.1177/1086296X12450445.
[26] A. Reisman, Reading like a historian: A document-based history curriculum intervention in
urban high schools, Cognition and Instruction 30 (2012) 86–112. doi:10.1080/07370008.2011.
634081.
[27] C. C. Bonwell, J. A. Eison, Active Learning: Creating Excitement in the Classroom, ASHE-ERIC</p>
      <p>Higher Education Reports (1991). URL: https://eric.ed.gov/?id=ED336049.
[28] S. Shawalludin, M. Sanmugam, H. Mohamed, N. A. M. Salim, Transformative Trends: Augmented
Reality and Multimedia Interactivity in Malaysia’s Digital History Education Revolution, Journal of
Educational Technology Development 12 (2024) 119–134. doi:10.1007/978-981-97-8752-4_7.
[29] L. Graham, Teachers are digikids too: The digital histories and digital lives of young teachers in</p>
      <p>English primary schools, Literacy 42 (2008) 10–18. doi:10.1111/j.1467-9345.2008.00476.x.
[30] D. L. Muenster, S. Muenster, R. Dietz, Digital history education for pupils. first steps towards a
teaching learning lab, in: International Archives of the Photogrammetry, Remote Sensing and
Spatial Information Sciences - ISPRS Archives, volume 48, 2023, pp. 1105–1111. doi:10.5194/
isprs-Archives-XLVIII-M-2-2023-1105-2023.
[31] M. M. Manfra, T. C. Hammond, Teachers’ instructional choices with student-created digital
documentaries: Case studies, Journal of Research on Technology in Education 41 (2008) 223–245.
doi:10.1080/15391523.2008.10782530.
[32] A. Pescador, Asking the archives, spreading on the web: a methodological and didactic proposal to
take history to the high-school [Indagar el archivo, divulgar en la web: una propuesta metodológica
y didáctica para llevar la historia al bachillerato], Ciencia Nueva, Revista de Historia y Politica 3
(2019) 2–21. doi:10.22517/25392662.20851.
[33] B. Calandra, J. Lee, The digital history and pedagogy project: Creating an interpretative/
pedagogical historical website, Internet and Higher Education 8 (2005) 323–333. doi:10.1016/j.iheduc.
2005.09.007.
[34] K. Luther, A. Bruckman, Flash collabs: Collaborative innovation networks in online communities
of animators, Procedia - Social and Behavioral Sciences 2 (2010) 6571–6581. doi:10.1016/j.
sbspro.2010.04.067.
[35] C. Matitaputty, et al., Project-based learning in digital history: Enhancing historical consciousness
through collaborative inquiry, Social Studies Research and Practice 19 (2024) 430–448. doi:10.
11591/edulearn.v18i2.21152.
[36] J. T. Burman, Digital methods can help you . . . if you’re careful, critical, and not historiographically
naïve, History of Psychology 21 (2018) 297–301. doi:10.1037/hop0000112.
[37] Q. E. Wang, Toward a multidirectional future of historiography: Globality, interdisciplinarity, and
posthumanity, History and Theory 59 (2020) 283–302. doi:10.1111/hith.12159.
[38] D. Baeva, D. Atanasova, Ontology based resource for history education, TEM Journal 7 (2018)
782–786. doi:10.18421/TEM74-13.
[39] A. Crymble, M. J. Afanador-Llach, The Programming Historian: Original Research in Digital</p>
      <p>History, Imperial College Press, 2021.
[40] M.-A. Éthier, D. Lefrançois, Historical Video Games and Teaching Practices, in: E. Champion, J. F.</p>
      <p>Hiriart Vera (Eds.), Assassin’s Creed in the Classroom: History’s Playground or a Stab in the Dark?,
De Gruyter Oldenbourg, Berlin, Boston, 2023, pp. 11–33. doi:10.1515/9783111253275-002.
[41] M. Sunkara, A. K. Nayak, S. Kalari, S. R. Kodandaram, S. Jayarathna, H.-N. Lee, V. Ashok, Assessing
the Accessibility and Usability of Web Archives for Blind Users, Lecture Notes in Computer Science
(including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
15177 LNCS (2024) 203–221. doi:10.1007/978-3-031-72437-4_12.
[42] S. Y. Syn, D. Sinn, S. Kim, Impact of contexts, resource types and perceptions on information
management within the personal domain among college students, Aslib Journal of Information
Management 72 (2020) 909–927. doi:10.1108/AJIM-05-2020-0163.
[43] C. Conte, The Usambara Knowledge Project: Place as Archive in a Tanzanian Mountain Range,</p>
      <p>History in Africa 48 (2021) 83–102. doi:10.1017/hia.2021.11.
[44] E. Sebring, World on the head of a pin: Visualizing micro and macro points of view in China’s</p>
      <p>Boxer War of 1900, Technoetic Arts 10 (2012) 229–237. doi:10.1386/tear.10.2-3.229_1.
[45] S.-L. Hopf, Self-assessment of digital literacy-courses with pupils. Interim project report
teachinglearning-hub: digital history, in: Proceedings of the 21st International Conference on Cognition
and Exploratory Learning in the Digital Age, CELDA 2024, 2024, pp. 375–378. doi:10.21125/
edulearn.2022.1326.
[46] C. Armand, L. Cao, X. Tan, IAO Scholar: A global platform for the digital history of Modern
China: By the doctoral students of the Lyons Institute for East Asian Studies (IAO-ENS Lyon), in:
Proceedings of the DigitalHeritage 2013 - Federating the 19th Int’l VSMM, 10th Eurographics GCH,
and 2nd UNESCO Memory of the World Conferences, Plus Special Sessions fromCAA, Arqueologica
2.0 et al., volume 1, 2013, p. 753. doi:10.1109/DigitalHeritage.2013.6743833.
[47] J. Zapata, Taking chicana/o activist history to the public: Chicana/o activism in the southern plains
through time and space, Great Plains Quarterly 38 (2018) 407–424. doi:10.1353/gpq.2018.0062.
[48] J. W. Torgerson, Historical practice in the era of digital history, History and Theory 61 (2022)
37–63. doi:10.1111/hith.12276.
[49] J. D. Millán, G. Salas, G. Marsico, Psychological Experiments on Student Self-Government: The
Early Impact of Wilhelm Mann’s Work in Chile and the German Empire, History of Psychology
26 (2022) 51–75. doi:10.1037/hop0000227.
[50] M. B. Zielezinski, P. Franz, Recasting the textbook: Student creation of interactive digital history
textbooks with primary source documents, Proceedings of International Conference of the
Learning Sciences, ICLS 2 (2014) 1137–1141. doi:https://www.researchgate.net/publication/
286859873.
[51] K. Ahlfeld, Creating Community Archives: Giving Voice to the Unheard, Journal of Library</p>
      <p>Administration 61 (2021) 493–499. doi:10.1080/01930826.2021.1906570.
[52] M. Rüth, K. Kaspar, Commercial Video Games in School Teaching: Two Mixed Methods Case
Studies on Students’ Reflection Processes, Frontiers in Psychology 11 (2021). doi: 10.3389/fpsyg.
2020.594013.
[53] K. Middleton, A. York, Collaborative publishing in digital history, OCLC Systems and Services 30
(2014) 192–202. doi:10.1108/OCLC-02-2014-0010.
[54] I. Maslova, I. Krapotkina, G. Burdina, Methods of Working with Local Digital Resources on
History: Foreign Experience and Russian Practices, International Journal of Web-Based Learning
and Teaching Technologies 16 (2021). doi:10.4018/IJWLTT.293279.
[55] J. Frith, J. Richter, Building participatory counternarratives: Pedagogical interventions through
digital placemaking, Convergence 27 (2021) 696–710. doi:10.1177/1354856521991956.
[56] A. Nurhasanah, Nadiroh, A. Maksum, Bridging cognition and ethics: Socio-emotional skills and
digital history literacy in fostering critical thinking, Social Sciences &amp; Humanities Open 12 (2025)
101786. doi:10.1016/j.ssaho.2025.101786.
[57] D. Kumalasari, P. Hieronymus, A. Suranto, Comparative analysis of Generation Z’s digital history
literacy in history education majors on Java Island, International Journal of Instruction 17 (2024)
90–108. doi:10.20448/jeelr.v11i1.5342.
[58] A. Lucadamo, R. Miessler, I. Isherwood, The First World War Letters of H.J.C. Peirs: A Case Study
of the Creation and Growth of a Collaborative, Pedagogy-Driven Digital History Project, in: I. G.
Russell, G. Layne-Worthey (Eds.), The Routledge Companion to Libraries, Archives, and the Digital
Humanities, Routledge, London, 2024, pp. 231–246. doi:10.4324/9781003327738-20.
[59] R. Ditlmann, B. Firestone, O. Turkoglu, Participating in a Digital-History Project Mobilizes People
for Symbolic Justice and Better Intergroup Relations Today, Psychological Science 36 (2025)
249–264. doi:10.1177/09567976251331040.
[60] Y.-M. Shiue, Y.-C. Hsu, Understanding factors that afecting continuance usage intention of
gamebased learning in the context of collaborative learning, Eurasia Journal of Mathematics, Science
and Technology Education 13 (2017) 6445–6455. doi:10.12973/ejmste/77949.
[61] J. Thomas, A. Harden, Methods for the thematic synthesis of qualitative research in systematic</p>
      <p>A. Documents excluded at screening stage
1. Shawalludin et al. [28]: participants do not meet criteria (71 schoolchildren instead of university
students)
2. Graham [29]: participants do not meet criteria (young teachers instead of students)
3. Muenster et al. [30]: participants do not meet criteria (schoolchildren instead of university
students)
4. Manfra and Hammond [31]: participants do not meet criteria (teachers instead of students)
5. Pescador [32]: participants do not meet criteria (schoolchildren instead of university students)
6. Calandra and Lee [33]: no empirical data on efectiveness (methodological article on resource
development)
7. Luther and Bruckman [34]: intervention does not concern teaching history (about online animator
communities)
8. Matitaputty et al. [35]: participants do not meet criteria (11th grade schoolchildren)
9. Burman [36]: not empirical research + focus on graduate students
10. Wang [37]: theoretical article without empirical data
11. Shiue et al. [16]: participants do not meet criteria (5th grade students)
12. Corlett-Rivera [6]: participants do not meet criteria (focus on librarians)
13. Baeva and Atanasova [38]: focus on technical aspects without educational efectiveness research
14. Crymble and Afanador-Llach [39]: theoretical article without empirical data
15. Éthier and Lefrançois [40]: participants do not meet criteria (schoolchildren)
16. Sunkara et al. [41]: intervention does not concern teaching history (accessibility web archives)
17. Syn et al. [42]: intervention does not concern teaching history (personal information management)
18. Conte [43]: not empirical research of learning efectiveness (digital archive development)
19. Sebring [44]: not empirical research of learning efectiveness
20. Hopf [45]: participants do not meet criteria (schoolchildren)
21. Armand et al. [46]: not empirical research + focus on graduate students
22. Zapata [47]: not focus on student learning (public history project)
23. Torgerson [48]: theoretical article without empirical data
24. Millán et al. [49]: not about modern teaching of digital history (historical research)
25. Zielezinski and Franz [50]: participants do not meet criteria (10th grade schoolchildren)
26. Ahlfeld [51]: not empirical research of efectiveness
27. Rüth and Kaspar [52]: participants do not meet criteria (10-12th grade schoolchildren)
28. Middleton and York [53]: not empirical research of learning efectiveness</p>
    </sec>
    <sec id="sec-11">
      <title>B. Full-text articles assessed for inclusion criteria compliance</title>
      <p>1. Soh et al. [19]: “Digital histories for the digital age: Collaborative writing in large lecture courses”
2. Davis et al. [8]: “Faculty–library collaborations in digital history: A case study of the travel
journal of Cornelius B. Gold”
3. Maslova et al. [54]: “Methods of Working with Local Digital Resources on History: Foreign</p>
      <p>Experience and Russian Practices”
4. Frith and Richter [55]: “Building participatory counternarratives: Pedagogical interventions
through digital placemaking”
5. Coleborne and Bliss [3]: “Emotions, Digital Tools and Public Histories: Digital Storytelling using</p>
      <p>Windows Movie Maker in the History Tertiary Classroom”
6. Nurhasanah et al. [56]: “Bridging cognition and ethics: Socio-emotional skills and digital history
literacy in fostering critical thinking”
7. Kumalasari et al. [57]: “Comparative analysis of Generation Z’s digital history literacy in history
education majors on Java Island”
8. Lucadamo et al. [58]: “The First World War Letters of H.J.C. Peirs: A Case Study of the Creation
and Growth of a Collaborative, Pedagogy-Driven Digital History Project”
9. Ditlmann et al. [59]: “Participating in a Digital-History Project Mobilizes People for Symbolic</p>
      <p>Justice and Better Intergroup Relations Today”
10. Lee and Molebash [17]: “Becoming digital: Using personal digital histories to engage teachers in
contemporary understandings of teaching social studies”
11. Shiue and Hsu [60]: “Understanding factors that afecting continuance usage intention of
gamebased learning in the context of collaborative learning”
12. Bell et al. [7]: “’History is a conversation’: teaching student historians through making digital
histories”
13. Darmawan et al. [9]: “Developing Living History Model Assisted by Digital History Textbooks in</p>
      <p>History Learning to Improve Students’ Historical Empathy”
14. Thomas and Harden [61]: “The history harvest: An experiment in democratizing the past through
experiential learning”
15. Woodring and Fox-Horton [62]: “History Harvesting: A Case Study in Documenting Local</p>
      <p>History”
16. Lewis and Taylor-Poleskey [63]: “Hidden Town in 3D: Teaching and Reinterpreting Slavery</p>
      <p>Virtually at a Living History Museum”
17. McLean et al. [18]: “Spaces of collaboration: The poetics of place and historical consciousness”</p>
    </sec>
    <sec id="sec-12">
      <title>C. Review map</title>
      <sec id="sec-12-1">
        <title>GENERAL STUDY INFORMATION</title>
        <sec id="sec-12-1-1">
          <title>Document type:</title>
          <p>journal article (ARTICLE) / conference proceedings article (CONFERENCE) / book chapter (BOOK
CHAPTER)
Country of study:
Funding source: government / private / university / not specified / none
• Study title:
• Authors (surnames, initials):
• Publication year:
• Journal/conference/book name:
• Volume, issue, pages:
• DOI:</p>
        </sec>
      </sec>
      <sec id="sec-12-2">
        <title>STUDY CHARACTERISTICS</title>
        <p>Study design:</p>
        <p>Randomized controlled trial (RCT)
Quasi-experimental study
Pre-post intervention study
Case study with empirical data
Mixed methods</p>
        <p>Other (specify):
Study aim: (briefly describe main aim)</p>
        <sec id="sec-12-2-1">
          <title>Study duration:</title>
          <p>• Intervention duration:
• Observation period:</p>
        </sec>
      </sec>
      <sec id="sec-12-3">
        <title>PARTICIPANT CHARACTERISTICS (POPULATION)</title>
        <p>Total number of participants:
(immediately after / after
days/weeks/months)
Participant characteristics:
• Age: mean years (range: )
• Gender: male % / female % / not specified
• Year of study: 1st / 2nd / 3rd / 4th / mixed groups / not specified
• Student specialization:
□ Historians
□ Non-historians (specify specialization):
□ Mixed groups
• Prior experience with digital technologies: high / medium / low / not specified</p>
        <sec id="sec-12-3-1">
          <title>Group allocation:</title>
          <p>• Experimental group: participants
• Control group: participants (if applicable)
• Randomization/allocation criteria:</p>
        </sec>
      </sec>
      <sec id="sec-12-4">
        <title>INTERVENTION CHARACTERISTICS</title>
        <p>Intervention name/description:</p>
        <sec id="sec-12-4-1">
          <title>Context of use:</title>
          <p>□ Classroom sessions
□ Out-of-class work
□ Blended learning
□ Fully online</p>
        </sec>
      </sec>
      <sec id="sec-12-5">
        <title>COMPARATOR CHARACTERISTICS</title>
        <p>Type of control intervention:
□ Traditional lectures
□ Seminars with printed sources
□ Standard textbooks
□ Regular work with archival materials
□ No intervention (waiting list)
□ Other (specify):
Control intervention description:</p>
      </sec>
      <sec id="sec-12-6">
        <title>STUDY OUTCOMES</title>
        <p>PRIMARY OUTCOMES
1. Historical knowledge:
• Measurement method: (tests, exams, essays, projects)
• Instrument: (test name, scales)
• Measurement time: before intervention / after intervention / after
• Experimental group results:  =  =  =
• Control group results:  =  =  =
• -value: / efect size:</p>
        <sec id="sec-12-6-1">
          <title>2. Understanding of historical concepts:</title>
          <p>• Measurement method:
• Instrument:
• Results:
SECONDARY OUTCOMES
3. Learning motivation:
• Measurement method:
• Instrument/scale:
• Results:
4. Student engagement:
• Measurement method:
• Indicators:
• Results:
5. Source work skills:
• Measurement method:
• Instrument:
• Results:
6. Critical thinking skills:
• Measurement method:
• Instrument:
• Results:
(questionnaire, interview, observation)
(discussion participation, attendance, time on task)
7. Technological literacy:
• Measurement method:
• Results:</p>
        </sec>
        <sec id="sec-12-6-2">
          <title>8. Ability to create historical narratives:</title>
          <p>• Measurement method:
• Results:</p>
        </sec>
        <sec id="sec-12-6-3">
          <title>9. Other outcomes:</title>
        </sec>
      </sec>
      <sec id="sec-12-7">
        <title>AUTHORS’ CONCLUSIONS</title>
        <p>Main conclusions regarding efectiveness:
Authors’ recommendations:
Study limitations (noted by authors):</p>
      </sec>
      <sec id="sec-12-8">
        <title>STUDY QUALITY ASSESSMENT</title>
        <p>Risk of bias:
• Randomization: low / high / unclear risk
• Allocation concealment: low / high / unclear risk
• Blinding of participants: low / high / unclear risk
• Blinding of outcome assessors: low / high / unclear risk
• Incomplete outcome data: low / high / unclear risk
• Selective reporting: low / high / unclear risk
Overall quality assessment: high / moderate / low</p>
      </sec>
      <sec id="sec-12-9">
        <title>ADDITIONAL NOTES</title>
        <p>Conflict of interest: present / absent / not specified
Ethical approval: obtained / not required / not specified
Additional reviewer comments:
Map completion date:
Reviewer:</p>
      </sec>
    </sec>
    <sec id="sec-13">
      <title>D. Studies excluded at full-text assessment stage</title>
      <p>1. Soh et al. [19]: “Digital histories for the digital age: Collaborative writing in large lecture courses”
2. Davis et al. [8]: “Faculty–library collaborations in digital history: A case study of the travel
journal of Cornelius B. Gold”
3. Maslova et al. [54]: “Methods of Working with Local Digital Resources on History: Foreign</p>
      <p>Experience and Russian Practices”
4. Frith and Richter [55]: “Building participatory counternarratives: Pedagogical interventions
through digital placemaking”
5. Coleborne and Bliss [3]: “Emotions, Digital Tools and Public Histories: Digital Storytelling using</p>
      <p>Windows Movie Maker in the History Tertiary Classroom”
6. Nurhasanah et al. [56]: “Bridging cognition and ethics: Socio-emotional skills and digital history
literacy in fostering critical thinking”
7. Kumalasari et al. [57]: “Comparative analysis of Generation Z’s digital history literacy in history
education majors on Java Island”
8. Lucadamo et al. [58]: “The First World War Letters of H.J.C. Peirs: A Case Study of the Creation
and Growth of a Collaborative, Pedagogy-Driven Digital History Project: ”
9. Ditlmann et al. [59]: “Participating in a Digital-History Project Mobilizes People for Symbolic
Justice and Better Intergroup Relations Today”
11. Shiue and Hsu [60]: “Understanding factors that afecting continuance usage intention of
gamebased learning in the context of collaborative learning”
16. Lewis and Taylor-Poleskey [63]: “Hidden Town in 3D: Teaching and Reinterpreting Slavery</p>
      <p>Virtually at a Living History Museum”</p>
    </sec>
  </body>
  <back>
    <ref-list />
  </back>
</article>