Reference management software (RMS) is ubiquitous in academia but is typically confined to administrative tasks like citation management, overlooking its pedagogical potential to foster collaborative skills. This study addresses this gap by introducing and rigorously evaluating a novel pedagogical framework. This collective scientific research life cycle transforms standard RMS into a dynamic hub for computer-supported collaborative learning (CSCL). A sequential explanatory mixed-methods design involving 54 master's students was employed. A quasiexperimental, pre-test/post-test control group design (n = 23 experimental, n = 31 control) measured the intervention's impact on teamwork skills. Quantitative data were contextualised through thematic analysis of semi-structured interviews with experimental group participants. The quantitative analysis revealed a statistically significant improvement in teamwork competencies for the experimental group compared to the control group (p < .01), with a large efect size (d = 0.91). The qualitative ifndings illuminated three core mechanisms for this success: (1) the model's scafolding structure provided actionable clarity and enhanced accountability; (2) the creation of a 'visible cognition' space promoted deeper knowledge co-construction; and (3) initial technical challenges functioned as a productive struggle, catalysing team cohesion. The research provides a validated, theory-driven, and transferable framework for educators. It demonstrates how a standard digital tool can be pedagogically repurposed to cultivate the essential collaborative competencies required in the 21st-century academic and professional landscape.
While the demand from employers for graduates with robust teamwork and problem-solving skills is
unequivocal [
The ongoing digital transformation of academia amplifies this pedagogical challenge. With research workflows becoming increasingly reliant on digital ecosystems, traditional teaching methods often fail to prepare students for the realities of modern, technology-mediated collaboration. This disconnect creates a critical research gap: a lack of empirically validated pedagogical models that seamlessly integrate collaborative skill development with the practical, technology-driven processes of contemporary scientific inquiry.
To address this gap, this study introduces and empirically validates a novel pedagogical model: the collective scientific research life cycle. This model re-envisions the learning process by structuring collaborative student research around a central digital hub – the Zotero reference management software. Instead of viewing such tools as mere repositories, our methodology leverages them as dynamic platforms for shared analysis, annotation, and knowledge co-construction. The primary aim of this study is to evaluate the proposed model’s efectiveness, guided by the following research questions: • RQ1: Is the proposed methodology, based on the collective scientific research life cycle model and the Zotero platform, more efective for developing students’ teamwork skills than traditional pedagogical approaches? • RQ2: How do students perceive the model’s impact on their ability to collaborate, manage research tasks, and produce a collective scientific output?
This research is anchored in the theoretical framework of computer-supported collaborative learning
(CSCL), which posits that learning is fundamentally a social process of knowledge co-construction.
Within the CSCL paradigm, understanding emerges not from passive information reception but from
active interaction, negotiation of meaning, and collaborative problem-solving, all mediated by
technology [
The global shift towards online and hybrid learning, dramatically accelerated by the COVID-19 pandemic,
has moved digital collaboration from the periphery to the core of educational practice [
While new digital practices have emerged that support collaborative learning, their successful
implementation demands new digital and pedagogical competencies from both educators and students
[
Within the vast ecosystem of academic software, reference management software (RMS) like Zotero,
Mendeley, and EndNote is ubiquitous. Its primary function is to streamline the administrative burdens
of research, such as citation and bibliography management [
However, a critical review reveals a significant limitation in how these tools have been approached
from a pedagogical point of view. The overwhelming majority of studies treat RMS as a passive
repository – a digital library for sharing readings – rather than an active environment for collaborative
knowledge construction. While scholars acknowledge its utility for group projects (e.g., [
This study introduces and evaluates the collective scientific research life cycle model in response to this identified gap. This model provides a formal pedagogical structure that leverages Zotero as a central collaborative hub, transforming it from a simple repository into an active CSCL environment. The model is designed to be cyclical and iterative, guiding student teams through the authentic stages of scholarly inquiry. As depicted in figure 1, the model consists of eight interconnected stages, with Zotero and its associated functionalities underpinning the core collaborative activities.
This diagram illustrates the iterative process where research team members, using Zotero as a central platform, cycle through stages of (1) Preparatory work, (2) Analysis of sources, (3) Storage of materials in a shared library, (4) Organisation of knowledge through tagging and collections, (5) Sharing of ifndings within the team, (6) Reuse of materials for synthesis, (7) collaborative citing of sources, and (8) Experimental Group (n=23)
Control Group (n=31) Total (N=54) Creation of the final research output. The cycle emphasises continuous collaboration and knowledge co-construction.
This model operationalises CSCL principles by creating a transparent, shared cognitive space. It scafolds the research process, making each member’s contributions visible and enabling the team to collectively build, refine, and synthesise knowledge within a single, integrated digital ecosystem.
By embedding RMS within this structured pedagogical framework, we move beyond the simple use of a digital tool towards a holistic, theory-driven approach to developing teamwork skills. We hypothesise that this integrated methodology will be more efective than traditional teaching methods that teach teamwork in isolation or provide tools without a guiding pedagogical structure. Specifically, this study tests the hypothesis that students who engage in collaborative research guided by the collective scientific research life cycle model will demonstrate a statistically significant improvement in teamwork competencies compared to their peers in a control group.
This study used a sequential explanatory mixed-methods design to evaluate the efectiveness of the
proposed pedagogical model. This approach consists of two distinct phases: first, a quantitative (QUAN)
phase to measure the outcomes, followed by a qualitative (QUAL) phase to explain and contextualise
those outcomes [
The quantitative component utilised a quasi-experimental, pre-test/post-test control group design. This design was chosen to compare the change in teamwork skills between an experimental group that experienced the intervention and a control group that did not. The subsequent qualitative phase involved semi-structured interviews with participants from the experimental group. This phase provided a deeper understanding of the intervention’s processes, benefits, and challenges, explaining the quantitative results.
The study was conducted in the spring semester 2025 at Berdyansk State Pedagogical University within the master’s programme “Professional Education. Computer Technologies”. A total of 54 students participated in the experiment. Participants were randomly assigned to either the experimental group (n = 23) or the control group (n = 31). All participants were informed about the nature of the research and consented to participate. The demographic characteristics of the sample are presented in table 1.
Prior experience was self-assessed based on familiarity with collaborative digital tools (e.g., Google Docs, Trello, shared cloud storage) for academic projects.
The groups were homogenous regarding their academic level and general background knowledge, and an initial t-test confirmed no statistically significant diference in their baseline teamwork skills (p > 0.05), ensuring a valid basis for comparison.
The experiment lasted for one academic semester. Both groups were tasked with preparing a scientific research project on the topic “The application of digital technologies for the organisation of distance education”. 3.3. Control group: traditional instruction (n=31) Participants in the control group received standard instructions on conducting scientific research. The task was framed as an individual project. While students were encouraged to use digital tools for their personal work (e.g., Microsoft Word for writing, Google Scholar for search, spreadsheets for data analysis), there was no mandated collaborative structure. The pedagogical focus was on the individual mastery of research components: literature search, critical analysis, and academic writing. Any collaboration was informal, unstructured, or mediated by a specific pedagogical model. 3.4. Experimental group: the intervention (n=23) The experimental group undertook the same research project, but their work was structured according to the collective scientific research life cycle model described previously. The intervention’s core was using a shared Zotero library as the central collaborative hub. The process was scafolded by the instructor, guiding students through iterative cycles of: 1. Collaborative analysis. Jointly find and add sources to the shared library. 2. Shared annotation: using Zotero’s notes feature to comment on and discuss articles directly within the platform. 3. Collective organisation: co-creating a shared system of tags and collections to systematise knowledge. 4. Collaborative writing: using the Zotero plugin for Google Docs to allow multiple team members to simultaneously write and insert citations from the shared library into a single document.
Regular, structured team meetings were held to discuss progress and resolve issues, with meeting notes and action items also stored in the shared Zotero library.
We employed the “Acceptance of Others Scale” developed by William F. Fey [
Despite these limitations, the Fey scale was selected for its specific focus on a single, foundational psychological construct of teamwork: the degree to which an individual accepts and values the input, perspectives, and contributions of others. This foundational aspect of collaboration is arguably contextindependent. However, recognising that this single scale could not capture the complex dynamics of technology-mediated collaboration, a qualitative component was intentionally integrated into the research design. This mixed-methods approach was deemed essential to mitigate the quantitative instrument’s limitations and provide a rich, contextualised explanation of the collaborative processes that quantitative scales alone often fail to capture.
Following the post-test, semi-structured interviews were conducted with a purposeful sample of 10 students from the experimental group. The interviews were conducted via Zoom, lasted approximately 20-25 minutes each, and were audio-recorded and transcribed verbatim for analysis. The interview protocol was designed to explore participants’ lived experiences with the intervention, focusing on collaboration. Key guiding questions included: 1. Can you describe how using the structured Zotero model difered from your previous group project experiences? 2. Which stage of the model (e.g., shared analysis, collective organising) had the biggest impact on your team’s ability to work together, and why? 3. What were your team’s most significant challenges while using this methodology? How did you overcome them? 4. Can you provide a specific example of a moment when the shared system helped your team resolve a disagreement or integrate diferent points of view?
All quantitative data were analysed using the R programming language (Version 4.5.1) and the RStudio
IDE. Independent samples t-tests were performed using base R functions, while Cohen’s d for efect size
was calculated with the efsize package [
In addition to determining statistical significance, we calculated the efect size using Cohen’s d to measure the practical significance of the diference between the groups. Cohen’s d was calculated using the formula: = exp − ctrl
SDpooled
where exp and ctrl are the means of the experimental and control groups, and pooled is the
pooled standard deviation. The efect size was interpreted using Cohen’s [
The transcribed interview data were analysed using thematic analysis, following the six-phase process
outlined by Braun and Clarke [
This section details the findings from our mixed-methods study. We first present the quantitative results from the pre-test/post-test quasi-experiment to establish the intervention’s efect. Subsequently, we present the qualitative findings from the thematic analysis of student interviews to explain how and why these efects occurred.
(1)
The quantitative phase aimed to measure the impact of the collective scientific research life cycle model on students’ teamwork skills.
Prior to the intervention, the homogeneity of the control and experimental groups was assessed. The results of the input control, including a statistical comparison using an independent samples t-test on the pre-test scores, are presented in table 2.
The t-test confirmed that there was no statistically significant diference in baseline teamwork skills between the experimental group (M = 51.91, SD = 8.32) and the control group (M = 50.93, SD = 6.74), t(52) = 0.462, p = 0.646. This established a valid basis for comparing the groups’ performance following the intervention.
After the semester-long intervention, a post-test was administered to both groups. As shown in figure 2, the distribution of skill levels shifted dramatically in the experimental group, with a significant increase in students rated at “average with a trend to the high” and “high” levels.
We compared the post-test scores to verify the statistical significance of this visual trend. Table 3 presents the descriptive and inferential statistics.
An independent samples t-test revealed that the experimental group’s mean score was significantly higher than that of the control group, t(52) = 3.152, p = 0.003.
Cohen’s d was calculated to measure the impact of the intervention, yielding d = 0.91. According to
established conventions [
To explain how the intervention achieved these results, we conducted a thematic analysis of interviews with 10 students from the experimental group. This analysis illuminated the internal processes of collaboration and revealed three key themes: (1) Scafolding success: from ambiguity to actionable clarity; (2) Visible cognition: co-constructing knowledge in a shared space; and (3) Productive struggle: overcoming hurdles as a team-building catalyst.
Students overwhelmingly contrasted the structured nature of the intervention with the ambiguity of their past group projects. The life cycle model was described as a “scafold” or “roadmap” that translated a large, intimidating research project into manageable, sequential steps.
“In previous group work, it was always a nightmare at the start. Everyone is lost, no one knows where to begin. Here, the model laid it all out. Step 1: We all find and upload five key articles. Step 2: We use the tagging system we agreed on. It gave us a clear direction and made it easy to see who contributed and who was not. It removed all the initial chaos.” (P3, participant 3)
This clarity was also linked to a reduction in interpersonal friction and an increase in accountability. “The structure itself was the best part. We had a shared library and a shared task list within our Zotero notes. It was impossible to say, ’Oh, I did not know that was my job.’ Everything was transparent. This model makes you accountable to the team by default.” (P8)
The interviews profoundly revealed that the methodology transformed collaboration from a simple division of labour into genuine knowledge co-construction. The shared Zotero environment made individual thought processes visible to the entire team.
“For me, the game-changer was the shared notes on the PDFs. I could see my teammate’s highlights and read their summary and critique while I was reading the article myself. It was like having a dialogue with them. It stopped being ’my research’ and ’your research’ and became ’our understanding’ of the topic. The ifnal paper emerged from that shared understanding.” (P6)
This visibility fostered deeper engagement and a more synthesised final product.
“We used the tagging feature to create a live, evolving outline. We would tag an article with ’Key_Methodology’ or ’Counter_Argument’. It allowed us to see the structure of our paper building in real-time within Zotero. It was far more dynamic than just writing separate parts in a Google Doc and hoping they fit together.” (P1)
The analysis also captured initial challenges, particularly the technical learning curve of Zotero for collaborative use. However, students framed this “struggle” not as a negative, but as a crucial, early team-building exercise. “At first, a couple of us were frustrated with Zotero. We couldn’t get the group syncing to work right. But we had to schedule a call, share screens, and figure it out together. It was actually the first problem we solved as a team. Overcoming that little technical hurdle made us feel more like a unit before we even got into the deep research.” (P10)
This theme suggests that the tool served as a low-stakes object for initial collaboration, forcing communication and joint problem-solving, strengthening the team’s capacity to handle more complex academic disagreements later in the project.
These quantitative and qualitative findings demonstrate that the collective scientific research life cycle model was highly efective in producing statistically superior outcomes and fundamentally reshaping the student collaboration experience into a more structured, visible, and co-constructive process.
The central finding of this research is that structuring collaborative work around a shared digital hub (Zotero) within a formal pedagogical model significantly outperforms traditional, individualistic teaching methods. This is evidenced by the large and statistically significant improvement in teamwork competencies (d = 0.91) and the qualitative data that provide a nuanced explanation for why this success occurred. As illuminated by our qualitative findings, the model’s efectiveness can be understood through the confluence of three key factors: the provision of explicit scafolding, the creation of a shared cognitive space, and the transformative power of productive struggle.
A critical interpretation of our results must first address the inherent diference in structure between the experimental and control groups. It is important to acknowledge that the observed improvement could, in part, be attributed to introducing any form of structured collaboration compared to the unstructured conditions of the control group, which mimicked standard but often inefective pedagogical practices. However, a deeper analysis, informed by our qualitative findings, suggests that the success was not merely a product of structure itself, but rather a result of the specific afordances of the collective scientific research life cycle model. Student interviews reveal that the key mechanisms of change were highly specific to our pedagogical approach. For instance, creating a ’visible cognition’ space within Zotero fostered a level of knowledge co-construction that a generic project plan would not. Therefore, while the presence of structure was undoubtedly a factor, our evidence indicates that the quality and nature of that structure – specifically, its ability to foster a shared cognitive environment – were the primary drivers of the observed success.
The mechanisms behind this success can be further understood by examining the three core themes
from the qualitative data. First, the model’s structured scafolding was crucial for mitigating process
losses often associated with student group work, such as poor coordination and social loafing.
Participants described the model as a “road map” that provided clarity and reduced the initial chaos typical
of unstructured projects. This finding aligns with established cognitive science research advocating
for guided instruction over unguided discovery [
Second, the intervention succeeded by creating an environment of “visible cognition”. Using shared
notes, tags, and annotations within Zotero transformed the tool from a passive repository into an
active space for knowledge co-construction. This provides powerful empirical support for the core
tenets of CSCL, which posits that learning is advanced through the externalisation and negotiation of
ideas [
Third, initial technical challenges served as a catalyst for team cohesion, a phenomenon that can
be framed as “productive struggle” [
Finally, the positive impact of these mechanisms becomes even more pronounced when contrasted with the control group’s experience. Informal feedback gathered during the semester highlighted their persistent challenges with communication, confusion regarding the use of shared digital tools, and the absence of a unified workflow. This starkly contrasts with the experimental group’s reports of clarity and shared understanding, underscoring that the observed positive outcomes directly resulted from the pedagogical intervention that provided the structure and collaborative intentionality the control group lacked.
The findings of this research have significant implications for educational theory, practice, and technology design. Theoretical Implications: This study contributes to CSCL theory by providing an empirically validated model that operationalises its core principles within a specific, widely available technological context. We demonstrate that the efectiveness of a CSCL intervention depends not on the tool’s sophistication but on its integration into a sound pedagogical framework. Furthermore, we expand the conceptualisation of RMS in the educational literature, reframing it from an administrative utility to a potent platform for collaborative learning and visible cognition.
Practical Implications: For educators and curriculum designers, this research ofers a replicable, low-cost, and highly efective model for fostering essential 21st-century skills. The collective scientific research life cycle model can be readily adapted for capstone projects, research methods courses, or any discipline requiring collaborative inquiry. It provides a concrete alternative to the standard but inefective practice of simply telling students to “work in a group”. For university administrators, our ifndings underscore the value of investing in training and support for the pedagogical use of existing campus-wide software, rather than solely pursuing new technological solutions.
While this study provides robust findings, several limitations warrant discussion as they ofer avenues for future research.
First, the sample was drawn from a single master’s programme at one university, which may limit the generalisability of the results. The efectiveness of the model could be context-dependent. Future research should therefore aim to replicate this study across diferent disciplines (e.g., humanities, social sciences) and in diverse institutional and cultural contexts to assess the model’s transferability and potential need for adaptation.
Second, our methodological choices for assessment have inherent limitations. Although our
mixedmethods design helped to mitigate the reliance on a dated quantitative instrument [
Third, this study focused primarily on the positive outcomes of the intervention. We did not systematically investigate potential drawbacks or unintended consequences. For example, the need to learn a new digital tool’s collaborative features while simultaneously engaging in complex research could increase cognitive load for some students or lead to initial frustration. The high degree of transparency in the model could also potentially foster “groupthink” rather than critical debate in some teams. Future research could incorporate measures of cognitive load or specifically investigate how teams navigate disagreement within this evident environment.
Finally, this study’s cross-sectional design does not capture the long-term development of teamwork skills. A longitudinal study that tracks students over multiple semesters or into their professional careers is needed to provide insights into the sustainability and transferability of the skills gained. Future research could also evaluate the efectiveness of diferent RMS tools (e.g., Zotero vs. Mendeley) when embedded within the same pedagogical model to determine the influence of specific technological afordances.
This study investigated whether a structured pedagogical framework, the Collective Scientific Research Life Cycle model, could enhance university students’ teamwork skills by integrating collaborative workflows into a standard digital tool. The mixed-methods findings indicate that the model led to a statistically significant improvement in collaborative competencies compared to a control group, with a large and practically meaningful efect size (d = 0.91). The qualitative analysis identified the primary mechanisms for this success: the model’s scafolding provided procedural clarity, its shared digital space fostered knowledge co-construction, and initial technical challenges served as a catalyst for team cohesion.
The primary contribution of this research is an empirically validated and transferable pedagogical framework that addresses a persistent gap between the recognised need for collaborative skills and the lack of efective, integrated methods to cultivate them. Specifically, this work demonstrates how a standard digital tool can be pedagogically re-envisioned from a simple repository into a dynamic environment for collaborative inquiry. It ofers a structured alternative to the often-inefective “divide and conquer” approach in student group work, moving towards a more holistic and co-constructive process.
Ultimately, this study provides empirical evidence that embedding digital tools within a robust pedagogical structure can create authentic learning environments that mirror contemporary research practices. It presents a replicable solution for educators seeking to equip students with the essential, digitally-mediated collaborative skills necessary for their future academic and professional careers.
Conceptualization and methodology, Liliia V. Pavlenko and Maksym P. Pavlenko; formal analysis and investigation, Liliia V. Pavlenko and Maksym P. Pavlenko; writing – original draft, review and editing, Liliia V. Pavlenko and Maksym P. Pavlenko. All authors have read and agreed to the published version of the manuscript.
This research received no external funding.
The data supporting the findings of this study are openly available in the Zenodo repository at
https://doi.org/10.5281/zenodo.16493901 [
The authors declare no conflict of interest.
The authors have not employed any Generative AI tools.