<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>SustHack: A hackathon approach for engaging citizens and fostering a sustainability mindset</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mikhail O. Adisa</string-name>
          <email>mikhail.adisa@lut.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Shola Oyedeji</string-name>
          <email>shola.oyedeji@lut.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Larry Abdullai</string-name>
          <email>larry.abdullai@lut.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jari Porras</string-name>
          <email>jari.porras@lut.fi</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sian L. Lau</string-name>
          <email>sianlunl@sunway.edu.my</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LUT University</institution>
          ,
          <addr-line>Lappeenranta</addr-line>
          ,
          <country country="FI">Finland</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Sunway University</institution>
          ,
          <addr-line>Kuala Lumpur</addr-line>
          ,
          <country country="MY">Malaysia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Hackathons and code camps have been used over the years to ideate, collaborate and develop innovative solutions to address sustainability challenges with citizens. However, there is less research on how hackathon products can drive citizens' behavioral changes via engagement in sustainable activities to improve sustainability awareness in society. In this study, we evaluate the potential of the hackathon to address local sustainability issues and develop innovative solutions to engage and stimulate citizens and hackathon participants for sustainable activities and awareness. Our approach involves the implementation of two hackathons, Living Lab Hack and SustHack. The result from the two hackathons shows that citizen engagement in hackathons brings a new dimension that facilitates inclusiveness in designing sustainability solutions and increases citizen sustainability awareness. Furthermore, the hackathon served as a reawakening call to action for the students and the citizens about the sustainability impacts of their activities.</p>
      </abstract>
      <kwd-group>
        <kwd>1 sustainability</kwd>
        <kwd>local actions</kwd>
        <kwd>hackathons</kwd>
        <kwd>code camp</kwd>
        <kwd>citizens' engagement</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Sustainability is a critical issue that impacts
every aspect of our lives and the planet across
various dimensions, covering environmental,
social, and economic challenges. It is a complex
issue that must be addressed to create a
sustainable future. Becker et al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], through the
Karlskrona Manifesto for Sustainability Design,
described sustainability as a systemic concept and
a conceptual framework built on five dimensions:
the environmental, the economic, the technical,
the social, and the individual dimensions.
Addressing the challenges associated with each
dimension calls for collective input from
academicians, organizations, policymakers, and
individuals. In addition, engaging and inspiring
the next generation of leaders in sustainability is
essential as part of the efforts to save the
environment and mitigate the climate crisis.
Higher education institutes (HEIs) are
wellpositioned to champion creative solutions that
consolidate skills and competencies that address
many sustainability issues like sustainable
mobility choices, sustainable consumption, and
sustainable lifestyles. However, engaging higher
education students in sustainability issues,
creating awareness, and stimulating their interest
in sustainability can be challenging for
academicians [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        Although hackathons and code camps have
existed over the years [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], especially in software
engineering [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], and have further become a
practical and intensive approach to demonstrating
fundamental practical skills and solving
realworld problems with different objectives [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and
for encouraging innovation and collaboration,
active learning, and creative thinking among
diverse participants in various fields in an equally
supportive setting [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Hackathons can have a
different topical focus and domains, for example,
to accelerate new scientific discoveries,
collaboration, enriching social networks, and
knowledge transfer [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]; to improve education
and strengthen curricula [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Furthermore,
hackathons can focus on developing new digital
solutions and business models to drive sustainable
actions, circularity, and environmentally friendly
initiatives [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Alternatively, the goal
could be to develop civic digital interventions and
design effective sustainability plans [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], to
coproduce improved knowledge, and navigate
complex climate adaptation governance [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        Hackathons offer fast-paced, design-driven,
and practical events where participants transform
ideas into solutions for a specific problem or
challenge, typically within a particular time frame
[
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. It is a popular means of producing innovative
prototypes and creative product ideas that extend
impact beyond product innovation [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. However,
their potential to stimulate students’ interest in
sustainability and engage citizens in climate
actions has not been fully harnessed. With the
triple planetary crisis (climate change, pollution,
and biodiversity loss) and its associated threat,
there is a need to intensify actual actions to
identify real-life issues at the community level
while leveraging technology for environmental
benefits. Hence, our study aims to fill this gap
through sustainability-focused hackathons that
include the engagement of citizens in
sustainability actions to solve real-life
environmental challenges and strengthening the
UN’s call for a ‘Decade of Action’[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
particularly at the local and individual levels,
raising awareness within communities to promote
environmentally conscious behaviors.
      </p>
      <p>Our study ignites a call to action to address
local sustainability issues and highlight the
perceived impacts of engaging citizens in
sustainable activities through prototype design.
Specifically, this study answers the following
research questions.</p>
      <p>• RQ1 How can hackathons be used to
engage citizens and foster a sustainability
mindset in their local environment?
• RQ2 What are the perceived impacts of
such engagement among citizens and
hackathon participants?</p>
    </sec>
    <sec id="sec-2">
      <title>2. Background</title>
    </sec>
    <sec id="sec-3">
      <title>2.1. Sustainability education in IT</title>
      <p>
        Emphasizing sustainability education is
essential to raise awareness and drive sustainable
behavioral changes among academia, business
organizations, government, and society to
guarantee a more sustainable future. However,
while many Higher education institutes (HEIs)
continue to integrate sustainability teachings into
their curriculum, the specific focus on IT
sustainability courses is limited. For example,
Genovese and Genovese [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] identified HEIs role
in empowering young students to the awareness
of environmental challenges. The study proposed
integrating new values and skills that will trigger
behavioral changes and facilitate a sustainable
society through academic learning, to close the
gap between student awareness and proactive
environmental behavior. As a result, the young
generations have been identified as beneficiaries
of sustainable development goals and saddled
with responsible behavior to safeguard the
environment by maintaining a sustainable
lifestyle [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Therefore, every HEIs must be
committed to equipping their students with such
skills and values to awaken their environmental
consciousness and increase their sustainability
engagement. Such sustainability awareness
embedded into IT learning can empower the
students to develop innovative solutions triggered
by the peculiarity of sustainability issues in their
immediate Community and simultaneously bring
about an opportunity to discuss sustainability
activities among the residents.
2.2.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Sustainability cultures</title>
      <p>
        Lappeenranta is widely known for its
sustainability culture and being among the
Greenest cities in Europe and won the European
Green Leaf Award 2021 [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. In addition, the two
Universities involved in this project are at the
forefront of championing sustainability actions
and sustainable education in their respective
communities. Using hackathon events to tackle
local sustainability issues is, therefore, culturally
and academically aligned with the goals of the
participating universities. Cultural diversity in
sustainability is a binding force that shapes human
perception, understanding, behavior, and
relationship with evolving environmental reality
[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
      </p>
      <p>
        Recognizing the importance of Culture in
human decision-making and sustainability can
bring the economic, social, and environmental
aspects closer [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. Therefore, hackathons can
leverage cultural diversity’s crucial role in team
composition, ideating, and solution development
to bring a multicultural experience and
background to finding solutions to local
environmental issues.
2.3.
      </p>
    </sec>
    <sec id="sec-5">
      <title>Sustainability hackathons</title>
      <p>
        Hackathons are implemented to drive
innovative, practical solutions in different formats
and structures, participation criteria, and intended
outcomes. Unfortunately, research that combines
sustainability, citizen engagement, and
hackathons is limited. Nevertheless, we found a
few studies that have explored the potential of
hackathons as a tool for promoting sustainability.
For example, Zapico et al. [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] use the concept of
a green hackathon event to bring end users (in
adhoc) and technical experts together to discuss
sustainability issues and encourage more
reflective practices. The result shows that a mix of
competencies (technical, communication, design,
creativity, programmers, and non-programmers)
facilitates interdisciplinary collaboration and
helps to promote sustainability. A related study
conducted as an innovation contest to foster civic
engagement and citizens’ participation [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] led to
a reawakening of citizens’ and other stakeholders’
awareness and involvement in tackling
environmental challenges.
      </p>
      <p>
        Furthermore, a study on citizen empowerment
with civic technologies [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ] uses hackathons to
connect citizens and empower them to embrace
broader community participation. The result is an
increase in the involvement of the local
neighborhood that brings diversity in evaluating
the prototype solution in addition to the expert
evaluation. A related study by Taylor et al. [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]
uses a gamified hackathon to tackle the
socioenvironmental problems of residual and discarded
items. The result found that hackathons offer a
robust means of awakening the consciousness of
sustainability issues and promoting
crossdisciplinary collaboration and creativity that
students are unlikely to experience under a
traditional curriculum. Finally, the hackathon has
been identified as an innovative strategy to foster
collaboration between academia and corporate
organizations [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] to drive sustainability,
circularity, and lower environmental impact with
technology solutions.
      </p>
      <p>
        A study by Szymanska et al. [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] revealed how
hackathons provide opportunities for students to
explore, learn, and apply new, cutting-edge
technologies and trends, allowing instructors to
adapt to the student’s needs and provide guidance
rather than simply lecturing. This approach also
allows the introduction of real-world scenarios
and environmental issues that can be tested with
new technological solutions.
      </p>
      <p>There is still room to explore the suitability of
hackathons in the sustainability and citizen
engagement domains to deliver on the critical
value of promoting sustainability awareness,
offering innovative fast-track solutions, and
providing support for enhancing citizens’
engagement. Nevertheless, this study contributed
to novel knowledge of exploring the capability of
hackathons to drive and foster a sustainability
mindset and engage citizens for sustainable
lifestyles and behavioral changes.</p>
    </sec>
    <sec id="sec-6">
      <title>3. SustHack methodology</title>
      <p>The approach involves the implementation of
two hackathons - The Living Lab and SustHack,
organized as part of the project titled
‘Synchronizing sustainable development actions
between Finland and Malaysia - the Hackathon
approach.’ The project connected two universities
with a strong sustainability focus: LUT University
in Finland and Sunway University in Malaysia.
The project aimed to develop sustainability
education in both countries through hackathons to
solve real, local challenges while engaging the
citizens. This paper focuses on two hackathons
delivered in Finland.
3.1.</p>
    </sec>
    <sec id="sec-7">
      <title>Living Lab hackathon</title>
      <p>The Living Lab hack was a five-day local
hackathon (between 25th April and 29th April
2022). The first in the series to find solutions to
empower citizens and business owners for the
common good. The participants were required to
develop actionable solutions or services in the
form of a prototype of innovative ideas that ensure
the engagement of various stakeholders. While
the theme is tagged “Local Sustainability Issue,”
each team was tasked to conduct a preliminary
assessment by meeting with small business
owners (SMEs), targeted customers, and general
citizens within their immediate environment (the
University and the Community) for interactions to
identify local sustainability issues. The identified
local issues are then presented for review,
adoption, and initial feedback from the
organizers. Finally, each team developed a
suitable prototype solution to tackle the
challenges identified. There were three
participating teams consisting of four members
each. The best two teams qualify for the final
SustHack (Engagement hackathon). The
prototype is enhanced, tested, and the approach is
The juries were from LUT University, Finland,
and Sunway University, Malaysia, with expertise
in software engineering, sustainability, citizen
engagement, and digital innovation. Table 2
details the jury’s research interest distribution.</p>
      <p>The solutions were evaluated on six focus areas:
(1) sustainability issues; (2) technically
implementable; (3) innovation; (4) citizen focus;
(5) economic viability; and (6) pitching of the
solution. At the end of the presentations and
evaluation, Team Titan and Team BinaryBin
emerged as the best two winning teams, and Team
SustMine 2nd runner-up, respectively.
3.2.</p>
    </sec>
    <sec id="sec-8">
      <title>SustHack Hackathon</title>
      <p>Unlike the traditional hackathons reported in
the literature, we adopted a robust citizen
discussed in a real-time environment by engaging
the relevant stakeholders (citizens and business
owners) in partnership with the visiting Malaysian
students.</p>
      <p>All the participating members in this phase are
M.Sc students of Software Engineering (SE) at
LUT University, Finland, with varying prior
hackathon experiences and a strong interest in
sustainability education. The demography details
of the participants are in Table 1.</p>
      <p>Cultural diversity</p>
      <p>Role distribution
Asian and African
Asian, African,
and European
Asian, African,
and European</p>
      <p>Project manager, Req. Engineer,
Full stack developer, UI Designer
Product manager, Req. Engineer,
Front-end developer, Back-end
developer
Req. Engineer, Product manager,</p>
      <p>Full stack developer, Designer
engagement approach in the SustHack supported
by a sustainable action-oriented that goes beyond
the technical aspect of problem-solving to include
users’ validation to spur climate actions. The
SustHack hackathon was held in a five-day
(between 23rd May and 27th May 2022) intensive
event at LUT University, Finland, to take the
winning solutions from the best two teams of the
Living Lab hackathon (Teams Titan and
BinaryBin) to the public and engage with relevant
stakeholders. In addition, two additional members
from Sunway University, Malaysia, with
computer science (CE) and Artificial intelligence
(AI) backgrounds, joined the teams to make the
group a six-members each. This addition
improved the teams’ diversity and perspectives as
they went head-to-head to perfect their solutions
and engage with the citizens.</p>
      <p>The SustHack Hackathon phase was used to
enhance and work more on the solutions and
includes technical implementation of the
sustainability solutions with a citizens’
engagement and validation approach that covers
direct engagement with targeted stakeholders to
receive feedback and validate the suitability and
value of the proposed solutions to solving the
sustainability issues that was identified and
discussed in the first phase. Table 3 provides
information about the SustHack participant’s
distributions.</p>
      <p>The SustHack approach (see Figure 1) covered
the following vital aspects; planning,
presentations, further brainstorming on the
sustainability issues, ideation and design, codings
and implementation, market research and citizen
engagement, pitching, and jury evaluation. In
addition, the mentorship was provided by a group
of 6 Ph.D. students throughout the hackathons
processes. Figure 1 provides an overview of the
SustHack process.</p>
      <p>Education level Role distribution
5 master’s</p>
      <p>students
1 bachelor</p>
      <p>student
5 master’s</p>
      <p>students
1 bachelor
student</p>
      <p>Project manager, Req.</p>
      <p>Engineer, Full stack developer,
UI/UX Designer
Product manager, Req.</p>
      <p>Engineer, Front-end
developer, Back-end
developer
two products to the local Community. In addition,
adequate time was allocated for debriefing
sessions to evaluate sustainability ideas,
engagement approach, patterns of teamwork, and
an implementation plan for turning the winning
solutions into actual projects that will last beyond
the participants.</p>
      <p>Data were collected through surveys,
interviews, and observation methods.</p>
      <p>Day 1
*Presentations
*Brainstorming
*Planning</p>
      <p>Day 2
*Ideation &amp; design
* Citizens
engagement</p>
      <p>Day 3
*Implementation</p>
      <p>Day 4
*Market research
*Citizens
engagement</p>
      <p>Day 5
*Finalizing
*Pitching
*Q&amp;A
*Awards</p>
    </sec>
    <sec id="sec-9">
      <title>Resources and data collection</title>
      <p>
        The LUT University’s Linux Lab provides the
participants with all the tools and resources for
ideating, designing, implementing, and presenting
their ideas throughout the hackathons. The first
hackathon was organized following the
methodology reported by Happonen et al. [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] and
covered the pre-hackathon, hackathon, and
posthackathon stages. However, we modified the
prehackathon stage to include ‘initial engagement’
with citizens on sustainability issues.
Furthermore, we introduced a new approach in the
second phase of the hackathon, wherein the two
winning teams considered the business feasibility
and actual engagement with the citizens to capture
their feedback and validate the relevancy of the
•
      </p>
      <p>Surveys: The team conducted a random
stakeholder engagement survey before the
Living Lab hackathon and a validated survey
with their proposed solutions for the
SustHack hackathon. The approach allowed
the teams to identify a suitable method to
engage their targeted users and highlight the
proposed solution’s suitability for the
identified sustainability issues.</p>
      <p>The survey participants include SMEs and
citizens. They were recruited in two stages.
First, by random approach within the
University and the city area and asking
questions about their understanding of
sustainability, their businesses, challenges,
suggestions, customer experience, reality,
expectations, background, and willingness to
test and review the proposed solution in the
second phase. The outcome of the
engagement survey was used to arrive at the
decisions on which issues to address and
which stakeholder groups to engage further
in the later part of the hackathon.</p>
      <p>
        Secondly, the stakeholders willing to
participate in the second phase were
approached with a prototype solution
developed in the SustHack stage for
evaluation and feedback. Finally, new and
interested participants (likely end users) were
also included to test and answer a short
survey about the developed prototype.
• Interview: We interviewed all the
participants from both Living Lab and
SustHack hackathons (16 in total) following
the completion of the hackathon to gather
indepth information about participants’
experiences, perceptions, challenges,
engagement approach, and learning
outcomes. The interview protocol included
questions about participants’ motivations for
the hackathon, perceptions of the event
organizations, challenges, areas of
improvement, skills used and newly
developed, and general feedback.
• Observation: We observed both hackathon
events to gather data on the team selection
and organization, design and
implementation, participants’ interactions,
and collaborative activities during the event
to balance the response from interviewing.
The teams presented their findings from the
engagement activities and survey conducted as
part of their solution presentations on the fifth
day. The findings from the engagement stage are
discussed in section 5, respectively. We employ
the narrative analysis method and guidelines [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]
to uncover and interpret the nature of the
participant’s experiences and challenges. Through
this method, we built on each participant’s story
and behavior to arrive at generalizations of
thoughts and meanings from the interview
conducted for the participants.
      </p>
    </sec>
    <sec id="sec-10">
      <title>4. Result</title>
      <p>The result presentation is based on the
information from the team’s presentations, their
pre-hackathon and hackathon engagement
surveys, and the post-hackathon interview and
observations conducted by the researchers. Even
though an international traveling prize was
attached to the winning solution, all the teams
cordially conducted themselves. They
demonstrated their knowledge of sustainability
education accordingly in a friendly mood
throughout the event. Furthermore, good
collaboration in and across the teams without
negative competing behavior was observed as the
team used their dedicated writing boards to ideate
and collaborate. For example, we observed how
Team BinaryBin openly requested the integration
of an API key at a point from the Tarvary Team,
which was gladly provided.
4.1.</p>
      <sec id="sec-10-1">
        <title>Participants’ motivation</title>
        <p>We asked the teams about their motivation for
participating in the event, and their responses
showed a voluntary interest, building on previous
experience, interest in solving common
sustainability issues, eagerness to experience new
learning, and eyes on the final prize. The summary
of the keywords of their response was presented
in Figure 2 as a word cloud.</p>
      </sec>
      <sec id="sec-10-2">
        <title>Impact on participants’ skills</title>
        <p>From the participant’s responses concerning
the perceived improved skills during the event, the
two hackathons revealed the essential skills,
competencies, and current knowledge of
sustainability that helped each team navigate the
events’ entire processes. The most cited improved
skills identified from their verbatim responses
during the interview include communication,
teamwork, technical competency, stress
management, knowledge of sustainability, and
project management.</p>
        <p>
          The participants also reported that the
hackathon was an engaging and stimulating
experience that helped them think critically about
sustainability issues, gain new skills, develop
innovative solutions, improve self-confidence and
consider various approaches to engaging their
targeted users. The findings align with previous
authors’ work [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] on student, technology, and
civic action hackathons.
4.3.
        </p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>Citizens’ engagement strategy</title>
      <p>Participants relied on the first briefing of the
event organizer, their understanding of previously
completed sustainability courses, and their team’s
communication skills to recruit their targeted
citizens and formulate an engagement strategy to
be adopted. The fact that the LUT University
community is mainly known for its strong
commitment to promoting sustainability within
and outside the University empowered the
targeted group within the community with a
reasonable understanding of sustainability. There
is evidence of many sustainability activities and
calls to action in and around the University
campus. The participants reported dividing their
coverage area into 3: the University community,
Prisma and its environs, and the City Centre. The
engagement strategy is grouped into five
(education and communication; empowerment;
calls to action; ownership; and feedback); the
description is presented in Table 4.</p>
      <p>Approaches
Education and
communication
Empowerment
Calls to action
Ownership
Feedback</p>
      <p>Description Outcome
Discuss and understand challenges, supported with Reimagining sustainability issues that
credible evidence and narration. were previously neglected.
Provide platform and alternative options to ensure Empowering citizens to champion
participation in addressing common needs. sustainable behavioral changes.
Provide a clear, attractive, and well-communicated Broadening community participation,
call to action to trigger a sustainable behavioral inclusiveness, and ownership.
change.</p>
      <p>Highlight the importance of taking ownership and
commitment to a sustainable environment.</p>
      <p>Feedback system that shows the impact of one’s
action and promotes positive reinforcement for
behavioral changes.</p>
      <p>Demonstrations of sustainability
knowledge and community support.</p>
      <p>Continuous feedback and reminders
about the impact of one’s actions on the
environment.</p>
      <p>Some existing calls to action and sustainable
activity points identified within the University
community and the city include waste drop points,
waste separation guides, plastics and bottles
recycling points, sustainable food consumption
points, e-biking spots, bicycle lanes, public
transport adverts, sustainable energy usage, and
second-hand shops in different locations. Starting
from the University, the teams reach out to the
SME owners on campus, their customers,
university staff, and students. This was followed
by Prisma and City center area, where random
SME owners and citizens were engaged. An
excerpt from the teams is quoted below:</p>
      <p>“The first stage started with the discussion
on their awareness and experience about
University’s sustainable activities. The discussion
opened up new ideas and challenges. However,
most new students and staff (especially Non-EU)
express low knowledge about sustainable
activities… The same approach was used at the
Prisma area and the City center”.
4.4.</p>
    </sec>
    <sec id="sec-12">
      <title>Hackathon solutions</title>
      <p>Three prototype solutions emerged from the
LivingLab to the SustHack hackathons. However,
only the best two prototypes made it to the
SustHack, where the winner emerged. The overall
winner demonstrated the best engagement plan,
reached out to the highest number of citizens, and
presented the most convincing pitch with their
prototype app (TarvaryMoves) that focuses on the
engagement of the SMEs to promote the
sustainable movement of goods and facilitate
citizens’ commitment to reducing CO2 emissions,
encourage social engagement and interaction, and
boost sharing economy. The developed solutions
promise not just to save the environment but also
to contribute to the socio-economic empowerment
of citizens and instigate individual actions toward
achieving sustainable lifestyles. The description
and ranking of each team’s solution are presented
in Table 5.</p>
    </sec>
    <sec id="sec-13">
      <title>5. Discussion and findings</title>
    </sec>
    <sec id="sec-14">
      <title>5.1. Pre-hackathon</title>
      <p>The cooperation of all the participants in
abiding by the rules and following the instructions
is commendable. In addition, their common
educational background aided the participants’
team formation. Quoting from the teams.</p>
      <p>“Actually, we have all worked together as a
group previously in the Software Architecture
course during our time in Italy. We all had
experience participating in hackathons before
now, and we consider this event an opportunity to
demonstrate our understanding of courses on
sustainability to solve real-life sustainability
issues in our immediate environment”. - Titan
Team</p>
      <p>“We have some coding activities we do as we
just code together. We shared a common interest
in coding previously, and when the hackathons
came up, we all embraced it and decided to work
together again” - Binary Team</p>
      <p>“Three of us have never participated in a
hackathon before, and we are very excited about
participating in this one” – SustMine Team</p>
      <p>We discovered that all the participants were
motivated by the ultimate prize of international
traveling and competition. They were also
motivated to demonstrate their understanding of
sustainability-related courses and previous
experiences and learn new ones, working as a
team to build products and services to reawake
civic actions for sustainability among the citizens
and do something good for the community.
5.2.</p>
    </sec>
    <sec id="sec-15">
      <title>Hackathon</title>
      <p>•
•</p>
      <p>Skills and collaboration: The event helped
the participants to demonstrate several
skills and competencies more practically. It
also improved soft and hard skills, as the
organizers emphasized this through several
short presentations and mentorship. The
teams were allowed to seek assistance from
each other and were gladly provided. The
participant also appreciated the importance
of short punctuation during the event, as it
helps to ensure feedback, mentoring, and
fun. Additionally, they reported that
working in a time-limited and goal-oriented
environment motivated them to think more
deeply about their immediate
environmental issues and how the users of
the solution perceived the significance of
the developed solutions.</p>
      <p>Citizen recruitment and engagement: The
fact that the LUT University community is
known for its strong commitment to
promoting sustainability within and outside
the University empowered the Community
with a reasonable understanding of
sustainability. The initial engagement’s
outcome helped the participant finalize a
specific local issue to address.</p>
      <p>All citizens who willingly participated
in the engagement phases have varying
reasons for participation. They do so out of
their interest to contribute to sustainability
actions around them and as an opportunity
to suggest their ideas, raise their challenges
and work with the students in their learning
pursuits.</p>
      <p>Overall, the impact of the citizens’
engagement includes reawakening and
discussion of sustainability with the citizens,
validation of the existence of local
sustainability issues, and relevance of the
proposed solutions to solving them.
Additionally, it helps to identify factors
(rewards, incentives, ease of use, availability,
and prior awareness) that motivate citizens’
adoption of the solution and strengthen the
participant’s sustainability knowledge and
entrepreneurship plan.</p>
      <p>Hackathon solution and ranking: The team
with the most coverage, the most significant
number of feedback, and the best pitching
emerged as the winner. The prototype
solution comes with web and mobile apps. It
utilizes persuasive strategies like rewards,
incentives, and leaderboards to encourage
environmentally-friendly behavior and foster
a sustainable mindset among the citizens.</p>
      <p>
        Furthermore, the event helped the team to
strengthen their teamwork, problem-solving,
and critical thinking skills and develop a sense
of personal responsibility for addressing
sustainability challenges, as reported in [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ].
5.3.
      </p>
    </sec>
    <sec id="sec-16">
      <title>Post-hackathon - the outcome</title>
      <p>There were a few challenges identified before
and during the hackathon. Firstly, students
reported challenges in getting the willingness of
the engagement participants (especially those
outside the University environment) to cooperate
with the student in the pre-hackathon stage. This
is primarily due to the language barrier among
SME owners. At one point, all the teams worked
together to share the knowledge of the two Finnish
speakers on the team. Secondly, the visiting team
member from Malaysia had an initial cultural
shock and issue understanding the motivation
behind the proposed solution. Finally, the
participants’ group expressed the challenges in
convincing others to join their team and discussed
the hackathon requirements before registration.</p>
      <p>Another important finding is that the
participants believed that community engagement
and education were crucial to the success of
sustainability initiatives. The stakeholder
engagement brings a new dynamism to the entire
process, as participants were able to validate that
their solutions address one of the numerous
sustainability issues facing the citizens. All three
teams hope the prototype will outlive the
hackathon event.</p>
      <p>
        The importance of post-hackathon activities
and further implementation after the event must
be emphasized. However, the assertions of
previous authors [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ] focus only on
such continuation being pushed by the
participants rather than by the organizers.
Nevertheless, it is crucial to ensure that the
solutions created during the hackathon have a
lasting impact beyond the participants [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]. Such
gains might be short live, except the organizer
considers the prototype’s scalability to ensure its
continued improvement by building a community
around the solution. Furthermore, continuous
tracking and measuring of the solution’s impact
can demonstrate its value to the immediate
Community and attract additional support to
sustain the solution in the long term as the need
arises.
      </p>
      <p>We answered RQ1 by demonstrating the
potential of the hackathon to engage citizens to
foster a sustainability mindset through real-world
solutions that have citizens’ input in the design
and a lasting impact on society. The hackathon
opens up discussions between the participant and
the citizens about their immediate sustainability
issues, activities, what could be changed, how it
could change, and their commitment to an
ecofriendly environment through their behavior and
actions.</p>
      <p>We uncovered the impact of citizens’
engagement on both the participants and the
citizens (RQ2); the participants shared that their
engagement with targeted users provided valuable
insights into actual sustainability issues. They
reported gaining a deeper understanding of the
challenges and opportunities in the field through
engagement activities, which helped the team to
identify needed features and changes in the
potential solutions. In addition, they highlighted
that the hackathon approach was unique and a
valuable learning experience that allowed them to
go out and meet real users for ideas and engage
them in problem-solving to understand users’
dynamics. Another finding is the importance of
exposure to diverse perspectives and experiences
in the hackathon setting. They noted that this
exposure helped them to broaden their thinking
and approach to sustainability issues, understand
market/user needs, and validate their ideas. As a
result, they felt better equipped to make a positive
impact on sustainability education.</p>
    </sec>
    <sec id="sec-17">
      <title>6. Threat to validity</title>
      <p>
        Our research is subject to several threats to
validity, including internal, external, and
conclusion validity. The threats to the study’s
validity and mitigation [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] are discussed for
completeness.
      </p>
      <p>Internal validity relates to a causal
relationship. Because hackathon participants were
recruited via a well-advertised method, they were
motivated to participate due to their awareness
about sustainability, knowledge, and skills
without being coarse. Thus, their choice of
sustainability issues as community residents may
differ from what the majority consider a
sustainability issue. However, they validated the
issues’ existence while engaging with the citizens.</p>
      <p>External validity relates to the generalization
of our findings. This means that the result of
adopting citizens’ engagement guarantees
assurance with a hackathon. The engaged citizens
ranged from individual city residents to relevant
business owners, who all agreed with the
existence of sustainability issues and were willing
to embrace sustainable behavioral changes.</p>
      <p>Conclusion validity relates to the degree to
which conclusions drawn from the relationships
in data are reasonable. The participants in the final
SustHack are 12 in total, with each team
presenting its engagement outcome. The
posthackathon interview for the participants was
open-ended to learn about their motivation,
experience, lessons learned and the perceived
impact of the SustHack approach in fostering
sustainable actions.</p>
    </sec>
    <sec id="sec-18">
      <title>7. Conclusion</title>
      <p>We highlighted how hackathons could
motivate the participants and citizens and
reawaken a sustainability mindset through
friendly discussion, highlighting the impact of
one’s actions and activities on the environment.
Through the engagement, we uncovered local
sustainability issues and developed prototype
solutions emphasizing behavioral changes and
adopting an eco-friendly commitment to tackling
local sustainability issues.</p>
      <p>Additionally, the perceived impact of
engagement during the hackathons was
unraveled. The participants in the hackathon were
motivated by their previously completed ICT
(software and systems) sustainability courses.
They demonstrated their knowledge to solve
reallife challenges by offering the citizens a voice in
solving local issues.</p>
      <p>Beyond the usual potential and value of
hackathons, we have proven the possibility of
hackathons to contribute to learning and foster
sustainability awareness, citizens’ engagement,
and eco-friendly behavioral changes within and
outside the HEIs. The citizens’ engagement
approach is promising and would bring about
positive impacts of the hackathon and the
sustainability of developed solutions beyond the
hackathon itself. Additionally, the research gap
suggests limited adoption of the general citizens’
engagement in the previous hackathons for
sustainability and evidence of their input in
validating the outcome.</p>
      <p>The engagement approach in the sustainability
hackathon poses an exciting research direction for
technology-driven sustainability research and
needs further exploration. This study provides a
unique means of empowering and engaging
software engineering students and citizens in
sustainability education and awareness. It is a
valuable starting point for demonstrating positive
actions toward a sustainable lifestyle. The
findings from the study are an excellent pointer to
creating awareness and reawakening local and
people’s actions toward achieving sustainable
development goals. We recommend the inclusion
of locals and fluent speakers of the local language
in future team formation to reduce language and
culture barriers.</p>
      <p>Further research on the sustainability
hackathons with citizens’ engagement approach
across different sustainability issues will help
shed more light on the benefits and perceived
impact on the citizens, the participants, and the
sustainability of the developed solutions beyond
the hackathon event. In addition, a post-hackathon
sustainability plan will help keep the developed
solutions alive and suitable for general usage.</p>
    </sec>
    <sec id="sec-19">
      <title>8. Acknowledgments</title>
      <p>The hackathons were organized as part of the
project titled ‘Synchronizing sustainable
development actions between Finland and
Malaysia - the Hackathon approach.’ We
acknowledge all the participating students from
Software Engineering for Green Deals (SE4GD),
LUT Finland, the Computing and Information
Systems students from Sunway University,
Malaysia, and all the citizens engaged in the
project for their commitment to promoting
sustainability awareness.</p>
    </sec>
    <sec id="sec-20">
      <title>9. References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>C.</given-names>
            <surname>Becker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Penzenstadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chitchyan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Seyff</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Duboc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Venters</surname>
          </string-name>
          , &amp; S.
          <string-name>
            <surname>Easterbrook</surname>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>“Sustainability Design and Software: The Karlskrona Manifesto; Sustainability Design and Software: The Karlskrona Manifesto</article-title>
          .” https://doi.org/10.1109/ICSE.
          <year>2015</year>
          .
          <volume>179</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>H.</given-names>
            <surname>Sjerps-Jones</surname>
          </string-name>
          , “
          <article-title>Engaging students with sustainability issues</article-title>
          ,” http://dx.doi.org/10.11120/plan.
          <year>2007</year>
          .
          <volume>00180</volume>
          040, vol.
          <volume>18</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>40</fpage>
          -
          <lpage>42</lpage>
          , Jun.
          <year>2015</year>
          , doi: 10.11120/PLAN.
          <year>2007</year>
          .
          <volume>00180040</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>D.</given-names>
            <surname>Jimenez</surname>
          </string-name>
          , “
          <article-title>The History of Hackathons: A Digital Evolution</article-title>
          | HackerNoon,”
          <year>2021</year>
          . https://hackernoon.com/the-history
          <article-title>-ofhackathons-a-digital-evolution (accessed:</article-title>
          <source>Feb. 03</source>
          ,
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Komssi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Pichlis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Raatikainen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kindström</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Järvinen</surname>
          </string-name>
          , “
          <article-title>What are Hackathons for?,” IEEE Softw.</article-title>
          , vol.
          <volume>32</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>60</fpage>
          -
          <lpage>67</lpage>
          , Sep.
          <year>2015</year>
          , doi: 10.1109/MS.
          <year>2014</year>
          .
          <volume>78</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>E. P. P.</given-names>
            <surname>Pe-Than</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nolte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Filippova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bird</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Scallen</surname>
          </string-name>
          and
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Herbsleb</surname>
          </string-name>
          , “
          <article-title>Designing Corporate Hackathons With a Purpose: The Future of Software Development,”</article-title>
          <source>IEEE Software</source>
          , vol.
          <volume>36</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>15</fpage>
          -
          <lpage>22</lpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .-Feb.
          <year>2019</year>
          , doi: 10.1109/MS.
          <year>2018</year>
          .
          <volume>290110547</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Porras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Happonen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Knutas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Khakurel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Ikonen</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Herala</surname>
          </string-name>
          , “
          <article-title>Code camps and hackathons in education - literature review and lessons learned</article-title>
          ,
          <source>” Proc. Annu. Hawaii Int. Conf. Syst. Sci.</source>
          , vol. 2019- January, pp.
          <fpage>7750</fpage>
          -
          <lpage>7759</lpage>
          , Jan.
          <year>2019</year>
          , doi: 10.24251/HICSS.
          <year>2019</year>
          .
          <volume>933</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J. Falk</given-names>
            <surname>Olesen</surname>
          </string-name>
          and
          <string-name>
            <given-names>K.</given-names>
            <surname>Halskov</surname>
          </string-name>
          , “
          <article-title>10 years of research with and on hackathons</article-title>
          ,
          <source>” 2020 - Proc. 2020 ACM Des. Interact. Syst. Conf.</source>
          , pp.
          <fpage>1073</fpage>
          -
          <lpage>1088</lpage>
          , Jul.
          <year>2020</year>
          , doi: 10.1145/3357236.3395543.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>F. J.</given-names>
            <surname>Frey</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Luks</surname>
          </string-name>
          , “
          <article-title>The innovationdriven Hackathon - One means for accelerating innovation</article-title>
          ,
          <source>” ACM Int. Conf. Proceeding Ser</source>
          .,
          <string-name>
            <surname>Jul</surname>
          </string-name>
          .
          <year>2016</year>
          , doi: 10.1145/3011784.3011794.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>B.</given-names>
            <surname>Lyonnet</surname>
          </string-name>
          , “
          <source>Hackathon Approach: Its Contributions on Collaboration and Teamwork Skills: A Case Study in Maritime Sector,” ACM Int. Conf. Proceeding Ser</source>
          ., pp.
          <fpage>91</fpage>
          -
          <lpage>98</lpage>
          , Dec.
          <year>2021</year>
          , doi: 10.1145/3510309.3510324.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A.</given-names>
            <surname>Leemet</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Milani</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Nolte</surname>
          </string-name>
          , “Utilizing Hackathons to Foster
          <source>Sustainable Product Innovation-The Case of a Corporate Hackathon Series,” Proc. - 2021 IEEEACM 13th Int. Workshop Coop. Hum. Asp. Softw. Eng. CHASE</source>
          <year>2021</year>
          , pp.
          <fpage>51</fpage>
          -
          <lpage>60</lpage>
          , May
          <year>2021</year>
          , doi: 10.1109/CHASE52884.
          <year>2021</year>
          .
          <volume>00014</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Cobham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Gowen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Jacques</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Laurel</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Ringham</surname>
          </string-name>
          , “
          <string-name>
            <surname>From AppFest To Entrepreneurs: Using A Hackathon Event To Seed A University Student-Led</surname>
            <given-names>Enterprise</given-names>
          </string-name>
          ,”
          <source>in Proceedings of 11th annual International Technology, Education and Development Conference</source>
          , Valencia, Mar.
          <year>2017</year>
          , vol.
          <volume>1</volume>
          , pp.
          <fpage>522</fpage>
          -
          <lpage>529</lpage>
          . doi:
          <volume>10</volume>
          .21125/INTED.
          <year>2017</year>
          .
          <volume>0265</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Hou</surname>
          </string-name>
          and
          <string-name>
            <given-names>C.</given-names>
            <surname>Lampe</surname>
          </string-name>
          , “
          <article-title>Sustainable hacking: Characteristics of the design and adoption of civic hacking projects</article-title>
          ,
          <source>” ACM Int. Conf. Proceeding Ser.</source>
          , vol.
          <source>Part F128532</source>
          , pp.
          <fpage>125</fpage>
          -
          <lpage>134</lpage>
          , Jun.
          <year>2017</year>
          , doi: 10.1145/3083671.3083706.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>H.</given-names>
            <surname>Kvamsås</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Neby</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Haarstad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Stiller-Reeve</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Schrage</surname>
          </string-name>
          , “
          <article-title>Using collaborative hackathons to coproduce knowledge on local climate adaptation governance</article-title>
          ,
          <source>” Curr. Res. Environ. Sustain.</source>
          , vol.
          <volume>3</volume>
          , p.
          <fpage>100023</fpage>
          ,
          <string-name>
            <surname>Jan</surname>
          </string-name>
          .
          <year>2021</year>
          , doi: 10.1016/J.CRSUST.
          <year>2020</year>
          .
          <volume>100023</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14] UN, “Decade of Action,”
          <source>United Nations Sustainable Development</source>
          ,
          <year>2019</year>
          . https://www.un.org/sustainabledevelopment /decade-of-action/ (accessed Nov.
          <volume>09</volume>
          ,
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>E.</given-names>
            <surname>Genovese</surname>
          </string-name>
          and E. Genovese, “
          <article-title>University student perception of sustainability and environmental issues</article-title>
          ,
          <source>” AIMS Geosci</source>
          .
          <year>2022</year>
          4645, vol.
          <volume>8</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>645</fpage>
          -
          <lpage>657</lpage>
          ,
          <year>2022</year>
          , doi: 10.3934/GEOSCI.2022035.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>A. M. Aleixo</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Leal</surname>
          </string-name>
          , and U. M. Azeiteiro, “
          <article-title>Higher education students' perceptions of sustainable development in Portugal,”</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Clean</surname>
          </string-name>
          . Prod., vol.
          <volume>327</volume>
          , p.
          <fpage>129429</fpage>
          ,
          <string-name>
            <surname>Dec</surname>
          </string-name>
          .
          <year>2021</year>
          , doi: 10.1016/j.jclepro.
          <year>2021</year>
          .
          <volume>129429</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>M. K. Watson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Lozano</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <string-name>
            <surname>Noyes</surname>
            , and
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Rodgers</surname>
          </string-name>
          , “
          <article-title>Assessing curricula contribution to sustainability more holistically: Experiences from the integration of curricula assessment and students' perceptions at the Georgia Institute of Technology,”</article-title>
          <string-name>
            <given-names>J.</given-names>
            <surname>Clean</surname>
          </string-name>
          . Prod., vol.
          <volume>61</volume>
          , pp.
          <fpage>106</fpage>
          -
          <lpage>116</lpage>
          , Dec.
          <year>2013</year>
          , doi: 10.1016/j.jclepro.
          <year>2013</year>
          .
          <volume>09</volume>
          .010.
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>European</surname>
            <given-names>Commission</given-names>
          </string-name>
          , “Grenoble, Gabrovo and
          <article-title>Lappeenranta win prestigious European green city awards</article-title>
          ,” Directorate-General for Environment,
          <year>2021</year>
          . https://environment.ec.europa.
          <article-title>eu/news/gren oble-gabrovo-and-lappeenranta-winprestigious-european-green-</article-title>
          <string-name>
            <surname>city-</surname>
          </string-name>
          awards2020-
          <fpage>10</fpage>
          -09_en (accessed
          <year>Feb</year>
          .
          <volume>03</volume>
          ,
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hosagrahar</surname>
          </string-name>
          , “
          <article-title>Culture: at the heart of SDGs,”</article-title>
          <string-name>
            <surname>UNESCO</surname>
          </string-name>
          , Apr.
          <volume>11</volume>
          ,
          <year>2017</year>
          . https://en.unesco.org/courier/april-june2017/
          <article-title>culture-heart-sdgs (accessed Feb</article-title>
          .
          <volume>03</volume>
          ,
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <article-title>Voices of Culture, “Culture and the Sustainable Development Goals: Challenges</article-title>
          and Opportunities” Sep.
          <year>2020</year>
          . Accessed: Feb.
          <volume>03</volume>
          ,
          <year>2023</year>
          . [Online]. Available: https://voicesofculture.eu/
          <year>2020</year>
          /09/21/cultur e-and
          <article-title>-the-sustainable-development-goalschallenges-and-opportunities/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>J. L.</given-names>
            <surname>Zapico</surname>
          </string-name>
          , “
          <article-title>Green Hackathon : Hacking for sustainable food</article-title>
          ,” in Joint Workshop Proceedings of ICT4S, Stockholm, Aug.
          <year>2014</year>
          , pp.
          <fpage>38</fpage>
          -
          <lpage>42</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>S.</given-names>
            <surname>Hartmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Mainka</surname>
          </string-name>
          , and W. G. Stock, “Innovation Contests:
          <article-title>How to Engage Citizens in Solving Urban Problems?,” Civic Engagement and Politics: Concepts, Methodologies, Tools, and</article-title>
          <string-name>
            <surname>Applications</surname>
          </string-name>
          ,
          <year>2019</year>
          . https://www.igiglobal.com/chapter/innovationcontests/220201 (accessed Feb.
          <volume>08</volume>
          ,
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>B.</given-names>
            <surname>Baccarne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Mechant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Schuurman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Colpaert</surname>
          </string-name>
          , and L. De Marez, “
          <article-title>Urban sociotechnical innovations with and by citizens</article-title>
          ,” Interdiscip. Stud. J., vol.
          <volume>3</volume>
          , no.
          <issue>4</issue>
          ,
          <string-name>
            <surname>Art</surname>
          </string-name>
          . no.
          <issue>4</issue>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>N.</given-names>
            <surname>Taylor</surname>
          </string-name>
          , L. Clarke,
          <string-name>
            <given-names>M.</given-names>
            <surname>Skelly</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Nevay</surname>
          </string-name>
          , “
          <article-title>Strategies for Engaging Communities in Creating Physical Civic Technologies,”</article-title>
          <source>in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems</source>
          , Montreal QC Canada,
          <year>Apr</year>
          .
          <year>2018</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>12</lpage>
          . doi:
          <volume>10</volume>
          .1145/3173574.3174081.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>I.</given-names>
            <surname>Szymanska</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Sesti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Motley</surname>
          </string-name>
          , and G. Puia, “
          <article-title>The Effects of Hackathons on the Entrepreneurial Skillset and Perceived SelfEfficacy as Factors Shaping Entrepreneurial Intentions,”</article-title>
          <source>Adm. Sci. 2020</source>
          Vol
          <volume>10</volume>
          Page 73, vol.
          <volume>10</volume>
          , no.
          <issue>3</issue>
          , p.
          <fpage>73</fpage>
          ,
          <string-name>
            <surname>Sep</surname>
          </string-name>
          .
          <year>2020</year>
          , doi: 10.3390/ADMSCI10030073.
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>A.</given-names>
            <surname>Happonen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Minashkina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nolte</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Medina</surname>
          </string-name>
          , “
          <article-title>Hackathons as a company - University collaboration tool to boost circularity innovations and digitalization enhanced sustainability</article-title>
          ,” in 13th International Engineering Research Conference,
          <year>2020</year>
          . doi:
          <volume>10</volume>
          .1063/5.
          <year>0001883</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>N. L.</given-names>
            <surname>Sharp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. A.</given-names>
            <surname>Bye</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Cusick</surname>
          </string-name>
          , “Narrative Analysis,” in Handbook of Research Methods in Health Social Sciences, P. Liamputtong, Ed. Singapore: Springer,
          <year>2019</year>
          , pp.
          <fpage>861</fpage>
          -
          <lpage>880</lpage>
          . doi:
          <volume>10</volume>
          .1007/
          <fpage>978</fpage>
          -981- 10-5251-4_
          <fpage>106</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>A.</given-names>
            <surname>Nolte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. P. P.</given-names>
            <surname>Pe-Than</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Filippova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bird</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Scallen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Herbsleb</surname>
          </string-name>
          , “You Hacked and
          <string-name>
            <given-names>Now</given-names>
            <surname>What</surname>
          </string-name>
          ?
          <article-title>- Exploring Outcomes of a Corporate Hackathon,”</article-title>
          <string-name>
            <given-names>Proc. ACM</given-names>
            <surname>Hum</surname>
          </string-name>
          .-Comput. Interact., vol.
          <volume>2</volume>
          , no.
          <source>CSCW</source>
          , p.
          <volume>129</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>129</lpage>
          :
          <fpage>23</fpage>
          ,
          <string-name>
            <surname>Nov</surname>
          </string-name>
          .
          <year>2018</year>
          , doi: 10.1145/3274398.
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>A.</given-names>
            <surname>Nolte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.-A.</given-names>
            <surname>Chounta</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Herbsleb</surname>
          </string-name>
          , “
          <article-title>What Happens to All These Hackathon Projects? Identifying Factors to Promote Hackathon Project Continuation,”</article-title>
          <string-name>
            <given-names>Proc. ACM</given-names>
            <surname>Hum</surname>
          </string-name>
          .-Comput. Interact., vol.
          <volume>4</volume>
          , no.
          <source>CSCW2</source>
          , p.
          <volume>145</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>145</lpage>
          :
          <fpage>26</fpage>
          ,
          <string-name>
            <surname>Oct</surname>
          </string-name>
          .
          <year>2020</year>
          , doi: 10.1145/3415216.
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>E. P. P.</given-names>
            <surname>Pe-Than</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Nolte</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Filippova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bird</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Scallen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Herbsleb</surname>
          </string-name>
          , “
          <article-title>Corporate hackathons, how and why? A multiple case study of motivation, projects proposal and selection, goal setting, coordination, and outcomes,” Human-Computer Interact</article-title>
          ., vol.
          <volume>37</volume>
          , no.
          <issue>4</issue>
          , pp.
          <fpage>281</fpage>
          -
          <lpage>313</lpage>
          , Jul.
          <year>2022</year>
          , doi: 10.1080/07370024.
          <year>2020</year>
          .
          <volume>1760869</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>L.</given-names>
            <surname>Shanley</surname>
          </string-name>
          and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Bastian</surname>
          </string-name>
          , “
          <article-title>The Power of Hackathons: Roadmap for Sustainable Open Innovation,” Commons Lab Policy Memo Ser</article-title>
          . Vol
          <volume>3</volume>
          ,
          <string-name>
            <surname>Jul</surname>
          </string-name>
          .
          <year>2013</year>
          , Accessed: Feb.
          <volume>07</volume>
          ,
          <year>2023</year>
          . [Online]. Available: https://www.academia.edu/5798830/The_Po wer_of_Hackathons_Roadmap_for_Sustain able_Open_Innovation
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>W. R.</given-names>
            <surname>Shadish</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. D.</given-names>
            <surname>Cook</surname>
          </string-name>
          , and D. T. Campbell,
          <article-title>Experimental and QuasiExperimental Designs for Generalized Causal Inference</article-title>
          .
          <source>Houghton Mifflin Company</source>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>