<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A Citizen Science Approach Using Information Systems to Provide Qualitative Information on Historic Natural Disasters to Risk Communicators and the General Public</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Michael Klafft</string-name>
          <email>michael.klafft@jade-hs.de</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Agnieszka Dudzińska-Jarmolińska</string-name>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ivana Harari</string-name>
          <email>iharari@mail.info.unlp.edu.ar</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Ricardo Gacitua</string-name>
          <email>ricardo.gacitua@ufrontera.cl</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Bustos</string-name>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Solhanlle Bonilla Duarte</string-name>
          <email>solhanlle.bonilla@intec.edu.do</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Teresa Morrobel</string-name>
          <email>tmorrobel@iddi.org</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Instituto Dominicano de Desarrollo Integral</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Instituto Tecnológico de Santo Domingo</institution>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Jade Hochschule Wilhelmshaven and Fraunhofer FOKUS</institution>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Universidad Nacional de La Plata</institution>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Universidad de La Frontera</institution>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>Uniwersytet Warszawski</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <fpage>197</fpage>
      <lpage>208</lpage>
      <abstract>
        <p>This paper presents the concept of an ICT tool for collecting existing knowledge in the population on historic natural disasters, and an organizational concept for making this knowledge and experience usable for risk and crisis communication, and discussions with relevant decision makers including politicians. A key focus of the proposed solution is the systematic collection of qualitative information on past natural disasters using a citizen science approach: what did previous disasters actually mean for the everyday lives of the citizens, what was the concrete damage caused by the disaster and what did this damage look like, how did the disasters impact people's safety, their wellbeing, and their economic activities, what type of help was needed (and missing) when the disaster struck, where was it needed, how could people have better prepared themselves, how did the affected population cope with the disaster, what were successful (or unsuccessful) coping strategies. In order to achieve these goals, the proposed software will be able to enrich existing quantitative information on disasters with qualitative experiences in the form of live cases narrated by survivors, and historic (multi) media documentations such as texts, photographs and films on disasters. In order to make this information usable, relevant meta data will be acquired and provided for each contribution, and the information will be archived in an easy to use data base, that allows for an intuitive (visual) presentation of its inputs. In order to assure that a critical amount of input is generated</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>(and used), an organizational concept involving educational institutions like schools, and
universities, as well as volunteer organizations is proposed. The expected advantage of the
proposed approach is that it will become clearer to all stake holders what a disaster actually
means for the everyday lives of the population. Instead of just relying on disaster statistics, the
impact of a potential disaster becomes audible and visible. Multimedia materials from the
system can be used to create exhibitions on the local relevance of disasters, which can be
used to communicate existing risks to (younger) citizens, as well as politicians and other
decision makers.</p>
    </sec>
    <sec id="sec-2">
      <title>Zusammenfassung</title>
      <p>Dieser Beitrag präsentiert das Konzept einer Software, mit deren Hilfe in der Bevölkerung
vorhandenes Wissen über in der Vergangenheit eingetretene Naturkatastrophen systematisch
erfasst werden kann. Zudem wird ein organisatorisches Konzept vorgestellt, mit dessen Hilfe
sich die vorgeschlagene Software in der Praxis effizient einsetzen lässt. Dabei wird ein
„Citizen-Science“-Ansatz verfolgt, der darauf abzielt, insbesondere qualitative Informationen
zu vergangenen Naturkatastrophen systematisch zu erheben: wie wirkten sich die
Naturkatastrophen auf das alltägliche Leben aus, wie sahen die angerichteten Schäden aus, wie
beeinflusste die Katastrophe die Sicherheit, das Wohlbefinden und die wirtschaftlichen
Aktivitäten, welche Hilfe wurde wann wo benötigt (und war ggf. nicht verfügbar), was waren
erfolgreiche (oder auch weniger erfolgreiche) Krisenbewältigungsstrategien, was hätte man
tun können, um sich besser auf die Katastrophe vorzubereiten. Um diese Ziele zu erreichen,
reichert die vorgeschlagene Software vorhandene quantitative Informationen zu
Naturkatastrophen mit subjektiven Erfahrungen Überlebender in Form von (Audio-)Berichten an und
archiviert vorhandene historische multimediale Materialien wie Fotos, Film- und Textbeiträge
über die vergangenen Katastrophen. Um diese Informationen nutzbar zu machen, müssen bei
der Dateneingabe für jeden Beitrag relevante Metadaten erfasst werden. Zudem sollen die in
einer Datenbank erfassten Inhalte über ein Front-End wie z. B. eine Webseite zugänglich sein,
wobei besonderer Wert auf eine intuitive visuelle Repräsentation der Inhalte gelegt wird. Um
sicher zu stellen, dass für die jeweilige Anwendungsregion auch eine ausreichende Menge an
Beiträgen generiert wird, schlagen die Autoren ergänzend ein organisatorisches Konzept vor,
das auf einer Zusammenarbeit mit Schulen, Hochschulen und Freiwilligenorganisationen
aufbaut. Vorteil des hier präsentierten Ansatzes ist es, dass allen Stakeholdern, aber auch den
Bürgern deutlicher wird, was die lokal relevanten Naturkatastrophen für die Bevölkerung
konkret bedeuten, da die Auswirkungen hörbar und sichtbar werden. Die vorhandenen
multimedialen Materialien aus der Datenbank können dann vor Ort dazu genutzt werden, die
Risikokommunikation zu unterstützen (zum Beispiel durch den Download als
Unterrichtsmaterial, aber auch durch die Nutzung der Materialien in Ausstellungen zu den örtlich
bedeutsamen Naturkatastrophen).</p>
      <sec id="sec-2-1">
        <title>1 Motivation</title>
        <p>
          Existing technical solutions that ask citizens to provide information on disasters focus
on the present and the future.
          <xref ref-type="bibr" rid="ref9">Mee and Duncan [Mee &amp; Duncan 2015</xref>
          ], for example,
developed a concept based upon the Dewetra tool to monitor ongoing volcanic activity
in Saint Vincent and the Grenadines with the help of local citizens. Web-based tools
like Ushaidi have been used to gather information on ongoing disasters with the
purpose to coordinate relief efforts by volunteers [
          <xref ref-type="bibr" rid="ref4">Gao et al. 2011</xref>
          ]. However, these
solutions do not focus on gathering and using experiences from historic disasters for
risk communication purposes. Data bases on historic disasters, such as EM-DAT
[Center for Research on the Epidemiology of Disasters 2018], focus on the quantitative
aspects such as lives lost and damage caused, but provide little insights on the
qualitative impact on societies and everyday lives. Communication research, however,
points towards the persuasive power of narratives in risk communication. [
          <xref ref-type="bibr" rid="ref12">Ricketts et
al. 2010</xref>
          ] found that narratives are 19% more effective in promoting safety behavior,
compared to non-narrative communication approaches, and narratives achieved this
goal without inducing fear in the audience. [Janssen et al. 2013] point out that
narratives are suitable to increase risk awareness in a health risk context, and
[
          <xref ref-type="bibr" rid="ref2">Dahlstrom 2014</xref>
          ] showed that narratives “offer increased comprehension, interest, and
engagement” when communicating about scientific topics. Given the fact that all
natural disasters are caused by scientific phenomena, this provides an argument for
including narratives in risk communication on natural disaster risks. Existing data
bases, however, are not providing suitable materials for this communication approach.
With the proposed solution, we intend to close this gap.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2 Approach</title>
        <p>In order to address existing information gaps on historic disasters, we propose an
easyto-use technical solution (for information collection, retrieval, and presentation), and an
organizational concept how the tool can be embedded in existing risk-communication
and urban planning strategies.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>2.1 Organizational strategy</title>
      <p>
        The goal of the organizational concept is to motivate citizens to participate in the data
collection effort by providing eyewitness accounts and historic media material on
highimpact, low-frequency disasters. The organizational concept will be based on the
following approaches:
• Data collection activities will be included in courses at universities and higher
educational institutions. This can be achieved as part of courses on risk and
crisis communication, urban planning, or disaster management. Media projects
conducted as part of journalism and media science programs can also collect
and use information on historic disasters to create exhibitions or multimedia
features on disaster types of regional relevance. The feasibility of this approach
has been shown – among others – by [
        <xref ref-type="bibr" rid="ref10">Mucha 2017</xref>
        ] who designed and
produced a radio feature on the snow catastrophe in Eastern Frisia in 1979,
based upon archival materials as well as interviews with stakeholders affected
by this disaster (citizens, and disaster managers).
• Acquired multimedia contributions on historic disasters will be provided to
geography and history teachers for download, who can then use the material in
their classes at school. The materials will also be of interest for extra-curricular
learning places who often provide teaching modules on natural hazards and
disasters - for example on flooding of rivers [
        <xref ref-type="bibr" rid="ref11">Restrepo 2016</xref>
        ] or on the history of
coastal protection and climate change [
        <xref ref-type="bibr" rid="ref8">Lernort Technik und Natur 2017</xref>
        ].
• A prerequisite to maximize the impact of the proposed data base will be to
cooperate with stakeholders such as disaster management organizations,
volunteer organizations, urban planners, and policy makers to match content
from the data base with current disaster prevention and coping strategies, and
urban planning activities.
      </p>
      <p>
        Finally, these activities shall be extended by workshops or townhall meetings to initiate
a dialogue between local government and citizens, in order to discuss disaster
prevention measures, as well as measures for adaptation to climate change. This
socalled social participation approach mobilizes the society to participate in the changes
to be made in a given area. The approach is also required by the Aarhus Convention,
which imposes a duty to inform the society about decisions connected with the natural
environment and having an effect on the functioning of social groups
[Sobiesiak200
Penszko 2013]. As a result, (trustful) relations are established between the public
administration and the citizens, and decision makers gain additional knowledge and
experience which they do not possess yet [
        <xref ref-type="bibr" rid="ref13">Siemiński 2007</xref>
        ]. This also allows for
mitigating complications and conflicts during the implementation of planned solutions
(such as inconveniences caused by construction works during the transformation
period).
      </p>
      <p>
        As proposed in [
        <xref ref-type="bibr" rid="ref1">Cremer et al. 2013</xref>
        ], interviews or workshops with a wide circle of
specialists (risk and crisis communicators, urbanists, architects, landscape architects,
hydrologists, metrology specialists, etc.) should be conducted, in order to make the
proposed citizen science approach in data collection more effective. Specialists will
specify what contributions they need most to create a specific strategy for risk and
crisis communication, or for adaptation of a given area to climate changes. To stay
focused, risk communicators and urban planners need to delimit the areas requiring
data collection activities. In case of floods, stakeholders can build upon the
“Copenhagen Cloudburst Formula” as described by the [American Society of
Landscape Architects 2016], and empiric data obtained from local communities
(including the elderly, who have unique knowledge and experience connected with
historic disaster incidents). In order to make citizen participation as seamless as
possible, contributors from society should be given the freedom to choose time and
place for the handover of information, which increases the outreach to various social
groups [
        <xref ref-type="bibr" rid="ref7">Jezierska 2015</xref>
        ]. The result should be the creation of the so-called social
coverage and its interpretation during the common discussion, during with the social
history of disasters will be reconstructed and the experiences connected with it will be
shared [
        <xref ref-type="bibr" rid="ref6">Jarosz &amp; Gierczyk 2016</xref>
        ]. Subsequently, the obtained information must be
interpreted and design solutions must be adapted to specific areas, along with an
additional analysis of socioeconomic benefits and costs in accordance with the
Copenhagen Cloudburst Formula [American Society of Landscape Architects 2016].
Once possible solutions have been designed, another important step will be to engage
in a dialogue with the society and to present (in a clear manner adapted to a given
social group) the created solutions, using proper tools, such as: discussion or activities
of "Planning for real" type, i.e. explanation of proposed solutions through their
visualisation on large models of city parts or through visual presentations [
        <xref ref-type="bibr" rid="ref1">Cremer et
al. 2013</xref>
        ]. It is important that the dialogue goes both ways. The last step is the process
201
of implementation of the solutions and their monitoring. Participation of citizens in
adaptation of urban areas to negative effects of climate changes is to be planned on a
long-term basis.
      </p>
    </sec>
    <sec id="sec-4">
      <title>2.2 Technological implementation</title>
      <p>In order to support the organizational approach, an information system to collect and
provide qualitative information on historic natural disasters has to be developed. This
technical solution should comprise
•
•
•
an easy-to-use smartphone app and website that allows volunteers (or elderly
people themselves) to collect, categorize, and visualize information on and
experiences with past disasters, such as historic photos, eyewitness reports on
disaster impact or on historic observations from nature, drawings, sketches, etc.
a back-end for information storage, including a tool used by moderators to
validate and approve new users, as well as entries into the data base,
a website for information retrieval (both using map-based multimedia
presentations as well as a functionality for the download of specific content).</p>
    </sec>
    <sec id="sec-5">
      <title>2.2.1 Architectural considerations</title>
      <p>In order to implement the proposed solution, the authors propose a
layeredarchitecture as illustrated in Figure-1.
The architecture comprises four main layers, which are described as follows:
•
•
•
a. Data acquisition layer.</p>
      <p>The bottom layer of the architecture is the data acquisition layer. Devices to
acquire data will mainly be smartphones or desktop computers, which will be used
to upload photographs, text, audio files, etc. Smartphones are well suited for data
acquisition by volunteers who visit disaster survivors, and they usually provide
functionalities for content collection such as microphones for audio recording and
a camera. However, some initial discussions with seniors who experienced
disasters indicate that this target group may prefer stationary computers to
provide their multimedia contributions to the system, so that both a mobile and a
desktop version of the data collection tool are needed. Please note that some
basic meta data on the multimedia materials is also collected in this layer.
b. Communication layer.</p>
      <p>The communication layer supports the connectivity of data acquisition devices
with the data base, using protocols such as TCP/IP (and HTTP/HTTPS and
RESTful approaches on those).
c. Data layer.</p>
      <p>This layer stores the data provided by the input devices and provides the ability to
process and act upon these data. This layer comprises three main components:
• a verification / validation module, which performs some (automated)
procedures for checking that the input data is related to disaster events and
complies with minimum input requirements.
• a categorization module, which uses, among others, taxonomies of disasters
and timelines to further classify input materials into different contexts and
situations (context-based grouping of related contributions based upon
contribution properties and their metadata). This will be needed because
many end-users of the systems may be laypeople (e.g. history teachers)
who will not be able (or do not want to) perform sophisticated queries on the
database and may want to be easily provided with material on certain
situations.
• a publication / selection module, which provides contextualized multimedia
materials to the end-users’ front end(s).
•
d. Application layer.</p>
      <p>This layer contains the application that present the database’s content to
endusers like citizens, teachers, or urban planners. Initially, this shall contain a
visualization component with different filters (e.g., based upon disaster types or
situations), as well as a download functionality to provide multimedia materials to
end-users for their further use. Future extensions to third party applications shall
be possible. Please note that the application may also be used to access
hardware resources in the data acquisition layer (if run on the data acquisition
device).</p>
    </sec>
    <sec id="sec-6">
      <title>2.2.2 User interfaces</title>
      <p>
        Technology acceptance models [
        <xref ref-type="bibr" rid="ref3">Davis 1985</xref>
        ] indicate that ease of use is a key factor
influencing the adoption of an IT system. It is therefore essential to make it very easy
for the system’s users to contribute input on disasters, and to access information on
disasters. Figure-2 provides an initial interaction design idea for the desktop version of
the site for collecting input on disasters from citizens. Besides information on the
contributor, it provides the opportunity to upload audio and video files, photos, and to
post written disaster reports. Meta data are collected by selecting the relevant incident
type(s), as well as location information and information on the date to which the new
contribution refers. Some help functionalities are also provided so that users may
contact a moderator if they experience problems with the website. One possible
approach to implement quality assurance would be to introduce peer-to-peer
reviewing, where other users who experienced the same situation / context are asked
to review new contributions. This may be implemented in addition to a reviewing tool
for moderators / administrators, who should also be able to assess contributions (and
eventually reclassify or delete them).
Similarly, user experience for end-users of the system such as risk communicators,
teachers, or urban planners shall be smooth. One feature of the proposed system is to
arrange contents related to specific contexts / situations. This could be specific
disasters, as displayed in Figure 3.
Additional screens to be included in the application shall be a map-based view, as well
as a site to query the data base content in line with customized search parameters.
      </p>
      <sec id="sec-6-1">
        <title>3 Conclusion and Outlook</title>
        <p>This paper provides an initial idea how qualitative information and multimedia materials
on historic disasters may be collected using a citizen science approach and an IT tool,
and how this material may be made accessible to stakeholders such as risk
communicators or urban planners. Please note that at the current state, the presented
solutions display the authors’ own initial ideas, and have not yet been discussed in
depth with possible end users. Once a detailed requirement analysis has been
completed, the proposed approach will need to be adapted, detailed, and refined.</p>
      </sec>
      <sec id="sec-6-2">
        <title>4 References</title>
        <p>American Society of Landscape Architects (2016). The Copenhagen Cloudburst Formula: A
Strategic Process for Planning and Designing Blue-Green Interventions.
https://www.asla.org/2016awards/171784.html (accessed June 4th, 2018)
Center for Research on the Epidemiology of Disasters (2018): EM-DAT – The International</p>
        <p>Disaster Data Base. http://www.emdat.be/ (accessed March 23rd, 2018).</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>Cremer E.</given-names>
            , DeCicco A.,
            <surname>McCann</surname>
          </string-name>
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Rivas</surname>
          </string-name>
          <string-name>
            <surname>A.</surname>
          </string-name>
          (
          <year>2013</year>
          )
          <article-title>Managing climate change - Sjaellandsgade as a Green Corridor</article-title>
          , Worcester Polytechnic Institute, Worcester, MA https://web.wpi.edu/Pubs/E-project/Available/E-project-
          <volume>050613</volume>
          -135037/unrestricted/ eCDR_Managing_Climate_Change.pdf (
          <issue>accessed June 3rd</issue>
          ,
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>Dahlstrom. M. F.</surname>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>: Using narratives and storytelling to communicate science with nonexpert audiences</article-title>
          .
          <source>In: Proceedings of the National Acadamy of Sciences of the United States of America</source>
          <volume>111</volume>
          (
          <issue>4</issue>
          ),
          <fpage>13614</fpage>
          -
          <lpage>13620</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Davis</surname>
            ,
            <given-names>Fred D.</given-names>
          </string-name>
          (
          <year>1985</year>
          )
          <article-title>A technology acceptance model for empirically testing new end-user information systems: Theory and results</article-title>
          . Cambridge: Massachusetts Institute of Technology,
          <year>1985</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ; Barbier,
          <string-name>
            <surname>G.</surname>
          </string-name>
          ; Goolsby,
          <string-name>
            <surname>R.</surname>
          </string-name>
          (
          <year>2011</year>
          )
          <article-title>: Harnessing the Crowdsourcing Power of Social Media for Disaster Relief</article-title>
          .
          <source>In: IEEE Intelligent Systems</source>
          <volume>26</volume>
          (
          <issue>3</issue>
          ),
          <fpage>10</fpage>
          -
          <lpage>14</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Jannsen</surname>
          </string-name>
          , E.; van Osch, L.; de Vries, H.;
          <string-name>
            <surname>Lechner</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2013</year>
          ):
          <article-title>The influence of narrative risk communication on feelings of cancer risks</article-title>
          .
          <source>In: Health Psychology</source>
          <volume>18</volume>
          (
          <issue>3</issue>
          ),
          <fpage>407</fpage>
          -
          <lpage>419</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>Jarosz E.</given-names>
            ,
            <surname>Gierczyk</surname>
          </string-name>
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2016</year>
          )
          <article-title>Photovoice in social research and activities</article-title>
          ,
          <source>Pedagogika Społeczna</source>
          <volume>60</volume>
          ,
          <fpage>167</fpage>
          -
          <lpage>181</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <surname>Jezierska</surname>
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2015</year>
          )
          <article-title>Dialog obywatelski</article-title>
          w Szwecji, http://partycypacjaobywatelska.pl/wpcontent/uploads/2015/09/2d_
          <article-title>dialog_obywatelski_szwecja_raport_z_desk_research2.pdf (accessed June 3rd,</article-title>
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>Lernort</given-names>
            <surname>Technik und Natur</surname>
          </string-name>
          (
          <year>2017</year>
          ). Themenkatalog. https://www.lernortwhv.de/fileadmin/Dokumente/Themenkatalog_
          <year>2017</year>
          .pdf (
          <issue>accessed June 4th</issue>
          ,
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <surname>Mee</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Duncan</surname>
            ,
            <given-names>M.J.</given-names>
          </string-name>
          (
          <year>2015</year>
          ):
          <article-title>Increasing resilience to natural hazards through crowdsourcing in St. Vincent and the Grenadines</article-title>
          . Nottingham: British Geological Survey.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <surname>Mucha</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>In Nature's grasp - the snow catastrophe in February 1979 in Friesland and Wilhelmshaven: Production and Conceptual Design of a Radio Feature (in German)</article-title>
          .
          <source>Bachelor Thesis</source>
          , Wilhelmshaven: Jade University of Applied Sciences.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <surname>Restrepo</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2016</year>
          ). ¿Por Qué Desbordan los Rios?,
          <source>Catalejo</source>
          <volume>9</volume>
          ,
          <fpage>10</fpage>
          -
          <lpage>11</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <surname>Ricketts</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Shanteau</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>McSpadden</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ;
          <string-name>
            <surname>Fernandez-Medina</surname>
            ,
            <given-names>K.M.</given-names>
          </string-name>
          (
          <year>2010</year>
          )
          <article-title>: Using stories to battle unintentional injuries - Narratives in safety and health communication</article-title>
          .
          <source>In: Social Science &amp; Medicine</source>
          <volume>70</volume>
          (
          <issue>9</issue>
          ),
          <fpage>1441</fpage>
          -
          <lpage>1449</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <surname>Siemiński W.</surname>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>Goals and participles of social participation in spatial planning</article-title>
          ,
          <source>Człowiek i Środowisko</source>
          <volume>31</volume>
          ,
          <fpage>37</fpage>
          -
          <lpage>59</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <surname>Sobiesiak-Penszko</surname>
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2013</year>
          ) (Ed.).
          <article-title>Prawo a partycypacja publiczna pod redakcją</article-title>
          ,
          <source>Instytut Spraw Publicznych</source>
          , Warszawa.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>