<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>October</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Enabling Citizen Science in Rural Environments with IoT and Mobile Technologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Unai Lopez-Novoa</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jefrey Morgan</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kathryn Jones, Omer Rana</string-name>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tim Edwards</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Fabio Grigoletto</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Campus Lagoa do Sino, Federal University of São Carlos</institution>
          ,
          <addr-line>Buri - SP, 18290-000</addr-line>
          ,
          <country country="BR">Brazil</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Cardif Business School, Cardif University</institution>
          ,
          <addr-line>Cardif, CF10 3EU</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Data Innovation Research Institute, (DIRI), Cardif University</institution>
          ,
          <addr-line>Cardif, CF24 3AA</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Department of Computer Languages</institution>
          ,
          <addr-line>and Systems</addr-line>
          ,
          <institution>University of the Basque Country</institution>
          ,
          <addr-line>48013 Bilbao</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>School of Computer Science &amp;</institution>
          ,
          <addr-line>Informatics</addr-line>
          ,
          <institution>Cardif University</institution>
          ,
          <addr-line>Cardif, CF24 3AA</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <volume>22</volume>
      <issue>2019</issue>
      <fpage>50</fpage>
      <lpage>56</lpage>
      <abstract>
        <p>Citizen Science focuses on engaging and incentivising individuals to collect, categorise and sometimes analyse scientific data. Over the last few years, many of these projects have contributed to relevant scientific discoveries, but bringing them to successful completion is often full of challenges and complexities. In this paper we present our progress in the creation and deployment of a Citizen Science project in Guapiruvu, a village located in the Atlantic Forest in Brazil. We propose an IoT communications platform based on LoRaenabled Raspberry Pis, which act as network hubs, and which can communicate directly with smartphone hosted applications. This platform is used to run a messaging app that allows two or more smartphones to exchange text over a LoRa network. We tested the platform in the village and results show that communication was possible up to 220 meters, even if one of the hubs was located in an area densely populated with trees. We also discuss how Sapelli Collector, a popular Citizen Science-enabler app, can be used over our developed infrastructure, and mechanisms that can used to increase adoption.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        1 INTRODUCTION
Supporting ‘citizen science’ projects with personally owned
systems and devices has seen significant growth in recent years [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
This includes the use of smart phones that enable data capture with
geo-referencing. This data is subsequently delivered to a cloud
service for storage and analysis.
      </p>
      <p>
        Copyright © 2019 for this paper by its authors. Use permitted under
Creative Commons License Attribution 4.0 International (CC BY 4.0).
A number of citizen science appli-cations have been proposed in
recent years, ranging from pollution monitoring in cities to
monitoring of local habitats [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>A key premise of citizen science projects is to engage volunteers
to gather or process data, and subsequently to use this data (as part
of a bigger data collection effort), to address scientific question(s) of
interest to a community. Data generated through a citizen science
project is combined/co-referenced to curated data obtained from
more official sources, e.g. government agencies.</p>
      <p>Understanding how participants involved in such an effort can be
incentivised to engage actively remains a challenge for a successful
project. Citizen science projects are closely aligned with efforts in
‘cyber-physical-social’ systems, whereby the social dynamics and
incentive mechanisms within the group of (usually) volunteers are
key to the successful delivery of its outcomes.</p>
      <p>Understanding how human users, who are often not technical
experts in the systems they use, can use mobile technologies to
support data capture and sense-making is particularly useful when
dealing with global challenges – e.g. climate change, sustainable
development, etc. Citizen science therefore provides a good example
of how cyber-physical-social systems (CPSS) can be utilized in a
particular context. Studying the potential impact that CPSS have
on humans and how they use these systems to undertake problem
solving, and vice versa, remain important challenges.</p>
      <p>The capability available through sensors embedded in smart
phones (accelerometer, microphone, camera), associated apps, and
externally hosted infrastructure (e.g. internet of things &amp; edge
devices) has significantly altered the range of possible applications
that can be realised. Many of these systems however rely on the
existence of a backbone communications network to transmit the
data from the user device to a cloud system. Where such network
is only available intermittently (or not at all), understanding how
a data transmission infrastructure can be provisioned, supported
through ‘citizen’ effort, remains a challenge.</p>
      <p>Efforts range from the use of “relays” or mesh networks, where
devices of individuals are used as routers to forward data from a
source to a destination (assuming that the final node in the path
has a connection to the cloud hosted server), to variable speed local
area networks (e.g. LoRaWan, SIGFox etc) to enable development
of a long distance low-bit rate communications network.</p>
      <p>In this paper we present the progress towards developing a
Citizen Science project in the Guapiruvu village, in the rainforest
of Brazil. Our final goal is to create a platform that enables the
citizens of the village to develop their own network and data capture
infrastructure. The key premise is that citizens should not only be
collecting data, but also contributing to infrastructure that is used
to support this data collection. To this end, we rely on low cost
hardware, such as Raspberry Pi devices, to develop a data exchange
environment that can connect to apps hosted on mobile devices.</p>
      <p>The remainder of this paper is structured as follows: a
description of the overall aims of the project and the Guapiruvu village is
provided in Section 2. Section 3 describes our proposed IoT
platform and Section 4 the tests we conducted with it in the village.
Section 5 presents the work with a mobile data collection app and
some related work is reviewed in Section 6. Finally, we draw some
conclusions and describe lines of future work in Section 7</p>
    </sec>
    <sec id="sec-2">
      <title>2 GUAPIRUVU VILLAGE IN BRAZIL</title>
      <p>
        The final aim of this work is to address the knowledge and
infrastructure deficits that have hampered the sustainable development
aspirations of the Guapiruvu tropical forestry community in the
Sete Barras region of Brazil1. Our research focuses on addressing
the challenges of climate change, which for this community of 300
households, has been exacerbated by political inaction, geographic
isolation and educational deficits. For those living in Guapiruvu,
climate change has accelerated environmental destruction, which
has resulted in socio-economic deprivation as traditional farming
and foraging practices are compromised[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Without co-ordinated
engagement and suitable education, members of this community
will continue to be disenfranchised. Our aim is to enable the broad
cross-section of the community (farmers and children alike) to
better understand the value and relevance of biodiversity.
      </p>
      <p>We focus on supporting citizen science as part of the curriculum
of rural schools in Guapiruvu, with the insertion of content focused
on environmental issues, and the valorization of the rural and the
forest as a source of work and income opportunities. In addition
to income opportunities through local agriculture, the production
of environmental services through rural tourism and the
conservation of forests and river sources could be strengthened as a viable
career pathway for young people. Consequently, the project
focuses on supporting school children in the community capture data
about biodiversity in their local area. The school also acts as a ‘hub’
for implementing and supporting a bottom-up communications
infrastructure.</p>
    </sec>
    <sec id="sec-3">
      <title>2.1 Stakeholders &amp; Incentive Models</title>
      <p>Figure 1 identifies the members of the community involved and the
potential incentive models that we can use to engage them.
Stakeholders can include: (i) the school children – the most important
1Sete Barras region (in Portuguese) http://www.setebarras.sp.gov.br
participants who need to be incentivised to engage and contribute;
(ii) school teachers – who are responsible for coordinating the
overall activities undertaken by the children, and to manage the clubs
(technology and bio-diversity tracking); (iii) government agencies –
such as Instituto de Pesquisas Ecologicas (IPE)2 in Brazil, who are
responsible for conducting bio-diversity studies in the region. It
is important to involve these agencies, as they remain important
beneficiaries of the data collection supported through the citizen
science eforts, and (iv) other community members who see a
beneift in school children carrying out these activities – these include
local farmers and “elder” promoting economic and environmentally
sustainable practices to be developed in their community.</p>
      <p>An incentive model can be both short term, e.g. giving immediate
recognition to the child who has made the greatest number of
observations (referred to as "Fame/Recognition" in Figure 1), and
long-term, e.g. articulating the benefit of sustainable agricultural
practices for the community and its impact on the bio-diversity of
the area. Based on discussions with the community, it is important
that these incentive models must also include economic benefit,
such as potential revenue that can be generated through tourism.
3</p>
    </sec>
    <sec id="sec-4">
      <title>IOT COMMUNICATIONS PLATFORM</title>
      <p>The lack of a communication infrastructure in the Guapiruvu village
led us to the development of a system that could enable long range
communication in the area. To this end, we designed a platform
with the following hardware:
• Raspberry Pi 3 B+, as a portable communication hub with a
built-in Wi-Fi antenna3.
• LoRa modules: We used a solution provided by Cooking
Hacks with a Semtech SX1272 chipset and an
Arduino-toRaspberry Pi connection bridge4.</p>
      <p>This platform was conceived as a standalone solution using
LoRaenabled Raspberry Pis, with additional wireless-enabled devices as
interface (e.g. laptop, tablet or smartphone). This design decision
was motivated by the limited resources available in the deployment
environment, the village (e.g. lack of a backbone network), as we
did not want to rely on external screens/input devices or internet
connectivity to manage the LoRa connections.</p>
      <p>Figure 2 depicts a sample scenario with 2 Raspberry Pis that
communicate using LoRa and with smartphones running an application
that displays a user interface. Each Raspberry Pi runs a software
stack as depicted in Figure 3, formed of the following blocks:
• Hostapd and dnsmasq: used to create a wireless hotspot
and a DNS+DHCP server in the Raspberry Pi. A user of the
platform connects a device (e.g. smartphone) to the hotspot
and, then he/she is redirected to a web page served by the
Raspberry Pi.
• A Python-based web stack: used to serve the web page that
acts as interface with the LoRa module. The web front-end
uses Bootstrap5 for the visual elements, like the fonts and the
2IPE: https://www.ipe.org.br/en
3Raspberry Pi 3 B+:
https://www.raspberrypi.org/products/raspberry-pi-3-model-bplus
4LoRa SX1272 Shield:
https://www.cooking-hacks.com/sx1272-lora-shield-forraspberry-pi-900-mhz
5Bootstrap library: https://getbootstrap.com
buttons. This front-end calls a set of REST APIs in the
Backend, which act as proxy for several LoRa functions in charge
of sending and receiving messages through LoRa. These web
modules are built on top of Flask, a Python framework for
web development.
• A LoRa module: on top of the LoRa library and APIs
provided by the manufacturer, we developed several functions
in charge of setting up the LoRa module at start-up, and of
sending and receiving messages through the LoRa devices
when they are called from the web back-end.</p>
      <p>In order to test long range communication with a realistic
application, we developed a simple messaging app that enabled a user
to send a text message (140 characters long at maximum) to any
other device found in range. The web page is self-refreshed every 5
seconds to check if there is any new message received from other
devices. Figure 4 shows a screenshot of the web page.</p>
      <p>The software we developed is publicly available in an open
repository6.
6LoRa Messenger: https://github.com/ulopeznovoa/lora-messenger</p>
    </sec>
    <sec id="sec-5">
      <title>4 LONG RANGE COMMUNICATION TESTS</title>
      <p>We conducted a set of tests with the IoT platform in Guapiruvu on
the 5th of November 2018, between 10:00 and 12:00 local time. The
weather was sunny, with no rain but high humidity.</p>
      <p>The LoRa devices were configured in Broadcast mode, so any
device could send and receive messages to/from any other device.
Table 1 shows the main parameters of the LoRa configuration we
used.</p>
      <p>In order to provide mobility to the prototype, an Anker
PowerCore 26800 external battery7 was attached to each Raspberry Pi.
This 26800 mAh battery provided suficient charge to run all the
tests with less than a 25% of its charge.</p>
      <p>Figure 5 shows a representation of the test area as a map – please
note that it is not made at scale. Also note 3 icons of a photographic
camera with a number next to them: these correspond to several
pictures taken in the area and shown in this manuscript (Figures 6,
7 and 8). This link8 provides a 360 degree view of the test area in
Google Maps uploaded by user Gabriel Aoki.</p>
      <p>The main objective of the test was to find the limits of LoRa
in the area and in particular, to find places where the Raspberry
Pis could communicate not being in line of sight. We used two
Raspberry Pis, each with an external battery, and a smartphone per
Raspberry as interface. We report below the most relevant scenarios
where communication was possible, which are depicted in Figure 5
as dashed lines:
• Test A: Approximately 100 meters with a house of bricks in
between.
• Test B: Approximately 220 meters, 100 of them in a dense
area full of trees (as in Figure 8).</p>
      <p>These tests show that it would be possible to set several
distributed LoRa-enabled Raspberry Pis scattered across the village to
act as hubs for the exchange of information.
5</p>
    </sec>
    <sec id="sec-6">
      <title>USING SAPELLI COLLECTOR</title>
      <p>To engage the citizens of Guapiruvu further in Citizen Science,
we plan to introduce a data collection activity such as counting
sightings of local wildlife. Using hand-held mobile devices such as
smartphones, the children will use a mobile app to record each time
they see a particular type of animal. The sightings from each child
will then be collated to produce a survey of the local wildlife.
8Test area in Google Maps: https://goo.gl/maps/F64su7oZPc82</p>
      <p>Repeating this activity over weeks, months or even years will
illustrate any changes to wildlife patterns that may be seasonal or
due to local development in the region that afect wildlife habitats.
Through this data collection activity, the children will learn the
value of data for monitoring their local environment and how they
can be instrumental in that monitoring. In fact, they will likely be
the only citizens monitoring the wildlife in their local region.</p>
      <p>To collect data on animal sightings we plan to use Sapelli
Collector9, an open source citizen science mobile app. Sapelli Collector
has three compelling features that match the requirements of our
data collection activity for children:
• An icon-driven rather than language-driven user interface
that enables children with a variety of ages and
correspondingly varied levels of literacy development to participate.
• A decision-tree interaction style that leads users quickly
though the app to record their observations.
• Functionality to record photographs, video and geographical
coordinates of the observations.</p>
      <p>Figure 9 shows an example user interface from a Sapelli Collector
application for observing wildlife crimes. The user interface of
Sapelli Collector can be configured to show icons specific to each
data collection application. We will work collaboratively with the
children to design the icons of the animals to further engage them
in the data collection activity.</p>
      <p>Each Sapelli Collector app transmits the observations made with
the app to a GeoKey10 data collection server. GeoKey is a Django
server application that provides a REST API for receiving
geographic data collected by citizen science applications. Sapelli
Collector sends the geotagged photo and video data to GeoKey through
the REST API.</p>
      <p>Sapelli Collector has a flexible data transmission system that
makes it ideal for use in Guapiruvu with its limited internet
connectivity, as described above. In the best case, where internet
connectivity is available, Sapelli Collection can transmit directly to a
GeoKey server. When an internet connection cannot be established
but there is a mobile phone signal, Sapelli Collector can transmit
9Sapelli: http://www.sapelli.org
10GeoKey: https://geokey.org.uk
limited observation data via SMS to a phone that does have an
internet connection with a GeoKey server. In the worst case, where
no internet connection or mobile phone signal is available, Sapelli
Collector can store observations locally on the mobile device and
transmit them later when an internet connection to a GeoKey server
becomes available. Figure 10 shows Sapelli Collector’s flexible data
transmission system.</p>
      <p>As a feasibility test, we have successfully deployed the GeoKey
server on a Raspberry Pi 3 B+, which included installing a Django
stack, PostgreSql and PostGIS, a geographic extension to PostgreSql.
This way, the main hardware requirements for our data collection
activity would be smartphones and a set of Raspberry Pis.
6</p>
    </sec>
    <sec id="sec-7">
      <title>RELATED WORK</title>
      <p>The Citizen Science community has been active in deploying
information exchange and communication systems to enable data
collection in rural environments. This section presents some of the
most relevant proposals found in the literature.</p>
      <p>
        In 2011, Rohokale et al. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] proposed a cooperative IoT platform
to monitor the health status of a community of people. To that end,
each monitored individual should wear an active RFID sensor to
measure parameters like blood pressure or hemoglobin levels. Each
of these RFID sensors would submit the collected information to a
network of nodes called Opportunistic Large Array, in charge of
sending the data via internet to a doctor that can assess the health
of the individual. Authors set a theoretical experimental scenario
and evaluate the energy, latency, and throughput tradeofs in the
network using simulation.
      </p>
      <p>
        In 2015, Dlodlo and Kalezhi [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] presented a literature analysis
and review about the ways that IoT technologies could be used to
reduce poverty in rural areas of South Africa and Zambia. They
ifrst present an analysis of the state of agriculture in those regions
and after that, an exploration of potential uses of IoT in agriculture,
e.g., to use sensors to monitor and control temperature, humidity
and light.
      </p>
      <p>
        In 2016, Pham et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] developed a low-cost communication
platform based on LoRa for rural environments with the aim of
improving the productivity of applications like agriculture or fish
farming. Similar to the work we have presented, they built a LoRa
gateway using a Raspberry Pi and a SX1272/76 communications
board. However, in their case, they forward the collected
information to servers out of rural environments for further data analysis.
Their LoRa gateways were deployed outdoors with appropriate
casing and left running for several months with no technical issues.
      </p>
      <p>
        In the same year, O’Grady et al. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] presented a discussion on the
issues of setting a distributed platform to enable Citizen Science.
They presented their SIXTH Middleware as a layer for ubiquitous
sensing, in charge of collecting sensor data through mobile phones,
and the way the developed an extension to enable P2P
communication. In their tests, they use Libelium Waspmote sensors and Apache
Cordova to implement a multi-platform mobile app. Based on this
infrastructure, the authors describe the key challenges they
encountered to enable a Citizen Science project, like task management and
implementing gamification.
      </p>
      <p>
        Also in 2016, Petrić et al [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] conducted a performance assessment
of a LoRa communications network arranged as a star topology in
the city of Rennes, France. They built several types of IoT nodes
for their network, ones called IoT objects, with Arduino boards
and LoRa shields, in charge of data collection and forwarding, and
others called IoT stations using a Kerlink solution to acts as a LoRa
hub with Ethernet or 3G internet connection for data forwarding.
Authors generated synthetic traffic that represented a real-world
application like sensor monitoring and used it to benchmark the
capacity of the network. They chose 7 spots across the city to place
their IoT nodes and they present a study of the sensitivity of the
system to the position of the nodes and the performance in each of
the scenarios.
      </p>
      <p>
        In 2017, Oliveira et al. [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] measured the coverage distance of LoRa
in a rural and two urban scenarios in Portugal. For each scenario,
they present the covered range, details about signal quality and
performance of the solution delivering information. In their tests,
authors achieve communication in a distance of 5 km in the urban
scenario and close to 2 km in urban scenarios.
      </p>
      <p>
        Finally, in 2018, Sanchez-Iborra et al. [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] presented a
performance evaluation of LoRaWAN network under different
environmental conditions. They chose an urban, a suburban and a rural
environments, all three in the region of Murcia, Spain. Authors
placed a LoraWAN end-node in the roof of a car and a base station
in different locations of the described environments. They drove the
car through the test scenarios while the end-node kept transmitting
data to the base station and performed an analysis of the robustness
of the network and the data transmission. Authors conclude that,
based on their results, wave propagation has a significant effect in
the performance of a Long Range WAN.
      </p>
    </sec>
    <sec id="sec-8">
      <title>7 CONCLUSIONS</title>
      <p>This paper has described the progress in the deployment of a Citizen
Science project in Guapiruvu, a village in the Sete Barras region,
Brazil. To this end, we have built an IoT platform using Raspberry
Pis and LoRa communication hardware, and developed a messenger
app as a case study. In November 2018, we conducted some tests
with the IoT platform in the village and proved that communication
was possible up to 220 meters, including an area densely populated
with trees, and up to 100 meters in a area with a house in between.
We have also tested Sapelli and GeoKey, two pieces of software that
would enable out-of-the-box data collection by the citizens of the
village on top of the IoT platform.</p>
      <p>The future work on the technical side will head in two
directions: First, to further test and improve the deployment of the
LoRa-enabled Raspberry Pis in the village. These devices will need
to be able to respond to operational constraints (such as humidity,
rain fall, etc), and need to be positioned to ensure that there is good
coverage of a given area. Second, to deploy and test Sapelli and
GeoKey in the Guapiruvu village with end users. We will
introduce Sapelli to the citizens of the village and set it up so they find
interesting and amenable to use.</p>
      <p>After this, the project will focus on using the technological
deployment to address the deficits of knowledge of the community
and to foster the collaborative collection of nature data for further
analysis, as described in depth in Section 2.</p>
    </sec>
    <sec id="sec-9">
      <title>ACKNOWLEDGMENTS</title>
      <p>This project has been partly funded by the Data Innovation Research
Institute Seedcorn programme 2018, Cardif University. Authors
would like to thank the support of Dr Mario Aquino Alves and Dr
Luiz Fernando Bittencourt in this work.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Rick</given-names>
            <surname>Bonney</surname>
          </string-name>
          , Jennifer L. Shirk, Tina B.
          <string-name>
            <surname>Phillips</surname>
            , Andrea Wiggins, Heidi L. Ballard,
            <given-names>Abraham J</given-names>
          </string-name>
          .
          <string-name>
            <surname>Miller-Rushing</surname>
          </string-name>
          , and
          <string-name>
            <surname>Julia</surname>
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Parrish</surname>
          </string-name>
          .
          <year>2014</year>
          .
          <article-title>Next Steps for Citizen Science</article-title>
          .
          <source>Science</source>
          <volume>343</volume>
          ,
          <issue>6178</issue>
          (
          <year>2014</year>
          ),
          <fpage>1436</fpage>
          -
          <lpage>1437</lpage>
          . https://doi.org/10.1126/science. 1251554 arXiv:https://science.sciencemag.org/content/343/6178/1436.full.pdf
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>N.</given-names>
            <surname>Dlodlo</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Kalezhi</surname>
          </string-name>
          .
          <year>2015</year>
          .
          <article-title>The internet of things in agriculture for sustainable rural development</article-title>
          .
          <source>In 2015 International Conference on Emerging Trends in Networks and Computer Communications (ETNCC)</source>
          .
          <volume>13</volume>
          -
          <fpage>18</fpage>
          . https: //doi.org/10.1109/ETNCC.
          <year>2015</year>
          .7184801
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Fabio</given-names>
            <surname>Grigoletto</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>O bairro Guapiruvu como lugar-organização: uma abordagem institucional do organizar</article-title>
          .
          <year>2018</year>
          .
          <volume>258</volume>
          f.
          <source>Ph.D. Dissertation. Doctor Degree in Public Administration and Government</source>
          , Getulio Vargas Foundation.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Michael</given-names>
            <surname>J. O'Grady</surname>
          </string-name>
          , Conor Muldoon, Dominic Carr, Jie Wan, Barnard Kroon, and
          <string-name>
            <surname>Gregory M. P. O'Hare</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Intelligent Sensing for Citizen Science</article-title>
          .
          <source>Mobile Networks and Applications</source>
          <volume>21</volume>
          ,
          <issue>2</issue>
          (
          <issue>01</issue>
          <year>Apr 2016</year>
          ),
          <fpage>375</fpage>
          -
          <lpage>385</lpage>
          . https://doi.org/10.1007/ s11036-016-0682-z
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Michael</given-names>
            <surname>J. O'Grady</surname>
          </string-name>
          , Conor Muldoon, Dominic Carr, Jie Wan, Barnard Kroon, and
          <string-name>
            <surname>Gregory M. P. O'Hare</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Intelligent Sensing for Citizen Science</article-title>
          .
          <source>Mobile Networks and Applications</source>
          <volume>21</volume>
          ,
          <issue>2</issue>
          (
          <issue>01</issue>
          <year>Apr 2016</year>
          ),
          <fpage>375</fpage>
          -
          <lpage>385</lpage>
          . https://doi.org/10.1007/ s11036-016-0682-z
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>R.</given-names>
            <surname>Oliveira</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Guardalben</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Sargento</surname>
          </string-name>
          .
          <year>2017</year>
          .
          <article-title>Long range communications in urban and rural environments</article-title>
          .
          <source>In 2017 IEEE Symposium on Computers and Communications (ISCC)</source>
          .
          <volume>810</volume>
          -
          <fpage>817</fpage>
          . https://doi.org/10.1109/ISCC.
          <year>2017</year>
          .8024627
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>T.</given-names>
            <surname>PetriÄĞ</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Goessens</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Nuaymi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Toutain</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Pelov</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Measurements, performance and analysis of LoRa FABIAN, a real-world implementation of LPWAN</article-title>
          .
          <source>In 2016 IEEE 27th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC)</source>
          .
          <article-title>1-7</article-title>
          . https://doi.org/10.1109/PIMRC.
          <year>2016</year>
          .7794569
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>C.</given-names>
            <surname>Pham</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rahim</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Cousin</surname>
          </string-name>
          .
          <year>2016</year>
          .
          <article-title>Low-cost, Long-range open IoT for smarter rural African villages</article-title>
          .
          <source>In 2016 IEEE International Smart Cities Conference (ISC2)</source>
          .
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . https://doi.org/10.1109/ISC2.
          <year>2016</year>
          .7580823
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>V. M.</given-names>
            <surname>Rohokale</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. R.</given-names>
            <surname>Prasad</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Prasad</surname>
          </string-name>
          .
          <year>2011</year>
          .
          <article-title>A cooperative Internet of Things (IoT) for rural healthcare monitoring and control</article-title>
          .
          <source>In 2011 2nd International Conference on Wireless Communication</source>
          , Vehicular Technology,
          <source>Information Theory and Aerospace Electronic Systems Technology (Wireless VITAE)</source>
          .
          <article-title>1-6</article-title>
          . https://doi. org/10.1109/WIRELESSVITAE.
          <year>2011</year>
          .5940920
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Ramon</given-names>
            <surname>Sanchez-Iborra</surname>
          </string-name>
          ,
          <article-title>Jesus Sanchez-Gomez, Juan Ballesta-ViÃśas, MariaDolores Cano</article-title>
          , and Antonio F. Skarmeta.
          <year>2018</year>
          .
          <article-title>Performance Evaluation of LoRa Considering Scenario Conditions</article-title>
          .
          <source>Sensors</source>
          <volume>18</volume>
          ,
          <issue>3</issue>
          (
          <year>2018</year>
          ). https://doi.org/10.3390/ s18030772
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>