<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Social Web Meets Sensor Web: From User-Generated Content to Linked Crowdsourced Observation Data</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dong-Po Deng</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Guan-Shuo Mai</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tyng-Ruey Chuang</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rob Lemmens</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kwang-Tsao Shao</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Biodiversity, Research Center</institution>
          ,
          <addr-line>Academia Sinica, Taipei</addr-line>
          ,
          <country country="TW">Taiwan</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Faculty of, Geo-Information</institution>
          ,
          <addr-line>Science and Earth, Observation (ITC)</addr-line>
          ,
          <institution>University of Twente</institution>
          ,
          <addr-line>Enschede</addr-line>
          ,
          <country country="NL">Netherlands</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Institute of, Information Science</institution>
          ,
          <addr-line>Academia Sinica, Taipei</addr-line>
          ,
          <country country="TW">Taiwan</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2011</year>
      </pub-date>
      <abstract>
        <p>The reach of dominating social media like Facebook and Twitter in the current population is enormous, and these media have long been leveraged for diverse applications. In particular, for some citizen science projects, existing social media increasingly become platforms on which participants interact and contribute. These user contributions, often termed User-Generated Content (UGC), can be a mix bag of posts, comments, images, and other media. We report in this paper a work-in-progress in formalizing user contributions from a large Facebook group (more than 4,000 users) established for biodiversity observation. A major part of our work is to extract structured datasets with welldefined semantics from unstructured UGC collections. We use common vocabularies from Darwin Core (DwC), Friendof-a-friend (FOAF), Semantically-Interlinked Online Communities (SIOC), Semantic Sensor Network (SSN), among</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>This research is supported in part by the Ministry of
Science and Technology (grant no. 102-2627-M-001-009) and
by the Endemic Species Research Institute, Council of
Agriculture, Taiwan. We are grateful to Te–En Lin and his group
at the Endemic Species Research Institute for their help
with the collected data.
yDong–Po Deng is also a PhD candidate at the Faculty of
Geo–Information Science and Earth Observation (ITC),
University of Twente.
zTyng–Ruey Chuang is also affiliated with the Research
Center for Information Technology Innovation and the
Research Center for Humanities and Social Sciences (Center
for Geographic Information Science), both at Academia
Sinica.</p>
      <p>This paper is released under the Creative Commons Attribution 4.0 License.
You are free to share and adapt this paper for any purpose, even
commercially, as long as you give appropriate credit, provide a link to the license,
and indicate if changes were made. These freedoms cannot be revoked as
long as you follow the license terms. For a copy of the license, please visit
&lt;http://creativecommons.org/licenses/by/4.0/&gt;.
Linked Data on the Web (LDOW2014), April 8, 2014. Seoul, Korea.
others, to formalize the extracted datasets, hence, make
them readily linkable. A nice consequence of this approach
is that a multi-faceted browser can be quickly built to
explore biodiversity information in large collections of UGC.</p>
    </sec>
    <sec id="sec-2">
      <title>Categories and Subject Descriptors</title>
      <p>H.3.5 [Online Information System]: [Web-based services];
H.5.3 [Group and Organization Interfaces]: [Web-based
Interaction]; I.2.4 [Knowledge Representation Formalisms
and Methods]: Semantic Networks</p>
    </sec>
    <sec id="sec-3">
      <title>General Terms</title>
    </sec>
    <sec id="sec-4">
      <title>1. INTRODUCTION</title>
      <p>
        Citizen science is a crowdsourcing mechanism that refers
to a distributed, collaborative problem-solving model in
which a crowd of undefined size is engaged to solve a
complex or scientific problem through an open call [
        <xref ref-type="bibr" rid="ref20 ref3 ref36">3, 20</xref>
        ].
Incorporation with trained volunteers participating in
scientific studies as field assistants has a long history [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ].
However, the landscape of citizen science has been transformed
by modern Web services and communications enabling
people around the world to spread information. Social media
is one of significant tools in changing the ways information
is produced and used in citizen science projects. A social
media site can offer participants of citizen science projects
not only a virtual environment for social interactions but
also a platform for sharing, discussing, and modifying data
together. On one hand, social media potentially provide
situational awareness and opportunities for assistance on
an individual level [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The communication channels make
possible for participants to share and manage their own
sightings on a globally accessible database [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. That is,
the citizens are locally acting as human sensors, and social
media are acting as platforms connecting these human
sensors. On the other hand, social media enable scientists to
reach out a large number of people, over a large geographic
region and over an extended time period, to introduce them
to citizen science projects. Therefore, the use of social
media has greatly increased citizen participation and
improved data collection process in citizen science projects.
Such crowdsourced approach often can reduce cost and
effort in data management and exchange [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ].
      </p>
      <p>However, to utilize social media for citizen science projects,
there is a need to bridge a knowledge gap between human
and the machine. In using social media for collecting
participants’ observations, it is often hard in controlling the
quality of the content. Social media applications and services
facilitate social interactions, but not scientific activities and
data exchanges. Valuable scientific content is mixed up with
huge amounts of noisy, low-quality, unstructured text and
media. Often a crowdsourcing effort only creates
humanreadable content but not machine-readable data. Moreover,
often the lack of sufficient metadata for crowdsourced data
makes it difficult to derive meaningful interpretations from
the data. Correspondingly, data integration and sharing
in different knowledge domains is hampered. To achieve
semantic computing on crowdsourced data, it requires not
only text mining for extracting valuable information from
user-generated content but also semantic enrichment for
interpreting the meaning of the extracted information.</p>
      <p>
        An ontology, as a “shared conceptualization”, plays an
important role for the basis of connections between datasets
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. It is because an ontology presents a formal modeling
for knowledge representation geared towards resolving
semantic ambiguity, and consequently it contributes to the
achievement of semantic interoperability between
information communities [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. Linked Data refers to the
publication of structured data on the Web in such a way that it
is machine-readable, its meaning is explicitly defined, it is
linked to other external datasets, and can in turn be linked
to from external datasets [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Technically, the Linked Data
paradigm combines knowledge representation
technologies, e.g. RDF and OWL, with traditional Web technologies,
e.g. HTTP and REST, for publishing and interlinking data
and information [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. The technologies enable a process
evolving transition from current document-oriented Web
into a Web of interlinked data and, ultimately, into the
Semantic Web [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>This paper reports our experiences on processing
crowdsourced data from social media into interlinked data for the
Web. The process can be elaborated by the following:
how the crowdsourced observation data can be
transformed and represented by an ontology of citizens as
sensors,
how the crowdsourced observation data can be
interlinked with other Linked Data resources such as
biodiversity (TaiCOL) and geospatial information
(Geonames),
how the crowdsourced observation data can be
accessible to machines by using the Linked Data paradigm
and be readable for humans by means of a faceted
browser.</p>
      <p>The paper is organized as follows. After introducing the
citizen science project in Section 2, we describe how
namedentities can be extracted from crowdsourced data, and the
evaluation of the information extraction in Section 3. We
explain the design of the synthesis ontology of citizens as
sensors, and how crowdsourced data can be transferred
to RDF data model in Section 4. In Section 5 we make
spatiotemporal queries and present a faceted browser for
the linked crowdsourced sensor data. Then we provide
related work in Section 6. Finally we conclude in Section 7
with an outlook to future work.</p>
    </sec>
    <sec id="sec-5">
      <title>2. REPTILE ROAD MORTALITY: A CITI</title>
    </sec>
    <sec id="sec-6">
      <title>ZEN SCIENCE PROJECT</title>
      <p>This section introduces the data collection in the citizen
science project, Reptile Road Mortality (in Chinese, ïº
&gt;). This citizen science project is hosted by the Endemic
Species Research Institute, Council of Agriculture, Taiwan.
The citizen science project aims to collect reports of dead
animals that have been struck and/or killed by motor
vehicles through the use of a Facebook group. The reason of
using Facebook as a crowdsourced data collection platform
is its high user base in the Taiwanese population.
According to a statistic of Socialbakers1, over half of Taiwanese
population has a Facebook account. Facebook thus can be
a good social place for recruiting participants. The number
of participants in the Reptile Road Mortality is 4,187 at the
end of year 2013, but only 618 persons ever posted at least
one observation. The ratio of participants and contributive
participants reveals the reality of mass collaboration, which
is often said that 80% of the work is done by 20% of the
people. Up to Jan. 4 2014, the group has assembled 7,842
posts as shown in Figure 1.</p>
      <p>Any user possessing a Facebook account can join this
citizen project and post his/her observations of roadkill
animals. Figure 2 illustrates a roadkill observation posted
in the Facebook group Reptile Road Mortality. Chuang
YuTa saw a killed animal on the road, so he took a photo and
posted his observation with location and time description
on the group. When Joyce read the post, she identified the
species in Chuang Yu-Ta’s photo and left the species name
as comment. Thus, the roadkill observation was composed
of photo, description of location and time, and identification</p>
      <sec id="sec-6-1">
        <title>1http://www.socialbakers.com</title>
        <p>Post
section
Comment
section
of species.</p>
        <p>The participants of this citizen project would be asked
to provide the location and time descriptions for the their
observations. Because of privacy and security issues,
Facebook strips metadata (EXIF) from the photos. Without EXIF
data, a photo from Facebook is just an image; the photo
cannot in itself indicates the date and location on which it was
taken. The text messages accompanying the photos will
be the main sources for extracting biodiversity information
about the species in the photos.</p>
        <p>Facebook posts can be retrieved using the Facebook
Graph API2 which enables developers to read from and
write data to Facebook. This API offers a simple, consistent
view of the Facebook social graph, uniformly
representing objects in the graph (e.g., people, photos, events, and
pages) and the connections in between them (e.g., friend
relationships, shared content, and photo tags).</p>
      </sec>
    </sec>
    <sec id="sec-7">
      <title>3. INFORMATION EXTRACTION 3.1</title>
    </sec>
    <sec id="sec-8">
      <title>Name-Entity Recognition</title>
      <p>The data offered by the Facebook Graph API is structured
around the Facebook social graph which is useful for
processing social relationships. However, this citizen science
project focuses on collecting occurrences of roadkill
animals. The valuable information is in the photos for proving
occurrences of roadkill animals, and in the texts for
describing the time and location of occurrences of roadkill animals.
To extract the information of occurrences of roadkill
animals, we apply name-entity recognition to identify location,
time, and species in Facebook posts and comments.
Because the participants in the Facebook group use traditional
Chinese as the communication language, our task of
nameentity recognition actually aims at Chinese text processing.
Chinese texts are character-based, not word-based.
Moreover, there is often no space between characters in written
Chinese sentences. This unique language feature leads to
a challenge of word segmentation.</p>
      <sec id="sec-8-1">
        <title>2https://developers.facebook.com/docs/graph-api</title>
        <p>
          Several different algorithms have been proposed to deal
with the challenge. Generally speaking, the algorithms
can be classified into character-based and word-based
approaches [
          <xref ref-type="bibr" rid="ref33">33</xref>
          ]. The character-based approaches ignore the
concept of words, and use characters to extract word-level
information in the construction of information extraction
system. The word-based approaches apply lexicon to
segment Chinese words. They often reply on a rich lexicon,
sophisticated word segmentation, and/or syntactic
analysis in extracting word-level information from documents
[
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. However, existing Chinese lexicons are constructed for
general applications. The lacks of domain-specific corpora
often hamper the information extraction in specific domains
such as geography and biodiversity. For example, the group
Chinese Knowledge Information Processing (CKIP)3 is
continually building a Chinese word lexicon with rigid syntactic
information. The lexicon now contains over 140,000 word
entries, and is used in a corpus with over a million parsed
sentences. This is a great research resource. Unfortunately
using the CKIP lexicon for extracting location and species
names is not efficient.
        </p>
        <p>
          To efficiently extract species and location names from
Facebook threads, it is necessary to constitute specific
lexicons. We compiled a geo-name lexicon from the Taiwan
Geographic Names database4 and a species-name lexicon from
the Taiwan Catalogue of Life databases (TaiCOL)5 . Note
that, however, species names and place names found in
Facebook posts and comments are not always in these two
specific lexicons. The name-entity recognition approach
we use was elaborated in a paper we previously published
[
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
      </sec>
    </sec>
    <sec id="sec-9">
      <title>3.2 Evaluation of Name-Entity Recognition</title>
      <p>
        Precision and recall are the basic measures used in
Natural Language Processing to evaluate information extraction
methods [
        <xref ref-type="bibr" rid="ref18 ref30 ref9">9, 18, 30</xref>
        ]. Generally speaking, it needs a training
dataset to assess the quality of information extraction. Our
training dataset is generated by domain experts. While the
training dataset is considered as a positive set, the names
extracted by Name-Entity Recognition (NER) is a negative
set. According to whether an identification is correct, four
sets can be distinguished: true positive, false positive, true
negative, and false negative. From the statistical point of
view, false negative are Type I errors, and false positives
are Type II errors. Precision is the ratio of the number
of correct names identified by both NER and domain
experts (True Positive) to the total number of incorrect and
correct names identified by NER (True Positive + False
Positive) (Eq. 1). Recall is the ratio of the number of correct
names identified by both NER and domain experts (True
Positive) to the total number of correct names identified
by domain experts (True Positive + False Negative) (Eq. 2).
The F-score is an overall metric that is calculated from both
precision and recall, treating these two metrics as equally
important (Eq. 3).
      </p>
      <p>Recall =
jnameactual \ namepredictj
jnameactualj
(1)
3http://ckip.iis.sinica.edu.tw/CKIP/engversion/index.htm
4http://placesearch.moi.gov.tw
5http://col.taibif.tw
where nameactual is the set of place names or species
names that has been identified from Facebook messages by
domain experts, and namepredict is the set of place names
or species names that has been identified from Facebook
messages by the NER.</p>
      <p>400 posts are randomly selected from the entire 7,842
posts for the evaluation. The confusion matrix of the
information extraction assessment is shown in Table 1. Thus, the
precision is 282=(282 + 7) = 0:9758, the recall is 282=(282 +
10) = 0:9656, and the F-score is 2.8973.</p>
    </sec>
    <sec id="sec-10">
      <title>4. AN ONTOLOGY FOR CITIZENS AS SEN</title>
    </sec>
    <sec id="sec-11">
      <title>SORS</title>
    </sec>
    <sec id="sec-12">
      <title>4.1 A synthesis of social networks and sensor networks</title>
      <p>Before we begin to transform the crowdsourced content
to RDF, we first develop an ontology for not only expressing
the notions of “Citizens as Sensors” but also formalizing the
extracted name-entities, e.g. species and geospatial names.
To make linked data interoperable, the ontology reuses
suitable vocabularies from the existing ontologies as many as
possible. Since the crowdsourced dataset is retrieved from
Facebook, a social media site, its content can be mapped
to RDF using existing social semantic web ontologies. The
Semantically Interlinked Online Communities (SIOC)6 is
used for representing the content of the Facebook group
Reptile Road Mortality, e.g. threads, posts, and images.
The Friend of a Friend (FOAF)7 can be used to describe
content creators. Figure 3 shows the vocabularies of SIOC
and FOAF used in our ontology.</p>
      <p>
        In this study, “Citizens as Sensors” means that a Citizen
voluntarily reporting his/her observations via social media
for a citizen science project. The citizen acts as a Sensor
which enables automatic measurement and/or recording of
physical properties. To express the notion, the vocabularies
of W3C Semantic Sensor Network (SSN) ontology are used
to express the content from social networks. Conceptually,
the action that a participant reports her/his roadkill
observation matches the pattern of Stimulus-Sensor-Observation.
The pattern describes a process that a sensor transforms a
stimulus from the physical world into an observation and
thereby it allows us to reason about the observed
properties of particular features of interest [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. A roadkill animal
actually is the stimulus which triggers a citizen to a post
her/his observations on the Facebook at specific time and
6http://sioc-project.org
7http://www.foaf-project.org
foaf:holdsAccount
      </p>
      <p>sioc:reply_of
location. Also, the species of the animal is the feature of
interest. Figure 4 displays the use of the vocabularies of
the SSN ontology in our ontology.</p>
      <p>However, the citizen is a person and cannot exactly be
regarded as a sensor. The persons can be expressed as
foaf:Person, and the sensors can be defined to ssn:Sensor.
All individuals of foaf:Person cannot be the same as all
individuals of ssn:Sensor. Only some of these
individuals can be expressed as not only foaf:Person but also
ssn:Sensor. To clarify the concept, we create the class
Citizen_As_Sensor which is a subclass of the
intersection of the two classes. That is, an individual of the class
Citizen_As_Sensor can be an instance of both classes. But
the instances of foaf:Person or ssn:Sensor are not
necessary to be the individuals of the class Citizen_As_Sensor.
Moreover, the same situation occurs for ssn:SesnorOutput,
as some instances are in sioc:Post or in sioc:Image.
Therefore, we define the class Post_As_SesnorOutput to be in
the intersection of sioc:Post and ssn:SensorOutput, and
the class Image_As_SesnorOutput to be a subclass of both
sioc:Image and ssn:SensorOutput.</p>
    </sec>
    <sec id="sec-13">
      <title>4.2 Formalizations of the extracted name-entities</title>
      <sec id="sec-13-1">
        <title>4.2.1 Geospatial information</title>
        <p>
          In the process of information extraction, name entity
recognition is used to identify the geospatial and species
names. The extraction of geospatial information includes
not only location names (such as names of populated places
and point of interests) and road names with kilometers
but also coordinates (longitude and latitude). If
coordinates were not written in the texts of observation posts,
the location names would be used to retrieve the longitude
and latitude. To semantically encode geospatial data, we
use the vocabularies of Open Geospatial Consortium (OGC)
GeoSPARQL. The GeoSPARQL is one of OGC standards
which provides three main components for semantically
encoding geographic data: (1) The definitions of vocabularies
for representing features, geometries, and their
relationships; (2) A set of domain-specific, spatial functions for use
in SPARQL queries; (3) A set of query transformation rules
[
          <xref ref-type="bibr" rid="ref21">21</xref>
          ].
        </p>
        <p>The ontology of the GeoSPARQL standard includes three
ssn:observerBy
main classes: geo:SpatialObject , geo:Features, and
geo:Geometry . The geo:Feature and geo:Geometry are
the subclass of geo:SpatialObject. The geo:Feature class
represents features, which are abstractions of real world
phenomena. The concept of feature is derived from ISO
19109 General Feature Model. The geo:Geometry,
expressing spatial geometries of the features, has sixteen
subclasses defining a hierarchy of geometry types such as
point, polygon, curve, arc, and multi-curve. These geometry
classes are derived from ISO 19107 Spatial Schema. RDF
literals are used to store geometry values. There are two
ways to store geometry values via RDF literals: Well Known
Text (WKT) and Geography Markup Language (GML). The
geo:asWKT and geo:asGML properties map between the
geometry entities and the geometry literals. Geometry
values for these two properties use the geo:WKTLiteral and
geo:GMLLiteral data types respectively. Figure 5 shows
the classes and properties of GeoSPARQL used in our
ontology.</p>
        <p>Although DUL:hasLocation is usually a predicate in
between ssn:Observation and DUL:Entity in W3C SSN, it
actually can be a property between any entities. To clarify the
place of observation, we create a class PlaceOfObservation
which is a subclass of both of DUL:Entity and
geo:Feature. The class PlaceOfObservation not only keeps the
DUL:hasLocation property but also inherits the formal
geospatial concepts from geo:Feature. As for the time of
an ssn:Observation event, ssn:observationResultTime
can be a predicate in between the class ssn:Observation
and the class time:DateTimeInterval.</p>
      </sec>
      <sec id="sec-13-2">
        <title>4.2.2 Biodiversity information</title>
        <p>
          Discovery and inventory of specimen data is a
fundamental work in biodiversity informatics. With the development
of Internet technologies, the aggregation and dissemination
geo:Feature
of biodiversity data has increased the scale from regional to
global, and has broaden the scope beyond that of
establishing species ranges [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. To reach global biodiversity data
coordination, standardized metadata vocabularies i.e.
Darwin Core is used to develop data infrastructures for sharing
biodiversity data. Darwin Core is a standard for sharing
data about biodiversity — the occurrence of life on earth
and its associations with the environment [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]. However,
Darwin Core is comprised of technology-independent
vocabularies. The classes in Darwin Core are categories and
have no formal domain declarations for vocabularies [
          <xref ref-type="bibr" rid="ref31">31</xref>
          ].
To improve the knowledge representation of Darwin Core,
Darwin-SW8 designs the properties between classes and
formalizes the classes including five existing core classes
of Darwin Core (i.e. Taxon, Event, Identification, Location,
Occurrence) and two new ones (i.e. Token and Individual
Organism). Figure 6 shows the classes and properties of
Darwin Core are used in our ontology.
        </p>
        <p>Traditionally, a specimen collecting all or part of an
organism serves as an evidence for the occurrence of the
organism, and is a basis for identifying the organism to a
taxon concept. However, the documentation process
nowadays has many possible methods such as images, sound,
or DNA sequences. The class dsw:Token is used to
represent evidences from the classes dwctype:Occurrence and
dwctype:Identification. To connect Darwin Core to W3C
SSN, we create classes Token_As_FeatureOfInterest and
Occurrence_As_Stimulus. Token_As_FeatureOfInterest
is a subclass of the intersection of ssn:FeatureOfInterest
and dwstype:Token. The class Occurrence_As_Stimulus
is in the intersection of ssn:Stimulus and
dwctype:Occurrence.
4.3 Transformations from the extracted
nameentities to the RDF model
8https://code.google.com/p/darwin-sw/</p>
      </sec>
    </sec>
    <sec id="sec-14">
      <title>5. SPATIOTEMPORAL QUERIES</title>
      <p>Since the geospatial information is formalized by the
vocabularies of OGC GeoSPARQL, information in our RDF
dataset can be retrieved via spatiotemporal queries. This</p>
      <p>Assembling the above-mentioned vocabularies, we can
create the ontology of “Citizen as Sensor”, as shown in
Figure 7. Such designed ontology plays as the schema for
transforming crowdsourced content to linked sensor data.</p>
      <p>Take Figure 2 as example, we can correspondingly
transform the user-generated content to RDF data, as shown
in the Appendix. The extracted name entities of species
and place names are pointed to by URLs. The word “,~”
(M elogale moschata subaurantiaca) is identified as a taxon
&lt;http://taibif.tw/lod/resource/Species/380522&gt;, as
shown in Figure 8, and mapped to the scientific name
&lt;http://taibif.tw/lod/resource/ScientificName/380522&gt;, PPRREEFFIIXX ggeeoof::&lt;&lt;hthttptp:/:///wwwwww..opoepnegnigsis..nentet//ondtef//gefousnpcatriqoln/#&gt;geosparql/&gt;
as shown in Figure 9. The extracted place name “°” (Sin- PREFIX owl: &lt;http://www.w3.org/2002/07/owl#&gt;
dian) also is linked to a URI in Taiwan Geographic Name PPRREEFFIIXX rrddffs::&lt;&lt;hthttptp:/:///wwwwww..w3w3..orogrg/1/929090/00/20/12/2r-dfrd-fs-chseynmtaa#x&gt;-ns#&gt;
whose URIs are all mapped to Geonames.org, as shown in PREFIX sf: &lt;http://www.opengis.net/ont/sf#&gt;
Figure 10. PPRREEFFIIXX tuinmiets::&lt;&lt;hthttptp:/:///wwwwww..w3o.peonrggi/s2.00n6e/t/tidmeef#/&gt;uom/OGC/1.0/&gt;
PREFIX xsd: &lt;http://www.w3.org/2001/XMLSchema#&gt;
PREFIX eoe: &lt;http://lod.tw/ontologies/eoe.owl#&gt;
PREFIX DUL: &lt;http://www.loa-cnr.it/ontologies/DUL.owl#&gt;
PREFIX ssn: &lt;http://purl.oclc.org/NET/ssnx/ssn#&gt;
study uses BBN Parliament, which is an open source triple
store developed by Raytheon BBN Technologies. The BBN
Parliament is compliant with OGC GeoSPARQL standard,
and supports spatial and non-spatial SPARQL queries.
Using BBN parliament, we build a GeoSPARQL endpoint9. for
the linked crowdsourced sensor dataset. The following lists
a GeoSPARQL query, and Figure 11 is the result of the
query.</p>
      <sec id="sec-14-1">
        <title>9http://lod.tw/parliament/</title>
        <p>DUL:hasLocation</p>
        <p>To efficiently browse the RDF triples, we develop a faceted
viewer10 including a taxon tree, a social relation graph, and
an observation map, as shown on Figure 12. The taxon tree
can visualize the identified species names via their taxon
10http://taibif.tw/vgd/ldow2014/viewer.php
concepts such as kingdom, phylum, class, order, family, and
genus. The social relation graph shows the connections
in between the participants in the citizen science project.
It can be used to view who observes what species, and
where the species occurs. To display locations of species
occurrences, the coordinates are used to pin the species on
the map. Also a timeline is used to show the times of the
species occurrences.</p>
      </sec>
    </sec>
    <sec id="sec-15">
      <title>6. RELATED WORK</title>
      <p>
        Traditionally, in order to ensure the quality of data
collections, training and educating volunteers by experts or
experienced participants is a common method in citizen
science [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. The volunteers, thus, are capable to fill
designated forms, to use well-defined terms, and/or to follow
default steps on the web for reporting their observations.
The user-contributed data, thus, can be fitted to a default
data model. However, this method is difficult to apply when
citizen science projects depend on Web applications and
services. It is argued there exists an inherent trade-off
between data quality and data quantity [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. The growth
of data quantity will be slow if the data contribution is
restricted to experts or trained volunteers. On the contrary,
data volume often increases rapidly if data contribution
is entirely open to volunteers. But data quality is hard to
guarantee. Such volunteered contributions can easily be
imperfect (e.g. erroneous, incomplete, or fraudulent) and
unstructured (e.g. in the form of texts and/or images) [
        <xref ref-type="bibr" rid="ref10 ref6">6,
10</xref>
        ]. Crowdsourcing is the first step of data collection in
citizen science. After preprocessing and cleaning up the
noise in crowdsourced data, it can provide more valuable
information to scientists than what raw data can do. The role
of semantic web technologies is increasingly important for
tackling crowdsourced data. To enable semantic computing
to process crowdsourced data, Sheth proposed
semanticsempowered social computing architecture for dealing with
crowdsourced data [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ]. The architecture emphasized the
use of domain-specific or spatial-temporal-thematic
ontologies for extracting meaning in the data.
      </p>
      <p>
        The idea of citizen sensing is not new. Goodchild coined
the term “Volunteered Geographic Information” (VGI) to
describe a contemporary trend where Web technologies
empower a network of human sensors voluntarily reporting
and interpreting in-situ information [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Sheth also
described Internet users or Web-enabled social community as
citizens. The ability to interact with Web 2.0 services can
augment these citizens into citizen sensors [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. He further
explained the advantages of “human-in-the-loop sensing”,
emphasizing the background knowledge and past
experiences from human in citizen sensing. Janowicz and
Compton developed the Stimulus-Sensor-Observation ontology
pattern which forms the Semantic Sensor Network (SSN)
ontology as developed by the W3C SSN Incubator Group
[
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. The design pattern provides a knowledge
representation for integration of social web and sensor web. Some
studies not only transformed the crowdsourced data to a
standard format such as RDF but also leverage the power
of the SSN ontology to describe the sensors on mobile
devices for passenger information system and in emergency
reporting applications on microblogging platforms [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ].
      </p>
      <p>
        Linked Data has established itself as the de facto means
for the publication of structured data over the Web. More
and more ICT ventures offer innovative data management
services on the top of Linked Open Data (LOD) [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ].
Ortmann et al. described an approach based on LOD to
alleviating the integration problems of crowdsourced data, and
to improving the exploitation of crowdsourced data in
disaster management [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. To solve the problem of structural
and semantic interoperability, they also suggested engage
people in processing unstructured observations into
structured RDF-triples according to Linked Open Data principles.
The process would increase the impact of crowdsourced
data in disaster management, and it shall help
humanitarian agencies make informed decisions. The exploitation
of external semantic resources to disambiguate contents
is often said to be an effective method. To enrich the
semantics of folksonomies, Choudhury et al. not only built
up relations among tags via statistical analysis but also
integrated the structured tags with the linked data cloud
through the DBpedia [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Mendes et al. proposed a Linked
Open Social Signals architecture for collection, semantic
annotation, and analysis of real-time social signals from
microblogging data [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]. The design of Linked Data
management often aim to “reach a high level of automation
with respect to the processing of an open and decentralized
data space bringing together data sources published by
different parties, of varying quality and using heterogeneous
conceptual schemas and vocabularies” [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. Crowley et al.
proposed a generic framework for aggregating and linking
heterogeneous data from various sources and transforming
them to Linked Data [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The framework allows reuse and
integration of the produced data with other data resources
(including social media and sensors) enabling spatial
business intelligence for various domain-specific applications.
      </p>
    </sec>
    <sec id="sec-16">
      <title>7. CONCLUSION AND FUTURE WORK</title>
      <p>Social media creates new opportunities for citizen
science. The information created from social media is
considered a new resource for scientific works. Meanwhile, the
use of social media in citizen science projects also brings
new issues to research data. This study explored the
issues involved in the use of social media in citizen science
projects, as well as reported our experiences in
transferring unstructured collaborative information to structured
data for scientific purposes. We shared our experiences in
tackling the data collection from social process to scientific
process. The successful implementation of this approach
can further facilitate the development of social-media based
citizen science projects. We believe it also has broader
applications in user-generated content management, and
promises to be a practical solution to an important design
problem in citizen science projects on the Web.</p>
      <p>This study deals with crowdsourced content from a
citizen science project via a “Citizen as Sensor” ontology. The
processed data is formalized by inheriting the concepts
from the ontology. Thus, the extracted name entities can
be mapped to the existing resources and linked to
domainspecific concepts. With clarified domain-specific semantics,
the triplified data can be applied in faceted exploration for
new knowledge. This study uses several tools for storing
and visualizing the RDF triples. To make the browser more
usable, a task to integrate the tools into a knowledge-based
browser remains to be done in the future. Moreover, the
triplified dataset should be considered for linkage to larger
linked datasets such as DBPedia and other resources.</p>
    </sec>
    <sec id="sec-17">
      <title>8. REFERENCES</title>
    </sec>
    <sec id="sec-18">
      <title>APPENDIX</title>
      <p>A. FROM UGC TO ENRICHED RDF DATA
eoe:point_559070840853748 rdf:type geo:Point ,
owl:NamedIndividual ;
w3c_geo:long "121.575200" ;
w3c_geo:lat "24.951490" ;
geo:asWKT "Point(121.575200
24.951490)"^^sf:wktLiteral .
eoe:thread_559070840853748 rdf:type sioc:Thread ,
owl:NamedIndividual ;
sioc:has_container fb:groups/roadkilled .
eoe:occr_559070840853748 rdf:type eoe:Occurrence_As_Stimulus ,
owl:NamedIndividual ;
dsw:hasEvidence eoe:token_559070840853748 .
eoe:person_100002525111203 rdf:type eoe:Person_As_Sensor ,
owl:NamedIndividual ;
rdfs:label "Chuang Yu Ta" ;
ssn:detects eoe:occr_559070840853748 ;
ssn:observes eoe:token_559070840853748 ;
foaf:account fb:100002525111203 .
taxon:380522 rdf:type dwctype:Taxon ,</p>
      <p>owl:NamedIndividual ;
dsw:hasName taibif:380522 ;
skos:preLabel "Melogale moschata subaurantiaca" ;
skos:altLabel " ,~’" .</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Auer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.-C. N.</given-names>
            <surname>Ngomo</surname>
          </string-name>
          .
          <article-title>Introduction to linked data and its lifecycle on the web</article-title>
          .
          <source>In Proceedings of the 7th International Conference on Reasoning Web: Semantic Technologies for the Web of Data, RW'11</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>75</lpage>
          , Berlin, Heidelberg,
          <year>2011</year>
          . Springer-Verlag.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>C.</given-names>
            <surname>Bizer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Heath</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          .
          <article-title>Linked data - the story so far</article-title>
          .
          <source>Int. J. Semantic Web Inf. Syst.</source>
          ,
          <volume>5</volume>
          (
          <issue>3</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>22</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>G.</given-names>
            <surname>Chatzimilioudis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Konstantinidis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Laoudias</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Zeinalipour-Yazti</surname>
          </string-name>
          .
          <article-title>Crowdsourcing with smartphones</article-title>
          .
          <source>Internet Computing</source>
          , IEEE,
          <volume>16</volume>
          (
          <issue>5</issue>
          ):
          <fpage>36</fpage>
          -
          <lpage>44</lpage>
          ,
          <year>Sept 2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L.-F.</given-names>
            <surname>Chien</surname>
          </string-name>
          .
          <article-title>Pat-tree-based keyword extraction for chinese information retrieval</article-title>
          .
          <source>In ACM SIGIR Forum</source>
          , volume
          <volume>31</volume>
          , pages
          <fpage>50</fpage>
          -
          <lpage>58</lpage>
          . ACM,
          <year>1997</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>S.</given-names>
            <surname>Choudhury</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. G.</given-names>
            <surname>Breslin</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Passant</surname>
          </string-name>
          .
          <article-title>Enrichment and ranking of the YouTube tag space and integration with the linked data cloud</article-title>
          .
          <source>In International Semantic Web Conference</source>
          , volume
          <volume>5823</volume>
          <source>of LNCS</source>
          , pages
          <fpage>747</fpage>
          -
          <lpage>762</lpage>
          . Springer,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>D.</given-names>
            <surname>Corsar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Edwards</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Velaga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Nelson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          .
          <article-title>Short paper: Addressing the challenges of semantic citizen-sensing</article-title>
          .
          <source>In Proceedings of the 4th International Workshop on Semantic Sensor Networks(SSN'11)</source>
          , pages
          <fpage>101</fpage>
          -
          <lpage>106</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>D.</given-names>
            <surname>Crowley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Passant</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. G.</given-names>
            <surname>Breslin</surname>
          </string-name>
          .
          <article-title>Short paper: Annotating microblog posts with sensor data for emergency reporting applications</article-title>
          .
          <source>In Proceedings of the 4th International Workshop on Semantic Sensor Networks (SSN'11)</source>
          , pages
          <fpage>95</fpage>
          -
          <lpage>100</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>D. N.</given-names>
            <surname>Crowley</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dabrowski</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. G.</given-names>
            <surname>Breslin</surname>
          </string-name>
          .
          <article-title>Decision support using linked, social, and sensor data</article-title>
          .
          <source>In Proceedings of the Nineteenth Americas Conference on Information Systems</source>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>K.</given-names>
            <surname>Crowston</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. E.</given-names>
            <surname>Allen</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Heckman</surname>
          </string-name>
          .
          <article-title>Using natural language processing technology for qualitative data analysis</article-title>
          .
          <source>International Journal of Social Research Methodology</source>
          ,
          <volume>15</volume>
          (
          <issue>6</issue>
          ):
          <fpage>523</fpage>
          -
          <lpage>543</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>D.-P. Deng</surname>
            ,
            <given-names>G.-S.</given-names>
          </string-name>
          <string-name>
            <surname>Mai</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.-H. Hsu</surname>
            ,
            <given-names>T.-R.</given-names>
          </string-name>
          <string-name>
            <surname>Chuang</surname>
            , T.-E. Lin,
            <given-names>H.-H.</given-names>
          </string-name>
          <string-name>
            <surname>Lin</surname>
            , K.-T. Shao,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Lemmens</surname>
            , and
            <given-names>M.-J.</given-names>
          </string-name>
          <string-name>
            <surname>Kraak</surname>
          </string-name>
          .
          <article-title>Using social media for collaborative species identification and occurrence: Issues, methods, and tools</article-title>
          .
          <source>In Proceedings of the 1st ACM SIGSPATIAL International Workshop on Crowdsourced and Volunteered Geographic Information, GEOCROWD '12</source>
          , pages
          <fpage>22</fpage>
          -
          <lpage>29</lpage>
          , New York, NY, USA,
          <year>2012</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>A.</given-names>
            <surname>Flanagin</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Metzger</surname>
          </string-name>
          .
          <article-title>The credibility of volunteered geographic information</article-title>
          .
          <source>GeoJournal</source>
          ,
          <volume>72</volume>
          :
          <fpage>137</fpage>
          -
          <lpage>148</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>H.</given-names>
            <surname>Gao</surname>
          </string-name>
          , G. Barbier, and
          <string-name>
            <given-names>R.</given-names>
            <surname>Goolsby</surname>
          </string-name>
          .
          <article-title>Harnessing the crowdsourcing power of social media for disaster relief</article-title>
          .
          <source>Intelligent Systems</source>
          , IEEE,
          <volume>26</volume>
          (
          <issue>3</issue>
          ):
          <fpage>10</fpage>
          -
          <lpage>14</lpage>
          , May
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>M.</given-names>
            <surname>Goodchild</surname>
          </string-name>
          .
          <article-title>Citizens as sensors: the world of volunteered geography</article-title>
          .
          <source>GeoJournal</source>
          ,
          <volume>69</volume>
          :
          <fpage>211</fpage>
          -
          <lpage>221</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>T. R.</given-names>
            <surname>Gruber</surname>
          </string-name>
          .
          <article-title>A translation approach to portable ontology specifications</article-title>
          .
          <source>KNOWLEDGE ACQUISITION</source>
          ,
          <volume>5</volume>
          :
          <fpage>199</fpage>
          -
          <lpage>220</lpage>
          ,
          <year>1993</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>K.</given-names>
            <surname>Janowicz</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Compton</surname>
          </string-name>
          .
          <article-title>The stimulus-sensor-observation ontology design pattern and its integration into the semantic sensor network ontology</article-title>
          .
          <source>In Proceedings of The 3rd International workshop on Semantic Sensor Networks</source>
          <year>2010</year>
          (
          <article-title>SSN10) in conjunction with the 9th International Semantic Web Conference (ISWC</article-title>
          <year>2010</year>
          ),
          <source>ISWC'10</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>S.</given-names>
            <surname>Kelling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Gerbracht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Fink</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Lagoze</surname>
          </string-name>
          , W.-K. Wong,
          <string-name>
            <given-names>J.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Damoulas</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C. P.</given-names>
            <surname>Gomes</surname>
          </string-name>
          .
          <article-title>A human/computer learning network to improve biodiversity conservation and research</article-title>
          .
          <source>AI Magazine</source>
          ,
          <volume>34</volume>
          (
          <issue>1</issue>
          ):
          <fpage>10</fpage>
          -
          <lpage>20</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>R.</given-names>
            <surname>Lemmens</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Deng</surname>
          </string-name>
          .
          <article-title>Web 2.0 and semantic web: Clarifying the meaning of spatial features</article-title>
          .
          <source>Semantic Web meets Geopatial Applications</source>
          , AGILE,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>C. D.</given-names>
            <surname>Manning</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Schütze</surname>
          </string-name>
          .
          <article-title>Foundations of statistical natural language processing</article-title>
          . MIT press,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>P. N.</given-names>
            <surname>Mendes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Passant</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Kapanipathi</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A. P.</given-names>
            <surname>Sheth</surname>
          </string-name>
          .
          <article-title>Linked open social signals</article-title>
          .
          <source>In Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence</source>
          and
          <string-name>
            <surname>Intelligent Agent</surname>
          </string-name>
          Technology-Volume
          <volume>01</volume>
          , pages
          <fpage>224</fpage>
          -
          <lpage>231</lpage>
          . IEEE Computer Society,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>G.</given-names>
            <surname>Newman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Zimmerman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Crall</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Laituri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Graham</surname>
          </string-name>
          , and
          <string-name>
            <surname>L. Stapel.</surname>
          </string-name>
          <article-title>User-friendly web mapping: lessons from a citizen science website</article-title>
          .
          <source>Int. J. Geogr. Inf. Sci.</source>
          ,
          <volume>24</volume>
          (
          <issue>12</issue>
          ):
          <fpage>1851</fpage>
          -
          <lpage>1869</lpage>
          , Dec.
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>OGC. GeoSPARQL - A Geographic Query</surname>
          </string-name>
          <article-title>Language for RDF Data</article-title>
          .
          <source>Technical report</source>
          , http://www.opengeospatial.org/standards/geosparql,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>J.</given-names>
            <surname>Ortmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Linbu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Dong</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Kauppinen</surname>
          </string-name>
          .
          <article-title>Crowdsourcing linked open data for disaster management</article-title>
          . In W. W. Cohen and S. Gosling, editors,
          <source>Terra Cognita</source>
          , pages
          <fpage>11</fpage>
          -
          <lpage>22</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>J.</given-names>
            <surname>Parsons</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Lukyanenko</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wiersma</surname>
          </string-name>
          .
          <article-title>Easier citizen science is better</article-title>
          .
          <source>Nature</source>
          ,
          <volume>471</volume>
          (
          <issue>7336</issue>
          ):
          <fpage>37</fpage>
          ,
          <string-name>
            <surname>Mar</surname>
          </string-name>
          .
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>A.</given-names>
            <surname>Sheth</surname>
          </string-name>
          .
          <article-title>Citizen sensing, social signals, and enriching human experience</article-title>
          .
          <source>Internet Computing</source>
          , IEEE,
          <volume>13</volume>
          (
          <issue>4</issue>
          ):
          <fpage>87</fpage>
          -
          <lpage>92</lpage>
          ,
          <year>July 2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>A.</given-names>
            <surname>Sheth</surname>
          </string-name>
          .
          <article-title>Computing for human experience: Semantics-empowered sensors, services, and social computing on the ubiquitous web</article-title>
          .
          <source>Internet Computing</source>
          , IEEE,
          <volume>14</volume>
          (
          <issue>1</issue>
          ):
          <fpage>88</fpage>
          -
          <lpage>91</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>J.</given-names>
            <surname>Silvertown</surname>
          </string-name>
          .
          <article-title>A new dawn for citizen science</article-title>
          .
          <source>Trends in Ecology &amp; Evolution</source>
          ,
          <volume>24</volume>
          (
          <issue>9</issue>
          ):
          <fpage>467</fpage>
          -
          <lpage>471</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>E.</given-names>
            <surname>Simperl</surname>
          </string-name>
          .
          <article-title>Crowdsourcing semantic data management: Challenges and opportunities</article-title>
          .
          <source>In Proceedings of the 2Nd International Conference on Web Intelligence</source>
          , Mining and Semantics, WIMS '
          <volume>12</volume>
          , pages
          <issue>1</issue>
          :
          <fpage>1</fpage>
          -
          <issue>1</issue>
          :
          <fpage>3</fpage>
          , New York, NY, USA,
          <year>2012</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>C.</given-names>
            <surname>Stadler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lehmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Höffner</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Auer</surname>
          </string-name>
          .
          <article-title>Linkedgeodata: A core for a web of spatial open data</article-title>
          .
          <source>Semantic Web Journal</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ):
          <fpage>333</fpage>
          -
          <lpage>354</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>B. L.</given-names>
            <surname>Sullivan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. L.</given-names>
            <surname>Wood</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. J.</given-names>
            <surname>Iliff</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. E.</given-names>
            <surname>Bonney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Fink</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Kelling</surname>
          </string-name>
          .
          <article-title>ebird: A citizen-based bird observation network in the biological sciences</article-title>
          .
          <source>Biological Conservation</source>
          ,
          <volume>142</volume>
          (
          <issue>10</issue>
          ):
          <fpage>2282</fpage>
          -
          <lpage>2292</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>K.</given-names>
            <surname>Verspoor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. B.</given-names>
            <surname>Cohen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lanfranchi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Warner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. L.</given-names>
            <surname>Johnson</surname>
          </string-name>
          , C. Roeder,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Choi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Funk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Malenkiy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Eckert</surname>
          </string-name>
          , et al.
          <article-title>A corpus of full-text journal articles is a robust evaluation tool for revealing differences in performance of biomedical natural language processing tools</article-title>
          .
          <source>BMC bioinformatics</source>
          ,
          <volume>13</volume>
          (
          <issue>1</issue>
          ):
          <fpage>207</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>C.</given-names>
            <surname>Webb</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Baskauf.</surname>
          </string-name>
          Darwin-sw:
          <article-title>Darwin core data for the semantic web</article-title>
          .
          <source>TDWG Annual Meeting;</source>
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>J.</given-names>
            <surname>Wieczorek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Bloom</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Guralnick</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Blum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Döring</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Giovanni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Robertson</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Vieglais</surname>
          </string-name>
          .
          <article-title>Darwin core: An evolving community-developed biodiversity data standard</article-title>
          .
          <source>PLoS ONE</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          ):e29715,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <surname>K.-F. Wong</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Xu</surname>
            , and
            <given-names>Z.-s. Zhang.</given-names>
          </string-name>
          <article-title>Introduction to Chinese Natural Language Processing</article-title>
          . Morgan &amp; Claypool Publishers,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          @prefix rdf: &lt;http://www.w3.org/
          <year>1999</year>
          /02/22-rdf-syntax-ns#&gt; .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>@prefix foaf: &lt;http://xmlns.com/foaf/0.1/&gt; .</mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          @prefix w3c_geo: &lt;http://www.w3.org/
          <year>2003</year>
          /01/geo/wgs84_pos#&gt; .
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          @prefix rdfs: &lt;http://www.w3.org/
          <year>2000</year>
          /01/rdf-schema#&gt; .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>@prefix time: &lt;http://www.w3.org/2006/time#&gt; .</mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          @prefix owl: &lt;http://www.w3.org/
          <year>2002</year>
          /07/owl#&gt; .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>@prefix xsd: &lt;http://www.w3.org/2001/XMLSchema#&gt; .</mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          @prefix rdf: &lt;http://www.w3.org/
          <year>1999</year>
          /02/22-rdf-syntax-ns#&gt; .
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          @prefix skos: &lt;http://www.w3.org/
          <year>2004</year>
          /02/skos/core#&gt; .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>