<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>KnowledgeWiki: An OpenSource Tool for Creating Community-Curated Vocabulary, with a Use Case in Materials Science</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Nishita Jaykumar</string-name>
          <email>nishita@knoesis.org</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sarasi Lalithsena</string-name>
          <email>sarasi@knoesis.org</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>PavanKalyan Yallamelli</string-name>
          <email>pavany@knoesis.org</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Krishnaprasad</string-name>
          <email>tkprasad@knoesis.org</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Clare Paul</string-name>
          <email>clare.paul@us.af.mil</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vinh Nguyen</string-name>
          <email>vinh@knoesis.org</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Amit Sheth</string-name>
          <email>amit@knoesis.org</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Air Force Research Laboratory</institution>
          ,
          <addr-line>Wright-Patterson AFB, Dayton, OH</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Kno.e.sis Center, Wright State University</institution>
          ,
          <addr-line>Dayton Ohio</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Kno.e.sis Center, Wright State University</institution>
          ,
          <addr-line>Dayton, OH</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Thirunarayan, Kno.e.sis Center, Wright State University</institution>
          ,
          <addr-line>Dayton, OH</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p />
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Resource Description Framework (RDF) datasets can be
created by transforming structured databases, extracting
the triples from semi-structured and unstructured sources,
crowd-sourcing, or by integrating the existing datasets. The
reliability and quality of these datasets can be improved by
the participation of domain experts via a special purpose
tool or a crowd-sourced application. Wikidata and
Semantic MediaWiki are platforms which facilitate this kind of
crowd-sourced data curation.</p>
      <p>We present our system, KnowledgeWiki, which is built
upon the existing Semantic MediaWiki. We develop a novel
extension by adopting the singleton property data model in
our KnowledgeWiki. This extension allows various kinds of
metadata about the RDF triples to be created in the Wiki.
We combine this extension with other extensions such as
semantic forms to provide a user-friendly, Wiki-like interface
for domain experts with no prior technical expertise to easily
curate data. We also present our new enhancement to
Semantic Mediawiki, which facilitates importing existing RDF
datasets into the wiki-based curating platform based on the
singleton property approach, that preserves the provenance
of individual triples. We also describe how it is being used
by the materials science community to create and curate
consolidated vocabularies.
1.</p>
    </sec>
    <sec id="sec-2">
      <title>INTRODUCTION</title>
      <p>The White House's Materials Genome Initiative (MGI)
seeks to substantially improve the process of materials
discovery and development, and shorten the time to
deployment. One of the main goals of MGI is to develop solutions
which provide broader access to scienti c data. This allows
materials scientists to integrate each other's data and
facilitate communication among scientists working in di erent
stages of the materials development continuum.</p>
      <p>
        A key challenge in data integration is dealing with the
heterogeneity of data in the Semantic Web community [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
Standardized vocabularies are widely used as a component
of a toolkit to solve data heterogeneity issues. They play
the role of a shared language, which facilitates easy
communication and information exchange among people within the
community.
      </p>
      <p>
        While there exist disparate sets of vocabularies developed
for the materials domain, there is no easy mechanism to
curate these vocabularies by the domain scientists spreading
all over the world. The lack of such a mechanism prevents
the wider adoption of these vocabularies. Further, existing
vocabularies lack the support to capture provenance
metadata. Provenance metadata is crucial for data integration
from disparate sources in order to determine the
trustworthiness of the data and also to give proper credit to the
creators of the data. Provenance metadata would increase
interoperability, discoverability, reliability as well as
reproducibility for scienti c discourse and evidence-based
knowledge discovery [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        Crowd-sourcing is a cost-e ective and reliable approach
to easily distribute a task among a potentially large group
of contributors. The Semantic Web community has used
crowd-sourcing techniques for knowledge acquisition tasks,
including vocabulary development [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Semantic Mediawiki
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] is one such platform that can be used for crowd-sourced
vocabulary curation. However, it lacks built-in support to
capture the provenance metadata of RDF triples.
      </p>
      <p>
        To the best of our knowledge, Wikidata is the only
crowdsourced knowledge acquisition platform which supports
incorporating such provenance metadata [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. It is being used
to create and curate structured online database for
Wikipedia. Wikidata allows editors to annotate attribute-value
pairs using quali ers and references as a way to support
metadata. For this purpose, Wikidata uses an auxiliary node
in a way which is similar to a blank node as discussed in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
However, the RDF representation of this data model is not
intuitive and does not map to the standard RDF triples.
      </p>
      <p>
        In this work, we try to address the aforementioned
challenges with our tool, KnowledgeWiki. We adopt the
singleton property template approach developed by Nguyen et
al. A singleton property is de ned as a unique property
instance representing a newly established relationship between
two existing entities in one particular context [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. This
approach o ers a concise representation for RDF statements
about statements, with a formal semantics for an accurate
interpretation across applications, tools, and datasets.
Recent studies [
        <xref ref-type="bibr" rid="ref7 ref8">7, 8</xref>
        ] reported that the singleton property
approach o ered the most concise representation on a triple
level. Therefore, we adopted the singleton property in our
data model for the extension.
      </p>
      <p>
        In our KnowledgeWiki, by using Semantic MediaWiki as
the curation platform and embedding the singleton
property approach into Semantic MediaWiki as an extension, we
intend to capture metadata of RDF triples such, as
provenance information. We combine this extension with other
extensions such as semantic forms to provide a user-friendly
interface for data collection. The goal of KnowledgeWiki
is to provide a wiki-based platform for assisting in the
creation and curation of vocabularies in the materials science
domain. Our main contributions in this work are three-fold:
1. A Singleton Property Template Extension to
Semantic Mediawiki to capture the metadata
of RDF triples
We incorporate the singleton property approach for
RDF data representation into SMW. SMW takes a
simple straightforward approach to represent triples.
However, as mentioned earlier provenance information
is essential, but missing. The singleton property
template data model, which is an improvement over the
standard rei cation approach, is suitable for
representing metadata about the data in materials science [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
2. An algorithm to identify Singleton Property
Templates from RDF datasets and to support
importing RDF datasets into the wiki
We propose an algorithm to automatically identify the
regular and singleton property templates for every
entity from a given RDF dataset. All the templates
related to a single entity will be presented in the same
wiki page. This page allows the domain experts to
curate the content.
3. Demonstration of the use of this extension in
the materials science domain
We import three vocabularies extracted from the ASM
Handbook Volume 21, MIL-HDBK-5, and
MIL-HDBK17 from the materials science domain. We adopted
the singleton property template extension for
representing the provenance of the vocabularies. The three
vocabularies have been curated in our KnowledgeWiki.
For representing the provenance information, such as
source and license, we reuse the existing vocabularies
such as SKOS1, Dublin Core2, and QUDT (Quantities,
Units, Dimensions and Data Types)3.
      </p>
      <p>The remainder of the paper is organized as follows:
Section 2 discusses the context for the research, Section 3
discusses related work, Section 4 outlines our approach, Section
5 discusses our materials science use case. Finally, Section
6 and Section 7 discusses the future work and conclusion of
our work respectively.
2.</p>
    </sec>
    <sec id="sec-3">
      <title>CONTEXT FOR THIS RESEARCH</title>
      <p>
        The availability of a crowd-sourcing tool is crucial to achieve
the requirements proposed by MGI. If made widely available,
disparate sources of materials data also could be inventoried
to identify gaps in data and to limit redundancy in research
e orts. According to MGI, \To bene t from broadly
accessible materials data, a culture of data sharing must
accompany the construction of a modern materials data
infrastructure that includes the software, hardware, and data
standards necessary to enable discovery, access, and use of
materials science and engineering data. The system should
be available to house, search, and curate materials data
generated by the community. The initiative also states that the
community-developed standards should provide the format,
metadata, data types and criteria necessary for
interoperability and seamless data integration" [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ].
      </p>
      <p>
        The Air Force Research Laboratory (AFRL) proposed to
work towards the goals of the Materials Genome Initiative,
mainly in the context of bringing the materials science
community together to collaboratively create and curate a
consolidated vocabulary for materials science. For this purpose,
AFRL and its partners provided us with initial legacy data.
This data is comprised of materials science dictionary terms
from three vocabularies: ASM Handbook Volume 21 [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ],
MIL-HDBK-5 [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], and MIL-HDBK-17 [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The materials
science community was in need of a system that could: (1)
consolidate these vocabularies, (2) represent each dictionary
term and its metadata such as, provenance appropriately,
and (3) provide the community broader and easier access to
materials science terms and de nition.
      </p>
      <p>These requirements which were presented to us by AFRL
are ful lled via our KnowledgeWiki tool. We present its
development for ful lling the requirements along with some
preliminary results in the rest of the paper.
3.</p>
    </sec>
    <sec id="sec-4">
      <title>RELATED WORK</title>
      <p>
        The Semantic Web community leveraged crowd-sourcing
techniques for the purpose of data curation [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
Semantic wikis, which enhance traditional wikis with structured
knowledge representation, have been used to facilitate
collaborative development of ontologies and knowledge bases
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Semantic MediaWiki [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] is a widely known semantic
wiki and it has been used to capture semantic data in variety
1https://www.w3.org/2009/08/skos-reference/skos.html
2https://www.w3.org/TR/prov-dc/
3http://qudt.org/
of areas including healthcare [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], energy, media, and air
navigation. Semantic Mediawiki is currently being used in over
300 public wikis around the globe. Some of the other
examples of Semantic wikis include: OntoWiki [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], IkeWiki [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ],
SweetWiki [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], and Acewiki [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. More details on di erent
kinds of wikis can be found in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. However, none of these
wikis have a simple way to incorporate metadata into their
data models, a challenge our work addresses.
      </p>
      <p>
        As mentioned earlier Wikidata is the only crowd-sourced
application which provides the capability to incorporate
metadata. Wikidata [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] is a prominent community-oriented
effort to create and curate an online, structured knowledge
base that can be used by every language version of Wikipedia.
For example, the de nition of a term can be further
accompanied by its source and license information. In order to
represent this in RDF, Wikidata uses auxiliary node in a way
that is similar to a blank node. Figure 1 shows an example
of the modeling with an auxiliary node. Here, property P26
(De nition Text) is broken into two properties to use the
auxiliary node to link to the context information. As they
mentioned in their paper, this led to Wikidata properties
not directly corresponding to properties in RDF.
      </p>
      <p>
        The widely-known techniques for incorporating metadata
into the RDF data model are: (1) rei cation, (2) n-ary
relation, (3) the singleton property, and (4) a named graph.
In the recent work by Hernandez et al., [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] the authors
compared these techniques for reifying RDF triples, with the
goal of representing Wikidata as RDF, which would allow
legacy Semantic Web languages, techniques, and tools to
be used for Wikidata. They reported that the singleton
property approach o ered the most concise representation
on the triple level. Similarly, this approach also o ers the
most compact dataset according to the experimental
comparison in the PubChem dataset [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Therefore, we adopted
the singleton property approach [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], which was originally
developed by our group, to represent the metadata about
the RDF triples.
      </p>
      <p>Existing work, including Wikidata, lacks support for
importing an existing RDF data set with metadata. Even
though the SMW extension RDFIO4 provides the
capability to import arbitrary RDF triples into the wiki, it does
not have the capability to handle an RDF data set with
metadata information. The proposed RDF import
extension automatically identi es the RDF subgraph structure of
the dataset and imports the dataset while preserving the
4https://www.mediawiki.org/wiki/Extension:RDFIO</p>
      <p>In this section, we rst describe the overall architecture
of the system. Next, we describe how we developed the new
extension with singleton property templates for representing
the provenance metadata of the triples. Then, we describe
the algorithm for identifying the singleton property
templates for any given RDF dataset. The overall architecture
of KnowledgeWiki is shown in Figure 3.
4.1</p>
    </sec>
    <sec id="sec-5">
      <title>Overall Architecture</title>
      <p>The following sections describes the architecture overview
of our system (see Figure 3). We rst explain how the data
is collected via the existing semantic forms and how the
singleton property template is integrated into the SMW. Next,
we describe our new data representation module for SMW.
We also describe how each entity is processed and, how the
triples are created and, how each entity is represented on
a wiki page. Finally, we discuss how more complex
operations, such as CSV data import and RDF import/export are
performed.</p>
      <p>Data Collection. Templates are an integral part of
Semantic MediaWiki and the simplest way to give input. Each
template is de ned as a set of eld and value pairs. Each
eld in the template is mapped to a separate semantic
property. Semantic properties in SMW are used to express binary
relationships between semantic entities. The eld values can
be set to a number of prede ned datatypes, such as Text,
URL, Page, Boolean, Number, etc.</p>
      <p>For example, a regular template which provides the text
de nition for a given term is de ned as follows:
{{Definition Text
| Definition = }}</p>
      <p>For the term Autoclave, the page would be titled Autoclave
and this page would contain the regular template \De nition
Text" along with the property name and its value as follows:
{{Definition Text
| Definition = A closed vessel for producing ..}}</p>
      <sec id="sec-5-1">
        <title>Data</title>
      </sec>
      <sec id="sec-5-2">
        <title>Collection</title>
      </sec>
      <sec id="sec-5-3">
        <title>Semantic Forms (MMD Form)</title>
        <p>Singleton Template A
Property B: Value B
Property C: Value C
Template X
Property Y: Value Y
Property Z: Value Z</p>
      </sec>
      <sec id="sec-5-4">
        <title>Data</title>
      </sec>
      <sec id="sec-5-5">
        <title>Representation</title>
      </sec>
      <sec id="sec-5-6">
        <title>Parsing</title>
        <p>Datatype API
Data Processing
Type: Number
Type: Type
Type: URL</p>
      </sec>
      <sec id="sec-5-7">
        <title>Semantic Mediawiki</title>
      </sec>
      <sec id="sec-5-8">
        <title>Pages</title>
      </sec>
      <sec id="sec-5-9">
        <title>Rendering</title>
      </sec>
      <sec id="sec-5-10">
        <title>Semantic Data Processing</title>
      </sec>
      <sec id="sec-5-11">
        <title>Data</title>
      </sec>
      <sec id="sec-5-12">
        <title>Management</title>
      </sec>
      <sec id="sec-5-13">
        <title>CSV Import</title>
      </sec>
      <sec id="sec-5-14">
        <title>RDF Import</title>
      </sec>
      <sec id="sec-5-15">
        <title>RDF Export</title>
      </sec>
      <sec id="sec-5-16">
        <title>Mediawiki DB (MySQL)</title>
      </sec>
      <sec id="sec-5-17">
        <title>Semantic Store (Virtuoso)</title>
      </sec>
      <sec id="sec-5-18">
        <title>SPARQL Endpoint</title>
        <p>Templates allow users to specify annotations in the wiki
without the need of having to learn any kind of syntax. For
example, the eld \De nition" is mapped to the property
mv:de nition5, and this property holds the value \A closed
vessel..." as asserted in the following triple:</p>
        <p>Autoclave mv:definition "A closed vessel..."
This is the standard triple format; however, if we want
to describe the metadata about this triple, SMW does not
support it. For example, this triple was taken from the ASM
handbook glossary, but the existing template does not allow
for such an annotation to be represented.</p>
        <p>To overcome this, we modify the data model at the
template level. We developed a special purpose template called
\singleton property template", that is generic and allows for
any kind of data annotation such as provenance, access
control, or spatio-temporal information. We took the built-in
template and enhanced it to support metadata information.
We refer to this extension as the singleton property
template6. This enhancement, when used in semantic forms
for data collection from domain experts, will allow users to
specify assertions about the entity within the existing
infrastructure. Below is an example of how this information will
be represented using our singleton property template:
{{Definition Text
| Definition = A closed vessel for producing..
| Source = ASM handbook}}</p>
        <p>Templates are used to create forms. A semantic form is
a collection of related templates. This singleton property
5mv: Materials Vocabulary - MatVocab
6http://matvocab.org/wiki-dev/index.php/Special:
CreateMetaTemplate
template is included in our \Materials Manufacturing and
Design Form" depicted in Figure 5. We provide the details
on the development of this template in Section 4.2. We use
the semantic forms provided by the SMW to allow users to
add the terms and/or modify the element details.</p>
        <p>One of the goals of our system is to promote collaboration
and facilitate experts to edit data easily using our tool. By
using the semantic forms, domain experts can easily edit and
create new data on the wiki. In order to foster collaboration,
making this wiki-based form easy to use is crucial. For this
purpose, SMW also provides an \Edit with Form" option,
which allows users to edit each page via user-friendly forms
as depicted in Figure 5.</p>
        <p>KnowledgeWiki provides the following features: (1)
support for the singleton property approach to capture the
metadata, and (2) support for adding typed information of the
modeling elements.</p>
        <p>Data Representation. Here we discuss (1) how we use
the singleton property templates to represent data about an
entity in the semantic store and also (2) how each entity is
represented in a wiki page.</p>
        <p>The rst task is accomplished by the parsing phase. Once
the data is collected from users via the form, the Datatype
API is responsible for type checking and for mapping the
imported properties within the wiki for appropriate
representation. The de nition of a sample singleton property
template is shown in Figure 2. Within each template de
nition, there exists a hidden wiki snippet with a magic word.
Each magic word is associated with a set of parameters
corresponding to the eld-value pairs of the template. The
magic word and the associated parameters are processed
for creating triples in our extension. The triples generated
are inserted into the semantic store, and can be queried via
SPARQL. The semantic store can be chosen from a variety
of well-known engines: 4store, Blazegraph, Sesame,
Virtuoso, etc. In the work by Hernandez et al., they report that
singleton properties worked best with the Virtuoso triple
store and, hence, for our KnowledgeWiki we chose
Virtuoso. MySQL DB stores most of the schema-level information
such as, template, property and, form names and Virtuoso
has the semantic data as triples.</p>
        <p>The second task of representing entities on a wiki page
is accomplished by the rendering phase. In addition to the
creation of triples, a page is created for each entity on the
wiki. For this page, our extension renders the data from the
templates associated with each entity. Finally, a wiki page
is created for each entity with the term name as the page
title within the main namespace.</p>
        <p>Data Management. This phase involves the semantic
content management. This phase performs complex
operations that are conducted within the wiki (such as semantic
data processing). The wide range of capabilities that
KnowledgeWiki provides, allow for various tasks such as legacy
data processing, RDF data import, RDF data export, and
so on.
4.2</p>
      </sec>
    </sec>
    <sec id="sec-6">
      <title>Singleton Property Template Extension</title>
      <p>As mentioned earlier in Section 4.1, templates are an
integral part and the simplest way of including markup in the
wiki. We introduced the singleton property template in
Section 4.1. and in this section we describe the implementation
details. The singleton property template is an extension
that we implemented for representing the metadata of RDF
triples such as provenance. Since we developed a new
template for the purpose of disambiguation, we name the
traditional SMW template as a regular template and our new
template as a singleton property template. Every singleton
property template contains a set of eld-value pairs:
{{Singleton Property Template name
| property_1 = value_1
| property_2 = value_2
| property_3 = value_3
}}</p>
      <p>Each eld is mapped to a semantic property. Within
each template, a property selected for instantiating
singleton properties and is speci ed in the MagicWord parameters
associated with this template. A sample de nition for the
singleton property template is shown in Figure 2. We
introduce the MagicWord \#singletontemplate" for processing
the singleton property template, for example:
#singletontemplate:singleton prop=property 1.</p>
      <p>When creating the singleton property template, the user
gets to select the property to instantiate the singleton
property. Each template can contain only one singleton property.
This singleton property will bear the metadata of the RDF
triples and the semantic forms can contain more than one
singleton or regular template. In this case, the singleton
property will be created for the property \property 1." It
is associated with other meta properties such as \property
2" and \property 3." The singleton property template above
will be mapped to this set of triples as seen in Table 1.</p>
      <p>For instance, for the term Autoclave, we have a term
definition for it. This de nition has other metadata associated
with it, such as the source of the de nition, which is
provenance information. We have the rights or the license
information associated with this de nition. As discussed earlier,
the regular template doesn't have support for this kind of
representation. With the singleton property template, we
can represent the metadata requirement in this example.
Particularly, we de ne the singleton property template for
the term Autoclave as follows:
{{Definition Text
| Definition = A closed vessel..
| Source = ASM handbook Volume 21: Composites.
| Rights = Reproduced with permission of ASM
International. All rights reserved.
www.asminternational.org}}</p>
      <p>For processing this singleton property template, the
MagicWord parameter is de ned as:
#singletontemplate:singleton prop=De nition. This
singleton property \De nition" will bear the metadata of the RDF
triples, such as \Source" and \Rights." The singleton
property template above will be mapped to this set of triples as
seen in Table 2.</p>
      <p>The advantage of our approach is that the singleton
property template extension was seamlessly incorporated into the
existing extensions. We will demonstrate the use of the
singleton property extension for curating materials science
vocabularies in Section 5.
4.3</p>
    </sec>
    <sec id="sec-7">
      <title>Identifying Templates and Singleton Property Templates from RDF datasets</title>
      <p>As we extend Semantic MediaWiki to develop
KnowledgeWiki for curating the vocabularies, we identify its
potential as a curation platform for any given RDF dataset.
To exploit the full potential of this crowd-sourcing
platform for the curation of RDF datasets, importing the RDF
dataset into the Semantic MediaWiki platform is required.
Hence, we developed an extension to import an existing RDF
dataset into Semantic MediaWiki.</p>
      <p>We developed an algorithm to create pages in Semantic
MediaWiki for each entity given the RDF dataset as an
input. It also has the capability to handle the provenance
information included in the dataset by reusing the singleton
property template.</p>
      <p>mv:Termi
skos:Concept
rdfs:SeeAlso</p>
      <p>rdf:type
rdf:type</p>
      <p>mv:Term
mv:synonym</p>
      <p>vaem:abbreviation
synonym text</p>
      <sec id="sec-7-1">
        <title>Abbreviation</title>
      </sec>
      <sec id="sec-7-2">
        <title>Text</title>
        <p>dcterms:Agent
rdfs:label
mv:URI
dc:source
mv:TermskosDefinition
001
dc:creator
mv:URI
dc:rights
rdfs:label
vaem:Abbreviation</p>
      </sec>
      <sec id="sec-7-3">
        <title>Term Label</title>
      </sec>
      <sec id="sec-7-4">
        <title>Abbreviation</title>
        <p>Text
definition text
mv:singletonPropertyOf
mv:URI
skos:Definition
rdf:type
rdfs:label</p>
      </sec>
      <sec id="sec-7-5">
        <title>Creator Label rdf:type rdfs:label dcterms:</title>
      </sec>
      <sec id="sec-7-6">
        <title>RightStatement</title>
      </sec>
      <sec id="sec-7-7">
        <title>Right Statement</title>
      </sec>
      <sec id="sec-7-8">
        <title>Label</title>
        <p>For the purpose of curation, there exists no mechanism to
bring existing RDF datasets into the wiki for curation. This
is essential for wider usage and acceptability in the
semantic web community. To this end, we have implemented an
enhancement in our KnowledgeWiki where users can upload
existing RDF datasets into the wiki and open them up to the
community to add or edit existing information7. The user is
only required to provide the named graph and the SPARQL
endpoint address to KnowledgeWiki. Our algorithm rst
automatically identi es the RDF subgraph structures
corresponding to the regular and singleton property templates
associated with each entity. Finally, we create a wiki page
for each entity along with the data obtained from the
associated templates. In Section 4.1, we states that in order
to use the forms the properties and the templates have to
be created in advance. However, this algorithm identi es
and creates the set of semantic properties from a given RDF
dataset on the y. Properties and templates that are being
used in any given form should be created in advance and
must exist prior to using them within the semantic forms.</p>
        <p>Automatic creation of the properties and templates is a
very useful feature since it is not feasible to create all the
necessary properties and templates in advance. For a dataset
like Yago2S, which contains over 2.8 million entities with 33
distinct regular properties and 83 distinct generic properties,
it becomes tedious to create all these di erent properties in
advance. With this approach, we can automatically
identify the set of properties in a given RDF dataset and create
properties on the y.
7http://matvocab.org/wiki-dev/index.php/Special:
Importdataset
Algorithm 1 Property-Template Approach algorithm
1: procedure PT{Approach
2: identify a list of regular properties
3: identify a list of generic properties
4: create one wiki page per property
5: for each property, check the count of datatypes it
has (using group by query) do
6: if it has only datatype, map that datatype to the</p>
        <p>SMW datatype (create the [[has type: type]])
7: else create an empty property page
8: if the object is URI then the datatype is Page
9: end for
10: create a list of regular templates, the name of the
template is taken from the name of the property
11: generate the regular template tag.
12: create a list of singleton property template, the name
of the template is taken from the generic property
13: generate the meta-template tag/code for each
template
14: identify the list of entities
15: for each entity do
16: identify the list of regular and singleton property
template associated with this entity
17: create a wiki page for the content obtained from
the templates
18: end for
19: end procedure</p>
        <p>Algorithm. The stepwise implementation of the
algorithm is de ned here for importing an RDF dataset into
the wiki by identifying the regular and singleton property
templates in the dataset.</p>
        <p>Here we de ne three kinds of properties: regular
properties, generic properties, and singleton properties. A typical
property is termed as regular property. A property that has
a singleton property derived from it, is termed a generic
property. Singleton properties can be viewed as instances of
generic properties whose extensions contain a set of entity
pairs. If SP rdf:singletonPropertyOf P, then SP is the
singleton property of the generic property P and both these
properties are regular properties.</p>
        <p>Next, we identify all the distinct regular and generic
properties and create a page for each property. During property
creation task, our algorithm checks the datatype of each of
the property for the appropriate datatype association. For
example, for the property mv:sourceURL, which is used to
specify the resource link of the source of the de nition, we
create a property of the type URL. We create a property
page with the title mv:sourceURL and the content of this
page contains [[Has type::URL]].</p>
        <p>Then, we create one template per property. The template
title is the name of the property, and the wiki page holding
the template information also contains the MagicWord for
generating the necessary triples.</p>
        <p>We also create a list of singleton property templates. Since
a singleton property is an instance of a generic property,
we name the singleton templates with the generic property
name. We add the MagicWord and its associated parameters
\#singletontemplate:singleton prop=" within each template
page for processing singleton property templates.</p>
        <p>Once all the necessary properties and templates are
created, for each entity in the dataset, a wiki page is created
to represent the entity by adding all the required templates
with its values in the content of the wiki page.</p>
        <p>We implemented the algorithm in our KnowledgeWiki for
importing any given RDF graph, provided via SPARQL
endpoints. Our SPARQL endpoint is public and available for
querying. This feature is available at our wiki8. This work
is ongoing and we are planning to evaluate this algorithm
with di erent datasets.</p>
      </sec>
    </sec>
    <sec id="sec-8">
      <title>USE CASE FOR MATERIALS SCIENCE</title>
      <p>In this work, we were particularly interested in
understanding how our KnowledgeWiki could be utilized in
materials science community. We would like to explore this
question quantitatively and qualitatively with respect to the
materials science domain. The architecture of our
KnowledgeWiki was discussed in Section 4.1. Here we describe a
speci c use case of the system for materials science.
8http://matvocab.org/wiki-dev/index.php/Special:
Importdataset</p>
      <p>Schema-level description of vocabularies. We were
provided with three vocabularies by the community,
including ASM Handbook Volume 21, MIL-HDBK-17, and
MILHDBK-5. The data provided to us was legacy data present
in excel spreadsheets. We worked with domain scientists and
identi ed the following requirements: (1) consolidate these
disparate sets of vocabularies to have one common
vocabulary describing the materials science domain, (2) develop
a method to represent each term and its provenance
metadata appropriately, and (3) make this wiki-based tool open
for community authoring.</p>
      <p>Singleton Property Templates with semantic
interface for crowd-sourcing. To address the requirements
described above, we developed a new data model for
representation. Our data model captures elements such as
definition text, image, sound and other elements to represent
each term. We de ned eleven templates to model and
represent the materials science vocabulary, including six singleton
property templates and ve regular templates. The
singleton property templates are De nition Text, Image, Video,
Sound Recording, Equation, and Code Snippet. The regular
templates are Name Abbreviation Synonym, Symbol, Other
Website De nition, Unit, and References.</p>
      <p>We use existing vocabularies such as dcterms (Dublin
Core), skos (SKOS), and qudt (Quantities, Units,
Dimensions and Data Types) to de ne the classes and properties.
We also create a new pre x mv (MatVocab) for the new
integrated materials science vocabulary. Figure 4 shows
the schema-level data model that we developed using the
singleton property template extension. The property mv:
TermskosDe nition001 is a singleton property instance of
the imported property skos:de nition and is used to specify
the de nition of a term. Using the singleton property data
model, we can specify all the metadata associated with the
de nition such as provenance information dcterms:source
and rights information dcterms:rights. When creating a
singleton property template, the user gets to select the
property to instantiate the singleton property. For example, in
Figure 4 the \skos:de nition" is selected to generate the
singleton property.</p>
      <p>The singleton property template uses the singleton
property instance to refer to the entire triple succinctly, and
enable metadata to be associated with triples via the property
instance. Given a vocabulary term, our data model allows
users to add multiple de nitions (with associated details) for
any element. For example, the term Autoclave can have
multiple de nitions derived from di erent vocabularies such as
the ASM Handbook Volume 21, MIL-HDBK-5, and
MILHDBK-17. Singleton property templates can handle such
representations easily.</p>
      <p>Finally as mentioned earlier, using these templates along
with the forms a wiki page is created for each entity with
the term name as the page title within the main namespace.</p>
      <p>Speci cally, Table 4 describes a simple example where,
matsup could be the namespace URI coined by a materials
supplier coupled with a local part that speci es the materials.
Likewise, testhouse could be the namespace URI devised
by the company testing the materials (perhaps only used on
their intranet). The existing pre x URI rdf and dctype
include a number of de ned terms (local parts) that are widely
used.</p>
      <p>Loading vocabularies into KnowledgeWiki. The
three vocabularies (ASM Handbook Volume 21,
MIL-HDBK5, and MIL-HDBK-17) were imported into the wiki using
the \CSV Import" feature9. The implementation described
so far, allows users to add terms via semantic forms.
However, in the case when data providers have a large number
of terms, it is a tedious task for them to go and add each
term manually via semantic forms. Therefore, we developed
a bulk upload functionality to add a large number of terms
to KnowledgeWiki using a prede ned structured form. We
extended the Semantic MediaWiki Import CSV feature.</p>
      <p>We restrict the format of the input CSV le in a way which
adheres to our data model. More speci cally, we only allow
the properties supported by our semantic forms. In the CSV
le, the header row speci es the properties and other rows
specify the values for each term (Title). A sample CSV le
segment is shown in Table 3.</p>
      <p>Here the user just needs to upload a CSV le from their
le system. Once the le is uploaded, KnowledgeWiki
represents each entity on a wiki page and generates the semantic
triples. For example as seen in Table 3.</p>
      <p>In order to help the materials science community to create
a consolidated vocabulary (MatVocab) using our system, we
had to address some complex problems when dealing with
knowledge integration. For example, more than one de
nition can be present on a term's page. The community can
use KnowledgeWiki as a means to express member opinions
and ultimately select speci c elements as terms to de ne.
In other cases, what started as a de nition for one term
9http://matvocab.org/wiki-dev/index.php/Special:ImportCSV
could evolve into multiple terms with their own respective
de nition elements. For example, if \Modulus" were added
as a term then, through community discussion that speci c
term could be spun-o into other terms like TensileModulus,
ShearModulus, CompressiveModulus, or BulkModulus.</p>
      <p>One unique feature of KnowledgeWiki is the ability to
allow for multiple textual de nitions along with their
respective source and license information. Therefore, whenever an
element of a de nition is used, the license is presented along
with the element.</p>
      <p>The three vocabularies were successfully imported into
the wiki using our extensions. There is a total of 2,800
entity pages created from the three vocabularies. Each of
these terms may have values for 11 templates de ned on the
wiki. Currently Kno.e.sis is hosting an instance of
KnowledgeWiki, called MatVocab, that is being used to create and
curate a vocabulary for material scientists.</p>
      <p>Open Sourcing. Open sourcing a piece of software is to
make its source code available for modi cation or
enhancement by anyone. By making the software open source, it
becomes transparent, easy to use, and widely accepted in the
community. It allows for communities to freely access and
modify the software and customize it per their requirements.
The implementation of our KnowledgeWiki is open source
and free to use. The software is available on GitHub10.
6.</p>
    </sec>
    <sec id="sec-9">
      <title>DISCUSSION AND FUTURE WORK</title>
      <p>One of the important features of our wiki is how easily it
can be adapted to a new domain, as discussed below.</p>
      <p>1) Creating the data model for the vocabularies from other
domains. In order to create a vocabulary for a new domain,
we only need to create the set of templates to re ect the new
relationships in the domain. For this, the user has to identify
the information that the user wants to capture, and based on
requirement, the user can use a singleton property template
10https://github.com/MaterialWays/semanticwiki/tree/
deployment/deployment/README.md</p>
      <p>Subject
matsup:Material 7075T6
testhouse:TestSpecimen 3
testhouse:TestSpecimen 3
or a regular template. For example, if the user wants to
capture provenance information for an entity, the user should
use the singleton property template. Next, the user needs
to create the semantic forms using these templates. These
forms are used for creating and curating information on the
wiki. Further information on how to set up KnowledgeWiki
for a new domain can be found on our wiki page11</p>
      <p>
        This work can be applied to other domains such as
chemistry (e.g., PubChem) and bioinformatics (e.g., BKR). In
fact, the singleton property approach has been discussed by
the bio hackathon community and has also been evaluated
and compared with other approaches in PubChem. In
another work by Tudorache et al. they describe their tool
iCAT to curate the International Classi cation of Diseases
(ICD-11) [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]. They report the use of such a tool in the
classi cation of epidemiology and healthcare data management
for clinical purposes. Therefore, with the above mentioned
features we feel our system is easy to adapt to a new domain.
Another aspect is the
      </p>
      <p>2) Use of our system for creating RDF datasets in
general, this is not only with provenance metadata, but for any
kind of meta data about the triples. The semantic
extension that we developed for representing meta information is
generic and allows for any kind of data annotation such as
provenance, access control or spatio-temporal information.
Finally,</p>
      <p>3)Data re-usability, the data and its meta information
that is collected or created using our system is ultimately
represented as triples in the RDF format. This output
created by our system, where the data is represented using the
singleton property approach can be queried or reused by
other applications and tools. The singleton property triple
pattern allows consumers of our data to discover expected
access patterns for this data. Currently our data can be
queried using the standard SPARQL queries, we have listed
a set of simple SPARQL queries on our wiki page12.</p>
    </sec>
    <sec id="sec-10">
      <title>CONCLUSION</title>
      <p>In this work we have reported about the development of
our KnowledgeWiki and how we adopted it for curating
vocabularies in the materials science domain. We have showed
that by enhancing and extending the existing Semantic
MediaWiki we can facilitate communities to create and curate
vocabularies. KnowledgeWiki has been designed as an
extension to the well known open source platform Semantic
MediaWiki (SMW) that adds a mechanism to capture
provenance information e ciently by leveraging the well known
singleton property approach.</p>
      <p>KnowledgeWiki is open source and licensed under GNU
General Public License. The content published in
KnowledgeWiki is licensed under Creative Commons
AttributionShareAlike License unless overridden by the data providers
11http://wiki.knoesis.org/index.php/KnowledgeWiki
12http://wiki.knoesis.org/index.php/KnowledgeWiki
as stated in the new licensing statement. We have been able
to bring existing materials science data into the wiki
successfully for curation and preservation the metadata of the
RDF triples. The extension of singleton property templates
in KnowledgeWiki is able to accomplish such a goal.
8.</p>
    </sec>
    <sec id="sec-11">
      <title>ACKNOWLEDGEMENTS</title>
      <p>This research was funded by the U.S Air Force Research
Laboratory(AFRL), through the contract FA8750-13-1-0244.
We would like to thank Clare Paul for his vision of how
domain experts would use the KnowledgeWiki as well as his
technical contributions in its design and development. We
also thank Kalpa Gunaratna, Siva Kumar Cheekula,
Swapnil Soni, and Mary Panahiazar who contributed to related
aspects of this work.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Auer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Dietzold</surname>
          </string-name>
          , and
          <string-name>
            <given-names>T.</given-names>
            <surname>Riechert</surname>
          </string-name>
          .
          <article-title>OntoWiki{a tool for social, semantic collaboration</article-title>
          .
          <source>In The Semantic Web-ISWC</source>
          <year>2006</year>
          , pages
          <fpage>736</fpage>
          {
          <fpage>749</fpage>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M. N. K.</given-names>
            <surname>Boulos. Semantic Wikis</surname>
          </string-name>
          :
          <article-title>A comprehensible introduction with examples from the health sciences</article-title>
          .
          <source>Journal of Emerging Technologies in Web Intelligence</source>
          ,
          <volume>1</volume>
          (
          <issue>1</issue>
          ):
          <volume>94</volume>
          {
          <fpage>96</fpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>F.</given-names>
            <surname>Bry</surname>
          </string-name>
          , S. Scha ert, D. Vrandecic, and
          <string-name>
            <given-names>K.</given-names>
            <surname>Weiand</surname>
          </string-name>
          . Semantic wikis: Approaches, applications, and perspectives. Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>M.</given-names>
            <surname>Bu a</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Gandon</surname>
          </string-name>
          , G. Ereteo,
          <string-name>
            <given-names>P.</given-names>
            <surname>Sander</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Faron</surname>
          </string-name>
          .
          <article-title>SweetWiki: A semantic wiki</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>6</volume>
          (
          <issue>1</issue>
          ):
          <volume>84</volume>
          {
          <fpage>97</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>K.</given-names>
            <surname>Cheung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Drennan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Hunter</surname>
          </string-name>
          .
          <article-title>Towards an Ontology for Data-driven Discovery of New Materials</article-title>
          .
          <source>In AAAI Spring Symposium: Semantic Scienti c Knowledge Integration</source>
          , pages
          <volume>9</volume>
          {
          <fpage>14</fpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>F.</given-names>
            <surname>Erxleben</surname>
          </string-name>
          , M. Gunther, M. Krotzsch, J. Mendez, and
          <string-name>
            <given-names>D.</given-names>
            <surname>Vrandecic</surname>
          </string-name>
          .
          <article-title>Introducing Wikidata to the Linked Data Web</article-title>
          .
          <source>In The Semantic Web{ISWC</source>
          <year>2014</year>
          , pages
          <fpage>50</fpage>
          {
          <fpage>65</fpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Fu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Bolton</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. Q.</given-names>
            <surname>Rosinach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. I.</given-names>
            <surname>Furlong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Nguyen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Sheth</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Dumontier</surname>
          </string-name>
          .
          <article-title>Exposing Provenance Metadata Using Di erent RDF Models</article-title>
          .
          <source>arXiv preprint arXiv:1509.02822</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>D.</given-names>
            <surname>Hernandez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hogan</surname>
          </string-name>
          , and
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Krotzsch. Reifying RDF: What Works Well With Wikidata?</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>International</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. I. A. P. D.</given-names>
            <surname>Committee</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A. I. H.</given-names>
            <surname>Committee</surname>
          </string-name>
          . ASM handbook, volume
          <volume>13</volume>
          . ASM International,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>M.</given-names>
            <surname>Kro</surname>
          </string-name>
          tzsch,
          <string-name>
            <given-names>D.</given-names>
            <surname>Vrandecic</surname>
          </string-name>
          , and
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Volkel. Semantic mediawiki</article-title>
          .
          <source>In The Semantic Web-ISWC</source>
          <year>2006</year>
          , pages
          <fpage>935</fpage>
          {
          <fpage>942</fpage>
          . Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>T.</given-names>
            <surname>Kuhn</surname>
          </string-name>
          .
          <article-title>Acewiki: A natural and expressive semantic wiki</article-title>
          .
          <source>arXiv preprint arXiv:0807.4618</source>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>D.</given-names>
            <surname>Kukich</surname>
          </string-name>
          .
          <article-title>MIL-HDBK-17</article-title>
          . AMPTIAC Newsletter,
          <volume>1</volume>
          (
          <issue>3</issue>
          ):
          <fpage>2</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>V.</given-names>
            <surname>Nguyen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Bodenreider</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Sheth</surname>
          </string-name>
          .
          <article-title>Don't like RDF rei cation?: making statements about statements using singleton property</article-title>
          .
          <source>In Proceedings of the 23rd international conference on World wide web</source>
          , pages
          <volume>759</volume>
          {
          <fpage>770</fpage>
          . International World Wide Web Conferences Steering Committee,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>R. C.</given-names>
            <surname>Rice</surname>
          </string-name>
          .
          <article-title>Metallic Materials Properties Development and Standardization (MMPDS): Chapters 1-4</article-title>
          , volume
          <volume>1</volume>
          .
          <source>National Technical Information Service</source>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>C.</given-names>
            <surname>Sarasua</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Simperl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Noy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Abraham</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Leimeister</surname>
          </string-name>
          .
          <article-title>Crowdsourcing and the Semantic Web: A Research Manifesto</article-title>
          .
          <source>Human Computation</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>S.</surname>
          </string-name>
          <article-title>Scha ert. IkeWiki: A semantic wiki for collaborative knowledge management</article-title>
          .
          <source>In Enabling Technologies: Infrastructure for Collaborative Enterprises</source>
          ,
          <year>2006</year>
          . WETICE'
          <volume>06</volume>
          . 15th IEEE International Workshops on, pages
          <volume>388</volume>
          {
          <fpage>396</fpage>
          . IEEE,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>T.</given-names>
            <surname>Tudorache</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vendetti</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          .
          <article-title>Web-Protege: A Lightweight OWL Ontology Editor for the Web</article-title>
          .
          <source>In OWLED</source>
          , volume
          <volume>432</volume>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>D.</given-names>
            <surname>Vrandecic</surname>
          </string-name>
          and
          <string-name>
            <surname>M.</surname>
          </string-name>
          <article-title>Krotzsch. Wikidata: a free collaborative knowledgebase</article-title>
          .
          <source>Communications of the ACM</source>
          ,
          <volume>57</volume>
          (
          <issue>10</issue>
          ):
          <volume>78</volume>
          {
          <fpage>85</fpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>A. White.</surname>
          </string-name>
          <article-title>The materials genome initiative: One year on</article-title>
          .
          <source>MRS Bulletin</source>
          ,
          <volume>37</volume>
          (
          <issue>08</issue>
          ):
          <volume>715</volume>
          {
          <fpage>716</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>