<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Collaborative Structuring of Knowledge by Experts and the Public</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Tom Morris</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daniel Mietchen</string-name>
        </contrib>
      </contrib-group>
      <abstract>
        <p>There is much debate on how public participation and expertise can be brought together in collaborative knowledge environments. One of the experiments addressing the issue directly is Citizendium. In seeking to harvest the strengths (and avoiding the major pitfalls) of both user-generated wiki projects and traditional expert-approved reference works, it is a wiki to which anybody can contribute using their real names, while those with speci c expertise are given a special role in assessing the quality of content. Upon ful llment of a set of criteria like factual and linguistic accuracy, lack of bias, and readability by nonspecialists, these entries are forked into two versions: a stable (and thus citable) approved "cluster" (an article with subpages providing supplementary information) and a draft version, the latter to allow for further development and updates. We provide an overview of how Citizendium is structured and what it o ers to the open knowledge communities, particularly to those engaged in education and research. Special attention will be paid to the structures and processes put in place to provide for transparent governance, to encourage collaboration, to resolve disputes in a civil manner and by taking into account expert opinions, and to facilitate navigation of the site and contextualization of its contents.</p>
      </abstract>
      <kwd-group>
        <kwd>open knowledge</kwd>
        <kwd>open education</kwd>
        <kwd>open science</kwd>
        <kwd>open governance</kwd>
        <kwd>wikis</kwd>
        <kwd>expertise</kwd>
        <kwd>Citizendium</kwd>
        <kwd>Semantic Web</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Science is already a wiki if you look at it a certain way. It's just a highly
ine cient one { the incremental edits are made in papers instead of
wikispace, and signi cant e ort is expended to recapitulate existing knowledge
in a paper in order to support the one to three new assertions made in
any one paper.</p>
      <p>
        John Wilbanks [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]
      </p>
      <p>There are many ways to structure knowledge, including collaborative
arrangements of digital documents. Only a limited number of the latter ones have
so far been employed on a larger scale. Amongst them are wikis { online
platforms which allow the aggregation, interlinking and updation of diverse sets of
knowledge in an Open Access manner, i.e. with no costs to the reader.</p>
    </sec>
    <sec id="sec-2">
      <title>Wikis as an example of public knowledge environments online</title>
      <p>As implied by the introductory quote, it is probably fair to say that turning
science (or any system of knowledge production, for that matter) into a wiki
(or a set of interlinked collaborative platforms) would make research, teaching
and outreach much more transparent, less prone to hype, and more e cient.
Just imagine you had a time slider and could watch the history of research on
general relativity, plate tectonics, self-replication, or cell division unfold from the
earliest ideas of their earliest proponents (and opponents) onwards up to you,
your colleagues, and those with whom you compete for grants. So why don't we
do it?</p>
      <p>Traditionally, given the scope of a particular journal, knowledge about
specialist terms (which may describe completely non-congruent concepts in di erent
elds), methodologies, notations, mainstream opinions, trends, or major
controversies could reasonably be expected to be widespread amongst the audience,
which reduced the need to redundantly say and then repeat the same things all
over again and again (in cross-disciplinary environments, there is a higher
demand for proper disambiguation of the various meanings of a term). Nonetheless,
redundancy is still quite visible in journal articles, especially in the introduction,
methods, and discussion sections and the abstracts, often in a way characteristic
of the authors (such that services like eTBLAST and JANE can make quali ed
guesses on authors of a particular piece of text, with good results if some of the
authors have a lot of papers in the respective database, mainly PubMed, and if
they have not changed their individual research scope too often in between).</p>
      <p>A manuscript well-adapted to the scope of one particular journal is often
not very intelligible to someone outside its intended audience, which hampers
cross-fertilization with other research elds (we will get back to this below).
When using paper as the sole medium of communication there is not much to
be done about this limitation. Indeed, we have become so used to it that some
do not perceive it as a limitation at all. Similar thoughts apply to manuscript
formatting. However, the times when paper alone reigned over scholarly
communication have certainly passed, and wiki-like platforms provide for simple and
e cient means of storing information, updating it and embedding it into a wider
context.</p>
      <p>Cross- eld fertilization, for example, is crucial with respect to
interdisciplinary research projects, digital libraries and multi-journal (or indeed
crossdisciplinary) bibliographic search engines (e.g. Google Scholar), since these
dramatically increase the likelihood of, say, a biologist stumbling upon a not
primarily biological source relevant to her research (think shape quanti cation or
growth curves, for instance). What options do we have to systematically integrate
such cross-disciplinary hidden treasures with the traditional intra-disciplinary
background knowledge and with new insights resulting from research?</p>
      <p>
        The by now classical example of a wiki environment are the Wikipedias, a
set of interlinked wikis in multiple languages where basically anyone can edit
any page, regardless of subject matter expertise or command of the respective
language. As a consequence of this openness, the larger Wikipedias have a serious
problem with vandalism: take an article of your choice and look at its history
page for reverts - most of them will be about neutralizing subtle or blunt forms
of destructive edits that do nothing to improve the quality of the articles, but
may reduce it considerably. Few of these malicious edits persist for long [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
but nding and xing them takes time that could better be spent on improving
articles. This is less of an issue with more popular topics for which large numbers
of volunteers may be available to correct "spammy" entries but it is probably
fair to assume that most researchers value their time too much to spend it
on repeatedly correcting information that had already been correctly entered.
Other problems with covering scienti c topics at the Wikipedias include the
nebulous notability criteria which have to be ful lled to avoid an article being
deleted, and the rejection of "original research" in the sense of not having been
peer reviewed before publication. Despite these problems, one scienti c journal {
RNA Biology { already requires an introductory Wikipedia article for a subset
of papers it is to publish [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>Peer review is indeed a central aspect of scholarly communication, as it paves
the way towards the reproducibility that forms one of the foundations of
modern science. Yet we know of no compelling reason to believe that it works better
before than after the content concerned has been made public (doing it
beforehand was just a practical decision in times when journal space was measured in
paper pages), while emerging movements like Open Notebook Science { where
claims are linked directly to the underlying data that are being made public as
they arise { represent an experiment in this direction whose initial results look
promising and call into question Wikipedia's "no original research" as a valid
principle for generating encyclopaedic content.</p>
      <p>
        Although quite prominent at the moment, the Wikipedias are not the only
wikis around, and amongst the more scholarly inclined alternatives, there are
even a number of wiki-based journals, though usually with a very narrow scope
and/or a low number of articles. On the other hand, Scholarpedia (which has
classical peer review and an ISSN and may thus be counted as a wiki journal, too
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]), OpenWetWare [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], Citizendium [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and the Wikiversities [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] are
crossdisciplinary and structured (and of a size, for the moment) such that vandalism
and notability are not really a problem. With minor exceptions, real names
are required at the rst three, and anybody can contribute to entries about
anything, particularly in their elds of expertise. None of these is even close
to providing the vast amount of context existing in the English Wikipedia but
the di erence is much less dramatic if the latter were broken down to scholarly
useful content. Out of these four wikis, only OpenWetWare is explicitly designed
to harbour original research, while the others allow di erent amounts thereof.
Furthermore, a growing number of yet more specialized scholarly wikis exist (e.g.
WikiGenes [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], the Encyclopedia of Earth [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], the Encyclopedia of Cosmos [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ],
the Dispersive PDE Wiki [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], or the Polymath Wiki [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]), which can teach us
about the usefulness of wikis within speci c academic elds.
      </p>
      <sec id="sec-2-1">
        <title>The Citizendium model of wiki-based collaboration</title>
        <p>
          Despite the above-mentioned tensions between public participation and expertise
in the collaborative structuring of knowledge, it is not unreasonable to expect
that these can be overcome by suitably designed public knowledge environments,
much like Citizen Science projects involve the public in the generation of
scienti c data. One approach at such a design is represented by Citizendium. The
founder of Citizendium { Larry Sanger { is the co-founder of Wikipedia. The
two projects share the common goal of providing free knowledge to the
public, they are based on variants of the same software platform, and they use the
same Creative Commons-Attribution-Share Alike license [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. Yet they di er in
a number of important ways, such that Citizendium can be seen as composed
of a Wikipedia core (stripped down in terms of content, templates, categories
and policies), with elements added that are characteristic of the other wiki
environments introduced above: A review process leading to stable versions (as at
Scholarpedia), an open education environment (as at Wikiversity) and an open
research environment (as at OpenWetWare). Nonetheless, assuming that the
reader is less familiar with these three latter environments, we will follow
previous commenters and frame the discussion of Citizendium in terms of properties
di erentiating it from Wikipedia, and speci cally the latter's English language
branch [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ].
2.1
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Real names</title>
      <p>The rst of these is simply an insistence on real names. While unusual from
a Wikipedia perspective, this is custom in professional environments,
including traditional academic publishing and some of the above-mentioned wikis,
e.g. Scholarpedia and Encyclopedia of Earth. It certainly excludes a number
of legitimate contributors who prefer to remain anonymous but otherwise gives
participants accountability and allows to bring in external reputation to the
project.
2.2</p>
    </sec>
    <sec id="sec-4">
      <title>Expert guidance</title>
      <p>
        To compose and develop articles and to embed them in the multimedial context
of a digital knowledge environment, expert guidance is important. Of course,
many experts contribute to Wikipedia, and the Wikipedias in turn have long
started to actively seek out expert involvement, yet the possibility to see their
edits overturned by anonymous users that may lack even the most basic
education in that eld keeps professionals away from spending their precious time on
such a project. The Citizendium approach of verifying expertise takes a di erent
approach { sometimes termed "credentialism" { that rests on a common sense
belief that some people do know more than others: it is sometimes the case that
the thirteen-year-old kid in Nebraska does know more than the physics
professor. But most of the time, at least when matters of physics are concerned, this
is not the case. The role the experts have at Citizendium is not, as frequently
stated in external comments, that of a supreme leader who is allowed to exercise
his will on the populace. On the contrary, it is much more about guiding. We
use the analogy of a village elder wandering around the busy marketplace [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]
who can resolve disputes and whom people respect for their mature judgement,
expertise and sage advice. Wikipedia rejects "credentialism" in much the same
way that the Internet Engineering Task Force (IETF) does. David Clark
summarised the IETF process thusly [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]: "We reject kings, presidents and voting. We
believe in rough consensus and running code." In an open source project, or an
IETF standardisation project, one can decide a great many of the disputes with
reference to technical reality: the compiler, the existing network protocols etc.
If the code doesn't compile, think again. For rough consensus to happen under
such circumstances, one needs to get the people together who have some clear
aim in mind: getting two di erent servers to communicate with one another.
The rough consensus required for producing an encyclopaedia article is di
erent { it should attempt to put forward what is known, and people disagree on
this to a higher degree than computers do on whether a proper connection has
been established. It is di cult to get "rough consensus, running code" when two
parties are working on completely di erent epistemological standards. At this
point, one needs the advice of the village elderly who will vet existing content
and provide feedback on how it can be expanded or otherwise improved. Upon
ful llment of a set of criteria like factual and linguistic accuracy, lack of bias, and
readability by non-specialists, these vetted entries are forked into two versions: a
stable (and thus citable) approved "cluster" (an article with subpages providing
supplementary information) and a draft version, the latter to allow for further
development and updates (cf. Fig. 1).
      </p>
      <p>The respect for experts because of their knowledge of facts is only part of
the reasoning: the experts point out and correct factual mistakes, but they also
help to guide the structuring of content within an article and by means of the
subpages. The experts bring with them the experience and knowledge of years of
in-depth involvement with their subject matter, and the project is designed to
make best use of this precious resource, while still allowing everyone to
participate in the process. Of course, experts are likewise free to bring in content, be it
within their specialty or in other areas, where others take over the guiding role.
The Citizendium can also host 'Signed Articles', which are placed in a subpage
alongside the main article. A Signed Article is an article on the topic described
by a recognised expert in the eld, but can express opinions and biases in a way
that the main article ought not to.
2.3</p>
    </sec>
    <sec id="sec-5">
      <title>Contextualization</title>
      <p>
        Citizendium attempts to structure knowledge in a di erent way. Each article
on Citizendium can make comprehensive use of Subpages, i.e. pages providing
additional information that are subordinate to an article's page. Some of these {
e.g. the Sculptures subpage in Fig. 1 { are similar to but more exible than the
supplementary online materials now being published routinely along scholarly
articles. Two subpages types are di erent, with keywords and running title being
Fig. 2. Top: Screenshot of the Related Articles subpage from the [[Biology]] cluster
(which is approved) while logged in. It shows the Parent topics and the rst section
of the Subtopics { subdisciplines. For each related article, there is a short de nition
or description of the topic, and a link to its Related Articles subpage (hidden behind
the [r] ), as well as instructions on mouseover and a Table of Content. Bottom:
Related Articles subpage from the [[Open Knowledge Conference]] cluster (while logged
out) which has not yet been converted to subpage style but can already be used for
structuring information related to the topic. In principle, on could also think of adding
[[Open Knowledge Conference 2010]] as a subtopic and using this article for conference
blogging. However, the current MediaWiki software cannot handle parallel editing by
multiple users, though tools like Etherpad [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] have shown that it is feasible.
the closest analogues from academic papers: All pages are encouraged to have a
short De nition subpage (around 30 words or 150 characters) which de nes or
describes the subject of the page. They are also encouraged to have a
comprehensive Related Articles subpage, which uses templates to pull in the de nitions
from the pages that it links to (a feature that relies on the absence of vandalism).
If one looks at the Related Articles subpage of [[Biology]] (cf. Fig. 2, top), one
can see the parent topics of biology (science), the subtopics - subdisciplines of
biology like zoology, genetics and biochemistry, articles on the history of biology
and techniques used by biologists - and nally other related topics, including
material on the life cycle, the various biochemical substances like DNA and
proteins, the components of the cell, and other specialised language. This Related
Articles page gives a pretty comprehensive contextual introduction to what
biology is all about, and is structured by the authors of the article in a way that
is consistent across the site (cf. Fig. 2, bottom). This goes beyond Wikipedias
categories, "See also" sections and ad-hoc infoboxes. Citizendium's approach can
be considered as an exploratory next step towards linking encyclopaedic content
with the Semantic Web.
      </p>
      <p>
        Subpages (a further usage example is in (cf. Fig. 3) are one way in which
Citizendium is attempting to go beyond what is provided in either traditional
paper-based encyclopaedias or by Wikipedia: to engage with context, with
related forms of knowledge, and to emancipate knowledge from the page format
to which it was con ned in the print era. Marx wrote that "Philosophers have
hitherto only interpreted the world in various ways; the point is to change it"
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Traditional encyclopaedias attempt to re ect the world, but we are
attempting to go further. The open science movement - which has formed around the
combination of providing open access to journal articles, making scienti c data
more openly available in raw forms, using and sharing open source software and
experimenting with some of the new techniques appearing from the community
that is formed under the 'Web 2.0' banner - is exploring the edge of what is
now possible for scientists to do to create new knowledge. Some of the electronic
engagements by academics has been for actual research bene t, some has just
been PR for universities - doing podcasts to sound 'relevant'. The Citizendium
model, while a little bit more traditional than some of the open science
platforms, is willing to try a variety of new things. Wikipedia has produced a pretty
good rst version of a collaboratively written encyclopedia { the challenge is to
see if we can go further and produce a citizens' compendium of structured and
comprehensive knowledge and update it as new evidence or insights arise.
2.4
      </p>
    </sec>
    <sec id="sec-6">
      <title>Open governance</title>
      <p>Citizendium has an evolving, but hopefully soon-to-be clearly de ned governance
process - a Charter is in the process of being drafted by an elected group of
writers that will allow for democratic governance and oversight. The broad outline
is this: we will have a democratically elected Editorial Council which will deal
with content policy and resolving disputes regarding content, and we will also
have a Management Committee, responsible for anything not related to
content. The Management Committee appoint Constables who uphold community
policy regarding behaviour. Disputes with the Constables can be brought to an
Ombudsman selected by the Editorial Council and Management Committee. At
the time of writing, the charter is still to be rati ed by the community. One of
the reasons we have this is that although there is a cost to having bureaucracy
and democracy, the bene ts of having an open governance process outweigh the
costs. We have a real problem when governments of real-life communities are
controlled by shadowy cabals who invoke byzantine legal codes - all the same
problems would seem to apply to online communities. With a Wikipedia article,
the debate seems to shift very quickly from the truth value or relevance of the
content itself into often ritualized arguments about acronyms (AfDs, NPOV,
CSD, ArbCom, OR etc.). There is always a challenge in any knowledge-based
community in attempting to reconcile a fair and democratic process with a
meritocratic respect for expertise. There are no easy answers - if we go too far towards
bureaucracy, we risk creating a system where management is separated from the
actual day-to-day writing of the site, while if we attempt to let the site
'manage itself', we risk creating a rather conservative mob rule that doesn't a ord
due process to interested outsiders. A more traditional management structure,
combined with real names and civility, should help those outside of the online
community - the many experts in real life who work in universities, in business
and in public life - to participate on an equal footing. Hopefully, if we get the
governance decisions right, we can also not get in the way of the people who
engage on hobbyist terms with Citizendium.
2.5</p>
    </sec>
    <sec id="sec-7">
      <title>Open education</title>
      <p>An important part of the governance process is collaboration with partners
external to the Citizendium. One of our initiatives { called Eduzendium { provides for
educators in higher education to assign work on wiki articles as part of a course.
We have most recently had politics students from the Illinois State University
work on articles on pressure groups in American public life, as well as medical
students from Edinburgh, biologists from City University of New York and the
University of Colorado at Boulder, nance students from Temple University and
others. These courses reserve a batch of articles for the duration of the course,
and assign each article to one or more students. The course instructor can reserve
the articles for just the group of students enrolled in the course, or invite the
wider Citizendium community to participate. Much of the formatting is achieved
via course-speci c templates that can be generated semi-automatically by the
instructor and applied throughout the course pages, so that course participants
can concentrate on content.
3</p>
      <sec id="sec-7-1">
        <title>Open questions</title>
        <p>The project is still young, resulting in a number of challenges and opportunities.
In many elds, Citizendium does not meet our own standards { we do not have
a full range of expert editors. Larry Sanger once envisioned that Citizendium
could reach 100,000 articles by 2012. This would, on average, require about 150
new articles a day to reach; the current level is around 15. It is not obvious how
the necessary shift from linear to exponential growth can be achieved.</p>
        <p>Motivating both editors and authors to take part in both writing and
approving of content remains a di cult challenge { most experts have very little time to
o er for projects that do not contribute to the metrics according to which their
performance is evaluated, and others shy away from contributing under their
real name and in the presence of experts. Another problem is that the initial
structure of the community, and the nature of its interaction with Wikipedia,
has led to a few articles on popular pseudoscienti c topics which are hard to
handle from an editorial perspective because those willing to invest their time
on the topics are usually heavily biased in their approach, and most of those
capable of evidence-based comment prefer not to contribute to these topics.</p>
        <p>
          The project also needs to allow for more feedback by non-registered readers,
without harming the currently very collegial atmosphere that is to a large extent
due to the real-name policy and the respect for expertise. We may need to
explore how to codify our core policies and collaboration model as a possible
MediaWiki extension, from which other wikis could possibly bene t { online,
"code is law" [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], as is currently being highlighted by sites like Stack Over ow
which have changed the social interactions of participants by changing formal
features of user experience and social structure. We need to nd nancial backing
and support. So far, the project has been run on a basically volunteer-only
basis, yet the envisioned growth and improvement of English-language content
and the possible start of branches in other languages require a higher degree of
professionalisation, for which the upcoming Charter is meant as a basis.
4
        </p>
      </sec>
      <sec id="sec-7-2">
        <title>Open perspectives</title>
        <p>
          Citizendium is open for partnerships with other open science and online
knowledge communities and projects. Possible candidate projects would include, for
instance, AcaWiki [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] for references, OpenWetWare for primary research, and Open
Access journals [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ] as possible content providers, and of course the Wikipedias
and other public wikis for exchange on matters of content management,
community development and user experience. The key strength we think the
Citizendium model brings is a greater focus on knowledge contextualization: it will
be interesting to see whether we can evolve the social model for knowledge
production to keep up with changes in the technological possibilities. Many in
the Citizendium community are looking forward to working alongside both
academics and those working in the Semantic Web community to tie Citizendium
into data projects. We feel that despite the commoditization of Web 2.0
technologies, there is still plenty of opportunities for reinventing and experimenting with
new ways to render and collaborate on knowledge production and to see if we
can build a more stable, sustainable and collegial atmosphere { with democratic
and meritocratic elements { for experts and the public to work together.
Acknowledgments. The authors wish to thank Russell D. Jones, Howard C.
Berkowitz, Steven Mansour and Peter Schmitt for critical comments on earlier
versions of this draft as well as Claudia Koltzenburg, Francois Dongier and
Charles van den Heuvel for helpful discussions.
        </p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. AcaWiki, http://acawiki.org/ All URLs referenced in
          <source>this article were functional as of March 31</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>2. Citizendium, http://www.citizendium.org/</mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Plenary lecture, "A Cloudy Crystal Ball { Visions of the Future"</article-title>
          ,
          <source>Proc. 24th IETF: 539</source>
          (
          <year>1992</year>
          ), http://www.ietf.org/proceedings/prior29/IETF24.pdf
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Creative</surname>
          </string-name>
          Commons-Attribution-Share
          <source>Alike license 3</source>
          .0, http://creativecommons.org/licenses/by-sa/3.0/
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>5. Directory of Open Access Journals, http://www.doaj.org/</mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Dispersive</surname>
            <given-names>PDE</given-names>
          </string-name>
          Wiki, http://tosio.math.utoronto.ca/wiki/
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>7. Encyclopedia of Cosmos, http://www.cosmosportal.org/</mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>8. Encyclopedia of Earth, http://www.eoearth.org</mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>9. Etherpad source code, http://code.google.com/p/etherpad/</mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Lessig</surname>
          </string-name>
          , Lawrence: Code and Other Laws of Cyberspace, http://codev2.cc/
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Marx</surname>
          </string-name>
          , Karl: Theses on Feuerbach, http://www.marxists.org/archive/marx/works/1845/theses/theses.htm
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>12. OpenWetWare, http://www.openwetware.org/</mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Polymath</surname>
            <given-names>WIki</given-names>
          </string-name>
          , http://michaelnielsen.org/polymath1/
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Priedhorsky</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lam</surname>
            <given-names>STK</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Panciera</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Terveen</surname>
            <given-names>L</given-names>
          </string-name>
          , et al. (
          <year>2007</year>
          )
          <article-title>Creating, destroying, and restoring value in wikipedia</article-title>
          . In: GROUP '07: Proceedings of the 2007 international ACM conference on Supporting group work. New York, NY, USA: ACM, pp.
          <volume>259</volume>
          {
          <fpage>268</fpage>
          . http://doi.acm.
          <source>org/10</source>
          .1145/1316624.1316663.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Raymond</surname>
          </string-name>
          , Eric S.:
          <article-title>The Cathedral and the Bazaar</article-title>
          , http://www.catb.org/~esr/writings/homesteading/
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <article-title>RNA Biology, Guidelines for the RNA Families Track</article-title>
          , http://www.landesbioscience.com/journals/rnabiology/guidelines/
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Scholarpedia</surname>
          </string-name>
          , http://www.scholarpedia.org/
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>18. WikiGenes, http://www.wikigenes.org/</mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>19. English Wikipedia, http://en.wikipedia.org</mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Wikiversity</surname>
          </string-name>
          , http://www.wikiversity.org
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Wilbanks</surname>
          </string-name>
          , J.:
          <article-title>Publishing science on the web</article-title>
          , http://scienceblogs.com/commonknowledge/2009/07/publishing_science_
          <article-title>on_ the_web</article-title>
          .php
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>